Tajik

I would love, can we do, you know what would be fun? We just do an offshoot of the show where it's just us trying different types of food, like going to an Uzbeki restaurant and just doing that.

Wouldn't that be dope? Going to a Tajiki restaurant and doing Tajikistan food? I don't know if I'm saying that right.

Okay.

A couple other little notes.

Interestingly, in the original chart, PaLM 2 is even claimed to have higher performance than that at 78.1%.

If you remember, the reason we can't compare that to GPT-4 is that in the technical report for GPT-4, they admit that during their contamination check, "We discovered that portions of BIG-Bench were inadvertently mixed into the training set, and we excluded it from our reported results." Before we get to Gemini, Google show off in the latter half of the technical report with examples of linguistic ability, like writing paragraphs in Tajiki and then translating them into Persian.

They go on to show examples in Tamil, and they are really making a big point of showing off its multilingual capabilities.

At this point, and I'm gonna admit this is my personal opinion, Google then strays into dozens of pages on bias, toxicity, and gender.