GPT 4 Turbo-Charged? Plus Custom GPTS, Grok, AGI Tier List, Vision Demos, Whisper V3 and more

We're also

updating the knowledge cutoff.

We are just as annoyed as all of you, probably more, that GPT-4's knowledge about the world ended in 2021.

We will try to never let it get that out of date again.

GPT-4 Turbo has knowledge about the world up to April of 2023,

And my only comment on that is that this means that GPT-4 has knowledge of itself for the first time.

While GPT-4 was trained in August of 2022, it wasn't released until March of 2023.

GPT-4 should know a lot more about how it's trained and some of the latest advances in AI.

But how much can the new GPT-4 Turbo process at once? Well, 128,000 tokens, which is approximately 100,000 words in English.

GPT-4 supported up to 8K and in some cases up to 32K context length.

But we know that isn't enough for many of you and what you want to do.

GPT-4 Turbo supports up to 128,000 tokens of context.

That's 300 pages of a standard book, 16 times longer than our 8K context.

Don't assume though that just because it can process that many words that it will be equally accurate at comprehending all of them.

This analysis from yesterday showed that when you're trying to retrieve a fact from a document, particularly one of more than about 80,000 words or 100,000 tokens, if you place that fact at between 10 to 50% through the document, retrieval started to get pretty bad.

If the fact was towards the end of a document or you submitted fewer words or tokens, performance was much higher.

The good news though is that GPT-4 Turbo, the 11.06 preview, is much better than previous iterations of GPT-4 at retrieving facts from those context lengths.

So yes, even though performance does degrade the more tokens or words you submit, it's better than before.

But again, better than before still isn't even close to perfect.

Surprising no one, DALI 3, GPT-4 Turbo with vision, and the new text-to-speech model are all going into the API today.

And I'm going to give you a taste of the kind of things these new APIs unlock.

We have this implementation by Robert Lukoshko, integrating GPT Vision API and allowing you just to clip out bits of a screen and ask questions about it.

Part I'm interested in, and the GPT-4 is going to answer me, what is it? It's heap joint region.

And what about this part? What is it? I'm not giving it even any context.

It just knows.