So either we are at the sharp end of the singularity or Sam Altman really wants the headlines to shift away from other matters.
But for real though, it is a big update and ignoring frontier AI developments does feel more costly for professionals than ever.
Though I do sympathize with those trying to keep up because...
This is possibly the murkiest the AI landscape has ever been.
We get vague posts on X with earliest access, most often given to those who are going to praise models.
We get leaked reports and then accusations and counter-accusations, prediction market manipulation, and seemingly endless new benchmarks created by the companies themselves.
genuine progress in AI.
I pretty much gave up after reaching about 76 tabs on Chrome so I'm just going to give you the nine things I think people should know from yes the last few hours as well as the last few days of discombobulating developments.
Because for me,
The model was blind graded by experts against human outputs from across 44 white-collar occupations.
Selected, by the way, for their impact on GDP, hence the name of the benchmark, GDPVal.
If you include ties, it's 83% of the time.
But that headline leaves to one side catastrophic failures when the model makes a mistake that a human wouldn't make, and the fact that these tasks drawn from the work performed across these 44 occupations are self-contained, digital, and not representative of the full range of tasks and the purpose of these occupations.
You may have also noticed one narrative violation that we should hastily move on from, which is that GPT-5.4 Pro, available only to the highest paying users, actually scores worse in this benchmark than GPT 5.4.
But still, all those caveats aside, if we make the analogy with self-driving, we might not have reached a satisfying level of safety, but we may have passed that moment where mile for mile or spreadsheet for spreadsheet, the autonomous agents like GPT 5.4 are better.
And as Waymo has shown, even 10x the safety performance does not mean you get national or international adoption.
Which is to say, white-collar work is still set to last through the end of this year, he says nervously.
Now, if that benchmark result from GPC 5.4 sounds scary, well, then you might tell your boss about this benchmark.
Not quite as well as GPT-5.3 codecs, but measured by overall accuracy, it is close to state of the art.
But when GPT-5.4 gets things wrong, it is more likely than other models to BS an answer.
You want to be lower on this chart, in other words, and it's up here at 89%, meaning when it gets things wrong, instead of admitting it doesn't know the answer, it will BS.
So either we are at the sharp end of the singularity or Sam Altman really wants the headlines to shift away from other matters.
But for real though, it is a big update and ignoring frontier AI developments does feel more costly for professionals than ever.
Though I do sympathize with those trying to keep up because...
This is possibly the murkiest the AI landscape has ever been.
We get vague posts on X with earliest access, most often given to those who are going to praise models.
We get leaked reports and then accusations and counter-accusations, prediction market manipulation, and seemingly endless new benchmarks created by the companies themselves.
genuine progress in AI.
I pretty much gave up after reaching about 76 tabs on Chrome so I'm just going to give you the nine things I think people should know from yes the last few hours as well as the last few days of discombobulating developments.
Because for me,
The model was blind graded by experts against human outputs from across 44 white-collar occupations.
Selected, by the way, for their impact on GDP, hence the name of the benchmark, GDPVal.
If you include ties, it's 83% of the time.
But that headline leaves to one side catastrophic failures when the model makes a mistake that a human wouldn't make, and the fact that these tasks drawn from the work performed across these 44 occupations are self-contained, digital, and not representative of the full range of tasks and the purpose of these occupations.
You may have also noticed one narrative violation that we should hastily move on from, which is that GPT-5.4 Pro, available only to the highest paying users, actually scores worse in this benchmark than GPT 5.4.
But still, all those caveats aside, if we make the analogy with self-driving, we might not have reached a satisfying level of safety, but we may have passed that moment where mile for mile or spreadsheet for spreadsheet, the autonomous agents like GPT 5.4 are better.
And as Waymo has shown, even 10x the safety performance does not mean you get national or international adoption.
Which is to say, white-collar work is still set to last through the end of this year, he says nervously.
Now, if that benchmark result from GPC 5.4 sounds scary, well, then you might tell your boss about this benchmark.
Not quite as well as GPT-5.3 codecs, but measured by overall accuracy, it is close to state of the art.
But when GPT-5.4 gets things wrong, it is more likely than other models to BS an answer.
You want to be lower on this chart, in other words, and it's up here at 89%, meaning when it gets things wrong, instead of admitting it doesn't know the answer, it will BS.
The rest of this transcript — segmented and speaker-labeled, so you land on the exact moment something was said
Search every transcript — by keyword, by phrase, or by meaning, across every show Radar indexes
Trends — what is surging across podcasts, measured against its own baseline
Alerts — when a name you follow appears in a newly indexed episode
No account is needed to search Radar.