Sep 17, 2026 · 1 hr 20 min · 11 segments
New episode with Noam Brown. We talk about multi-agent, Navier-Stokes, and what the current explosion of maths progress tells us about what happens once you automate AI research. And we also discuss…
Noam BrownGuest
So the way I think about it, um, when you plot the performance of these reasoning models with test time compute on the X-axis and, um, performance on basically any reasoning benchmark on the Y-axis-

... you see a very clear pattern where the longer these models take to think about their answer, the better they do.

If you're taking the SATs, you have five minutes to go through the entire exam, you're not gonna do very well.

And, and they'll spend that time doing this monologue to themselves, figuring out, going through different cases, um, ruling out different possibilities, building on some of their previous discoveries.

The problem is that as you push that further and further, you hit a latency bottleneck.

You know, if you're, if you're gonna found a company, you wanna get a group of people together so you can go faster.

It's the same thing with these AI models that it helps to just have multiple agents working on something because they can just go faster.

And so multi-agent is a way of scaling test time compute in parallel instead of purely serial.

And it is, like, less efficient because it doesn't have-- It's not like a single agent has all the context, um, to itself, but it is, like, a very li- a very effective way of scaling test time compute if it's done well.
I, I, I'm gonna ask a bunch of naive questions because these systems-- So this is an unreleased model, so we haven't publicly seen how these systems work.
And so I just have a bunch of ways in which I'm, like, confused about, like, what the qualitative properties-
I am shocked by the scale of cognitive effort that you can concentrate in such a short period of time.
So if you think about what a hundred and thirty billion tokens are, if it was a single human thinking as, you know, a full-time job, stretched back to back, a hundred and thirty billion tokens would be a human thinking for, like, four thousand years, you know, eight hours a day or something, uh, working a normal work week.
So for-- Starting from, like, ancient Sumeria up till today, a single sequential human thinking that long concentrated in eighty-eight hours.

So the way I think about it, um, when you plot the performance of these reasoning models with test time compute on the X-axis and, um, performance on basically any reasoning benchmark on the Y-axis-

... you see a very clear pattern where the longer these models take to think about their answer, the better they do.

If you're taking the SATs, you have five minutes to go through the entire exam, you're not gonna do very well.

And, and they'll spend that time doing this monologue to themselves, figuring out, going through different cases, um, ruling out different possibilities, building on some of their previous discoveries.

The problem is that as you push that further and further, you hit a latency bottleneck.

You know, if you're, if you're gonna found a company, you wanna get a group of people together so you can go faster.

It's the same thing with these AI models that it helps to just have multiple agents working on something because they can just go faster.

And so multi-agent is a way of scaling test time compute in parallel instead of purely serial.

And it is, like, less efficient because it doesn't have-- It's not like a single agent has all the context, um, to itself, but it is, like, a very li- a very effective way of scaling test time compute if it's done well.
I, I, I'm gonna ask a bunch of naive questions because these systems-- So this is an unreleased model, so we haven't publicly seen how these systems work.
And so I just have a bunch of ways in which I'm, like, confused about, like, what the qualitative properties-
I am shocked by the scale of cognitive effort that you can concentrate in such a short period of time.
So if you think about what a hundred and thirty billion tokens are, if it was a single human thinking as, you know, a full-time job, stretched back to back, a hundred and thirty billion tokens would be a human thinking for, like, four thousand years, you know, eight hours a day or something, uh, working a normal work week.
So for-- Starting from, like, ancient Sumeria up till today, a single sequential human thinking that long concentrated in eighty-eight hours.
The rest of this transcript — segmented and speaker-labeled, so you land on the exact moment something was said
Search every transcript — by keyword, by phrase, or by meaning, across every show Radar indexes
Trends — what is surging across podcasts, measured against its own baseline
Alerts — when a name you follow appears in a newly indexed episode
No account is needed to search Radar.