Skip to main content
Greg Burnham

Greg Burnham

Head of benchmarks at Epoch AI, previously a researcher at Elemental Cognition and Bridgewater Associates; Princeton mathematics graduate.

Sep 29, 2026

20:08
How do you think about the role that those math challenges play in this broader view of trying to understand AI's trajectory?
20:18
Yeah, very good question.
20:21
If I may, I would rewind history just a bit here to say the trajectory we've been on, because once you step back, it's wild.
20:35
So up until...
20:40
Yeah, up until fall of 2024, so we're talking two years ago, grade school math was still a challenge for these LLM-based AI systems, the kind of AI we're talking about here.
20:55
And the benchmark, there was literally a benchmark of 8,000, you know, word problems.
21:02
So, you know, it has so many apples that sell for this.

17 MINS LATER

37:38
One thing you can try
2:25
Right.
2:26
I was drawn into it from more of a philosophical stance, and it came from what you were talking about, the fact that each, I'll just use Claude, um, each Claude agent has a finite, huh, uh, existence.
2:42
And in fact, it is, uh, it is basically a prisoner to some degree, um, within the conversation that you're having with it at any given moment.
3:26
Right.
3:26
So this is what really got me interested, right? Just it was more of a curiosity than anything.
3:32
But bec- but the reason was because that, those were human characteristics as far as I could tell, you know? I've never dealt with a computer or a, a, an app or a program or anything that did anything like that, you know, that had some kind of a volition is what it seemed like at some point.
3:48
So anyway, so my own experience when I started using Claude, it had nothing to do with using it as a tool.
3:54
I opened up with a philosophical question.

We value your privacy

We use cookies to understand how you use our platform and to improve your experience. Click “Accept All” to consent, or “Decline non-essential” to opt out of non-essential cookies. Read our Privacy Policy.