
Edwin Chen
8
APPEARANCES
8
PODCASTS
012
DEC 30
JAN 6
JAN 13
JAN 20
JAN 27
FEB 3
FEB 10
FEB 17
FEB 24
MAR 3
MAR 10
MAR 17
MAR 24
MAR 31
APR 7
APR 14
APR 21
APR 28
MAY 5
MAY 12
MAY 19
MAY 26
JUN 2
JUN 9
JUN 16
JUN 23
JUN 30
JUL 7
JUL 14
JUL 21
JUL 28
AUG 4
AUG 11
AUG 18
AUG 25
SEP 1
SEP 8
SEP 15
SEP 22
SEP 29
OCT 6
OCT 13
OCT 20
OCT 27
NOV 3
NOV 10
NOV 17
NOV 24
DEC 1
DEC 8
DEC 15
DEC 22
DEC 29
JAN 5
JAN 12
JAN 19
JAN 26
FEB 2
FEB 9
FEB 16
FEB 23
MAR 2
MAR 9
MAR 16
MAR 23
MAR 30
APR 6
APR 13
APR 20
APR 27
MAY 4
MAY 11
MAY 18
MAY 25
JUN 1
JUN 8
JUN 15
JUN 22
JUN 29
JUL 6
JUL 13
JUL 20
JUL 27
AUG 3
AUG 10
AUG 17
AUG 24
AUG 31
SEP 7
SEP 14
SEP 21
SEP 28
OCT 5
OCT 12
OCT 19
OCT 26
NOV 2
NOV 9
NOV 16
Jun 24, 2026
Building a School Where AI Models Learn About Humanity
7:13
30:39

Dan ShipperHOST
W- And what does that make you think? Okay, you, you wanna be a f- you wanna be a mathematician when you grow up, Fields Medalist sort of saying, "I'm relieved that it's not good enough," but you're, I, it's, you're s- you're talking as if, like, you feel pretty confident that it will be good enough in the next couple years.
E
7:30Edwin ChenGUEST
So my belief is that if you really believe in scaling laws, and I do, it's that it almost seems like there's nothing that humans can do that AI won't soon be capable of.
E
7:46Edwin ChenGUEST
And if you think about that very deeply, I think, uh, you almost have to worry about what would that mean for humanity? Like, what would that mean for the role of humanity in the universe? Like, a couple years ago, you know, we think about humanity and human intelligence as playing this very, very unique role in the galaxy.
E
8:06Edwin ChenGUEST
But then AI comes along and shows us that, as far as we know, we can create something that's actually smarter than us and better in many ways.
E
8:13Edwin ChenGUEST
And so you can sort of imagine one path where humanity as a species falls into a paralysis because people believe AI will do everything better anyways.
E
8:23Edwin ChenGUEST
Like yeah, all these kids who formerly would have really wanted to grow up to do mathematics, maybe now they believe that, "Okay, AI will just do it better than me anyways.
22 MINS LATER

Dan ShipperHOST
So I guess the obvious environment is, like, using a computer, but what would be an example of an environment that's non-obvious that's teaching models things we might not think of?
Aravind Srinivas & Edwin Chen: The $1B Bootstrap, Apple's AI Edge, and Benchmarks | TWiAI E10
E
24:05Edwin ChenGUEST
So we're still happily bootstrapped in [laughs] and growing in, I think, the, the best way possible.
E
24:10Edwin ChenGUEST
So, uh, [laughs] I'm actually really, really happy that, that we've never raised.
E
24:13Edwin ChenGUEST
And I mean, yeah, to your point, I think it's never been easier to raise money in AI.And that, that's kind of the problem.
E
24:20Edwin ChenGUEST
Like, when you raise a billion dollars, you get all these growth targets from your investors that incentivize volume over quality.
E
24:26Edwin ChenGUEST
You get all this board pressure to spend your time optimizing for your next fundraise instead of the product that you're building.
E
24:31Edwin ChenGUEST
Like, like all of my friends who are, who are, uh, CEOs of other companies, they're like, "Oh, yeah, I have to spend the next few weeks just prepping a board deck." And, uh, they're, like, always jealous of the fact that I [laughs] I, I don't have to do the same thing.
19 MINS LATER
Ep 80: CEO of Surge AI Edwin Chen on Why Frontier Labs Are Diverging, RL Environments & Developing Model Taste
7:24

Jacob EffronHOST
What are like the best companies doing to figure out like, hey, you know, on a month to month basis, like are our models getting better?
E
7:31Edwin ChenGUEST
All the companies that paid really, really hard attention to benchmarks, like these very, very academic benchmarks that had been created by the research community.
E
7:48Edwin ChenGUEST
Models, at the end of the day, they're very good at hill climbing, very concrete, very specific, very narrowly defined objective functions.
E
7:54Edwin ChenGUEST
And so what would end up happening is that the models would make a ton of progress on the benchmarks.
23 MINS LATER
The humans training AI to be better
19:31
33:10

Danny FortsonHOST
And... that kind of to what you're saying we are not ready for what is about to be unleashed from where you sit because you're on this cold face in a way that most people are not Do you think AGI is a thing that will happen? And two, do you have a sense of timeframe, recognizing that any prediction is going to be wrong because that's just how predictions go? Yeah,
E
19:55Edwin ChenGUEST
Like I see the trends, even today, when we add more and more of the data that we create, we teach the models in ever more sophisticated ways.
E
20:12Edwin ChenGUEST
Like, honestly, I think a lot of reason that people have such short timelines is because there's this Silicon Valley impetus towards hype and the need for fundraising.
13 MINS LATER

Danny FortsonHOST
he was like britain is becoming a vassal state of like a handful of silicon valley tech empires basically and i think implicit in that is this idea is that there's a real group think out here and that this place is fundamentally both boring and uniform it's like keeping up with the joneses but like to a really really high level oh here's my latest startup there's not a lot of conviction other than i just got to get my next round i got to get my valuation up i had to get more clicks Does that kind of ring true to you? And do you think that is dangerous? Again, when we go back to this idea of AGI and who was building these things and who they're building them for, is that a problem?
The 100-person AI lab that became Anthropic and Google's secret weapon | Edwin Chen (Surge AI)
5:30

Lenny RachitskyHOST
I'm curious just do you think this will happen more and more as a result of AI? And also just where has AI most helped you, uh, find leverage to be able to do this?
E
5:40Edwin ChenGUEST
Yeah, so we hit over a billion in revenue last year with under 100 people, and I think we're going to see companies with even crazier ratios, like 100 billion per employee in the next few years.
E
5:50Edwin ChenGUEST
AI is just going to get better and better and make things more efficient, so that ratio just becomes inevitable.
E
5:56Edwin ChenGUEST
Like I- I used to work at a bunch of the big tech companies, and I always felt that we could fire 90% of people and we would move faster because the best people wouldn't have all the distractions.And so when we started Surge, we wanted to build it completely differently with a super small, super elite team.
E
6:18Edwin ChenGUEST
One is that people are realizing they don't have to build giant organizations in order to win.
17 MINS LATER
The Startup Powering The Data Behind AGI
12:16
40:04

Lukas BiewaldHOST
And so can you talk a little bit about what technology you actually have to build to manage quality for a generic, complicated expert task involving language?
E
12:29Edwin ChenGUEST
So let me start actually by contrasting with... a very old school take on data and data quality and how we just think about the problem differently.
E
12:43Edwin ChenGUEST
So let's say you wanted to train a model to write an eight line poem about the moon.
E
12:48Edwin ChenGUEST
And the way most companies think about it is, okay, well, let's just hire a bunch of people from Craigslist or through some recruiting agency.
E
12:55Edwin ChenGUEST
And the way to think about quality, again, going back to coming to image annotation days, it's like, okay, is this a poem? Is it eight lines? Does it contain a word moon? They just check all these boxes in the same way you might check, okay, this is a cat, this is a dog.
27 MINS LATER

Lukas BiewaldHOST
But how would you collect the data? Would you get a Stanford professor and have it just score responses? I guess a scoring response would be easier than just generating responses.
The Power of Quality Human Data with SurgeAI Founder and CEO Edwin Chen
17:30
26:26

Elad GilHOST
If you assume eventually some form of superhuman performance across different model types relative to human experts, How do you think about the role of humans relative to data and data generation versus synthetic data or other approaches? Like at what point does human input sort of run out as a useful point of either feedback or data generation?
E
17:55Edwin ChenGUEST
So, I mean, even if I think about the landscape today, I think people often overestimate the role of synthetic data.
E
18:08Edwin ChenGUEST
Again, like I said earlier, there's a lot of cruft that simply isn't worth a human's time.
8 MINS LATER

Sarah GuoHOST
Going back to something Elad mentioned, like where should we expect to see like Surge investing over time? Like, what do you think you guys will do a few years from now that you don't do today?
20VC: Scaling to $1BN+ in Revenue with No Funding: Surge AI | The Most Insane Scaling Story in Tech |
16:32
42:45

Harry StebbingsHOST
Can you take me to the founding moment for you, leaving the last company and deciding that you were going to go all in on Surge?
E
16:39Edwin ChenGUEST
So I used to work as an ML engineer at a bunch of the big companies and the problem I just kept running into was that it- it just kept on being impossible to get the data that we needed to train our models.
E
16:49Edwin ChenGUEST
For example, I used to work on our ad- search and ad systems at Twitter, and one of the thing- first things I wanted to do was build a sentiment classifier.
E
16:56Edwin ChenGUEST
All- all you need is 10,000 tweets labeled as positive or negative to train your models, but our human data system at the time was literally just two people we'd hired off of Craigslist working nine to five.
E
17:06Edwin ChenGUEST
Even just in order to get started, we had to wait a month, then we had to wait ano- another month for them to label the tweets inside a spreadsheet because the tools that we had were just terrible.
26 MINS LATER

Harry StebbingsHOST
algorithms.If compute continues to prove to be the unlock, where throwing more compute at it unlocks more and more performance, does that denigrate data quality in the prioritization stack?