
Adarsh Hiremath
2
APPEARANCES
2
PODCASTS
012
DEC 30
JAN 6
JAN 13
JAN 20
JAN 27
FEB 3
FEB 10
FEB 17
FEB 24
MAR 3
MAR 10
MAR 17
MAR 24
MAR 31
APR 7
APR 14
APR 21
APR 28
MAY 5
MAY 12
MAY 19
MAY 26
JUN 2
JUN 9
JUN 16
JUN 23
JUN 30
JUL 7
JUL 14
JUL 21
JUL 28
AUG 4
AUG 11
AUG 18
AUG 25
SEP 1
SEP 8
SEP 15
SEP 22
SEP 29
OCT 6
OCT 13
OCT 20
OCT 27
NOV 3
NOV 10
NOV 17
NOV 24
DEC 1
DEC 8
DEC 15
DEC 22
DEC 29
JAN 5
JAN 12
JAN 19
JAN 26
FEB 2
FEB 9
FEB 16
FEB 23
MAR 2
MAR 9
MAR 16
MAR 23
MAR 30
APR 6
APR 13
APR 20
APR 27
MAY 4
MAY 11
MAY 18
MAY 25
JUN 1
JUN 8
JUN 15
JUN 22
JUN 29
JUL 6
JUL 13
JUL 20
JUL 27
AUG 3
AUG 10
AUG 17
AUG 24
AUG 31
SEP 7
SEP 14
SEP 21
Jul 14, 2026
Evals are agent infrastructure | Adarsh Hiremath from Mercor
4:36
4:43
5:04
5:13

Adarsh HiremathGUEST
Um, e-even just taking the example of 1Password, right? Um, the key thing is it's not just an agent that does dev workflows.

Adarsh HiremathGUEST
It's an agent that does dev workflows, workflows within 1Password, and for that agent to do a good job, it needs to know what 1Password considers is good for a specific role or a set of developer tasks, right? And that's like the, the, the magic thing here, right? Um, even for simple workflows, just the general intelligence of the model is not sufficient, right? Let's just say reviewing a resume.

Adarsh HiremathGUEST
You could take the smartest model and then have it review a resume, but if it's not calibrated with your recruiting team and what that team's looking for in the talent profile of a resume, it's just gonna fall flat on its face.

Adarsh HiremathGUEST
So the question of how do we understand what good looks like requires extracting the knowledge from an enterprise.
26 MINS LATER
20VC Exclusive: Mercor Raises $100M at a $2BN Valuation: Scaling to $70M in ARR in 24 Months | 9-9-6: 9AM-9PM - 6 Days Per Week: The Most Intense Culture in Silicon Valley | The Future of Programming, Models and Data with Adarsh Hiremath
13:50
13:56
14:14
14:20
14:25
14:41

Harry StebbingsHOST
Do you think that's fair, and is that a niche market or a wedge into a much larger market in your mind?

Adarsh HiremathGUEST
Actually, our insight about the market is that human data and talent assessment have actually become the same thing, where, you know, I can take you back five years where when we think of this data labeling or human data stuff, it's essentially a crowdsourcing problem.

Adarsh HiremathGUEST
You get a bunch of people across the world to draw boxes around stop signs to make the model better at classifying stop signs.

Adarsh HiremathGUEST
Fast-forward to today, and the nature of human data work has changed a lot.

Adarsh HiremathGUEST
Now it's GPT-4.0 or whatever model is not good in a particular domain, so we actually need an expert to make the model better in that domain, and figuring out who that expert should be is 100% a talent assessment problem and is a, is a perfect application of the platform.

Adarsh HiremathGUEST
With a lot of the, the labs that we work with, we're able to figure out who are the exceptional people in very, very specific domains and, and have those people work with the, with the labs.
7 MINS LATER