Human-in-the-Loop Machine Learning: Active Learning and Annotation for Human-Centered AI (Robert Monarch)
Oct 17, 2026 · 1 hr 8 min · 10 segments
Oct 17, 2026 · 1 hr 8 min · 10 segments
So a major auto manufacturer decided they were going to definitively win the autonomous vehicle race.
Like top of their class.
Top of their class.
Absolute wizards at building state-of-the-art algorithms, optimizing loss functions, tweaking learning rates, all of that.
But a little while later, the company had to fire that entire team.
Literally all of them.
All of them.
Because while these PhDs knew every mathematical proof there was to know about algorithms, they did not know data.
They had zero idea how to scale their data annotation strategy.
Which is a huge problem.
Yeah.
They literally could not teach the car what it was looking at fast enough or accurately enough to make the algorithms functional.
We spend so much time in academia and industry obsessing over the structural engineering of the model, and we argue about how many layers the network should have or the optimization algorithms.
Right.
The flashy stuff.
Exactly.
But roughly ninety percent of machine learning and production today relies on supervised learning.
And supervised learning, by definition, requires human feedback.
Right.
It requires a human being to look at a piece of data and attach a label to it.
If you do not know how to get that data, how to mathematically choose which specific data points to get, and how to build the psychological interface to connect the human to the machine, well, your brilliant multi-million dollar algorithm is effectively a paperweight.
Okay, so let us unpack this.
For you listening, we are doing a massive deep dive today exploring the science of exactly that gap.
So a major auto manufacturer decided they were going to definitively win the autonomous vehicle race.
Like top of their class.
Top of their class.
Absolute wizards at building state-of-the-art algorithms, optimizing loss functions, tweaking learning rates, all of that.
But a little while later, the company had to fire that entire team.
Literally all of them.
All of them.
Because while these PhDs knew every mathematical proof there was to know about algorithms, they did not know data.
They had zero idea how to scale their data annotation strategy.
Which is a huge problem.
Yeah.
They literally could not teach the car what it was looking at fast enough or accurately enough to make the algorithms functional.
We spend so much time in academia and industry obsessing over the structural engineering of the model, and we argue about how many layers the network should have or the optimization algorithms.
Right.
The flashy stuff.
Exactly.
But roughly ninety percent of machine learning and production today relies on supervised learning.
And supervised learning, by definition, requires human feedback.
Right.
It requires a human being to look at a piece of data and attach a label to it.
If you do not know how to get that data, how to mathematically choose which specific data points to get, and how to build the psychological interface to connect the human to the machine, well, your brilliant multi-million dollar algorithm is effectively a paperweight.
Okay, so let us unpack this.
For you listening, we are doing a massive deep dive today exploring the science of exactly that gap.
The rest of this transcript — segmented and speaker-labeled, so you land on the exact moment something was said
Search every transcript — by keyword, by phrase, or by meaning, across every show Radar indexes
Trends — what is surging across podcasts, measured against its own baseline
Alerts — when a name you follow appears in a newly indexed episode
No account is needed to search Radar.
