David Talby
2
APPEARANCES
2
PODCASTS
012
DEC 30
JAN 6
JAN 13
JAN 20
JAN 27
FEB 3
FEB 10
FEB 17
FEB 24
MAR 3
MAR 10
MAR 17
MAR 24
MAR 31
APR 7
APR 14
APR 21
APR 28
MAY 5
MAY 12
MAY 19
MAY 26
JUN 2
JUN 9
JUN 16
JUN 23
JUN 30
JUL 7
JUL 14
JUL 21
JUL 28
AUG 4
AUG 11
AUG 18
AUG 25
SEP 1
SEP 8
SEP 15
SEP 22
SEP 29
OCT 6
OCT 13
OCT 20
OCT 27
NOV 3
NOV 10
NOV 17
NOV 24
DEC 1
DEC 8
DEC 15
DEC 22
DEC 29
JAN 5
JAN 12
JAN 19
JAN 26
FEB 2
FEB 9
FEB 16
FEB 23
MAR 2
MAR 9
MAR 16
MAR 23
MAR 30
APR 6
APR 13
APR 20
APR 27
MAY 4
MAY 11
MAY 18
MAY 25
JUN 1
JUN 8
JUN 15
JUN 22
JUN 29
JUL 6
JUL 13
JUL 20
JUL 27
AUG 3
AUG 10
AUG 17
AUG 24
AUG 31
SEP 7
SEP 14
SEP 21
SEP 28
OCT 5
OCT 12
OCT 19
OCT 26
NOV 2
NOV 9
NOV 16
Oct 6, 2026
Seven Years of Applied AI, From NLP to Agents and the Push to Prove What Works
6:24
10:09

David TalbyGUEST
It kind of says, okay, well, you know, this is going to be like, you know, 50 to 100, you know, person thing.
Anna AnisinHOST
So maybe we could talk a little bit about how that's so important, not for just technical teams, but just people that are using AI and their businesses, right?
The AI Governance Game-Changer: How to Create Bias-Free Healthcare Solutions?
12:43
13:15
13:31

David TalbyGUEST
very often if you have a benchmark like public qa that's been around for six years at this point all the public llms are basically trained on this data set as well right it has seen the data set it has seen papers about the data set it's in paper that say what's wrong with this data set so a lot of what it's doing is memorization Data combination is also a big issue with leaderboards.

David TalbyGUEST
But basically, every time you see a model that claims 98%, 98.9% accuracy on a specific benchmark, with all likelihood, it really is just memorization right on that specific benchmark, and it's not going to generalize.

David TalbyGUEST
Other than being another form of cheating, the main problem here is that once you have data contamination, right, and basically kind of, you know, you've seen the, you know, you've seen the answers to the question and the answer to the test before you took the test, it leads to non-generalizable models, right? So it means that, yes, you know how to answer those specific questions, but even if you change the question slightly, you're going to fail.
7 MINS LATER