P
Pete Hunt
2
APPEARANCES
2
PODCASTS
012
DEC 30
JAN 6
JAN 13
JAN 20
JAN 27
FEB 3
FEB 10
FEB 17
FEB 24
MAR 3
MAR 10
MAR 17
MAR 24
MAR 31
APR 7
APR 14
APR 21
APR 28
MAY 5
MAY 12
MAY 19
MAY 26
JUN 2
JUN 9
JUN 16
JUN 23
JUN 30
JUL 7
JUL 14
JUL 21
JUL 28
AUG 4
AUG 11
AUG 18
AUG 25
SEP 1
SEP 8
SEP 15
SEP 22
SEP 29
OCT 6
OCT 13
OCT 20
OCT 27
NOV 3
NOV 10
NOV 17
NOV 24
DEC 1
DEC 8
DEC 15
DEC 22
DEC 29
JAN 5
JAN 12
JAN 19
JAN 26
FEB 2
FEB 9
FEB 16
FEB 23
MAR 2
MAR 9
MAR 16
MAR 23
MAR 30
APR 6
APR 13
APR 20
APR 27
MAY 4
MAY 11
MAY 18
MAY 25
JUN 1
JUN 8
JUN 15
JUN 22
JUN 29
JUL 6
JUL 13
JUL 20
JUL 27
AUG 3
AUG 10
AUG 17
AUG 24
AUG 31
SEP 7
SEP 14
SEP 21
Sep 23, 2026
Re-Air: AI, Abstractions, and the Future of Data Engineering with Pete Hunt of Dagster
20:54
21:02
21:12
21:23
21:31
28:07

John WesselHOST
Let's talk a little bit of evolution, modern data stack, and talk about tooling, like how you've seen that evolve, and then maybe where you see it headed.

Pete HuntGUEST
I mean, I think, you know, we were talking about running 20-minute queries on Hive back in the day.

Pete HuntGUEST
In many ways, big data was still a challenge, right? I would say that even in the high of the era, like big, like we had these big data tools, but big data was not a solved problem yet.

Pete HuntGUEST
We couldn't like easily compute over like unbounded sets of data, you know, in a reasonable way or like effectively unbounded anyway.

Pete HuntGUEST
And so I would say with the arrival of tools like that Peregrine thing that I told you about, but also like Snowflake, Databricks, BigQuery, you really got to like almost interactive query speeds, right? And to me, you know, right around the time that like BigQuery came out and I think the, you know, it's like the Google Dremel paper, right? Like that to me, it was when like big data kind of became a solved problem.
6 MINS LATER

John WesselHOST
So I think it'd be interesting to talk about even maybe specifically, maybe generally with orchestrators, but specifically with Dagster, like how do you see those coming together? And then on top of that, we've got this new component of the AI piece that also makes that a little bit more complicated as far as like what the roles might even look like.
Why distribution and attention are the real bottleneck in B2B SaaS | Pete Hunt @Dagster
6:56
7:09
7:24
23:56

Pete HuntGUEST
old school, but I think that you let the people use the tools they want to use and do work the way they want to do the work.

Pete HuntGUEST
For the most part, like if you didn't care what IDE people use, like why do you care like how they use AI? So like what we tried to do was tell people about it, tell them about the best practices.

Pete HuntGUEST
Certain teams would just like take off and have like really fast pace and other teams would be slower.
16 MINS LATER

Anna NadeinaHOST
So what works for you when you're building that brand and that trust with your customers? What works and maybe even more importantly, what doesn't?