Skip to main content
Dan Fu

Dan Fu

Chemist

Nov 10, 2026

23:55
So can you put into human words what the difference is?
Dan Fu
Dan FuGUEST
23:59
Yes, yeah.
Dan Fu
Dan FuGUEST
24:00
So let's see.
Dan Fu
Dan FuGUEST
24:00
How do we think about attention? So I'll make two analogies.
Dan Fu
Dan FuGUEST
24:04
So first is going to be a databases analogy.
Dan Fu
Dan FuGUEST
24:07
And this goes back to, if you know a little bit about attention, there's these things called query key and value, QKV, that have been in the attention operation, the nomenclature, since the beginning.
Dan Fu
Dan FuGUEST
24:19
This actually comes from basically a databases analogy.

14 MINS LATER

38:21
Yeah,
speaker_4ADVERTISER
13:53
Thank you.
Dan Fu
Dan FuGUEST
14:24
Another interesting piece is different applications will have different times.
Dan Fu
Dan FuGUEST
14:27
So if you're in a fast interactive chat-based loop or if you're talking on your phone to ChatGPT in the voice mode, you might have relatively quick responses.
Dan Fu
Dan FuGUEST
14:38
If, on the other hand, you've put together an agentic workflow where you say, hey, go do this for me.
Dan Fu
Dan FuGUEST
14:44
I'm going to leave you alone and just iterate on your own, you'll have a different cadence.
Dan Fu
Dan FuGUEST
14:49
If at some point your agent gets stuck and it's, hey, help, I need to ask for advice, and you don't notice it, there might be another gap between turns.
Dan Fu
Dan FuGUEST
14:57
So all of these things start to define what your workload looks like.

26 MINS LATER

speaker_4ADVERTISER
41:11
It's a new Workday.
3:35
And so like, what does it look like, I guess, then bringing that kind of mindset into your role at together? How does your ideas around those things like then impact the actual engineering that y'all end up delivering?
Dan Fu
Dan FuGUEST
3:52
Yeah.
Dan Fu
Dan FuGUEST
3:52
Yeah.
Dan Fu
Dan FuGUEST
3:53
The way I think about it is the, the ideas, the research ideas that are, um, a little bit more out there that, uh, could work one day that, that could have, that could have the moon shots.
Dan Fu
Dan FuGUEST
4:05
Exactly.
Dan Fu
Dan FuGUEST
4:05
Um, but that won't necessarily, um, you know, translate to something immediately.
Dan Fu
Dan FuGUEST
4:12
Those are the ideas that I tend to explore more at the lab.

28 MINS LATER

32:05
How have you all thought about building an engineering or AI first and preventing those bottlenecks from appearing? How do you think about ownership within with code as it moves for the SDLC? These are kinds of questions that a lot of our listeners are grappling with.

We value your privacy

We use cookies to understand how you use our platform and to improve your experience. Click “Accept All” to consent, or “Decline non-essential” to opt out of non-essential cookies. Read our Privacy Policy.