Data processing unit
8
MENTIONS
5
EPISODES
5
PODCASTS
Search complete. 8 mentions across 5 episodes found for "Data processing unit".
Sep 6, 2026
SN: 5 EP: 112 Hardware, Software, and Data: A Non-Technical Guide to AI Decisions
A
10:14AsifHOST
So before we talk about artificial intelligence, AI, remember that AI is physical before it becomes digital.
A
10:22AsifHOST
So you may hear people talk about terms like CPU, GPU, NPUs, and DPUs.
A
10:28AsifHOST
Well, write those down, right? If you have those written down, they're going to become part of your verbiage as you make those decisions because you don't have to memorize what every letter means.
A
10:37AsifHOST
What I want you to understand is this concept that different types of hardwares are becoming specialized for different types of work.
A
11:02AsifHOST
Then GPUs became extremely important because certain AI workload requires different kinds of processing.
A
11:09AsifHOST
So now you are increasingly hearing about NPUs, specializing AI processors appearing inside of laptops and phones and other devices.
A
11:17AsifHOST
You may also hear about DPUs, particularly when conversation becomes more focused about data centers, networking, and infrastructure.
A
11:24AsifHOST
You don't need engineers for any of them.
Why quantum networks need a new architecture
V
8:55Vijoy PandeyGUEST
it comes to technologies in the quantum space in fact we believe as well as others in the industry believe that you will not have a singular quantum technology modality that is going to be successful in the future you will have multiple modalities that will have different use cases that you can deploy on those modalities and it's no different than in the classical space.
V
9:19Vijoy PandeyGUEST
You have CPUs and GPUs and TPUs and DPUs and all kinds of XPUs in the classical space, all doing different things.
V
9:29Vijoy PandeyGUEST
We believe it's going to be the same thing on the quantum side.
V
9:32Vijoy PandeyGUEST
So your point
Gavin Baker: Why AI Demand Is Outrunning Compute Supply
G
61:35Gavin BakerGUEST
He's got, you know, Ethernet switches.
G
61:37Gavin BakerGUEST
He has two kinds of DPUs.
G
61:38Gavin BakerGUEST
You know, he's got...
G
61:40Gavin BakerGUEST
You know, we've gone from just, um, scale out networking being a thing.
AI:AM — Cloud AI and Open Innovation · August 24, 2026
M
34:10Mohamed AwadGUEST
So, you know, you think about Nvidia, they've got their AI factories that they build.
M
34:14Mohamed AwadGUEST
You know, uh, that's what, what Jensen likes to call them, and that really consists of CPUs, it consists of DPUs, which is, you know, networking, uh, gear, includes switching, it includes rack scale architectures, their accelerators, and their GPUs.
M
34:28Mohamed AwadGUEST
So these are complete systems which are designed to work together.
M
34:31Mohamed AwadGUEST
And actually, if you look across the landscape, what you're seeing is that AWS is doing the same thing with its Trainium products.
P
34:52Prakash NarayananHOST
Mm.
M
34:52Mohamed AwadGUEST
with those players right across the board.
M
34:54Mohamed AwadGUEST
Um, whether it's the AMD DPU or the CPUs and DPUs in Nvidia, whether it's the DPUs and acce- uh, CPUs that are part of the Graviton system, the CPU that we've built in partnership with Meta.
M
35:07Mohamed AwadGUEST
In every case, you know, we're sort of foundational in helping to bring those systems together and, and sort of meeting them where they, where they need us to be in order to kinda make those systems a reality.
(Re)Engineering the Inference Stack
S
19:54Stephen BatesGUEST
We've been working with VAST to make sure that those technologies bolt well together with VAST storage technologies.
S
20:01Stephen BatesGUEST
And then we've been building that on top of technologies on the networking side, like RDMA, where we can avoid the overhead of running TCP IP stacks, and we can offload the TCP IP stacks to things like DPUs.
S
20:15Stephen BatesGUEST
or advanced like NIC technology, and then also using technologies like NVMe for the backend storage where we get that advantage of low latency protocols talking to highly performant non-volatile memory technologies in order to make sure that that objective of low latency with low CPU overhead is met.
A
20:38Alon HorevGUEST
I think when we think about networking, there's a few aspects there that are critical.