Skip to main content

Ari Weil

Oct 14, 2026

NicoleHOST
3:45
Is this what you saw too, um, Ari?
3:48
Um, yeah, I would agree with what John said.
3:50
I mean, if we look at the way that Akamai's always thought about computing, um, from the very beginning, you know, creating the CDN gave us an opportunity to start playing around with ways that we could deliver code and not just content at the edge.
4:03
Security gave us a way to do that, to keep applications and endpoints safe, and we extended that when we started to really evolve Cloudlets into serverless, this lightweight language that really any developer could code against and use the big breadth that Akamai had established to very easily change the way their application worked, customize the results that a user would get, or otherwise optimize the experience.
4:28
And as we started to realize how much our customers wanted to do and the art of the possible in working with them, we said we've got to add infrastructure as a service, but true infrastructure that you could address, that you could build on, that you could really think about with the, the breadth and the scale that Akamai has as a, a distributed network that had all of the fittings of a cloud except for the infrastructure.
4:50
So we added the infrastructure to the scale and the breadth and the reliability and the security.
4:56
And then as we started to see ChatGPT giving way to changing the way that people were working and, and companies were defining, um, productivity, we started to realize that we could use our edge for more than just delivering an application, but it's really how you would build it, what powers the application that you're gonna be delivering, and then how you would protect it on the other side.

6 MINS LATER

NicoleHOST
11:42
How are you thinking about that?
3:52
Now, when we look at, let's say, whether it's agentic AI systems or how RAG models itself, right, how does that change the economics of inference when you're talking about agentic AI systems and RAGs?
4:09
Yeah, it's really interesting.
4:10
I mean, if we think about what's in the news cycle right now, we keep hearing about these trillion weight models that are coming out and how agents can spawn other agents and solve problems a lot faster.
4:21
But when it comes time for an enterprise or a business user to think about building an application that needs to scale to thousands or millions of users.
4:29
you start to really get sensitive to the economics of how many tokens you're going to be consuming.
4:34
And it just seems like every time we get a new model, it could be trained maybe on less GPU infrastructure and less overall capital, but it's consuming more tokens all the time.
4:44
And we hear that from our customers where they engage with some of these frontier LLM providers and they're told about the efficiency gains that are possible, but all they see is more and more tokens consumed for whatever they do.
6:15
Now, one of the things that you talked about is design considerations, right? When we look at why data movement, egress, and latencies are becoming a major design consideration, what was your rationale behind writing that?

We value your privacy

We use cookies to understand how you use our platform and to improve your experience. Click “Accept All” to consent, or “Decline non-essential” to opt out of non-essential cookies. Read our Privacy Policy.