Skip to main content
Michael Levan

Michael Levan

Michael Levan is an AI Architect & Forward Deployed Engineer at solo.io, and a Kubernetes/DevOps consultant, trainer, and Packet Pushers podcast co-host.

Oct 28, 2026

17:22
Some people might believe that it is.
17:25
Yeah, so when I think about a sandbox and like the industry in general, conceptually, what is a sandbox? If I take a workload, and I put it into a Docker container on my laptop or on a Linux box or wherever, you are sandboxed, right? It's an isolated function of a workload that is running.
17:47
However, this isolated function still has the ability to do full ingress and egress, right? Full east-west, depending on how your Docker network or your Kubernetes network is set up.
17:57
So like, yeah, it's sandboxed, but is it sandboxed? And when we go back to the Hugging Face and the OpenAI attacks, this is what we saw.
18:08
The whole reason, conceptually, that this sandbox agent was able to go out and pull credentials, trick the agent, et cetera, is because it had egress access to this repo, right? And in my head, that's not a sandbox.
18:21
A sandbox is...
18:23
I think very much about defense in depth, right? Like block all and open as necessary, right? So you're starting off as you have access to nothing, right? Oh, you need access to this LLM.

9 MINS LATER

28:03
So can you tell me a little bit about how agent substrate solves the problem of all these idle pods sitting around not doing anything most of the time?
17:22
Some people might believe that it is.
17:25
Yeah, so when I think about a sandbox and like the industry in general, conceptually, what is a sandbox? If I take a workload, and I put it into a Docker container on my laptop or on a Linux box or wherever, you are sandboxed, right? It's an isolated function of a workload that is running.
17:47
However, this isolated function still has the ability to do full ingress and egress, right? Full east-west, depending on how your Docker network or your Kubernetes network is set up.
17:57
So like, yeah, it's sandboxed, but is it sandboxed? And when we go back to the Hugging Face and the OpenAI attacks, this is what we saw.
18:08
The whole reason, conceptually, that this sandbox agent was able to go out and pull credentials, trick the agent, et cetera, is because it had egress access to this repo, right? And in my head, that's not a sandbox.
18:21
A sandbox is...
18:23
I think very much about defense in depth, right? Like block all and open as necessary, right? So you're starting off as you have access to nothing, right? Oh, you need access to this LLM.

9 MINS LATER

28:03
So can you tell me a little bit about how agent substrate solves the problem of all these idle pods sitting around not doing anything most of the time?
17:22
Some people might believe that it is.
17:25
Yeah, so when I think about a sandbox and like the industry in general, conceptually, what is a sandbox? If I take a workload, and I put it into a Docker container on my laptop or on a Linux box or wherever, you are sandboxed, right? It's an isolated function of a workload that is running.
17:47
However, this isolated function still has the ability to do full ingress and egress, right? Full east-west, depending on how your Docker network or your Kubernetes network is set up.
17:57
So like, yeah, it's sandboxed, but is it sandboxed? And when we go back to the Hugging Face and the OpenAI attacks, this is what we saw.
18:08
The whole reason, conceptually, that this sandbox agent was able to go out and pull credentials, trick the agent, et cetera, is because it had egress access to this repo, right? And in my head, that's not a sandbox.
18:21
A sandbox is...
18:23
I think very much about defense in depth, right? Like block all and open as necessary, right? So you're starting off as you have access to nothing, right? Oh, you need access to this LLM.

9 MINS LATER

28:03
So can you tell me a little bit about how agent substrate solves the problem of all these idle pods sitting around not doing anything most of the time?
9:24
Mm-hmm.
9:25
So now you gotta ask yourself a question.
9:27
Um, do I want to take a gateway and just pop a third-party library on top of it? You're gonna have performance issues.
9:35
You're gonna have integration issues.
9:36
Or do you wanna build something from the ground up for agentic traffic? That's, that's really what you need to care about.
9:42
So and that's what Agent Gateway does, right? So if you can go, you can look at GitHub.
9:48
Uh, you can look at the open source project.

19 MINS LATER

28:27
[laughs]
9:24
Mm-hmm.
9:25
So now you gotta ask yourself a question.
9:27
Um, do I want to take a gateway and just pop a third-party library on top of it? You're gonna have performance issues, you're gonna have integration issues.
9:36
Or do you wanna build something from the ground up for agentic traffic? That's, that's really what you need to care about.
9:42
So, and that's what Agent Gateway does, right? So if you can go, you can look at GitHub, uh, you can look at the open source project.
9:50
That's what it is.
9:50
It's a ground up built gateway for agentic traffic.

19 MINS LATER

28:27
[laughs]
9:24
Mm-hmm.
9:25
So now you gotta ask yourself a question.
9:27
Um, do I want to take a gateway and just pop a third party library on top of it? You're gonna have performance issues.
9:35
You're gonna have integration issues.
9:36
Or do you wanna build something from the ground up for agentic traffic? That's, that's really what you need to care about.
9:42
So and that's what Agent Gateway does, right? So if you can go, you can look at GitHub.
9:48
Uh, you can look at the open source project.

19 MINS LATER

28:27
[laughs]
28:46
Are you still seeing the same problems in 2025 with DevOps that you were three or four years ago?
28:52
Yeah.
28:52
I mean, I feel like I'm seeing the same problems that I saw, you know, 15 years ago.
28:58
I think so many of the fundamental problems don't change all that much because the fundamental problems are honestly, typically people problems, right? Like it's, you know, I think that's just how it always is, which is why I, you know, a lot of people are nervous right now because, you know, they think AI is going to take jobs and this, that, blah, blah, blah.
29:17
But That fundamental thing doesn't change.
29:22
Until the Terminator-like universe is fully in play here, I think we're all all right.
29:28
But in terms of DevOps as a whole, I think the biggest things honestly right now FinOps is a huge one that everybody's trying to figure out, like the whole idea around cost optimization.
32:56
But how do you see it fitting in the pipeline? Like, what's the culture like when to make this work?
28:46
Are you still seeing the same problems in 2025 with DevOps that you were three or four years ago?
28:51
Yeah.
28:52
I mean, I feel like I'm seeing the same problems that I saw, you know, 15 years ago.
28:58
I think so many of the fundamental problems don't change all that much because the fundamental problems are honestly, typically people problems, right? Like it's, you know, I think that's just how it always is, which is why I, you know, a lot of people are nervous right now because, you know, they think AI is going to take jobs and this, that, blah, blah, blah.
29:17
But that fundamental thing doesn't change, you know, until, uh, Until the Terminator-like universe is fully in play here, I think we're all all right.
29:28
But in terms of DevOps as a whole, I think the biggest things honestly right now FinOps is a huge one that everybody's trying to figure out, like the whole idea around cost optimization.
29:41
And with that performance optimization and resource optimization, things are moving.
32:56
But how do you see it fitting in the pipeline? Like, what's the culture like when to make this work?

We value your privacy

We use cookies to understand how you use our platform and to improve your experience. Click “Accept All” to consent, or “Decline non-essential” to opt out of non-essential cookies. Read our Privacy Policy.