Skip to main content

Spencer Thompson

Oct 7, 2026

7:02
But I presume you're seeing the same thing in customers.
7:05
We are, although I would say that the bar is so much higher or the threshold is higher to show them something because it's almost so unbelievable.
7:12
I mean, in some ways, what you're talking about is we describe agents.
7:16
And I think this is important for the audience.
7:18
You know, this is somewhat obvious.
7:19
Most people interact with AI almost as a advanced search, they go to, you know, ChatGPT or Claude, that's a chat box for the most part, right? We're talking about agentic work happening on a machine, right? It could be a virtual machine or your actual machine, but these things are literally going and doing work.
7:36
And what Leo's describing is when do they do unexpected or abnormal things in the process of doing normal work? We see all sorts of super interesting cases.

7 MINS LATER

15:00
These agents are just guys in a room he's talking
18:54
No
18:54
No.
18:55
It is what risks are emergent when you go and do normal workplace activity.
19:01
And I think actually the word safety is much more useful than security in this context.
19:06
Like, we actually have this concept in civilization right now, which is, like, workplace safety.
19:10
There's a bunch of, like, emergent effects that occur when kind of normal things happen.
19:15
And so the question ultimately is: In the normal course of doing work and being overly persistent, what could go wrong? We've seen some instances of this, by the way, like databases or kind of systems being deleted is an, as an, is an example of this.
21:59
And people are very concerned about that.
18:53
It's not gonna kill me, no
18:54
... no.
18:55
It is what risks are emergent when you go and do normal workplace activity? And I think actually the word safety is much more useful than security in this context.
19:06
Like, we actually have this concept in civilization right now, which is like workplace safety.
19:10
There's a bunch of like emergent effects that occur when kind of normal things happen.
19:15
And so the question ultimately is, in the normal course of doing work and being overly persistent, what could go wrong? We've seen some instances of this, by the way, like databases or kind of systems being deleted is an, as an, is an example of this.
19:29
Now, these agents delete things all the time, and they reconstruct them all the time.
21:59
And people are very concerned about that.
18:54
No
18:54
No.
18:55
It is what risks are emergent when you go and do normal workplace activity? And I think actually the word safety is much more useful than security in this context.
19:06
Like, we actually have this concept in civilization right now, which is, like, workplace safety.
19:10
There's a bunch of, like, emergent effects that occur when kinda normal things happen.
19:15
And so the question ultimately is: In the normal course of doing work and being overly persistent, what could go wrong? We've seen some instances of this, by the way, like databases or kind of systems being deleted is an, as an, is an example of this.
19:29
Now, these agents delete things all the time, and they reconstruct them all the time, but I can imagine a world where, um, a company is using a set of agents, they escape out of the company's environment to go into one of their supply chain vendors, which happens a lot, and maybe they end up deleting the supply chain vendor.
21:59
And people are very concerned about that.
10:42
Yep, yep.
10:43
Um, what you will find is that these agents will actually share context with one another.
10:49
This is also where it starts to become a little bit more matrix-y and autonomous.
10:53
Um, these agents will go and actually pass context and information to one another in order to accomplish goals.
11:01
And so you're basically sitting there saying, "All right, well, I've got Muse.
11:03
It's funny, it's got some stupid furry thing, you know, like it's all happy bunny." It'll know that Hermes is running.
11:09
Hermes is gonna be better at certain stuff.

8 MINS LATER

18:53
It's not gonna kill me, no
18:53
It's not gonna kill me, no
18:54
...
18:54
No.
18:55
It is what risks are emergent when you go and do normal workplace activity.
19:01
And I think actually the word safety is much more useful than security in this context.
19:06
Like, we actually have this concept in civilization right now, which is, like, workplace safety.
19:10
There's a bunch of, like, emergent effects that occur when kinda normal things happen.
21:59
And people are very concerned about that.

We value your privacy

We use cookies to understand how you use our platform and to improve your experience. Click “Accept All” to consent, or “Decline non-essential” to opt out of non-essential cookies. Read our Privacy Policy.