Ep 93: CEO of Redwood Research Buck Shlegeris on OpenAI/HuggingFace Revelations, Fixing AI Safety & Takeover Odds

It's interesting because obviously the public discourse has been dominated by the Hugging Face incident.

It seems like that third swarm is actually far more alarm bell inducing.

Yeah.

So I've spent a lot of time on thinking about risks from internal deployment of AIs.

And one of the main things I think is scary about developing powerful AI is that you're going to want to use them in all these really sensitive ways inside your cluster.

And there's all kinds of ways they could hack you and it might be really hard to recover from this.

One way of saying this is just AI companies are a particularly high value target to hack.

They're very important.

They're going to be more and more important in the future.

They're one of my least favorite places to have big cybersecurity incidents.

And so from my perspective, AI's hacking AI companies is actually quite concerning relative to AI's hacking random external companies.

So I would definitely start out with the presumption that it's very interesting to know what happened in the attack on OpenAI itself.

But obviously, it's not a felony nearly as clearly.

It hadn't been reported, or none of these things are felonies.

It hadn't been reported to the FBI.

So it's kind of unsurprising that a lot of public interest has focused on the Hugging Face incident.

And for all we know, the Urban AI attack was actually a nothing burger.

And if we looked into it, then nothing particularly exciting would have happened.

We just don't know.