
The Precipice: Existential Risk and the Future of Humanity
Book by Toby OrdWikipedia
25
MENTIONS
7
EPISODES
5
PODCASTS
Search complete. 25 mentions across 7 episodes found for "The Precipice: Existential Risk and the Future of Humanity".
Nov 20, 2026
We Started With Effective Altruism, and Ended With Destroying Humanity.
M
7:51Marc BarnesHOST
geographical nearness of all people is obliterated.
M
7:54Marc BarnesHOST
So I'll read you real quick something from Toby Ord's The Precipice, which was phenomenal.
M
8:02Marc BarnesHOST
Part of
A
8:02Alex DenleyHOST
the Oxford kind of futurist, effective altruist crowd.
24 MINS LATER
M
32:08Marc BarnesHOST
And because of that, it's a paradox in a certain way, but the present generation becomes at once totally unimportant relative to that Because if you're a utilitarian and you're going to do some good for us, you've got like, I don't know, maybe a glass of milk full of happiness.
M
32:31Marc BarnesHOST
But if you do it for the future people, you're talking about all the oceans of the world, right? Um, and so they, so, so there, so there's, um, yeah, so, so there's this, you know, bringing, bringing the future, future becomes the present moment I should say becomes, um, unimportant in relation to the future, but it also becomes profoundly important.
M
32:58Marc BarnesHOST
It becomes the most important, in fact, because as Toby Ord puts it, we stand on the precipice.
M
33:06Marc BarnesHOST
So they bring up this idea that the, and I think this is really important because I think it can be, Like there's something deeply boring about just like tech progress as it, right? It's like spiritual stagnation, kind of moral stagnation.
We Started With Effective Altruism, and Ended With Destroying Humanity.
M
7:39Marc BarnesHOST
But the work of effective altruism is to equalize not the dignity of the human person and the infidelity of the human person, but the actual dignity geographical nearness of all people is obliterated.
M
7:54Marc BarnesHOST
So I'll read you real quick something from Toby Ord's The Precipice, which was phenomenal.
M
8:02Marc BarnesHOST
Part of
A
8:02Alex DenleyHOST
the Oxford kind of futurist, effective altruist crowd.
24 MINS LATER
M
32:08Marc BarnesHOST
And because of that, it's a paradox in a certain way, but the present generation becomes at once totally unimportant relative to that Because if you're a utilitarian and you're going to do some good for us, you've got like, I don't know, maybe a glass of milk full of happiness.
M
32:31Marc BarnesHOST
But if you do it for the future people, you're talking about all the oceans of the world, right? Um, and so they, so, so there, so there's, um, yeah, so, so there's this, you know, bringing, bringing the future future becomes the present moment, I should say, becomes, um, unimportant in relation to the future, but it also becomes profoundly important.
M
32:58Marc BarnesHOST
It becomes the most important, in fact, because as Toby Ord puts it, we stand on the precipice.
M
33:06Marc BarnesHOST
So they bring up this idea that the.
Effective Altruism Makes You a Bad Person
A
9:14Alex DenleyHOST
Joseph Carl Smith, for example, at Anthropic, he's a leading alignment researcher.
A
9:18Alex DenleyHOST
He was a research fellow for The Precipice, the book by Toby Ord.
A
9:25Alex DenleyHOST
I think he worked for one of the effective altruist nonprofits for a little while.
A
9:30Alex DenleyHOST
And so the idea of doing the most good with AI, kind of effective altruism is in the background of a lot of this.
Effective Altruism Makes You a Bad Person
A
9:14Alex DenleyHOST
Joseph Carl Smith, for example, at Anthropic, he's a leading alignment researcher.
A
9:18Alex DenleyHOST
He was a research fellow for The Precipice, the book by Toby Ord.
A
9:25Alex DenleyHOST
I think he worked for one of the effective altruist nonprofits for a little while.
A
9:30Alex DenleyHOST
And so the idea of doing the most good with AI kind of – effective altruism is in the background of a lot of this.
273 – Vaden Masrani on… Critical Rationalism?
V
25:06Vaden MasraniGUEST
So the example I used in that podcast was Toby Ord.
V
25:10Vaden MasraniGUEST
And so Toby Ord in The Precipice gives a number of probabilistic estimates of different things that could kill us, existential risks.
V
25:18Vaden MasraniGUEST
So for instance, he talks about the probability of, say, supervolcanoes, the probability of asteroids.
V
25:27Vaden MasraniGUEST
When we are coming up with probabilities of these risks, what do we do? We look through the historical record.
V
27:21Vaden MasraniGUEST
Yeah.
V
27:22Vaden MasraniGUEST
But the problem when we start saying the probability is 63% or the chance is 14%, as soon as we add a number to it, now this gives us license, as Toby Ort did, to compare numbers that have been made up against counts of the real world.
V
27:40Vaden MasraniGUEST
So Toby Ord's whole point in The Precipice was to say, ignore all of the supervolcano risks, ignore all of the asteroids, ignore all of that, because the chance is so small compared to the chance of superintelligence, which is, I think he said, 1 in 10, and then he aggregated everything to be 1 in 6.
V
27:56Vaden MasraniGUEST
Sorry, man.
What Does Effective Altruism Really Believe?
W
16:07Will MacAskillGUEST
And so then that means, wow, there's just really a lot at stake if there are things that affect how the long-term future might go.
W
16:16Will MacAskillGUEST
And then the final point, which is what most of the book, What We Are the Future, spends its time on, is saying like, yeah, actually, there are things that are happening in our lifetimes.
W
16:27Will MacAskillGUEST
And since I've written this book, I now think within the next few years that will have very major impacts, not just on how well this generation goes, but how the whole course of the long-term future goes.
W
16:40Will MacAskillGUEST
And put that all together and you get the view that These things that will impact the long-term future, where that includes how we handle pandemics, how we handle AI, are among at least the very most important priorities of our time.
D
16:57Derek ThompsonHOST
What does it really mean to care about somebody who won't exist for a thousand or one million years? I feel like I can...
D
20:47Derek ThompsonHOST
And so we should try to not have civilization collapse or go extinct and care very much about things that present existential risks to civilization.
D
20:57Derek ThompsonHOST
You've done work on this.
D
20:58Derek ThompsonHOST
Toby Ord has a book, The Precipice, which is all about existential risk, whether it's AI or comets smashing into Yucatan peninsulas.
1 more episode mentions The Precipice: Existential Risk and the Future of Humanity.
Create an account to see the whole feed, search across every transcript, and follow the entities you care about.