
Micah Carroll
24
MENTIONS
14
EPISODES
5
PODCASTS
Search complete. 24 mentions across 14 episodes found for "Micah Carroll".
Sep 11, 2026
GPT-6 Astra - WOW, OpenAI = pro regulation, Trump admin warms to AI safety
G
16:19Greg AllenHOST
End quote.
G
16:20Greg AllenHOST
Then Micah Carroll, who's on the RSI preparedness team, in fact, he leads that team at OpenAI, he said on X, quote, GPT-6 is a very significant jump in capabilities, but also an important decrease in monitorability.
G
16:36Greg AllenHOST
In my opinion, monitorability and control will likely become a major bottleneck for responsible AI development quite soon.
G
16:45Greg AllenHOST
It should ultimately be in everyone's interest to agree on shared bounds for monitorability in order to avoid races to the bottom.
Jacob Coxon Warns of Human Extinction and Triggers a Preference Cascade
Z
10:12Zvi MowshowitzHOST
Again, the other post contains the full quotes.
Z
10:15Zvi MowshowitzHOST
There we have quotes from Tomek Korbac, V. McCoy, Adam Majmudar, Aidan Clark, Moe Bavarian, Boaz Barak, Micah Carroll, Julie Steele, Marcus Williams, Jason Wolfe, and Rune.
Z
10:29Zvi MowshowitzHOST
I will also quote Rune here as well, who has a relatively careful, optimistic take.
R
10:34RuneSOUNDBITE_SPEAKER
Rune.
27 MINS LATER
Z
37:46Zvi MowshowitzHOST
I have never spoken to Jacob Coxon, but the evidence is overwhelming that he believes what he is saying.
Z
37:52Zvi MowshowitzHOST
He has sent many extremely costly signals that yes, this is exactly what he believes.
Z
37:57Zvi MowshowitzHOST
We also have vouching, including from Tomek Korbac, Leo Gao, Micah Carroll, and Ethan Perez.
L
38:04Leo GaoSOUNDBITE_SPEAKER
Leo Gao, OpenAI.
“Jacob Coxon Warns of Human Extinction and Triggers a Preference Cascade” by Zvi
T
10:35Type Three AudioNARRATOR
Again, the other post contains the full quotes.
T
10:38Type Three AudioNARRATOR
There we have quotes from Tomek Korbak, Vi McCoy, Adam Majmuda, Aidan Clark, Mo Bavarian, Boaz Baric, Micah Carroll, Julie Steele, Marcus Williams, Jason Wolfe and Rune.
T
10:51Type Three AudioNARRATOR
I will also quote Rune here as well, who has a relatively careful, optimistic take.
T
10:57Type Three AudioNARRATOR
Quote Rune, open AI.
29 MINS LATER
T
39:35Type Three AudioNARRATOR
I have never spoken to Jacob Coxon, but the evidence is overwhelming that he believes what he is saying.
T
39:41Type Three AudioNARRATOR
He has sent many extremely costly signals that yes, this is exactly what he believes.
T
39:47Type Three AudioNARRATOR
We also have vouching, including from Tomek Korbak, Leo Gio, Micah Carroll and Ethan Perez.
T
39:54Type Three AudioNARRATOR
Quote Leo G.A.O., OpenAI.
“Jacob Coxon Warns of Human Extinction and Triggers a Preference Cascade” by Zvi
T
10:35Type 3 AudioNARRATOR
Again, the other post contains the full quotes.
T
10:38Type 3 AudioNARRATOR
There we have quotes from Tomek Korbak, Vi McCoy, Adam Majmuda, Aidan Clark, Mo Bavarian, Boaz Baric, Micah Carroll, Julie Steele, Marcus Williams, Jason Wolfe and Rune.
T
10:51Type 3 AudioNARRATOR
I will also quote Rune here as well, who has a relatively careful, optimistic take.
T
10:57Type 3 AudioNARRATOR
Quote Rune, open AI.
29 MINS LATER
T
39:35Type 3 AudioNARRATOR
I have never spoken to Jacob Coxon, but the evidence is overwhelming that he believes what he is saying.
T
39:41Type 3 AudioNARRATOR
He has sent many extremely costly signals that yes, this is exactly what he believes.
T
39:47Type 3 AudioNARRATOR
We also have vouching, including from Tomek Korbak, Leo Gio, Micah Carroll and Ethan Perez.
T
39:54Type 3 AudioNARRATOR
Quote Leo G.A.O., OpenAI.
“The Extinction Risk Preference Cascade: Quotes” by Zvi
T
8:20Type 3 AudioNARRATOR
Heading.
T
8:21Type 3 AudioNARRATOR
Micah Carroll.
T
8:23Type 3 AudioNARRATOR
Quote.
T
8:25Type 3 AudioNARRATOR
Micah Carroll, RSI Preparedness, OpenAI.
T
8:29Type 3 AudioNARRATOR
This is not a setup or some political psyop.
T
8:32Type 3 AudioNARRATOR
I had many lunches and dinners with Jacob at OpenAI in which we talked about AI existential risks in similar terms.
Astra Is Hard to Monitor
T
65:56Tomek KorbackSOUNDBITE_SPEAKER
I am worried.
M
65:57Micah CarrollSOUNDBITE_SPEAKER
Micah Carroll, RSI Preparedness, OpenAI.
M
66:01Micah CarrollSOUNDBITE_SPEAKER
A race to the bottom in monitorability due to a false belief that OpenAI is using neuralese models would be incredibly stupid.
M
66:08Micah CarrollSOUNDBITE_SPEAKER
He
Z
66:08Zvi MowshowitzHOST
explicitly confirms that this is false.
Z
66:11Zvi MowshowitzHOST
Micah also notes that monitorability will soon be a bottleneck for responsible developers, which can be seen as good news, since if true it means no one would be able to race that far to the bottom even if they wanted to do so.
M
66:24Micah CarrollSOUNDBITE_SPEAKER
Micah Carroll, RSI Preparedness OpenAI GPT-6 is a very significant jump in capabilities, but also an important decrease in monitorability, especially under adversarial evaluation.
M
66:37Micah CarrollSOUNDBITE_SPEAKER
We give many details about this in the system card.
“Astra Is Hard to Monitor” by Zvi
T
52:39Type Three AudioNARRATOR
End quote.
T
52:40Type Three AudioNARRATOR
Micah also notes that monitorability will soon be a bottleneck for responsible developers, which can be seen as good news since if true it means no one would be able to race that far to the bottom even if they wanted to do so.
T
52:52Type Three AudioNARRATOR
Quote.
T
52:54Type Three AudioNARRATOR
Micah Carroll, RSI Preparedness, OpenAI.
T
52:58Type Three AudioNARRATOR
GPT-6 is a very significant jump in capabilities, but also an important decrease in monitorability, especially under adversarial evaluation.
T
53:07Type Three AudioNARRATOR
We give many details about this in the system card.
“Astra Is Hard to Monitor” by Zvi
T
52:39Type 3 AudioNARRATOR
End quote.
T
52:40Type 3 AudioNARRATOR
Micah also notes that monitorability will soon be a bottleneck for responsible developers, which can be seen as good news since if true it means no one would be able to race that far to the bottom even if they wanted to do so.
T
52:52Type 3 AudioNARRATOR
Quote.
T
52:54Type 3 AudioNARRATOR
Micah Carroll, RSI Preparedness, OpenAI.
T
52:58Type 3 AudioNARRATOR
GPT-6 is a very significant jump in capabilities, but also an important decrease in monitorability, especially under adversarial evaluation.
T
53:07Type 3 AudioNARRATOR
We give many details about this in the system card.
“An Alien Mind: Jakub Pachocki Warns Us” by Zvi
T
23:00Type Three AudioNARRATOR
The calls are getting louder and often coming from inside the house.
T
23:05Type Three AudioNARRATOR
Quote, Micah Carroll, RSI Preparedness, OpenAI.
T
23:10Type Three AudioNARRATOR
"Voluntary slowdowns are great, but it's hard to rely on all actors to do them as necessary.
T
23:16Type Three AudioNARRATOR
We urgently need shared safety bars and transparency into them being met, or we're just waiting on other incidents, and it's just a matter of who causes them first.
An Alien Mind: Jakub Pachocki Warns Us
Z
23:19Zvi MowshowitzHOST
The calls are getting louder and often coming from inside the house.
Z
23:23Zvi MowshowitzHOST
Micah Carroll,
M
23:24Micah CarrollSOUNDBITE_SPEAKER
RSI Preparedness OpenAI Voluntary slowdowns are great, but it's hard to rely on all actors to do them as necessary.
M
23:32Micah CarrollSOUNDBITE_SPEAKER
We urgently need shared safety bars and transparency into them being met, or we're just waiting on other incidents.
4 more episodes mention Micah Carroll.
Create an account to see the whole feed, search across every transcript, and follow the entities you care about.