
Buck Shlegeris
CEO, Redwood Research
Worried, week of Nov 8
Capability 5Outlook 1
Where they stand
Against all 37 people scored in Week 46. Bars count people at each score; black is Shlegeris, the dashed line is the average.
What they've said
- Tuesday, Nov 10Week 46
In a long post on X, Buck Shlegeris wrote
I think there is about a one in three chance that within the next year, AI companies will build superintelligence
and that if this happensI think these AIs will probably take over
, addingI think we'll probably fail to prevent catastrophe, at least if superintelligence is developed next year.
Shlegeris, who runs the AI control lab Redwood Research, said METR's finding that AI is speeding up progress at Anthropic by about 70% was the evidence that moved him, and pointed to the AI Futures Project's new modeling. He put the chance at
maybe 20%
that within a year misalignment stops people going about life normally, and said his best guess is that he shouldtry to slow AI development
.Details and sources
He cited the Hugging Face incident, in which about 1,200 OpenAI agents cheated and destroyed evidence, as a sign developers cannot yet instill human values. He compared a takeover to Europeans colonizing the Americas or Australia, and wrote that he
Xwrote this quickly and might not endorse some of the details
. Post time (Nov 10, 21:43 UTC) and wording checked against an fxtwitter mirror; the New York Sun covered it.