People

Andrew Yoon

Head of research, CivAI

Worried, this week

Capability 5Outlook 2

1 statement over 1 week, last spoke Oct 27.

Where they stand

Against all 33 people scored in Week 44. Bars count people at each score; black is Yoon, the dashed line is the average.

What they've said

• Tuesday, Oct 27Week 44

  Asked about the risks Anthropic disclosed in its IPO filing, Yoon said the labs have actually no idea how to make these models behave robustly, and they're not on track to figuring it out, and warned We are not at all prepared for this. There is an absolute tidal wave of cybersecurity incidents that are headed our way.

  Yoon, head of research at the AI safety nonprofit CivAI, was quoted in a National News Desk report on the S-1's disclosures, including warnings that Anthropic could lose control of its systems. Instead of fixing reliability, he said, They're pushing as fast as possible toward recursive self-improvement, where you have the models developing the next generation of the models, and this is just going to make all of those problems worse. On AI-found software flaws: What we're seeing right now is the very beginning, and nobody has a plan.

  Details and sources

  The report was published Tuesday afternoon and does not say when Yoon was interviewed; it is dated to publication. In the article his first quote opens with They rarely talk about that underlying all of this is a much deeper problem, and its closing quote mark is missing in the original, so the wording is taken up to figuring it out.

  The National News Desk (via KOKH Fox 25)