You’ve probably seen these reports of an employee of the AI company Anthropic who quit his job and issued a warning on X that suggested AI could, in next few years, escape control and lead to the extinction of humanity. These sound like not just wild but science fiction-type claims. And they’ve lurked around frontier AI labs for years. It’s one of the many weirdnesses of the AI world and those who lead it. The basic pitch: AI is awesome. We need to built it as quickly as possible. Also it might lead to human extinction. Quite an attractive offer! There’s always been a strong sense among many observers that these claims or suggestions or warnings are part of the AI hype machine itself, albeit of a kind of contradictory or paradoxical variety.

But this warning by the ex-Anthropic employee, Jacob Coxon, seems different and is unquestionably being reacted to very differently. That’s the one part of this that is new and real – the reaction to this warning/comment etc is much bigger and operating in the tech, financial and general media. Wired has a good interview with him here. (I think you can read it as a free article if you haven’t read other Wired articles this month.) The gist is that Coxon says it’s imperative to create a regulatory structure, or at least an ad-hoc agreement that can slow the competition between OpenAI and Anthropic, the two most advanced AI engines and research entities. (The inflection point people are focusing on is something called “recursive self-improvement,” which is when this generation of AI model builds the next one.) The problem is that you really need an agreement that brings China into some common framework too. Because they’re in this same hunt, running these same risks, even though I think the common consensus is that Chinese companies are running at least somewhat behind the most advanced U.S. companies. China’s strength has been building models which are only a bit behind the U.S. models but at dramatically lowest costs.

You’ve probably seen that Treasury Secretary Scott Bessent has now tried to knock down interest rates on US debt – and thus secondarily general rates – with a series of buy backs. But it’s failing. I was actually going to reach out to some economists I know about this because in addition to the real factors – not just momentary crises of confidence – the scale of the interventions seem quite small. $6 billion? In any case, I noticed this update on Paul Krugman’s substack. And he adds something important. Clearly there are an endless list of things Donald Trump has done over the last twenty months or so which would create very rational loss of confidence in the management of the US economy and particularly the US Treasury. But he doesn’t think this is about Trump or falling confidence in US institutions, in large part because the run up is affecting other countries’ borrowing as well. The immediate issue is that there’s only a finite about of money in the world to borrow and the AI build out is taking up enough of it that it’s simply driving up the cost of money. Here’s Krugman’s take.