This was the week the people building frontier AI asked for a brake. Anthropic chief executive Dario Amodei wrote that the industry must slow the pace at which it improves AI capabilities, Sam Altman and Elon Musk publicly agreed, and OpenAI said it will not go public this year. AI-linked stocks fell around the world on Monday morning, and Congress, alarmed by an Anthropic researcher's very public resignation, conceded it has only one workweek left before the election. Meanwhile, nothing else paused: Meta shipped an agent that can send email and make payments, investors nearly doubled Cognition's valuation, Mistral closed a record European round while Cohere entered talks for a record Canadian one, Amazon struck a chip deal worth up to $60 billion with Qualcomm, and Ottawa put $13 million into teaching a million students how to use AI well. The labs may slow down. The market around them has not.
1. The heads of the biggest AI labs asked their own industry to slow down
In a September 12 essay titled "We Must Pace the Frontier," Anthropic chief executive Dario Amodei wrote that "we must slow the pace at which we improve the capabilities of AI models," warning that within six to 12 months AI agents could be capable of causing hundreds of billions of dollars in damage online, and Sam Altman and Elon Musk publicly backed the call. Anthropic committed on its own to the first step of a three-step plan, giving outside evaluators employee-level access to verify safety practices and report incidents, while the later steps depend on governments and rival labs joining in.
2. Markets flinched, and OpenAI shelved its IPO
AI-linked stocks fell across Asia, Europe and Wall Street on September 14, the first trading session after the slowdown call, with SoftBank down as much as 13.2%, SK Hynix down 6.3% and Nasdaq futures off 1.9%, while Sam Altman said OpenAI would not go public this year, calling it an "ill-advised moment" given the safety concerns. Anthropic is still pushing ahead with a listing expected next month, which leaves investors asking the question one strategist put plainly: if the AI race slows materially, who pays for all that infrastructure?
3. Congress is alarmed about AI but has no time left to act before the election
The week's warnings started when Anthropic safety researcher Jacob Coxon resigned publicly, writing that "the people building AI earnestly believe that it could kill us all by the end of the decade," and lawmakers in both parties have since pointed to bills including the FRONTIER Act and the bipartisan AI Kill Switch Act. But there is no consensus and the House has only one more workweek before Election Day, with Speaker Mike Johnson saying AI needs safety measures but that he does not want to stifle American innovation.
4. Meta launched an AI agent that can send your email and make payments
Meta released Muse on September 8, a personal agent for the US that connects to email, calendars and payment methods and can fill out forms and complete multi-step tasks on its own, offered free or at $20 or $100 a month. Meta says Muse never sees actual passwords or payment details and asks before doing anything sensitive, but users must opt out if they do not want their interactions used to train Meta's models, and chief AI officer Alexandr Wang called commerce a potentially really interesting business model for it.
5. Investors nearly doubled Cognition's valuation in four months
Cognition, maker of the Devin coding agent, raised $2 billion at a $48 billion valuation on September 8, up from $26 billion in May, in a round led by Andreessen Horowitz, Accel, Founders Fund, General Catalyst and Avenir. A day later legal AI company Harvey raised $550 million at a $15.5 billion valuation and bought Guardrails AI, a security platform for AI agents, showing that money is still flowing to the companies that turn frontier models into work software.
6. Europe and Canada are putting record money into home-grown AI labs
France's Mistral raised €3 billion at a valuation above €21 billion on September 8 in a round led by Samsung, the largest equity round ever completed by a European technology company. Three days later The Globe and Mail reported that Toronto's Cohere is in advanced talks to raise $2 billion to $3 billion at a $20 billion valuation, including money from the Canadian government, which would be the largest round on record for a private Canadian startup if it closes.
7. Amazon could buy up to $60 billion of AI chips from Qualcomm
Qualcomm said on September 8 that Amazon could buy up to $60 billion of its AI data-centre chips under a long-term partnership, with a warrant letting Amazon buy about $4 billion of Qualcomm stock, making Amazon the third hyperscaler after Microsoft and Meta to back Qualcomm as an alternative to Nvidia. Nvidia answered two days later with a $3.5 billion investment in MediaTek, which will adopt Nvidia's NVLink Fusion so that customers' custom AI chips plug directly into Nvidia infrastructure.
8. Ottawa is funding free AI literacy courses for a million students
AI Minister Evan Solomon launched a $13 million National AI Literacy Initiative in Edmonton, delivered by the Alberta Machine Intelligence Institute (Amii), with free courses aimed at up to one million post-secondary students and more than 50,000 K-12 educators, and schools can sign on starting September 21. The courses teach people to assess AI-generated information, recognise bias, misinformation and privacy risks, and decide when to use the technology, a notably different path from New York City and Los Angeles, which restricted most student AI use this school year.
9. Workers who use AI are the most worried about losing their jobs
A new idealis report on AI adoption at work found that 72% of employees who use AI are concerned about their job security, compared with 46% of those who do not, even as professional AI use rose 16 percentage points in a year to 62% of workers. The researchers argue the people closest to the tools are the first to see how much work is changing, which makes employee confidence a leadership problem rather than a training checkbox.
