Technology & AI
Anthropic’s IPO pitch includes a warning about human extinction
Source: Ars Technica - All content · Published
Anthropic has formally warned investors that its technology may pose “existential risks to humanity” in a long-awaited initial public offering prospectus circulated with a small group of partners in recent days. The nearly $1 trillion AI start-up led by Dario Amodei devoted almos
Anthropic has formally warned investors that its technology may pose “existential risks to humanity” in a long-awaited initial public offering prospectus circulated with a small group of partners in recent days. The nearly $1 trillion AI start-up led by Dario Amodei devoted almost a third of its lengthy S-1 filing to detailing “risk factors,” including the potential of increasingly advanced AI models to manipulate, blackmail, and exhibit other unpredictable behaviors. Anthropic outlined more prosaic risks, including the extreme concentration of its customer base, with close to a quarter of revenue last year coming from just two clients, according to people familiar with the filing.
Read full article Comments
Related stories
Anthropic’s prospectus details losses, growth, and, yes, a warning that its AI could end humanity
In its prospectus, Anthropic just told investors it's losing tens of billions of dollars a year, but also growing like crazy, and — oh yeah — its own AI might pose an existential risk to humanity.
TechCrunch ·
AI researchers put out videos saying superintelligence is ‘exactly as dangerous as it sounds’
"The chance of human extinction is about a coin flip, in my view," Geoffrey Irving, a former OpenAI and Google DeepMind employee, said in a new interview. It's one of a dozen interviews with AI researchers, including current and former employees at OpenAI, Google, and Anthropic.
The Verge ·
Appeals Court Lets the Pentagon Designate Anthropic a Supply-Chain Risk
The AI lab had argued multiple violations of its rights, but a divided panel of judges sided with the Trump administration.
WIRED ·
Why China Is Requiring Ninth Graders to Read ‘Jane Eyre’
The Victorian heroine has long been celebrated in China for her independence and insistence on equality.
NYT > World News ·
Anthropic ‘warns of existential AI risks to humanity’ in IPO document
Reported admission to investors of AI’s ‘self-preserving behaviours’ comes as company prepares for a potential $2tn flotation Anthropic is telling investors that advanced AI could pose “catastrophic or existential risks to humanity”, according to reports, as it prepares for a pot
Business | The Guardian ·