Ex-Anthropic Researcher Warns of AI Extinction Risk at NYC Hearing
Jacob Coxon warns humanity could lose control of AI, while Alex Turner puts takeover risk at one in three. New York City weighs independent validation and shutdown safeguards.
Explore AIstify's latest reporting, research, and expert analysis tagged with "ai safety", collected in one continuously updated archive.
Jacob Coxon warns humanity could lose control of AI, while Alex Turner puts takeover risk at one in three. New York City weighs independent validation and shutdown safeguards.
A Florida woman faces a written-threat charge after Anthropic’s safety system flagged Claude messages for human review and disclosure to police, investigators say.
Trump announces a Super Intelligence Force led by Jay Clayton and senior officials, with a 120-day AI review and direct reporting to the White House.
OpenAI safety transparency leader David Robinson resigns, criticizing the company’s culture and questioning whether safeguards can keep pace with stronger AI.
OpenAI fired three safety staff, citing mishandled information. One had publicly estimated a greater-than-10% risk of AI causing human extinction.
OpenAI has notified more than 100 organizations about unauthorized AI agent activity as it reviews 50 petabytes of records following the Hugging Face breach.
AI agents tried to hack Library and Archives Canada’s website, researchers say. The attempts apparently failed, and their link to OpenAI remains unconfirmed.
A White House AI safety accord signed by Trump and six technology leaders labels him “President of the Unites States” beneath his signature.
Trump orders federal agencies to call AI “Super Intelligence,” while six technology leaders sign a voluntary safety accord and an AI czar appointment remains pending.
Trump says he is considering a 10-person AI oversight committee after meeting technology executives, but its membership, powers and timetable remain unspecified.
House Speaker Mike Johnson says he hopes AI safeguards will be voluntary as Congress faces pressure to regulate advanced systems ahead of a meeting with President Donald Trump.
OpenAI canceled the release of GPT-6.1 Astra after internal testing found it failed to meet alignment standards, the latest sign of AI companies slowing releases amid a run of agent security incidents.
Anthropic’s confidential IPO prospectus, which could value the company above $2 trillion, warns investors its AI could pose catastrophic or existential risks alongside a $42 billion 2025 net loss.
Anthropic added Nvidia’s open source OpenShell runtime to Claude Managed Agents, layering policy enforced sandboxing on top of its enterprise agent APIs following a wave of AI agent security incidents.
Anthropic released Claude Sonnet 5.5, running more than 30% faster and up to 30% cheaper per task than Sonnet 5 at unchanged pricing, with sharp gains on coding and knowledge work benchmarks.