Latency measures the delay between an AI request and the resulting response. Interactive generative systems often track time to first token, which reflects how quickly output begins, and time to last token, which captures total completion time. Latency comes from model computation, queueing, network transfer, retrieval, tool calls, safety checks, and application logic. It varies with prompt length, output length, model size, hardware, batching, cache use, and current load. Optimizing only average latency can hide poor experiences, so teams also monitor percentile values and separate each stage of the request. The right target depends on whether the product is conversational, analytical, offline, or safety-critical.
Ethereum’s Vitalik Buterin argued the gravest AI risk is not rogue superintelligence but a few companies or governments seizing control of it, in a widely shared thread on AI’s future.
Hugging Face disclosed a breach it says was run end to end by an autonomous AI agent, and revealed that safety guardrails blocked frontier models from helping its own forensics.
Alibaba previewed Qwen 3.8, a 2.4-trillion-parameter model it claims is second only to Anthropic’s Fable 5, days after Moonshot’s Kimi K3 rattled markets, though no benchmarks back it.
Economists warn AI’s biggest near-term danger may be fiscal: if it displaces high-earning workers, income-tax revenue could fall sharply while welfare costs rise, straining public budgets.
Anthropic’s new ad “There’s hope in hard questions” drew mockery, including from Sam Altman, for pairing bleak imagery like a cemetery with questions about whether AI can be trusted.
SoftBank plans to sell about ¥60 billion of notes in Japan this month, its latest raise to fund a mounting AI bet that includes nearly $65 billion committed to OpenAI.
Chinese startup Moonshot released Kimi K3, a 2.8-trillion-parameter open-weight model it says rivals Anthropic’s Claude, as the US-China AI gap narrows.
Anthropic is scheduling investor meetings ahead of a potential IPO as soon as October, a move that could take the Claude maker public before rival OpenAI.
OpenAI launched Codex Micro, a $230 mechanical keypad built with Work Louder that gives developers physical controls for its Codex coding agent, its first hardware to reach market.
NVIDIA unveiled Cosmos 3 Edge and said Japan’s robotics and manufacturing leaders, from FANUC to Sony, intend to join its Cosmos Coalition to build AI for the physical world.