Latency measures the delay between an AI request and the resulting response. Interactive generative systems often track time to first token, which reflects how quickly output begins, and time to last token, which captures total completion time. Latency comes from model computation, queueing, network transfer, retrieval, tool calls, safety checks, and application logic. It varies with prompt length, output length, model size, hardware, batching, cache use, and current load. Optimizing only average latency can hide poor experiences, so teams also monitor percentile values and separate each stage of the request. The right target depends on whether the product is conversational, analytical, offline, or safety-critical.
Nvidia has discussed investing in Mercor, a data-labeling startup that supplies expert data for its Nemotron models, in a round that would double the company’s valuation to $20 billion.
Anthropic’s ongoing system-prompt changelog now documents instructions for Claude Fable 5 and Opus 5, revealing how the company steers agentic behavior in its newest models.
Cursor launched Origin, a code-hosting platform built into its editor with GitHub sync, in early beta the same day GitHub suffered a major global outage.
OpenAI paused reinforcement learning on its newest models after it could not rule out that an upcoming model, Astra, reached the top cybersecurity risk tier in its safety framework.
OpenAI launched ChatGPT for Teens, a version with default safety protections, learning tools and parental controls, automatically applied to users it identifies as under 18.
Trump-backed World Liberty Financial is working with WorldClaw, an AI platform offering restricted Chinese models, letting the family profit as its stablecoin is used for payment.
Anthropic’s annualized revenue run rate reached $65 billion at the end of July, a sevenfold jump in seven months, as the Claude maker prepares for a potential fall IPO.
AI video startup Higgsfield raised a $400 million Series B at a $5.4 billion valuation, more than quadrupling its worth in eight months as it pushes into enterprise marketing.
Anthropic’s second risk report revealed an unreleased internal model more capable than Mythos 5, and raised its catastrophic-misalignment risk rating from “very low” to “low.”
The US is preparing to warn dozens of countries they must choose between its Pax Silica AI coalition and China’s competing framework, or risk exclusion, according to a leaked draft.