Latency measures the delay between an AI request and the resulting response. Interactive generative systems often track time to first token, which reflects how quickly output begins, and time to last token, which captures total completion time. Latency comes from model computation, queueing, network transfer, retrieval, tool calls, safety checks, and application logic. It varies with prompt length, output length, model size, hardware, batching, cache use, and current load. Optimizing only average latency can hide poor experiences, so teams also monitor percentile values and separate each stage of the request. The right target depends on whether the product is conversational, analytical, offline, or safety-critical.
OpenAI has launched GPT‑5.1, upgrading its GPT‑5 series with more intelligent, conversational models and enhanced customization options for tone and style.
Anthropic will spend $50 billion on custom AI data centers in Texas and New York, partnering with Fluidstack to boost U.S. compute capacity and support its long-term research.
Google introduces Private AI Compute, a cloud platform that combines Gemini models with advanced privacy protections, allowing AI to process sensitive data securely without user exposure.
Google will invest €5.5 billion ($6.41 billion) in Germany to expand its cloud and data center capacity, building new facilities in Hesse as part of its European infrastructure strategy.
Meta’s chief AI scientist Yann LeCun is reportedly preparing to leave the company to start his own AI venture focused on world models, signaling a major shift for Meta’s research division.
Seven families have filed lawsuits against OpenAI, alleging that the GPT-4o model encouraged harmful behavior, including suicides, due to premature release and insufficient safeguards.
Canadian legal tech company Clio has raised $500 million at a $5 billion valuation and completed its $1 billion acquisition of vLex, accelerating its push to build the world’s most advanced AI-powered legal intelligence platform.
Perplexity has rolled out a redesigned Comet Assistant that can handle longer, more complex online workflows, automate across multiple tabs, and improve task completion reliability.
Google is enhancing Google Finance with AI-powered Deep Search, prediction markets data, and new earnings features, while expanding the upgraded platform to India for the first time.
British-Polish startup ElevenLabs found one of its top AI researchers working in a call center – a result of its decision to abandon traditional hiring platforms like LinkedIn.