Latency measures the delay between an AI request and the resulting response. Interactive generative systems often track time to first token, which reflects how quickly output begins, and time to last token, which captures total completion time. Latency comes from model computation, queueing, network transfer, retrieval, tool calls, safety checks, and application logic. It varies with prompt length, output length, model size, hardware, batching, cache use, and current load. Optimizing only average latency can hide poor experiences, so teams also monitor percentile values and separate each stage of the request. The right target depends on whether the product is conversational, analytical, offline, or safety-critical.
Salesforce agreed to buy Fin, the customer-service AI company formerly known as Intercom, for about $3.6 billion to strengthen its Agentforce platform.
Kazakhstan’s Data Center Valley would deploy 100,000 Nvidia GPUs near cheap power by 2027, though analysts flag execution risk after a history of stalled deals
Z.ai released GLM-5.2, a flagship coding model with a usable 1-million-token context, shipping it to paying subscribers first while withholding benchmarks, an API and open weights.
Tech firms have cut close to 150,000 jobs in 2026 while citing AI, even as AI-driven IPOs mint vast new fortunes, sharpening questions about who benefits.
Google AI Overviews liability sets a precedent as a German court rejects the click-to-verify defense, a ruling that could reach ChatGPT, Claude and Perplexity.
Anthropic’s Fable 5 and Mythos 5 shutdown, the first US export control on an LLM, has Carney and EU lawmakers pushing to reduce reliance on American AI.
Anthropic has disabled Claude Fable 5 and Claude Mythos 5 globally after a U.S. government export-control directive restricted access to the models for foreign nationals, prompting the company to challenge the decision publicly.
Mistral’s reported €3 billion round would fund a 1-gigawatt European compute buildout, yet leaves the OpenAI rival far smaller than US and Chinese rivals.
SK Hynix, Nvidia’s largest memory partner and the HBM market leader, awaits SEC clearance for an ADR listing as its stock trades at a persistent Korea discount
Anthropic committed $150 million to Claude Corps, a fellowship paying 1,000 early-career workers to spend a year embedding AI in US nonprofits.