Latency measures the delay between an AI request and the resulting response. Interactive generative systems often track time to first token, which reflects how quickly output begins, and time to last token, which captures total completion time. Latency comes from model computation, queueing, network transfer, retrieval, tool calls, safety checks, and application logic. It varies with prompt length, output length, model size, hardware, batching, cache use, and current load. Optimizing only average latency can hide poor experiences, so teams also monitor percentile values and separate each stage of the request. The right target depends on whether the product is conversational, analytical, offline, or safety-critical.
Microsoft has introduced multi-model capabilities in Copilot, allowing GPT and Claude to collaborate on responses to improve accuracy and reliability.
OpenAI has launched plugin support for Codex, enabling integrations with tools like Slack, Notion, and Gmail as it builds an ecosystem for AI-driven workflows.
DDR5 memory prices are showing early signs of decline after Google’s TurboQuant algorithm reduced AI memory requirements, easing pressure on global DRAM supply.
A data leak at Anthropic exposed details of its upcoming Claude Mythos model, described as a major leap in AI capabilities, along with internal documents.
SoftBank has secured a $40 billion bridge loan to deepen its investment in OpenAI and accelerate its broader AI strategy.
Google has expanded Search Live globally, enabling users to interact with AI using voice and camera through its Gemini-powered search experience.
A U.S. federal judge has blocked the Pentagon’s attempt to ban Anthropic’s AI tools, allowing continued use of its systems during an ongoing legal dispute.
Anthropic is exploring an IPO as early as October, as both it and OpenAI accelerate enterprise strategies and infrastructure investments ahead of potential public listings.
ByteDance is rolling out its Seedance 2.0 AI video model in CapCut, enabling prompt-based video creation as competition in generative video intensifies.
AI-driven bots now generate more internet traffic than humans, according to a new report, highlighting the growing impact of automated systems online.