Latency measures the delay between an AI request and the resulting response. Interactive generative systems often track time to first token, which reflects how quickly output begins, and time to last token, which captures total completion time. Latency comes from model computation, queueing, network transfer, retrieval, tool calls, safety checks, and application logic. It varies with prompt length, output length, model size, hardware, batching, cache use, and current load. Optimizing only average latency can hide poor experiences, so teams also monitor percentile values and separate each stage of the request. The right target depends on whether the product is conversational, analytical, offline, or safety-critical.
Google is integrating Gemini AI into Chrome for U.S. users, bringing features like multi-tab summarization, agentic task automation, and deeper sync with Google apps.
AI search startup Perplexity has reportedly raised $200 million at a $20 billion valuation, just two months after a $100 million round – signaling its rapid rise as a major rival to Google.
IBM has unveiled a detailed development plan for Quantum Starling, the world’s first large-scale fault-tolerant quantum computer, aiming for deployment by 2029 – setting a milestone for practical quantum capability.