Latency measures the delay between an AI request and the resulting response. Interactive generative systems often track time to first token, which reflects how quickly output begins, and time to last token, which captures total completion time. Latency comes from model computation, queueing, network transfer, retrieval, tool calls, safety checks, and application logic. It varies with prompt length, output length, model size, hardware, batching, cache use, and current load. Optimizing only average latency can hide poor experiences, so teams also monitor percentile values and separate each stage of the request. The right target depends on whether the product is conversational, analytical, offline, or safety-critical.
AI coding startup Cursor is reportedly raising $2 billion at a $50 billion valuation. The move highlights strong investor demand for AI developer tools.
OpenAI’s ChatGPT and related services experienced a widespread outage, leaving thousands unable to access the platform. The company is investigating the issue.
Adobe has launched CX Enterprise, a new AI platform integrating agents across major tech ecosystems. The move aims to streamline customer experience workflows at scale.
Salesforce has launched Headless 360, exposing its entire platform to AI agents via APIs and tools. The move redefines how enterprise software is accessed and used.
New app releases are surging across the App Store and Google Play, driven by AI tools lowering barriers to development. The trend challenges predictions that AI would replace apps.
Three OpenAI executives have announced their departures, adding to a wave of leadership changes. The exits come as the company restructures teams and prepares for future growth.
Anthropic has introduced Claude Design, a new tool for creating designs, prototypes, and presentations using AI. The product targets both designers and non-designers.
Nvidia has introduced Lyra 2.0, an AI model that generates explorable 3D worlds in real time. It addresses key issues like motion drift and inconsistent object rendering.
Anthropic CEO Dario Amodei is expected to meet White House officials as tensions ease over its Mythos AI model. The talks signal potential renewed government collaboration.
OpenAI has introduced GPT-Rosalind, a specialized AI model for life sciences research. The system aims to accelerate drug discovery and biological analysis workflows.