Latency measures the delay between an AI request and the resulting response. Interactive generative systems often track time to first token, which reflects how quickly output begins, and time to last token, which captures total completion time. Latency comes from model computation, queueing, network transfer, retrieval, tool calls, safety checks, and application logic. It varies with prompt length, output length, model size, hardware, batching, cache use, and current load. Optimizing only average latency can hide poor experiences, so teams also monitor percentile values and separate each stage of the request. The right target depends on whether the product is conversational, analytical, offline, or safety-critical.
Salesforce has launched Headless 360, exposing its entire platform to AI agents via APIs and tools. The move redefines how enterprise software is accessed and used.
New app releases are surging across the App Store and Google Play, driven by AI tools lowering barriers to development. The trend challenges predictions that AI would replace apps.
Three OpenAI executives have announced their departures, adding to a wave of leadership changes. The exits come as the company restructures teams and prepares for future growth.
Anthropic has introduced Claude Design, a new tool for creating designs, prototypes, and presentations using AI. The product targets both designers and non-designers.
Nvidia has introduced Lyra 2.0, an AI model that generates explorable 3D worlds in real time. It addresses key issues like motion drift and inconsistent object rendering.
Anthropic CEO Dario Amodei is expected to meet White House officials as tensions ease over its Mythos AI model. The talks signal potential renewed government collaboration.
OpenAI has introduced GPT-Rosalind, a specialized AI model for life sciences research. The system aims to accelerate drug discovery and biological analysis workflows.
Researchers at NTU Singapore have developed an AI-powered biochip that detects disease-linked microRNAs in minutes. The system could enable faster, more precise diagnostics.
OpenAI has upgraded Codex with computer control, memory, and workflow integrations. The update pushes Codex beyond coding into a full development lifecycle assistant.
Anthropic is rolling out identity verification for Claude users to strengthen safety and compliance. The move introduces ID checks for certain features and use cases.