Latency measures the delay between an AI request and the resulting response. Interactive generative systems often track time to first token, which reflects how quickly output begins, and time to last token, which captures total completion time. Latency comes from model computation, queueing, network transfer, retrieval, tool calls, safety checks, and application logic. It varies with prompt length, output length, model size, hardware, batching, cache use, and current load. Optimizing only average latency can hide poor experiences, so teams also monitor percentile values and separate each stage of the request. The right target depends on whether the product is conversational, analytical, offline, or safety-critical.
Target is deepening its partnership with OpenAI through a new ChatGPT shopping app and broader enterprise use of frontier models to streamline operations and improve guest experiences.
Google has released Gemini 3, its most powerful AI model yet, offering advanced multimodal reasoning, coding capabilities, and agentic planning tools across multiple platforms.
Stack Overflow unveiled new enterprise AI products at Microsoft Ignite, designed to convert internal expertise into AI-ready formats and streamline knowledge access for organizations.
Anthropic is committing $30 billion in Azure compute as part of a major new partnership with Microsoft and Nvidia, expanding Claude and deepening collaboration on AI infrastructure.
xAI has launched Grok 4.1, a major model upgrade designed to deliver more creative, emotionally aware, and coherent interactions, with new Thinking and Non-Thinking variants now live across all xAI platforms.
OpenAI is exploring how ads might fit into ChatGPT, but CEO of Applications Fidji Simo says any ad model must be radically different from traditional approaches.
Jeff Bezos joins Project Prometheus as co-CEO, helping lead the AI startup with $6.2 billion in funding to improve manufacturing across tech, automotive, and aerospace sectors.
OpenAI introduces group chat for ChatGPT, letting users collaborate in shared conversations with GPT‑5.1 Auto handling responses, image generation, and more.
Alibaba.com unveiled AI Mode at CoCreate Europe, integrating agentic AI into its platform to help businesses discover suppliers, optimize sourcing, and automate trade processes.
Google is introducing new AI-powered shopping experiences, including conversational search, agentic checkout, and Duplex-based store calls, designed to make online shopping faster, easier, and more natural ahead of the holiday season.