Latency measures the delay between an AI request and the resulting response. Interactive generative systems often track time to first token, which reflects how quickly output begins, and time to last token, which captures total completion time. Latency comes from model computation, queueing, network transfer, retrieval, tool calls, safety checks, and application logic. It varies with prompt length, output length, model size, hardware, batching, cache use, and current load. Optimizing only average latency can hide poor experiences, so teams also monitor percentile values and separate each stage of the request. The right target depends on whether the product is conversational, analytical, offline, or safety-critical.
A U.S. appeals court has denied Anthropic’s request to pause a Pentagon blacklist, allowing restrictions on its AI use in defense contracts to remain during litigation.
Meta has unveiled Muse Spark, a multimodal AI model with advanced reasoning and multi-agent capabilities, marking a step toward its vision of personal superintelligence.
OpenAI has introduced a policy blueprint aimed at strengthening U.S. child safety protections in the age of AI. The framework focuses on laws, reporting standards, and built-in safeguards.
New research shows AI is speeding up how quickly early-career employees become productive, while raising expectations and reshaping traditional entry-level roles.
Alphabet is ramping up large-scale AI investments as its early bet on SpaceX approaches a potential $100 billion return. CEO Sundar Pichai says the AI boom is creating new opportunities.
Alibaba and China Telecom are building a major AI data center powered by Alibaba’s own chips, marking a push toward domestic infrastructure amid U.S. restrictions.
Anthropic has launched Project Glasswing with major tech partners to use advanced AI for identifying and fixing software vulnerabilities. The move comes as AI models reach unprecedented offensive cyber capabilities.
Google is adding new mental health features to Gemini, including crisis detection tools and direct hotline access. The company is also committing $30 million to expand global support services.
Intel has joined Elon Musk’s Terafab project aimed at scaling AI chip production, though its exact role remains unclear. The effort targets massive compute output for AI and robotics.
Broadcom is expanding its role in AI infrastructure through new chip and compute deals with Google and Anthropic. The move reflects accelerating demand for large-scale AI capacity.