Latency measures the delay between an AI request and the resulting response. Interactive generative systems often track time to first token, which reflects how quickly output begins, and time to last token, which captures total completion time. Latency comes from model computation, queueing, network transfer, retrieval, tool calls, safety checks, and application logic. It varies with prompt length, output length, model size, hardware, batching, cache use, and current load. Optimizing only average latency can hide poor experiences, so teams also monitor percentile values and separate each stage of the request. The right target depends on whether the product is conversational, analytical, offline, or safety-critical.
Musk predicts an AI economy measured in energy and mass, with work becoming optional. His vision also raises doubts about human control.
ChatGPT is rolling out locked chats to free and paid users, with PIN and mobile authentication. Memory separation comes with important limits.
Meta’s Muse is gaining downloads and daily users, while ChatGPT’s US installs decline. The figures sharpen the AI race without proving users are switching.
Spotify says it has excluded more than 50 million slop and spam tracks from recommendations in 2026, using listener signals and AI detection tools.
Tolan has raised $30 million for its everyday AI companion. The startup says 70% of users are women as it balances wider access with computing costs.
Anthropic is discussing another $45 billion Nscale agreement for West Virginia computing capacity, adding to an existing commitment as Claude demand grows.
Mass General Brigham’s FAHR-Face analyzes facial photographs to estimate aging and cancer survival risk, but clinical benefit still needs testing.
DeepSeek has released DeepInfer, its production inference engine, with support for V4.1 Flash on Nvidia SM100 and Huawei Ascend 950 hardware. The public release covers offline inference.
Inception says Mercury 3 delivers 1,068 tokens per second with a million-token context window, bringing diffusion-based AI to fast agents, tutoring and customer support.
MiniMax has released M3.1 Flash for AI agents, coding and computer use, with API pricing from $0.15 per million input tokens and claimed speeds above 200 tokens per second.