Latency measures the delay between an AI request and the resulting response. Interactive generative systems often track time to first token, which reflects how quickly output begins, and time to last token, which captures total completion time. Latency comes from model computation, queueing, network transfer, retrieval, tool calls, safety checks, and application logic. It varies with prompt length, output length, model size, hardware, batching, cache use, and current load. Optimizing only average latency can hide poor experiences, so teams also monitor percentile values and separate each stage of the request. The right target depends on whether the product is conversational, analytical, offline, or safety-critical.
Meta’s 816B-parameter Muse Spark Open targets local coding agents on two 512GB Macs, due later this month. API access is already available.
Amazon unveils the $74.99 Bee Frontier and $99.99 Bee Eclipse, pairing conversation memory with optional Alexa and shopping links. Many features need Bee Pro.
Apple and Meta bring Muse Spark Open to Mac Studio clusters, opening a new front in the AI race. Here is what the partnership means for speed, cost and control.
Google reports 99.99% magic-state fidelity on Willow, with errors reduced 40x. The quantum computing advance retained 8% of attempts and still needs to scale.
One user says Claude Code turned a 63-second video request into 161 Codex sessions—and kept the boss job. The screenshot shows a plan for 700 frames.
Tether has invested in AIsa, which combines AI-agent access to data, models and APIs with usage-based payments in fiat or stablecoins.
Google Deep Review offers two free document checks a week, using AI agents to flag errors and weak arguments. Its benchmark results come with important limits.
Jensen Huang urges cooperation with Chinese AI researchers as the industry debates how to manage advanced systems and maintain effective human control.
Harmonic Security raises $50 million for contextual AI data protection, usage insights and Claude compliance integrations, bringing total funding to $76 million.
US attorneys general want users to be able to delete private chats before a Character.AI sale, with consent limits on AI training and other commercial uses.