Latency measures the delay between an AI request and the resulting response. Interactive generative systems often track time to first token, which reflects how quickly output begins, and time to last token, which captures total completion time. Latency comes from model computation, queueing, network transfer, retrieval, tool calls, safety checks, and application logic. It varies with prompt length, output length, model size, hardware, batching, cache use, and current load. Optimizing only average latency can hide poor experiences, so teams also monitor percentile values and separate each stage of the request. The right target depends on whether the product is conversational, analytical, offline, or safety-critical.
GPT-5.6 Sol brings stronger coding and cyber capabilities with OpenAI’s most robust safeguards, but a government-approved rollout echoes the Anthropic model ban.
Anthropic is hiring across Australia and Japan to expand its AI data center capacity in Asia-Pacific, as soaring demand for Claude strains its infrastructure.
OpenAI updated GPT-5.5 Instant, ChatGPT’s default model, to feel more conversational and handle advice, planning and shopping better across longer exchanges.
Anthropic told US senators that Alibaba-linked operators used about 25,000 fake accounts to extract Claude’s capabilities in what it calls its largest known distillation attack.
Cursor unveiled its first from-scratch AI model, an agent-first Git platform called Origin and an iOS app, days after SpaceX’s $60 billion acquisition of its parent.
Web3 gaming unicorn Immutable cut 29 roles and gutted its in-house game studios to focus on Audience, an AI marketing platform for the broader games industry.
SK Hynix filed to raise about $29 billion through a Nasdaq ADR listing set for July 10, roughly double earlier estimates, to fund its AI memory expansion.
Anthropic launched Claude Tag, a Slack agent teams summon with @Claude to delegate tasks, with shared channel memory and the ability to act on its own.
Qualcomm agreed to acquire Modular, the AI software startup led by Chris Lattner, to build a hardware-agnostic software layer and challenge Nvidia in data center AI.
ByteDance’s record offshore loan would nearly double its 2024 facility and help fund capital spending that could reach $70 billion this year on AI data centers.