A KV cache, or key-value cache, speeds up autoregressive transformer inference by storing attention information calculated for tokens that have already been processed. Without the cache, the model would recompute those keys and values each time it generates another token. Reusing them reduces repeated work and improves response latency, especially for long prompts and outputs. The tradeoff is memory: cache size grows with sequence length, batch size, layer count, and model dimensions. Production systems manage this cost with paging, quantization, eviction, prompt caching, and request scheduling. KV caching changes inference efficiency, not the model’s learned knowledge, and cached data must be protected when prompts contain sensitive information.
Gemini 3.5 Flash computer use folds screen control into one cheap model with prompt-injection safeguards, though it is a preview and the benchmark is self-reported.
GPT-5.6 Sol brings stronger coding and cyber capabilities with OpenAI’s most robust safeguards, but a government-approved rollout echoes the Anthropic model ban.
Anthropic is hiring across Australia and Japan to expand its AI data center capacity in Asia-Pacific, as soaring demand for Claude strains its infrastructure.
OpenAI updated GPT-5.5 Instant, ChatGPT’s default model, to feel more conversational and handle advice, planning and shopping better across longer exchanges.
Anthropic told US senators that Alibaba-linked operators used about 25,000 fake accounts to extract Claude’s capabilities in what it calls its largest known distillation attack.
Cursor unveiled its first from-scratch AI model, an agent-first Git platform called Origin and an iOS app, days after SpaceX’s $60 billion acquisition of its parent.
Web3 gaming unicorn Immutable cut 29 roles and gutted its in-house game studios to focus on Audience, an AI marketing platform for the broader games industry.
SK Hynix filed to raise about $29 billion through a Nasdaq ADR listing set for July 10, roughly double earlier estimates, to fund its AI memory expansion.
Anthropic launched Claude Tag, a Slack agent teams summon with @Claude to delegate tasks, with shared channel memory and the ability to act on its own.
Qualcomm agreed to acquire Modular, the AI software startup led by Chris Lattner, to build a hardware-agnostic software layer and challenge Nvidia in data center AI.