A KV cache, or key-value cache, speeds up autoregressive transformer inference by storing attention information calculated for tokens that have already been processed. Without the cache, the model would recompute those keys and values each time it generates another token. Reusing them reduces repeated work and improves response latency, especially for long prompts and outputs. The tradeoff is memory: cache size grows with sequence length, batch size, layer count, and model dimensions. Production systems manage this cost with paging, quantization, eviction, prompt caching, and request scheduling. KV caching changes inference efficiency, not the model’s learned knowledge, and cached data must be protected when prompts contain sensitive information.
Anthropic launched Reflect, a beta dashboard that shows users how they use Claude and nudges them toward healthier habits, a rare feature that can encourage using the product less.
OpenAI launched ChatGPT Work, a GPT-5.6 agent that pulls context from a user’s apps to produce finished docs, slides and sites, as it merges Codex into a unified desktop app.
SpaceXAI released Grok 4.5, a coding and agentic model trained jointly with Cursor that undercuts rivals on price and token use, though it trails Fable 5 on benchmarks.
Meta plans to begin manufacturing its in-house Iris AI chip in September as it aims to double computing capacity to 14 gigawatts next year and cut its reliance on Nvidia.
OpenAI released GPT-Live, full-duplex voice models that listen and speak at once and hand hard questions to GPT-5.5, replacing ChatGPT’s Advanced Voice Mode globally.
Meta will build its first Canadian data center, a 1-gigawatt AI facility in Alberta costing about C$13 billion, powered largely by a dedicated natural gas plant.
OpenAI will release its GPT-5.6 models, Sol, Terra and Luna, to the public on July 9 after clearing US government review far faster than the 30-day window the rules envisioned.
Apple expanded its partnership with Broadcom in a multi-year deal worth more than $30 billion, its largest US manufacturing commitment, to produce over 15 billion American-made chips.
Meta released Muse Image, a free AI image generator, but a feature that lets users turn any public Instagram user’s photos into AI images, opt-out by default, has sparked backlash.
Elon Musk’s xAI has rebranded to SpaceXAI, folding its Grok chatbot and X into SpaceX and signaling that AI, not rockets, is now central to the space company’s strategy.