A KV cache, or key-value cache, speeds up autoregressive transformer inference by storing attention information calculated for tokens that have already been processed. Without the cache, the model would recompute those keys and values each time it generates another token. Reusing them reduces repeated work and improves response latency, especially for long prompts and outputs. The tradeoff is memory: cache size grows with sequence length, batch size, layer count, and model dimensions. Production systems manage this cost with paging, quantization, eviction, prompt caching, and request scheduling. KV caching changes inference efficiency, not the model’s learned knowledge, and cached data must be protected when prompts contain sensitive information.
Perplexity unveils Perplexity Computer, a general-purpose AI system that orchestrates multiple frontier models to run complex workflows autonomously.
Andrej Karpathy argues AI coding agents now fundamentally change programming workflows, enabling long-running autonomous tasks and redefining software engineering.
Anthropic acquires Vercept to enhance Claude’s computer use capabilities, following major benchmark gains with Claude Sonnet 4.6 and continued expansion of its AI research team.
Irina Bodnar says Anthropic’s Claude and Meta-backed Manus introduced features that disrupted her AI ad startup Ryze AI, triggering a pivot and raising questions about startup survival in the age of AI giants.
MSCI introduces AI connectors enabling access to its data via MSCI ONE, ChatGPT, and Claude, debuting IndexAI Insights to deliver conversational index analytics powered by large language models.
Anthropic unveils a revised Responsible Scaling Policy with a Frontier Safety Roadmap, regular Risk Reports, and clearer separation between company commitments and industry recommendations.
ŌURA unveils a proprietary large language model for women’s health, combining clinical research and biometric data to deliver personalized, privacy-first AI guidance through Oura Advisor.
Meta plans to buy up to $100 billion in AMD GPUs and CPUs, issuing performance-based warrants as it ramps AI data centers and diversifies compute infrastructure.
As OpenAI nears a $100 billion round and Anthropic closes a $30 billion raise, overlapping investors are challenging traditional venture capital norms around exclusivity and loyalty.
Anthropic reveals industrial-scale campaigns by DeepSeek, Moonshot, and MiniMax to extract Claude’s capabilities via fraudulent accounts, highlighting national security and AI safety risks.