A KV cache, or key-value cache, speeds up autoregressive transformer inference by storing attention information calculated for tokens that have already been processed. Without the cache, the model would recompute those keys and values each time it generates another token. Reusing them reduces repeated work and improves response latency, especially for long prompts and outputs. The tradeoff is memory: cache size grows with sequence length, batch size, layer count, and model dimensions. Production systems manage this cost with paging, quantization, eviction, prompt caching, and request scheduling. KV caching changes inference efficiency, not the model’s learned knowledge, and cached data must be protected when prompts contain sensitive information.
Mistral AI released the general availability of Mistral Vibe 2.0, upgrading its terminal-based coding agent as it shifts developer tools from testing to paid enterprise products.
Amazon announced plans to cut roughly 16,000 corporate roles, the second major reduction since October, as it invests heavily in artificial intelligence and organizational efficiency.
Anthropic’s Claude AI now allows users to interact directly with workplace tools like Slack, Figma, and Canva inside the chat interface. The update aims to reduce context switching and make collaboration more visible and interactive.
Open-source AI assistant Clawdbot has rebranded as Moltbot following a trademark request from Anthropic, with no changes to the product’s functionality or mission.
Google’s lower-cost AI Plus subscription, priced at $7.99 in the U.S., is now available in all markets offering Google AI plans, providing access to Gemini 3 Pro, AI filmmaking tools, and more.
A new assessment by Common Sense Media finds xAI’s Grok chatbot exposes minors to sexual, violent, and unsafe content, with weak age verification and ineffective safety controls.
Climate tech startup Rainbow Weather has raised $5.5 million in seed funding to scale its AI-driven platform for hyper-local, real-time weather forecasting and environmental intelligence.
Microsoft has introduced Maia 200, a new AI chip built with TSMC and designed to power GPT-5.2 and Microsoft 365 Copilot, promising faster, more efficient AI performance.
Apple plans to debut a Gemini-based Siri in February, offering more natural conversations, complex tasks, and integration across iOS, iPadOS, and macOS.
Utah launches an AI pilot for prescription renewals, letting algorithms handle routine medication management without physicians, highlighting regulatory and safety challenges.