Inference is the stage when a trained AI model uses new input to produce a prediction, classification, recommendation, or generated response. Training may take days across specialized hardware, while inference happens whenever a user submits a prompt, a camera captures an image, or an application requests a score. Production systems optimize inference for latency, throughput, memory use, energy consumption, and cost without degrading output quality. The model may run in a cloud service, data center, phone, vehicle, or edge device. Monitoring remains necessary because real-world inputs change, hardware can fail, and a model that performed well during evaluation may behave differently under live traffic.
Meta plans to begin manufacturing its in-house Iris AI chip in September as it aims to double computing capacity to 14 gigawatts next year and cut its reliance on Nvidia.
Apple expanded its partnership with Broadcom in a multi-year deal worth more than $30 billion, its largest US manufacturing commitment, to produce over 15 billion American-made chips.
Nvidia’s Kyber rack for its 2027 Rubin Ultra chips has slipped more than a year to 2028 over a hard-to-manufacture circuit board, SemiAnalysis says, with no proven fallback.
OpenAI teased its first branded hardware, Codex Micro, a programmable macro pad built with Work Louder to give developers physical shortcuts for its Codex coding agent, launching July 15.
A record European heatwave is highlighting a growing threat to the AI boom: extreme weather that stresses data centers and the power grids they depend on at once.
SK Hynix filed to raise about $29 billion through a Nasdaq ADR listing set for July 10, roughly double earlier estimates, to fund its AI memory expansion.
Qualcomm agreed to acquire Modular, the AI software startup led by Chris Lattner, to build a hardware-agnostic software layer and challenge Nvidia in data center AI.
Anthropic has disabled Claude Fable 5 and Claude Mythos 5 globally after a U.S. government export-control directive restricted access to the models for foreign nationals, prompting the company to challenge the decision publicly.
OneSoil has partnered with Rainbow Weather to bring hyperlocal AI-powered rainfall forecasting to farmers worldwide, helping improve field operations and reduce weather-related losses.
Nvidia has unveiled its first Arm-based PC processor, the RTX Spark superchip, which will power a new generation of Windows laptops and desktops.