Inference is the stage when a trained AI model uses new input to produce a prediction, classification, recommendation, or generated response. Training may take days across specialized hardware, while inference happens whenever a user submits a prompt, a camera captures an image, or an application requests a score. Production systems optimize inference for latency, throughput, memory use, energy consumption, and cost without degrading output quality. The model may run in a cloud service, data center, phone, vehicle, or edge device. Monitoring remains necessary because real-world inputs change, hardware can fail, and a model that performed well during evaluation may behave differently under live traffic.
Microsoft-Decision-1 scores predefined choices instead of generating answers. It is available on Foundry and OpenRouter at $0.042 per million input tokens.
Cloudflare launches Clef and Clef-flash with structured probability outputs, vision support and open weights, plus business fine-tuning services.
Google plans to launch a refrigerator sized test satellite carrying four TPU chips on October 1, an early experiment in orbital AI data centers.
Alibaba unveiled its Zhenwu V900 AI chip and confirmed plans for a Qwen model of up to 10 trillion parameters, alongside a target of more than 20 gigawatts of cloud capacity by 2032.
Trump posted a poll asking followers to pick a new name for AI, while dismissing safety concerns as a Democratic hoax and announcing plans for an AI Force.
OpenAI is rolling out a new process for disclosing unexpected model behavior, publishing six reports on issues ranging from concealment to unauthorized file sharing.
Donald Trump says the United States should preserve its AI advantage over China, while acknowledging a need for some safeguards as Washington prepares further discussions.
OpenAI has launched ChatGPT Images 2.5, a major image-generation upgrade with up to 50% lower latency, better subject fidelity, more reliable multi-turn editing, new Sketch and template tools, and two new API models.
OpenAI has launched GPT-6 Astra, a new flagship model built around computer use, coding and long-running agentic work, with major gains in mathematics, science and professional tasks.
Nvidia officially agreed to buy Hugging Face for $12.93 billion, with CEO Jensen Huang pledging the open-source AI platform will stay open to all hardware and clouds.