Latency measures the delay between an AI request and the resulting response. Interactive generative systems often track time to first token, which reflects how quickly output begins, and time to last token, which captures total completion time. Latency comes from model computation, queueing, network transfer, retrieval, tool calls, safety checks, and application logic. It varies with prompt length, output length, model size, hardware, batching, cache use, and current load. Optimizing only average latency can hide poor experiences, so teams also monitor percentile values and separate each stage of the request. The right target depends on whether the product is conversational, analytical, offline, or safety-critical.
Anthropic is considering a major funding round amid strong investor demand and rapid revenue growth. The potential raise could value the company at up to $900 billion.
Microsoft says its revised OpenAI partnership strengthens flexibility while maintaining key advantages. The company reported AI revenue surpassing $37 billion amid growing multi-model demand.
SoftBank is preparing a new AI and robotics company to automate data center construction, with plans for a potential $100 billion IPO. The move targets growing demand for AI infrastructure.
OpenAI outlined how ChatGPT detects and responds to potential threats of violence, including escalation to human reviewers and law enforcement. The update follows growing scrutiny of AI safety practices.
Families of victims in a Canadian school shooting have sued OpenAI, alleging it failed to alert authorities about warning signs in ChatGPT conversations. The case raises questions about AI oversight and duty of care.
OpenAI is deepening ties with Amazon while restructuring its long-standing partnership with Microsoft. The shift reflects growing demand for flexible cloud access and AI infrastructure.
AI stocks fell sharply after reports that OpenAI missed growth targets and raised internal financial concerns. The news triggered a ripple effect across cloud and chip companies.
A high-profile trial between Elon Musk and OpenAI leaders has begun, centering on claims the company abandoned its nonprofit mission. The case could reshape governance in leading AI firms.
Anthropic has launched connectors that integrate Claude with major creative software platforms. The move aims to streamline workflows and expand AI-assisted production across design, audio, and 3D tools.
Xiaomi has launched two open-source AI models optimized for agent-based tasks with high efficiency and low cost. The release targets growing demand for scalable enterprise AI.