Latency measures the delay between an AI request and the resulting response. Interactive generative systems often track time to first token, which reflects how quickly output begins, and time to last token, which captures total completion time. Latency comes from model computation, queueing, network transfer, retrieval, tool calls, safety checks, and application logic. It varies with prompt length, output length, model size, hardware, batching, cache use, and current load. Optimizing only average latency can hide poor experiences, so teams also monitor percentile values and separate each stage of the request. The right target depends on whether the product is conversational, analytical, offline, or safety-critical.
Zendesk has introduced an autonomous support agent it claims can resolve up to 80% of support issues without human intervention, supported by a suite of copilot, voice, admin, and analytics agents.
Cisco has introduced its P200 networking chip and matching router, designed to connect AI data centers over long distances with greater power efficiency and data synchronization.
Elon Musk’s AI startup xAI is reportedly raising up to $20 billion, with Nvidia committing as much as $2 billion in equity. A significant portion of the funding is tied directly to acquisition of Nvidia GPUs.
IBM has partnered with Anthropic to integrate Claude into its enterprise software suite, launching a new AI-first IDE designed to automate development with built-in governance and security.
OpenAI’s computing agreements have now surpassed $1 trillion, spanning deals with AMD, Nvidia, Oracle, and more – a milestone that underscores the capital intensity driving AI infrastructure expansion.
AstraZeneca has signed a $555 million milestone-based partnership with Algen Biotechnologies to deploy AI and CRISPR gene-editing together for immunology drug discovery.
OpenAI is unveiling a new capability – Apps in ChatGPT – which allows developers to integrate apps natively inside ChatGPT. A preview of the Apps SDK is now open, enabling users to perform tasks like booking, design, and music all within a chat.
OpenAI has entered into a strategic agreement with AMD to supply high-performance AI chips, diversify its hardware sources, and build next-gen compute capacity.
Nvidia and Fujitsu have entered into a strategic collaboration to co-develop AI robotics and foundational AI infrastructure in Japan, aiming for deployment by 2030 and a ‘human-centric’ model of innovation.
Microsoft has committed $33 billion to neocloud partnerships, including a $19.4B deal with Nebius, to secure GPU capacity and avoid looming AI infrastructure bottlenecks.