BLEU, or Bilingual Evaluation Understudy, is an automatic metric originally developed for machine translation. It compares short sequences of words in generated text with one or more reference translations, combines precision across several n-gram lengths, and applies a penalty when output is too short. BLEU is inexpensive and useful for comparing systems on the same dataset, but it does not directly measure factuality, fluency, meaning, or human preference. Valid alternative wording can receive a low score, while awkward text can match many reference phrases. Results depend on tokenization and implementation, so reporting should include the exact evaluation settings and, when possible, human judgment.
More than 50 researchers and engineers have reportedly left Elon Musk’s SpaceXAI since February following the merger of SpaceX and xAI.
OpenAI has added Codex support to the ChatGPT mobile app, allowing users to manage coding agents and long-running development tasks from iOS and Android devices.
OpenAI has renewed calls for an international AI oversight body modeled after the IAEA ahead of the Trump-Xi summit in Beijing. The proposal would place the U.S. at the center of global AI governance while including China in cross-border safety coordination.
Security researchers used Anthropic’s Claude Mythos Preview to help identify vulnerabilities and develop a macOS privilege escalation exploit targeting Apple’s M5 silicon.
Mistral AI is developing a cybersecurity-focused AI model for European banks as institutions seek alternatives to restricted U.S. systems like Anthropic’s Mythos.
Notion has introduced a developer platform that expands its AI agent capabilities with workflow orchestration, external integrations, and custom code execution.
Anthropic has introduced Agent View for Claude Code, allowing developers to manage multiple AI coding agents from a single interface. The update also adds a continuous execution mode that lets Claude work uninterrupted until a task is completed.
The U.S. approved several Chinese companies to buy Nvidia’s H200 AI chips, but deliveries remain stalled amid political pressure and security concerns in both Washington and Beijing.
Microsoft is exploring acquisitions of AI startups including Inception as it builds internal AI capabilities beyond OpenAI. The move reflects growing competition for top AI talent and Microsoft’s effort to develop advanced models independently.
Anthropic has launched Claude for Small Business, a package of AI workflows and software connectors designed to automate finance, operations, marketing, and customer service tasks for small businesses. The platform integrates directly with tools including QuickBooks, PayPal, HubSpot, Canva, and Microsoft 365.