BLEU, or Bilingual Evaluation Understudy, is an automatic metric originally developed for machine translation. It compares short sequences of words in generated text with one or more reference translations, combines precision across several n-gram lengths, and applies a penalty when output is too short. BLEU is inexpensive and useful for comparing systems on the same dataset, but it does not directly measure factuality, fluency, meaning, or human preference. Valid alternative wording can receive a low score, while awkward text can match many reference phrases. Results depend on tokenization and implementation, so reporting should include the exact evaluation settings and, when possible, human judgment.
OpenAI buys Neptune for under $400 million in stock, gaining advanced AI model tracking tools and strengthening capabilities in large-scale AI development.
The European Commission investigates Meta over AI restrictions in WhatsApp, raising concerns about competition and access for third-party AI providers.
OpenAI introduces an experimental “confessions” system that rewards honest self-reporting of mistakes in GPT-5 Thinking models, aiming to improve AI safety and visibility of failures.
AWS introduced new tools for enterprise customers to build and fine-tune custom large language models, alongside AI infrastructure offerings for on-premises deployments.
Google is testing a new Search feature that lets users move from AI Overviews into conversational AI Mode on the same results page. The rollout comes as OpenAI declares a “code red” and refocuses on ChatGPT.
AWS AI Factories bring dedicated AI infrastructure directly into customer data centers, enabling enterprises and governments to rapidly develop and deploy AI applications while meeting data sovereignty and regulatory requirements.
penAI has put advertising plans for ChatGPT on hold after declaring a “code red,” shifting its focus toward improving the AI assistant’s performance, stability, and security amid intensifying competition in the AI market.
DeepSeek has launched two new open-source AI models — V3.2 and V3.2-Speciale — that the company says match or exceed leading U.S. systems in advanced reasoning and tool-use tasks.
Amazon’s AI shopping assistant Rufus saw a sharp spike in Black Friday usage, fueling significantly higher purchase-conversion rates compared with non-AI sessions, according to new data from Sensor Tower and Adobe Analytics.
Baidu is scaling up its in-house AI-chip business via its Kunlunxin unit, unveiling a five-year roadmap with M100 and M300 chips and aiming to fill the gap left by restricted Nvidia GPU access in China.