BLEU, or Bilingual Evaluation Understudy, is an automatic metric originally developed for machine translation. It compares short sequences of words in generated text with one or more reference translations, combines precision across several n-gram lengths, and applies a penalty when output is too short. BLEU is inexpensive and useful for comparing systems on the same dataset, but it does not directly measure factuality, fluency, meaning, or human preference. Valid alternative wording can receive a low score, while awkward text can match many reference phrases. Results depend on tokenization and implementation, so reporting should include the exact evaluation settings and, when possible, human judgment.
ByteDance is rolling out its Seedance 2.0 AI video model in CapCut, enabling prompt-based video creation as competition in generative video intensifies.
AI-driven bots now generate more internet traffic than humans, according to a new report, highlighting the growing impact of automated systems online.
Mistral has released Voxtral TTS, an open-source speech model designed for real-time voice agents and enterprise use cases, intensifying competition in voice AI.
Google has introduced TurboQuant, a new compression algorithm that reduces memory usage in AI systems while maintaining accuracy, improving performance in large models and search.
President Donald Trump has appointed top tech executives, including leaders from Meta, Nvidia, and Oracle, to a council shaping U.S. AI policy and strategy.
OpenAI will discontinue its Sora video app, ending a major partnership with Disney and signaling a retreat from generative video amid legal and cost pressures.
OpenAI will discontinue its Sora video-generation app, signaling a strategic shift toward core AI products amid rising competition and high compute costs.
New research shows that telling AI models they are “experts” can reduce accuracy in tasks like coding and math, while improving safety and alignment outcomes.
OpenAI has overhauled ChatGPT’s shopping features, focusing on product discovery after scaling back its Instant Checkout initiative. The update introduces visual browsing and merchant integrations.
Anthropic has upgraded Claude with the ability to control a user’s computer and complete tasks autonomously. The move intensifies competition in the fast-growing AI agent market.