BLEU, or Bilingual Evaluation Understudy, is an automatic metric originally developed for machine translation. It compares short sequences of words in generated text with one or more reference translations, combines precision across several n-gram lengths, and applies a penalty when output is too short. BLEU is inexpensive and useful for comparing systems on the same dataset, but it does not directly measure factuality, fluency, meaning, or human preference. Valid alternative wording can receive a low score, while awkward text can match many reference phrases. Results depend on tokenization and implementation, so reporting should include the exact evaluation settings and, when possible, human judgment.
OpenAI’s next version of its Sora video generator will default to including copyrighted content unless owners explicitly opt out – drawing criticism from media creators.
OpenAI introduces ChatGPT Pulse, a proactive feature delivering daily updates and suggestions directly in the app, positioning it as a potential challenger to social media feeds.
OpenAI and Databricks have forged a multiyear $100 million partnership to embed powerful AI agents into enterprise data platforms, enabling organizations to build agents using their own data.
Google is integrating Gemini AI into Chrome for U.S. users, bringing features like multi-tab summarization, agentic task automation, and deeper sync with Google apps.
AI search startup Perplexity has reportedly raised $200 million at a $20 billion valuation, just two months after a $100 million round – signaling its rapid rise as a major rival to Google.
IBM has unveiled a detailed development plan for Quantum Starling, the world’s first large-scale fault-tolerant quantum computer, aiming for deployment by 2029 – setting a milestone for practical quantum capability.