BLEU, or Bilingual Evaluation Understudy, is an automatic metric originally developed for machine translation. It compares short sequences of words in generated text with one or more reference translations, combines precision across several n-gram lengths, and applies a penalty when output is too short. BLEU is inexpensive and useful for comparing systems on the same dataset, but it does not directly measure factuality, fluency, meaning, or human preference. Valid alternative wording can receive a low score, while awkward text can match many reference phrases. Results depend on tokenization and implementation, so reporting should include the exact evaluation settings and, when possible, human judgment.
Google Cloud launched Gemini Enterprise for Legal, a specialized AI platform with agents for drafting and contract work, joining Anthropic and OpenAI in courting law firms.
Porsche signed a five-year, €1.25 billion AI partnership with Tata Consultancy Services, which is separately buying Porsche’s IT consulting arm MHP for €320 million.
OpenAI banned ChatGPT accounts it says originated in Russia and built a fake “expert institute” using plagiarized academic work to manufacture false credibility online.
Apple launched new Mac Mini and Mac Studio models with its M6 and M5 Ultra chips, explicitly built for developers running AI models and agents locally instead of in the cloud.
Nvidia is in talks to invest in Perplexity at a valuation above $30 billion, a 50% jump from a year ago, as the AI search startup’s revenue triples on its new agent product.
Alibaba launched Wan3.0, an AI video model that turns business documents into 30-second clips, a day after raising $10.2 billion in Hong Kong’s largest-ever follow-on share sale.
Hugging Face is reportedly exploring a sale valuing it at $13 billion or more, nearly triple its 2023 valuation, though no deal has been reached and no buyer identified.
Michael Polansky’s biotech startup Outer Biosciences keeps donated human skin alive for weeks and uses it to train an AI that predicts promising new skincare ingredients.
OpenAI launched AI Futures, a blog from a new Strategic Futures team arguing that AI’s gravest risk is letting power escape the checks that have long depended on human cooperation.
ChatGPT began scoping far more searches to specific websites on August 8, a change that coincided with Reddit’s citation share collapsing from 3.8% to 0.5%.