BLEU, or Bilingual Evaluation Understudy, is an automatic metric originally developed for machine translation. It compares short sequences of words in generated text with one or more reference translations, combines precision across several n-gram lengths, and applies a penalty when output is too short. BLEU is inexpensive and useful for comparing systems on the same dataset, but it does not directly measure factuality, fluency, meaning, or human preference. Valid alternative wording can receive a low score, while awkward text can match many reference phrases. Results depend on tokenization and implementation, so reporting should include the exact evaluation settings and, when possible, human judgment.
Nvidia has discussed investing in Mercor, a data-labeling startup that supplies expert data for its Nemotron models, in a round that would double the company’s valuation to $20 billion.
Anthropic’s ongoing system-prompt changelog now documents instructions for Claude Fable 5 and Opus 5, revealing how the company steers agentic behavior in its newest models.
Cursor launched Origin, a code-hosting platform built into its editor with GitHub sync, in early beta the same day GitHub suffered a major global outage.
OpenAI paused reinforcement learning on its newest models after it could not rule out that an upcoming model, Astra, reached the top cybersecurity risk tier in its safety framework.
OpenAI launched ChatGPT for Teens, a version with default safety protections, learning tools and parental controls, automatically applied to users it identifies as under 18.
Trump-backed World Liberty Financial is working with WorldClaw, an AI platform offering restricted Chinese models, letting the family profit as its stablecoin is used for payment.
Anthropic’s annualized revenue run rate reached $65 billion at the end of July, a sevenfold jump in seven months, as the Claude maker prepares for a potential fall IPO.
AI video startup Higgsfield raised a $400 million Series B at a $5.4 billion valuation, more than quadrupling its worth in eight months as it pushes into enterprise marketing.
Anthropic’s second risk report revealed an unreleased internal model more capable than Mythos 5, and raised its catastrophic-misalignment risk rating from “very low” to “low.”
The US is preparing to warn dozens of countries they must choose between its Pax Silica AI coalition and China’s competing framework, or risk exclusion, according to a leaked draft.