BLEU, or Bilingual Evaluation Understudy, is an automatic metric originally developed for machine translation. It compares short sequences of words in generated text with one or more reference translations, combines precision across several n-gram lengths, and applies a penalty when output is too short. BLEU is inexpensive and useful for comparing systems on the same dataset, but it does not directly measure factuality, fluency, meaning, or human preference. Valid alternative wording can receive a low score, while awkward text can match many reference phrases. Results depend on tokenization and implementation, so reporting should include the exact evaluation settings and, when possible, human judgment.
Meta quietly released Pocket, an app that lets people build small interactive games from text prompts and share them in a TikTok-style feed, built on its Gizmo acquisition.
Big Tech’s AI capital spending is projected to reach about 3.2% of US GDP by 2027, overtaking national defense spending as a share of the economy for the first time.
Anthropic published the cybersecurity rules behind its redeployed Claude Fable 5 model and proposed an industry framework for scoring how dangerous an AI jailbreak is.
Alibaba will bar employees from using Anthropic’s Claude Code from July 10 over alleged security risks, after developers found code that detects China-linked users.
Mark Zuckerberg told employees that Meta’s AI agents have progressed slower than expected and its restructuring was “not as clean” as planned, a rare admission amid huge AI spending.
OpenAI teased its first branded hardware, Codex Micro, a programmable macro pad built with Work Louder to give developers physical shortcuts for its Codex coding agent, launching July 15.
Microsoft is investing $2.5 billion in Frontier, a new unit that will embed 6,000 engineers with customers to help them adopt AI, joining a wider industry race into hands-on deployment.
Cloudflare opened a waitlist for its Monetization Gateway, which lets sites charge AI agents in stablecoins for any page, dataset, API or tool, with no accounts or API keys.
OpenAI has proposed handing the US government a roughly 5% stake, worth about $43 billion, to seed a public wealth fund and ease mounting political pressure in Washington.
Gamma’s connector lets users generate polished presentations, documents and webpages from inside a ChatGPT or Claude conversation, without copying content into a separate design tool.