Causal language modeling, abbreviated CLM, is a training objective in which a model predicts the next token from tokens that came before it. A causal attention mask prevents information from later positions from leaking into each prediction. Repeating this task across large text collections teaches an autoregressive model statistical patterns of language, knowledge associations, and ways to continue a sequence. At inference time, the model generates text token by token using the same left-to-right dependency. CLM differs from masked language modeling, which hides selected tokens inside a sequence and uses surrounding context on both sides. The objective supports open-ended generation but does not guarantee factual or intentional understanding.
Anthropic’s new ad “There’s hope in hard questions” drew mockery, including from Sam Altman, for pairing bleak imagery like a cemetery with questions about whether AI can be trusted.
SoftBank plans to sell about ¥60 billion of notes in Japan this month, its latest raise to fund a mounting AI bet that includes nearly $65 billion committed to OpenAI.
Chinese startup Moonshot released Kimi K3, a 2.8-trillion-parameter open-weight model it says rivals Anthropic’s Claude, as the US-China AI gap narrows.
Anthropic is scheduling investor meetings ahead of a potential IPO as soon as October, a move that could take the Claude maker public before rival OpenAI.
OpenAI launched Codex Micro, a $230 mechanical keypad built with Work Louder that gives developers physical controls for its Codex coding agent, its first hardware to reach market.
NVIDIA unveiled Cosmos 3 Edge and said Japan’s robotics and manufacturing leaders, from FANUC to Sony, intend to join its Cosmos Coalition to build AI for the physical world.
Microsoft is coaching its sales force to argue its AI products beat OpenAI’s and Anthropic’s on cost, security and completeness, turning on the partners whose models it long relied on.
A Reuters analysis found xAI installed 59 unpermitted gas turbines to power its Colossus 2 data center, releasing pollution near predominantly Black Memphis-area communities.
OpenAI’s first hardware, reportedly designed with Jony Ive, is a portable, screenless smart speaker built as a proactive AI companion that learns its owner and moves on its own.
Twenty-six Meta workers sued the company, alleging its AI systems used metrics like token consumption to select layoff targets, disadvantaging people on medical or family leave.