An attention mask is a control structure used in transformer models to limit which tokens participate in attention calculations. A padding mask prevents artificial padding tokens from affecting a sequence, while a causal mask blocks a token from seeing future positions during autoregressive generation. Other masks can enforce local attention, protect segments, or represent task-specific relationships. The mask is commonly stored as a binary or additive tensor that modifies attention scores before normalization. Incorrect masking can leak future information during training, make padded batches behave inconsistently, or cause generated text to fail. Attention masks shape information flow for a specific input; they do not change the model’s learned parameters.
Anthropic unveils a revised Responsible Scaling Policy with a Frontier Safety Roadmap, regular Risk Reports, and clearer separation between company commitments and industry recommendations.
ŌURA unveils a proprietary large language model for women’s health, combining clinical research and biometric data to deliver personalized, privacy-first AI guidance through Oura Advisor.
Anthropic reveals industrial-scale campaigns by DeepSeek, Moonshot, and MiniMax to extract Claude’s capabilities via fraudulent accounts, highlighting national security and AI safety risks.
Former DeepMind researcher David Silver has raised $1 billion for London-based Ineffable Intelligence, aiming to build a superintelligence that learns autonomously through experience.
Google DeepMind has introduced AlphaGenome, a new AI model designed to analyze long DNA sequences and predict how genetic variations may influence disease development.
OpenAI now uses age prediction to adjust ChatGPT’s safety settings for teens. Users 18 and older can verify their age to disable extra restrictions.
OpenAI has invested in Merge Labs, a brain-computer interface startup founded by CEO Sam Altman, as part of a $250 million seed round valuing the company at $850 million.
Google released a major upgrade to its Gemini Deep Research agent, giving developers access to advanced autonomous research capabilities through the Interactions API. The company also introduced DeepSearchQA, a benchmark for evaluating multi-step web research agents.
Google introduced the Titans architecture and the MIRAS framework to enable AI models to handle massive contexts and update their internal memory while running, improving performance in long-sequence tasks.
OpenAI co-founder Ilya Sutskever says the era of scaling compute and data as the main driver of AI progress is ending, arguing that meaningful advances now depend on true scientific breakthroughs and solving AI’s poor generalization.