Self-attention is a mechanism that builds a representation of each token or input element by comparing it with other elements in the same sequence. The model creates queries, keys, and values, calculates compatibility scores, normalizes them, and combines the value vectors according to those weights. This allows direct modeling of long-range relationships and supports highly parallel training, making self-attention central to transformers. Standard attention cost grows quickly with sequence length, so long-context systems may use sparse, local, compressed, or optimized implementations. Attention weights can offer clues about information flow, but they should not automatically be treated as complete explanations of why a model produced an output.
Anthropic unveils a revised Responsible Scaling Policy with a Frontier Safety Roadmap, regular Risk Reports, and clearer separation between company commitments and industry recommendations.
ŌURA unveils a proprietary large language model for women’s health, combining clinical research and biometric data to deliver personalized, privacy-first AI guidance through Oura Advisor.
Anthropic reveals industrial-scale campaigns by DeepSeek, Moonshot, and MiniMax to extract Claude’s capabilities via fraudulent accounts, highlighting national security and AI safety risks.
Former DeepMind researcher David Silver has raised $1 billion for London-based Ineffable Intelligence, aiming to build a superintelligence that learns autonomously through experience.
Google DeepMind has introduced AlphaGenome, a new AI model designed to analyze long DNA sequences and predict how genetic variations may influence disease development.
OpenAI now uses age prediction to adjust ChatGPT’s safety settings for teens. Users 18 and older can verify their age to disable extra restrictions.
OpenAI has invested in Merge Labs, a brain-computer interface startup founded by CEO Sam Altman, as part of a $250 million seed round valuing the company at $850 million.
Google released a major upgrade to its Gemini Deep Research agent, giving developers access to advanced autonomous research capabilities through the Interactions API. The company also introduced DeepSearchQA, a benchmark for evaluating multi-step web research agents.
Google introduced the Titans architecture and the MIRAS framework to enable AI models to handle massive contexts and update their internal memory while running, improving performance in long-sequence tasks.
OpenAI co-founder Ilya Sutskever says the era of scaling compute and data as the main driver of AI progress is ending, arguing that meaningful advances now depend on true scientific breakthroughs and solving AI’s poor generalization.