A transformer is a neural network architecture that uses attention to model relationships within a sequence or across multiple data types. Unlike recurrent networks that process elements step by step, transformers can analyze many positions in parallel during training. Self-attention lets each token weigh the relevance of other tokens, while additional layers transform those contextual representations. The architecture underpins modern language models and is also used for images, audio, video, biology, and robotics. Transformers scale effectively but can require substantial data, memory, and computation. Their outputs still reflect training limitations, and long context does not guarantee correct reasoning or recall. Model size, attention design, data quality, and evaluation remain central to performance.
AI-driven bots now generate more internet traffic than humans, according to a new report, highlighting the growing impact of automated systems online.
New research shows that telling AI models they are “experts” can reduce accuracy in tasks like coding and math, while improving safety and alignment outcomes.
Meta introduced four new in-house MTIA chips designed for AI training and inference as the company accelerates data center expansion. The chips aim to improve performance and reduce reliance on external hardware suppliers.
Google has rolled out Canvas in AI Mode to all U.S. users in English, enabling people to create documents, dashboards, and interactive tools directly within Search. The feature provides a dynamic workspace for planning projects and building simple applications.
Andrej Karpathy argues AI coding agents now fundamentally change programming workflows, enabling long-running autonomous tasks and redefining software engineering.
MSCI introduces AI connectors enabling access to its data via MSCI ONE, ChatGPT, and Claude, debuting IndexAI Insights to deliver conversational index analytics powered by large language models.
Anthropic unveils a revised Responsible Scaling Policy with a Frontier Safety Roadmap, regular Risk Reports, and clearer separation between company commitments and industry recommendations.
ŌURA unveils a proprietary large language model for women’s health, combining clinical research and biometric data to deliver personalized, privacy-first AI guidance through Oura Advisor.
Anthropic reveals industrial-scale campaigns by DeepSeek, Moonshot, and MiniMax to extract Claude’s capabilities via fraudulent accounts, highlighting national security and AI safety risks.
A former Citigroup executive says commercially available humanoid robots can now deliver a return on investment in under 10 weeks, potentially accelerating enterprise automation.