Pretraining teaches an AI model broad patterns from a large dataset before it is adapted to a particular application. A language model may predict missing or next tokens across diverse text, while a vision model may learn from labeled images, self-supervised objectives, or image-text pairs. The resulting model provides reusable representations and capabilities that reduce the data and computing needed for downstream tasks. Pretraining is expensive and shapes nearly everything that follows, including strengths, blind spots, bias, language coverage, and memorized information. Developers may adapt the base through prompting, retrieval, instruction tuning, or fine-tuning, but those later steps do not automatically remove limitations introduced by the original data and objective.
HappyHorse-1.0, an open-source AI video model, has topped global benchmarks, outperforming leading proprietary systems and signaling a shift in the video generation market.
Meta shares climbed 7% after unveiling Muse Spark, its new multimodal AI model, signaling investor confidence in the company’s revamped AI strategy.
SoftBank has secured a $40 billion bridge loan to deepen its investment in OpenAI and accelerate its broader AI strategy.
AI-driven bots now generate more internet traffic than humans, according to a new report, highlighting the growing impact of automated systems online.
New research shows that telling AI models they are “experts” can reduce accuracy in tasks like coding and math, while improving safety and alignment outcomes.
Encyclopaedia Britannica and Merriam-Webster have sued OpenAI, alleging the company copied nearly 100,000 articles and dictionary entries to train ChatGPT without permission.
Meta introduced four new in-house MTIA chips designed for AI training and inference as the company accelerates data center expansion. The chips aim to improve performance and reduce reliance on external hardware suppliers.
Google has rolled out Canvas in AI Mode to all U.S. users in English, enabling people to create documents, dashboards, and interactive tools directly within Search. The feature provides a dynamic workspace for planning projects and building simple applications.
Andrej Karpathy argues AI coding agents now fundamentally change programming workflows, enabling long-running autonomous tasks and redefining software engineering.
MSCI introduces AI connectors enabling access to its data via MSCI ONE, ChatGPT, and Claude, debuting IndexAI Insights to deliver conversational index analytics powered by large language models.