Pretraining teaches an AI model broad patterns from a large dataset before it is adapted to a particular application. A language model may predict missing or next tokens across diverse text, while a vision model may learn from labeled images, self-supervised objectives, or image-text pairs. The resulting model provides reusable representations and capabilities that reduce the data and computing needed for downstream tasks. Pretraining is expensive and shapes nearly everything that follows, including strengths, blind spots, bias, language coverage, and memorized information. Developers may adapt the base through prompting, retrieval, instruction tuning, or fine-tuning, but those later steps do not automatically remove limitations introduced by the original data and objective.
AI startup Recursive Superintelligence has raised $500 million from Nvidia and GV to pursue self-improving AI systems, despite having no public product.
LinkedIn is testing a new platform that lets users earn up to $150 per hour training AI models. The move taps into fast-growing demand for human feedback in AI.
HappyHorse-1.0, an open-source AI video model, has topped global benchmarks, outperforming leading proprietary systems and signaling a shift in the video generation market.
Meta shares climbed 7% after unveiling Muse Spark, its new multimodal AI model, signaling investor confidence in the company’s revamped AI strategy.
SoftBank has secured a $40 billion bridge loan to deepen its investment in OpenAI and accelerate its broader AI strategy.
AI-driven bots now generate more internet traffic than humans, according to a new report, highlighting the growing impact of automated systems online.
New research shows that telling AI models they are “experts” can reduce accuracy in tasks like coding and math, while improving safety and alignment outcomes.
Encyclopaedia Britannica and Merriam-Webster have sued OpenAI, alleging the company copied nearly 100,000 articles and dictionary entries to train ChatGPT without permission.
Meta introduced four new in-house MTIA chips designed for AI training and inference as the company accelerates data center expansion. The chips aim to improve performance and reduce reliance on external hardware suppliers.
Google has rolled out Canvas in AI Mode to all U.S. users in English, enabling people to create documents, dashboards, and interactive tools directly within Search. The feature provides a dynamic workspace for planning projects and building simple applications.