Weight decay is a regularization technique that discourages a model’s learned weights from becoming unnecessarily large. During optimization, weights are slightly reduced at each update or penalized through the training objective, depending on the algorithm. This can limit overly complex solutions, reduce sensitivity to noise, and improve performance on unseen data. The decay strength is a hyperparameter: too little may have no useful effect, while too much can prevent the model from learning important patterns. Weight decay interacts with the optimizer, learning rate, architecture, normalization, and training duration, so it should be selected through validation rather than copied unchanged from another model.
Pinterest is turning to open source AI models to cut expenses and enhance its visual search and shopping tools, even as the company forecasts softer holiday revenue. CEO Bill Ready says the approach will support performance while keeping infrastructure costs in check.
Elon Musk has unveiled Grokipedia – an AI-driven encyclopedia built on Grok that aims to offer factual, bias-free knowledge as an alternative to Wikipedia.
Andrew Tulloch, co-founder of the $12 billion AI startup Thinking Machines Lab, has joined Meta after previously rejecting what reports described as a $1.5 billion offer — a figure Meta has since called ‘inaccurate and ridiculous.’
Google has unveiled Gemini Enterprise, a next-generation AI platform designed for business productivity and collaboration, positioning itself directly against Microsoft’s Copilot and OpenAI’s enterprise solutions in the race for workplace AI dominance.
Google Cloud and Figma have launched an expanded partnership to embed Google’s generative AI models – including Gemini 2.5 Flash and Imagen 4 – directly into Figma’s design tools, reducing latency and accelerating creative workflows.