Explore AIstify's latest reporting, research, and expert analysis tagged with "model training", collected in one continuously updated archive.
Low-rank adaptation (LoRA) is a parameter-efficient fine-tuning method that trains small adapter weights instead of updating an entire AI model.
Learning rate is a training hyperparameter that controls how much an AI model changes its weights during each optimization update.
Data parallelism trains copies of the same model on different data batches and combines their parameter updates.
Data augmentation expands a training dataset by creating realistic variations of existing examples while preserving their intended labels.
Encyclopaedia Britannica and Merriam-Webster have sued OpenAI, alleging the company copied nearly 100,000 articles and dictionary entries to train ChatGPT without permission.
Instruction tuning trains an AI model on instruction-and-response examples so it follows natural-language tasks more reliably across different use cases.
Compute is the processing capacity consumed when AI models are trained, evaluated, or used to generate predictions and outputs.
Discover how AI learns from data, improves over time, and makes decisions. A beginner-friendly guide to AI training and its real-world applications.
Weight initialization sets the starting parameters of a neural network so activations and gradients remain stable when model training begins.
Guide Labs launched Steerling-8B, an 8-billion parameter LLM with interpretable architecture that allows every token to be traced back to its training data.
Weight decay is a regularization method that limits large model weights during training to reduce overfitting and improve generalization.
Gradient descent is an optimization algorithm that reduces model error by repeatedly adjusting parameters in the direction indicated by the loss gradient.
A weight is a learned numerical parameter that controls the influence of an input or connection within a machine learning model or neural network.
AutoML automates parts of the machine learning workflow, including model selection, feature processing, and hyperparameter search.
Batch size is the number of examples a machine learning model processes before updating its weights during training and gradient optimization.