#DeepLearning Page 4 of 6

Explore AIstify's latest reporting, research, and expert analysis tagged with "deep learning", collected in one continuously updated archive.

Related Posts

Checkpoint
By • 1 min read

Checkpoint

By • 1 min read

A checkpoint is a saved snapshot of model parameters and training state that can be restored or deployed later.

Backpropagation
By • 1 min read

Backpropagation

By • 1 min read

Backpropagation trains neural networks by tracing prediction errors backward through their layers and adjusting internal weights to improve future results.

Weight Initialization
By • 1 min read

Weight Initialization

By • 1 min read

Weight initialization sets the starting parameters of a neural network so activations and gradients remain stable when model training begins.

Gradient Descent
By • 1 min read

Gradient Descent

By • 1 min read

Gradient descent is an optimization algorithm that reduces model error by repeatedly adjusting parameters in the direction indicated by the loss gradient.

Weight
By • 1 min read

Weight

By • 1 min read

A weight is a learned numerical parameter that controls the influence of an input or connection within a machine learning model or neural network.

Batch Size
By • 1 min read

Batch Size

By • 1 min read

Batch size is the number of examples a machine learning model processes before updating its weights during training and gradient optimization.

Attention Mask
By • 1 min read

Attention Mask

By • 1 min read

An attention mask tells a transformer which token positions it may consider and which positions should be ignored.