Vanishing Gradient
A vanishing gradient occurs when training signals become extremely small as they move backward through a deep neural network.
#DeepLearning
Explore AIstify's latest reporting, research, and expert analysis tagged with "deep learning", collected in one continuously updated archive.
Related Posts
Vision Transformer (ViT)
A Vision Transformer applies transformer attention to image patches for visual classification, recognition, and representation learning.
Softmax
Softmax converts a set of numerical scores into a probability distribution whose values sum to one.
Black Box Model
By
Samantha Reed
• 1 min read
A black box model is an AI system whose internal decision process is difficult to inspect or explain, even when its predictions are useful.
Tensor
By
Marcus Lee
• 1 min read
A tensor is a multidimensional array of numbers used to represent and process data inside machine learning systems.
Transformer
By
Daniel Mercer
• 1 min read
A transformer is a neural network architecture built on attention and used in modern language, vision, audio, video, and multimodal AI models.
Self-Attention
By
Ethan Caldwell
• 1 min read
Self-attention lets each element in a sequence weigh and combine information from other elements in that same sequence.
Attention Mechanism
By
Olivia Grant
• 1 min read
An attention mechanism helps an AI model focus on the most relevant parts of its input when interpreting information or generating an output.
Self-Supervised Learning
By
Daniel Mercer
• 1 min read
Self-supervised learning trains AI models with labels or objectives created from the data itself, reducing dependence on manual annotation.
YOLO (You Only Look Once)
By
Marcus Lee
• 1 min read
YOLO (You Only Look Once) is a real-time computer vision approach that detects and classifies multiple objects in one image processing pass.
Padding
By
Ethan Caldwell
• 1 min read
Padding adds placeholder values so variable-length inputs can be processed together in a fixed-size machine learning batch.
Recurrent Neural Network (RNN)
By
Daniel Mercer
• 1 min read
A recurrent neural network (RNN) is a deep learning model that carries information across sequential inputs such as text, speech, and time-series data.
NeRF (Neural Radiance Fields)
By
Marcus Lee
• 1 min read
NeRF is a neural representation that learns a 3D scene from 2D images and renders it from new viewpoints.
Multitask Learning
By
Ethan Caldwell
• 1 min read
Multitask learning trains one model on several related objectives so shared representations can improve multiple tasks.
Mila
By
AIstify Team
• 4 mins read
Mila is a Montreal-based artificial intelligence research institute known for machine learning, deep learning, academic research, education, and responsible AI initiatives.