Explore AIstify's latest reporting, research, and expert analysis tagged with "deep learning", collected in one continuously updated archive.
Multi-head attention runs several attention operations in parallel so a model can capture different relationships in the same input.
Model parallelism divides one large model across multiple processors so its parameters and computation fit collectively.
A perceptron is a simple artificial neuron that combines weighted inputs to make a binary classification and forms a foundation of neural networks.
The XOR problem is a classic machine learning example showing why neural networks need hidden layers and nonlinear activations for some patterns.
A parameter is a learned numerical value, such as a neural network weight, that determines how an AI model transforms input into output.
One-shot learning is an AI approach that recognizes a new task or category from one example by using knowledge learned during previous training.
Normalization transforms data or neural network activations into a consistent scale or distribution to support stable and efficient AI model training.
XLA (Accelerated Linear Algebra) is a compiler that optimizes tensor operations for faster and more efficient machine learning training and inference.
Gradient clipping limits the size of training gradients to prevent unstable parameter updates and exploding values.
A feedforward neural network moves information from input to output through layers without recurrent feedback connections.
A hidden layer is an internal neural network layer that transforms inputs into representations used to produce the final output.
A GPU is a highly parallel processor widely used to train and run neural networks and other compute-intensive AI workloads.
Xception is a computer vision architecture that uses depthwise separable convolutions for efficient image classification and feature extraction.
A mixture of experts (MoE) is an AI architecture that routes each input to selected subnetworks, increasing capacity without activating every parameter.
A GAN trains a generator and discriminator in competition so the generator learns to create increasingly realistic synthetic data.