GPU (Graphics Processing Unit)

A GPU, or graphics processing unit, is a processor built to perform many calculations in parallel. Although originally designed for rendering graphics, this structure is well suited to the matrix and vector operations at the center of deep learning. GPUs accelerate both model training and inference, and multiple units can be connected to handle larger models or datasets. Performance depends not only on raw arithmetic speed but also on memory capacity, memory bandwidth, interconnects, numerical formats, cooling, and software libraries. Consumer, data-center, and integrated GPUs serve different workloads, so the most expensive chip is not automatically the most efficient choice for every AI application.