Home Glossary GPU (Graphics Processing Unit)

GPU (Graphics Processing Unit) - Page 2

A GPU, or graphics processing unit, is a processor built to perform many calculations in parallel. Although originally designed for rendering graphics, this structure is well suited to the matrix and vector operations at the center of deep learning. GPUs accelerate both model training and inference, and multiple units can be connected to handle larger models or datasets. Performance depends not only on raw arithmetic speed but also on memory capacity, memory bandwidth, interconnects, numerical formats, cooling, and software libraries. Consumer, data-center, and integrated GPUs serve different workloads, so the most expensive chip is not automatically the most efficient choice for every AI application.

Nvidia Invests $6.5 Billion in Technology That Could Reshape AI Infrastructure
By • 3 mins read
AI & Machine Learning, Cloud & Infrastructure, News, Research & Innovation

Nvidia Invests $6.5 Billion in Technology That Could Reshape AI Infrastructure

By • 3 mins read

Nvidia has committed at least $6.5 billion to photonics companies in recent months as it seeks to overcome AI infrastructure bottlenecks. The investments target optical technologies that could reduce energy consumption and improve data transfer across future AI systems.