Skip to content
AI’s

hardware

Tensor Core

Specialized processing units within NVIDIA GPUs designed to accelerate matrix multiply-and-accumulate operations, the core computation in deep learning. Tensor Cores provide massive speedups for AI training and inference workloads.

In practice

The H100's fourth-generation Tensor Cores are 6x faster than the A100 for transformer model inference.