hardware
NVIDIA CUDA
A parallel computing platform and programming model by NVIDIA that allows developers to use GPUs for general-purpose computing. CUDA is the dominant software ecosystem for AI training and inference, giving NVIDIA a strong competitive moat.
In practice
Nearly all deep learning frameworks (PyTorch, TensorFlow) use CUDA under the hood for GPU acceleration.