deployment
Training Cost
The total computational expense of training an AI model, including GPU hours, electricity, and cooling. Training frontier models can cost tens to hundreds of millions of dollars and require thousands of GPUs running for months.
In practice
Training GPT-4 reportedly cost over $100 million in compute, while training smaller open-source models can cost under $1 million.