Skip to content
AI’s

training

Emergent Abilities

Capabilities that appear in larger models but are absent in smaller ones, seemingly arising spontaneously at certain scale thresholds. Emergent abilities include tasks like multi-step reasoning, arithmetic, and code generation that smaller models cannot perform.

In practice

Chain-of-thought reasoning appears to emerge in models above approximately 100 billion parameters.