Skip to content
AI’s

deployment

LoRA

Low-Rank Adaptation, a parameter-efficient fine-tuning method that adds small trainable matrices to frozen model weights. LoRA drastically reduces the number of trainable parameters and memory needed for fine-tuning, making it practical to customize large models.

In practice

LoRA can fine-tune a 7B model using only 0.1% of the parameters, requiring a single GPU instead of a cluster.

In the index

Tools that mention LoRA

Matched on each tool’s own description and feature list, highest trust score first.

Briefings

Further reading