LoRA

LoRA

/ˈlɔːrə/

Model Optimization

Low-Rank Adaptation; fine-tuning only a small subset of parameters

LoRA makes fine-tuning large models computationally affordable.

Origin: Acronym: Low-Rank Adaptation (Hu et al., 2021)