GlossarIA
Open AI glossary for companies
← Back to glossary

LoRA (Low-Rank Adaptation)

Efficient fine-tuning technique that trains only low-rank matrices instead of all model parameters.

Intermediate fine_tuning eficiencia optimizacion

Full definition

Efficient fine-tuning technique that trains only low-rank matrices instead of all model parameters.

Example in a business context

Adapting Llama-3-70B to a specific domain using only 0.1% of parameters.