← Back to glossary
Model distillation
Technique to transfer knowledge from a large expensive model to a smaller faster one while keeping nearly the same accuracy.
Advanced optimizacion eficiencia modelo
Full definition
Technique to transfer knowledge from a large expensive model to a smaller faster one while keeping nearly the same accuracy.
Example in a business context
Turning Llama-3-70B into an 8B version that runs on phones or edge devices.