← Back to glossary
Pre-training
Initial phase where a language model is trained on massive amounts of public internet text to learn general language patterns and world knowledge.
Advanced entrenamiento llm fundacion
Full definition
Initial phase where a language model is trained on massive amounts of public internet text to learn general language patterns and world knowledge.
Example in a business context
GPT-4 and Claude are pre-trained on trillions of words before any business fine-tuning.