π Step 9: AI/LLM#302 / 350
Pre-training
Pre-training
πOne-line summary
The initial training phase where a model learns basic language abilities from massive data.
π‘Easy explanation
The first massive round of education a model receives β reading billions of sentences to understand language itself. It's the groundwork before fine-tuning.
β¨Example
λͺ¨λΈ νμ΅ νμ΄νλΌμΈ
π
λκ·λͺ¨ λ°μ΄ν°
β‘
μ¬μ νμ΅
π―
νμΈνλ
π
Deploy