π Step 9: AI/LLM#321 / 350
Mixture of Experts
Mixture of Experts (MoE)
πOne-line summary
An architecture that activates only a subset of expert networks depending on the input.
π‘Easy explanation
A giant model with multiple 'experts' inside β only the relevant experts wake up for each question. More efficient because it doesn't use the whole model every time.
β¨Example
νμν μ λ¬Έκ°λ§ κΉ¨μ°κΈ°
π§βπ¬
μν
β
π§βπ¬
μ½λ©
π€
π§βπ¬
Language
β
π§βπ¬
κ³Όν
π€
μ μ²΄κ° μλ μΌλΆλ§ νμ±ν β ν¨μ¨μ