πŸ“– Step 9: AI/LLM#321 / 350

Mixture of Experts

Mixture of Experts (MoE)

πŸ“–One-line summary

An architecture that activates only a subset of expert networks depending on the input.

πŸ’‘Easy explanation

A giant model with multiple 'experts' inside β€” only the relevant experts wake up for each question. More efficient because it doesn't use the whole model every time.

✨Example

ν•„μš”ν•œ μ „λ¬Έκ°€λ§Œ 깨우기

πŸ§‘β€πŸ”¬

μˆ˜ν•™

βœ…

πŸ§‘β€πŸ”¬

μ½”λ”©

πŸ’€

πŸ§‘β€πŸ”¬

Language

βœ…

πŸ§‘β€πŸ”¬

κ³Όν•™

πŸ’€

전체가 μ•„λ‹Œ μΌλΆ€λ§Œ ν™œμ„±ν™” β†’ 효율적