A Comprehensive Survey of Mixture-of-Experts: Algorithms, Theory, and Applications

Mixture of Experts (MoE) is a scalable architecture that uses a gating function to activate specialized expert networks dynamically. This "divide and conquer" approach enhances efficiency and interpretability in CV, NLP, and Reinforcement Learning paradigms. Source: March 2025 A Comprehensive Survey of Mixture-of-Experts: Algorithms, Theory, and Applications University of Houston Siyuan Mu, Sen Lin https://arxiv.org/pdf/2503.07137