Sparse Mixture-of-Experts for Compositional Generalization: Empirical Evidence and Theoretical Foundations of Optimal Sparsity
Conference on Parsimony and Learning (CPAL 2026)Oral
PhD student · University of California, San Diego
Conference on Parsimony and Learning (CPAL 2026)Oral
ICLR 2024 Workshop on Mathematical and Empirical Understanding of Foundation Models