Kavli Affiliate: Jia Liu | First 5 Authors: Junzhuo Li, Bo Wang, Xiuze Zhou, Peijie Jiang, Jia Liu | Summary: The interpretability of Mixture-of-Experts (MoE) models, especially those with heterogeneous designs, remains underexplored. Existing attribution methods for dense models fail to capture dynamic routing-expert interactions in sparse MoE architectures. To address this issue, we propose […]

Kavli Affiliate: Misao Sasaki | First 5 Authors: Diego Cruces, Shi Pi, Misao Sasaki, , | Summary: $delta N$ formalism is a useful method to calculate the curvature perturbation. Contrary to what it is typically done in the literature, we re-formulate the $delta N$ formalism by using the $e$-folding number $n$ counted forward in time. […]

Kavli Affiliate: Misao Sasaki | First 5 Authors: Diego Cruces, Shi Pi, Misao Sasaki, , | Summary: $delta N$ formalism is a useful method to calculate the curvature perturbation. Contrary to what it is typically done in the literature, we re-formulate the $delta N$ formalism by using the $e$-folding number $n$ counted forward in time. […]