Mixture-of-experts models
EstablishedSparsely activated architectures that scale parameter count while keeping per-token compute roughly fixed.
Trend score: 51
Trend over time
Evidence papers — 50 most recent of 1094
-
Rupeng Liu, Bangsheng Tang, Zongwei Zhou, Chengji Yao, Yejin Lee · Nov 2026 · arXiv
-
Tao Hu, Ling-Xiang Zhang, Da-Wei Zhou · Nov 2026 · arXiv
-
Tiantong Wang, Zhiren Gong, Yixin Wang, Tiantong Wu, Wei Yang Bryan Lim · Nov 2026 · arXiv
-
Sutanshu Saksena Raj, Daksh Maan, Avinash Benki, Parijat Chatterjee, Pasunuti Prasanjith, Purusharth Malik · Nov 2026 · arXiv
-
Translated, Maria Pia Adinolfi, Isabelle Andrieu, Grazia Fiorella Anfuso, Melania Annunziata, Daniele Antonini, Marta Arena, Luca Barone, Dana Barras Franco, Francesca Basiricò, Francesca Bee, Sofia Bertini, Nicola Bertoldi, Giorgio Biancini, Alessandra Bigi, Giulia Boccalini, Tommaso Bonomo, Enrico Boscardi, Sebastien Bratieres, Francesco Brigante, Giulia Brignola, Romolo Buondestino, Brenda Patricia Byrne, Giorgia Campora, Edoardo Cappelli, Veronica Carascosi, Francesca Carducci, Cody Carlson, · Nov 2026 · arXiv
-
Yong Li, Haoyu Wang, Kan Liu, Tao Lan · Nov 2026 · arXiv
-
Viktor Veselý, Sebastian Jitaru · Nov 2026 · arXiv
-
Pierre-Luc Bacon, Diego Calanzone, Jean-Maxime Larouche · Nov 2026 · arXiv
-
Fang Lu, Yao Lu, Zhuangzhi Chen, Sicheng Zhang, Shanqing Yu, Yun Lin, Qi Xuan, Guan Gui · Nov 2026 · arXiv
-
Peiyao Wang, Jiahui Sun, Weining Wang, Jing Liu · Nov 2026 · arXiv
-
Shunming Liu, Pei Huang, Yajing Sun, Huaxiao Liu · Nov 2026 · arXiv
-
Sutanshu Saksena Raj, Purusharth Malik, Pasunuti Prasanjith, Daksh Maan, Parijat Chatterjee, Avinash Benki · Nov 2026 · arXiv
-
Xinyu Zhou, Fan Li, Shasha Chen, Min Cao, Ahtamjan Ahmat, Qiaoming Zhu, Mang Ye · Nov 2026 · arXiv
-
Reyna Abhyankar, Dylan Lim, Drew Wadsworth, Venkata Hasith Vattikuti, YuTong Julia Zhang, Jung Hwan Heo, Taeksang Kim, Kesavan Ramakrishnan, Evangelene Stanley, Xinyu Fang, Daniel Y. Fu, Simran Arora · Nov 2026 · arXiv
-
Sayed Amir Karim · Nov 2026 · arXiv
-
Anish Saxena, Hritvik Taneja, Christos Kozyrakis, Aamer Jaleel · Nov 2026 · arXiv
-
Tomer Solberg · Nov 2026 · arXiv
-
Yu Dong, Hong Li, Qiang Sun, Xu Zhou, Jinbiao Huo, Qixiu Cheng, Zhiyuan Liu · Nov 2026 · arXiv
-
Zhenhong Zhou, Mao Zheng, Mingyang Song, Qiankun Li, Kun Wang, Junfeng Fang · Nov 2026 · arXiv
-
Tomas Rasymas, Povilas Kvedaras · Nov 2026 · arXiv
-
Bingzhang Wang, Mo Poorsartep, Yasaman Esfandiari · Nov 2026 · arXiv
-
Kevin L. McKee · Nov 2026 · arXiv
-
Bo Li, Chulian Zhang, Or Biri, Anthony Chang, Anton Korzh, Noam Duvdevani, XingFei Xi, Daniel Stokes, Zhenhuan Chen, Ludwig Schneider, Artem Y. Polyakov, Julien Demouth, Chandler Zhou · Nov 2026 · arXiv
-
Valentin Burkin · Nov 2026 · arXiv
-
Charbel Yahchouchi, Nabyl Quignon, Noemi Roggero, Laurent Saroul, Antitza Dantcheva · Nov 2026 · arXiv
-
Yu Liu, Xingbang Du · Nov 2026 · arXiv
-
Junning Zhu · Nov 2026 · arXiv
-
InfraRSI Team, Yuchuan Tian, Haocheng Mei, Ye Yuan, Chao Xu, Boxun Li, Guohao Dai, Kai Han, Allen Chen, Yunhe Wang, Yu Wang · Nov 2026 · arXiv
-
Rafael Pina, Varuna De Silva · Nov 2026 · arXiv
-
Ruijia Yang, Shiyuan Lin, Chengxi Liao, Zeyi Wen · Nov 2026 · arXiv
-
Luv Verma · Nov 2026 · arXiv
-
Cheng Luo, Xinnan Dai, Zhongzhu Zhou, Zefan Cai, Ruijie Zhu, Tianyu Zhang, Junjie Hu · Nov 2026 · arXiv
-
Szymon Płotka, Gizem Mert, Pedro R. A. S. Bassi, Wenxuan Li, Zongwei Zhou, Anna Marcinkiewicz, Wiktoria Romańczyk, Jarosław B. Ćwikła, Łukasz Struski, Ewa Szczurek, Jacek Tabor, Arkadiusz Sitek · Nov 2026 · arXiv
-
William X. Zheng, Zhongjie Chen, Shuo Yang, Ziming Mao, Xiaoze Fan, Yi Pan, Kunjun Li, Hanfei Yu, Chenfeng Xu, Yang Zhou, Rishabh Iyer, Ion Stoica · Nov 2026 · arXiv
-
Dingying Fan, Mingkai Liu, Haohua Que, Haojia Gao, Xianliang Huang, Qian Zhang, Xueqian Wang, Fei Qiao · Nov 2026 · arXiv
-
Yikun Hou, Alp Yurtsever · Nov 2026 · arXiv
-
Shih-Yao Lin · Nov 2026 · arXiv
-
Gizem Mert, Szymon Płotka, Pedro R. A. S. Bassi, Wenxuan Li, Zongwei Zhou, Jarosław B. Ćwikła, Arkadiusz Sitek, Ewa Szczurek · Nov 2026 · arXiv
-
Anyuan Zhuo, Shaohua Zhang, Yuan Lin, Pinyan Lu · Nov 2026 · arXiv
-
Kwan Yun, Minhyeok Bang, Colette Suhjung Koo, Junyong Noh · Nov 2026 · arXiv
-
Canmiao Fu, Chen Li, Guohui Zhang, Hao Lu, Hongyang Wei, Huadong Wu, Huaisong Zhang, Hubery Yin, Liyuan Cui, Qixin Yan, Tong Shao, Xiaoqiang Zhou, Xinhang Leng, Ying Zhang, Zhenhai Liu, Zhipeng Huang · Nov 2026 · arXiv
-
Alexander Kastius · Nov 2026 · arXiv
-
Tomas Rasymas, Povilas Kvedaras · Nov 2026 · arXiv
-
Donggeun Kim · Nov 2026 · arXiv
-
Yichao Fu, Yuxuan Zhang, Minshen Zhang, Ruitian Wang, Junda Chen, Hao Zhang · Nov 2026 · arXiv
-
Xue Zheng, Aylin Yener · Nov 2026 · arXiv
-
Ashutosh Dayal, Mallika Garg, Debashis Sen · Nov 2026 · arXiv
-
Nguyen Minh Thang, Trinh Thi Phuong · Nov 2026 · arXiv
-
Erfan Baghaei Potraghloo, Saeid Shokoufa, Seyedarmin Azizi, Arya Fayyazi, Souvik Kundu, Mehdi Kamal, Massoud Pedram · Nov 2026 · arXiv
-
Shengjie Wang, Mohsen Fayyaz, Nanyun Peng · Nov 2026 · arXiv