ZeRO-Prefill: Zero Redundancy Overheads in MoE Prefill Serving

Zhaoyuan Su, University of Virginia; Olatunji Ruwase, Karthik Ganesan, Aurick Qiao, and Samyam Rajbhandari, Snowflake; Juncheng Yang, Harvard University; Yue Cheng, University of Virginia; Yuxiong He, Snowflake