Heterogeneity at Hyperscale: Characterization and Scheduling of Large Production AI Clusters

Suyi Li, Lingyun Yang, Haoxuan Yu, Sheng Yao, Tianyuan Wu, Xiaoxiao Jiang, and Hanfeng Lu, Hong Kong University of Science and Technology; Kangjin Wang, Alibaba Group; Chenhao Wang, Fudan University; Shenglin Xu, Alibaba Group; Lun Wang, University of Science and Technology of China; Qingyang Duan, Shenghao Liang, Xiu Lin, Meng Zhang, Wenchao Wu, Yinghao Yu, Guodong Yang, and Liping Zhang, Alibaba Group; Wei Wang, Hong Kong University of Science and Technology