Whale: Efficient Giant Model Training over Heterogeneous GPUs

TitleWhale: Efficient Giant Model Training over Heterogeneous GPUs
Publication TypeConference Paper
Year of Publication2022
AuthorsJia X, Jiang L, Wang A, Xiao W, Shi Z, Zhang J, Li X, Chen L, Li Y, Zheng Z, Liu X, Lin W
Conference Name2022 USENIX Annual Technical Conference (USENIX ATC 22)
Date Published07/2022
PublisherUSENIX Association
Conference LocationCarlsbad, CA
ISBN Number978-1-939133-29-57
URLhttps://www.usenix.org/conference/atc22/presentation/jia-xianyan