Fine-tuning giant neural networks on commodity hardware with automatic pipeline model parallelism

TitleFine-tuning giant neural networks on commodity hardware with automatic pipeline model parallelism
Publication TypeConference Paper
Year of Publication2021
AuthorsEliad S, Hakimi I, De Jagger A, Silberstein M, Schuster A
Conference Name2021 USENIX Annual Technical Conference (USENIX ATC 21)
Date Published07/2021
PublisherUSENIX Association
ISBN Number978-1-939133-23-6
URLhttps://www.usenix.org/conference/atc21/presentation/eliad