Syncopate: Automatic Fine-Grained Compute-Communication Overlap via Chunk-Centric Scheduling

Xinwei Qiang, Yue Guan, and Zhengding Hu, UCSD; Keren Zhou, George Mason University and OpenAI; Yufei Ding, UCSD and Meta; Adnan Aziz, Meta