vSMT-IO: Improving I/O Performance and Efficiency on SMT Processors in Virtualized Clouds

Authors: 

Weiwei Jia, New Jersey Institute of Technology; Jianchen Shan, Hofstra University; Tsz On Li, University of Hong Kong; Xiaowei Shang, New Jersey Institute of Technology; Heming Cui, University of Hong Kong; Xiaoning Ding, New Jersey Institute of Technology

Abstract: 

The paper focuses on an under-studied yet fundamental issue on Simultaneous Multi-Threading (SMT) processors — how to schedule I/O workloads, so as to improve I/O performance and efficiency. The paper shows that existing techniques used by CPU schedulers to improve I/O performance are inefficient on SMT processors, because they incur excessive context switches and spinning when workloads are waiting for I/O events. Such inefficiency makes it difficult to achieve high CPU throughput and high I/O throughput, which are required by typical workloads in the clouds with both intensive I/O operations and heavy computation.

The paper proposes to use context retention as a key technique to improve I/O performance and efficiency on SMT processors. Context retention uses a hardware thread to hold the context of an I/O workload waiting for I/O events, such that overhead of context switches and spinning can be eliminated, and the workload can quickly respond to I/O events. Targeting virtualized clouds and x86 systems, the paper identifies the technical issues in implementing context retention in real systems, and explores effective techniques to address these issues, including long term context retention and retention-aware symbiotic scheduling.

The paper designs vSMT-IO to implement the idea and the techniques. Extensive evaluation based on the prototype implementation in KVM and diverse real-world applications, such as DBMS, web servers, AI workload, and Hadoop jobs, shows that vSMT-IO can improve I/O throughput by up to 88.3% and CPU throughput by up to 123.1%.

Open Access Media

USENIX is committed to Open Access to the research presented at our events. Papers and proceedings are freely available to everyone once the event begins. Any video, audio, and/or slides that are posted after the event are also free and open to everyone. Support USENIX and our commitment to Open Access.

BibTeX
@inproceedings {254390,
author = {Weiwei Jia and Jianchen Shan and Tsz On Li and Xiaowei Shang and Heming Cui and Xiaoning Ding},
title = {vSMT-IO: Improving I/O Performance and Efficiency on {SMT} Processors in Virtualized Clouds},
booktitle = {2020 {USENIX} Annual Technical Conference ({USENIX} {ATC} 20)},
year = {2020},
isbn = {978-1-939133-14-4},
pages = {449--463},
url = {https://www.usenix.org/conference/atc20/presentation/jia},
publisher = {{USENIX} Association},
month = jul,
}

Presentation Video