Xiaojun Guo, Huazhong University of Science an Technology; Guangjie Xing, Hua Wang, and Ke Zhou, Huazhong University of Science and Technology (HUST); Min Fu, Ming Xie, Fenqiang Yang, and Guangchao Yang, Tencent Technology (Shenzhen) Co., Ltd.; Jingyu Tang and Jinhui Xu, Huazhong University of Science and Technology (HUST)
Separating data by invalidation time is critical for mitigating garbage collection (GC) overhead in log-structured storage. In this paper, we establish a formal model and derive an OP-Minimized Oracle that optimizes separation thresholds for a theoretical Write Amplification Factor (WAF) of 1 under limited physical streams. Guided by this Oracle, we then design MINOS (MINimized Over-provisioning Separation), a practical online approximation that classifies writes into fine-grained virtual streams, tracks their invalidation behaviors, and adaptively clusters them into limited physical streams. Across 170 workloads totaling 500 TiB of writes, MINOS reduces GC writes by 15.0%--40.5% and improves throughput by up to 14.2% over state-of-the-art approaches, while incurring negligible CPU and memory overhead.
Open Access Media
USENIX is committed to Open Access to the research presented at our events. Papers and proceedings are freely available to everyone once the event begins. Any video, audio, and/or slides that are posted after the event are also free and open to everyone. Support USENIX and our commitment to Open Access.
