Austere Flash Caching with Deduplication and Compression


Qiuping Wang and Jinhong Li, The Chinese University of Hong Kong; Wen Xia, Harbin Institute of Technology, Shenzhen; Erik Kruus and Biplob Debnath, NEC Labs; Patrick P. C. Lee, The Chinese University of Hong Kong


Modern storage systems leverage flash caching to boost I/O performance, and enhancing the space efficiency and endurance of flash caching remains a critical yet challenging issue in the face of ever-growing data-intensive workloads. Deduplication and compression are promising data reduction techniques for storage and I/O savings via the removal of duplicate content, yet they also incur substantial memory overhead for index management. We propose AustereCache, a new flash caching design that aims for memory-efficient indexing, while preserving the data reduction benefits of deduplication and compression. AustereCache emphasizes austere cache management and proposes different core techniques for efficient data organization and cache replacement, so as to eliminate as much indexing metadata as possible and make lightweight in-memory index structures viable. Trace-driven experiments show that our AustereCache prototype saves 69.9-97.0% of memory usage compared to the state-of-the-art flash caching design that supports deduplication and compression, while maintaining comparable read hit ratios and write reduction ratios and achieving high I/O throughput.

Open Access Media

USENIX is committed to Open Access to the research presented at our events. Papers and proceedings are freely available to everyone once the event begins. Any video, audio, and/or slides that are posted after the event are also free and open to everyone. Support USENIX and our commitment to Open Access.

@inproceedings {254447,
author = {Qiuping Wang and Jinhong Li and Wen Xia and Erik Kruus and Biplob Debnath and Patrick P. C. Lee},
title = {Austere Flash Caching with Deduplication and Compression},
booktitle = {2020 {USENIX} Annual Technical Conference ({USENIX} {ATC} 20)},
year = {2020},
isbn = {978-1-939133-14-4},
pages = {713--726},
url = {},
publisher = {{USENIX} Association},
month = jul,

Presentation Video