InfiniFS: An Efficient Metadata Service for Large-Scale Distributed Filesystems

Authors: 

Wenhao Lv and Youyou Lu, Department of Computer Science and Technology, BNRist, Tsinghua University; Yiming Zhang, School of Informatics, Xiamen University; Peile Duan, Alibaba Group; Jiwu Shu, Department of Computer Science and Technology, BNRist, Tsinghua University and School of Informatics, Xiamen University

Abstract: 

Modern datacenters prefer one single filesystem instance that spans the entire datacenter and supports billions of files. The maintenance of filesystem metadata in such scenarios faces unique challenges, including load balancing while preserving locality, long path resolution, and near-root hotspots.

To solve these challenges, we propose InfiniFS, an efficient metadata service for extremely large-scale distributed filesystems. It includes three key techniques. First, InfiniFS decouples the access and content metadata of directories, so that the directory tree can be partitioned with both metadata locality and load balancing. Second, InfiniFS designs the speculative path resolution to traverse the path in parallel, which substantially reduces the latency of metadata operations. Third, InfiniFS introduces the optimistic access metadata cache on the client-side, to alleviate the near-root hotspot problem, which effectively improves the throughput of metadata operations. The extensive evaluation shows that InfiniFS outperforms state-of-the-art distributed filesystem metadata services in both latency and throughput, and provides stable performance for extremely large-scale directory trees with up to 100 billion files.

Open Access Media

USENIX is committed to Open Access to the research presented at our events. Papers and proceedings are freely available to everyone once the event begins. Any video, audio, and/or slides that are posted after the event are also free and open to everyone. Support USENIX and our commitment to Open Access.

This content is available to:

BibTeX
@inproceedings {277828,
title = {{InfiniFS}: An Efficient Metadata Service for {Large-Scale} Distributed Filesystems},
booktitle = {20th USENIX Conference on File and Storage Technologies (FAST 22)},
year = {2022},
isbn = {978-1-939133-26-7},
address = {Santa Clara, CA},
pages = {313--328},
url = {https://www.usenix.org/conference/fast22/presentation/lv},
publisher = {USENIX Association},
month = feb,
}

Presentation Video