Chronicle: Capture and Analysis of NFS Workloads at Line Rate

Authors: 

Ardalan Kangarlou, Sandip Shete, and John D. Strunk, NetApp, Inc.

Abstract: 

Insights from workloads have been instrumental in hardware and software design, problem diagnosis, and performance optimization. The recent emergence of software-defined data centers and application-centric computing has further increased the interest in studying workloads. Despite the ever-increasing interest, the lack of general frameworks for trace capture and workload analysis at line rate has impeded characterizing many storage workloads and systems. This is in part due to complexities associated with engineering a solution that is tailored enough to use computational resources efficiently yet is general enough to handle different types of analyses or workloads.

This paper presents Chronicle, a high-throughput framework for capturing and analyzing Network File System (NFS) workloads at line rate. More specifically, we designed Chronicle to characterize NFS network traffic at rates above 10Gb/s for days to weeks. By leveraging the actor programming model and a pluggable, pipelined architecture, Chronicle facilitates a highly portable and scalable framework that imposes little burden on application programmers. In this paper, we demonstrate that Chronicle can reconstruct, process, and record storage-level semantics at the rate of 14Gb/s using general-purpose CPUs, disks, and NICs.

Open Access Media

USENIX is committed to Open Access to the research presented at our events. Papers and proceedings are freely available to everyone once the event begins. Any video, audio, and/or slides that are posted after the event are also free and open to everyone. Support USENIX and our commitment to Open Access.

BibTeX
@inproceedings {188464,
author = {Ardalan Kangarlou and Sandip Shete and John D. Strunk},
title = {Chronicle: Capture and Analysis of {NFS} Workloads at Line Rate},
booktitle = {13th {USENIX} Conference on File and Storage Technologies ({FAST} 15)},
year = {2015},
isbn = {978-1-931971-201},
address = {Santa Clara, CA},
pages = {345--358},
url = {https://www.usenix.org/conference/fast15/technical-sessions/presentation/kangarlou},
publisher = {{USENIX} Association},
month = feb,
}

Presentation Video

Presentation Audio

Comments

0 likes
0 dislikes