MicroMon: A Monitoring Framework for Tackling Distributed Heterogeneity

Authors: 

Baber Khalid, Rutgers University; Nolan Rudolph and Ramakrishnan Durairajan, University of Oregon; Sudarsun Kannan, Rutgers University

Abstract: 

We present MicroMon, a multi-dimensional monitoring frame-work for geo-distributed applications using heterogeneous hardware. In MicroMon, we introduce micrometrics, which is a set of fine-grained hardware and software metrics required to study the combined impact of heterogeneous resources on application performance. Besides collecting micrometrics, in MicroMon, we propose anomaly reports and concerted effort between the programmable switches and host OSes to reduce the overhead of collecting and disseminating thousands of micro metrics in WAN. We evaluate the MicroMon prototype on Cassandra deployed across multiple data centers and show 10–50% throughput gains in a geo-distributed setting with storage and network heterogeneity.

Open Access Media

USENIX is committed to Open Access to the research presented at our events. Papers and proceedings are freely available to everyone once the event begins. Any video, audio, and/or slides that are posted after the event are also free and open to everyone. Support USENIX and our commitment to Open Access.

BibTeX
@inproceedings {254308,
author = {Baber Khalid and Nolan Rudolph and Ramakrishnan Durairajan and Sudarsun Kannan},
title = {MicroMon: A Monitoring Framework for Tackling Distributed Heterogeneity},
booktitle = {12th {USENIX} Workshop on Hot Topics in Storage and File Systems (HotStorage 20)},
year = {2020},
url = {https://www.usenix.org/conference/hotstorage20/presentation/khalid},
publisher = {{USENIX} Association},
month = jul,
}

Presentation Video