Finding Consistency in an Inconsistent World: Towards Deep Semantic Understanding of Scale-out Distributed Databases

Authors: 

Neville Carvalho, Hyojun Kim, Maohua Lu, Prasenjit Sarkar, Rohit Shekhar, Tarun Thakur, Pin Zhou, Datos IO; Remzi H. Arpaci-Dusseau, University of Wisconsin—Madison

Abstract: 

We present a new problem in data storage: how to build efficient backup and restore tools for increasingly popular Next-generation Eventually Consistent STorage systems (NECST). We show that the lack of a concise, consistent, logical view of data at a point-in-time is the key underlying problem; we suggest a deep semantic understanding of the data stored within the system of interest as a solution. We discuss research and productization challenges in this new domain, and present the status of our platform, Datos CODR (Consistent Orchestrated Distributed Recovery), which can extract consistent and deduplicated backups from NECST systems such as Cassandra, MongoDB, and many others.

Open Access Media

USENIX is committed to Open Access to the research presented at our events. Papers and proceedings are freely available to everyone once the event begins. Any video, audio, and/or slides that are posted after the event are also free and open to everyone. Support USENIX and our commitment to Open Access.

BibTeX
@inproceedings {196396,
author = {Neville Carvalho and Hyojun Kim and Maohua Lu and Prasenjit Sarkar and Rohit Shekhar and Tarun Thakur and Pin Zhou and Remzi H. Arpaci-Dusseau},
title = {Finding Consistency in an Inconsistent World: Towards Deep Semantic Understanding of Scale-out Distributed Databases},
booktitle = {8th USENIX Workshop on Hot Topics in Storage and File Systems (HotStorage 16)},
year = {2016},
address = {Denver, CO},
url = {https://www.usenix.org/conference/hotstorage16/workshop-program/presentation/carvalho},
publisher = {USENIX Association},
month = jun,
}
Download
Carvalho PDF
View the slides