InnoDB to MyRocks Migration in Main MySQL Database at Facebook

Wednesday, May 24, 2017 - 9:00am9:55am

Yoshinori Matsunobu, Facebook

Abstract: 

At Facebook, we open sourced MyRocks—Flash optimized, space and write efficient MySQL database engine. We are in the process of migrating our main MySQL databases—storing Facebook social graphs, massively sharded, low latency and automated services—from InnoDB to MyRocks. We have been very successful so far and have reduced database size by half.

Compared to deploying new database software into new or non-critical services, replacing existing stable database running on very critical services is much harder. You need to pay attention to lots of things, like how to migrate existing data without stopping or slowing down services, how to migrate within reasonable amount of time, and how to continuously verify not to corrupt any data.

In this session, the speaker will talk about MyRocks production deployment story. The following topics will be covered

  • Overview of MySQL at Facebook
  • What is MyRocks, and why we decided to create yet another database engine
  • How Facebook MySQL SRE team collaborated with Engineering team
  • How we prepared, executed and monitored InnoDB to MyRocks migration
  • Lessons learned from the migration

Yoshinori Matsunobu, Facebook

Yoshinori Matsunobu is a Production Engineer at Facebook, and is leading MyRocks project and deployment. Yoshinori has been around MySQL community for over 10 years. He was a senior consultant at MySQL Inc since 2006 to 2010. Yoshinori created a couple of useful open source product/tools, including MHA (automated MySQL master failover tool) and quickstack.

Open Access Media

USENIX is committed to Open Access to the research presented at our events. Papers and proceedings are freely available to everyone once the event begins. Any video, audio, and/or slides that are posted after the event are also free and open to everyone. Support USENIX and our commitment to Open Access.

BibTeX
@conference {202779,
author = {Yoshinori Matsunobu},
title = {{InnoDB} to {MyRocks} Migration in Main {MySQL} Database at Facebook},
year = {2017},
publisher = {USENIX Association},
month = may,
}

Presentation Video 

Presentation Audio