Shopify's Move from the Data Centre to the Cloud

Thursday, June 07, 2018 - 9:00 am9:55 am

Scott Francis, Shopify

Abstract: 

Shopify is one of the largest commerce web sites in the world, with over 500,000 merchants including Kylie Jenner and Kanye West. In 2017, we made the decision to move from primarily co-located data centres to the cloud.

This talk will dig into why we made the decision to abandon the DC, one that may interest other companies considering the same move. We'll carefully talk through each step of the process—how we planned, managed and executed the migration.

We'll also dive deep into the tooling we built to make this possible: a tool for performing zero-downtime shard failovers; a live shop mover to migrate shops between shards; among others. These tools are what allowed us to successfully perform the migration with almost no downtime for our merchants.

We'll also go into our performance tuning methodologies and capacity planning process. And of course, no project executes as planned, so we'll also share some of the problems we encountered and lessons learned along the way.

Scott Francis, Shopify

Scott Francis is a senior production engineer lead at Shopify, focusing primarily on reliability, scalability, and performance. He'll take any opportunity to jump into gdb or debug a core dump. He enjoys cooking and sometimes dog walking in what little free time he has.

Open Access Media

USENIX is committed to Open Access to the research presented at our events. Papers and proceedings are freely available to everyone once the event begins. Any video, audio, and/or slides that are posted after the event are also free and open to everyone. Support USENIX and our commitment to Open Access.

BibTeX
@conference {214983,
author = {Scott Francis},
title = {Shopify{\textquoteright}s Move from the Data Centre to the Cloud},
year = {2018},
publisher = {USENIX Association},
month = jun
}

Presentation Video 

Presentation Audio