Extending a Scheduler to Better Support Sharded Services

Friday, June 14, 2019 - 2:00 pm3:00 pm

Laurie Clark-Michalek, Facebook

Abstract: 

Sharded services are incredibly common in modern computing, but schedulers don't usually consider them when making scheduling decisions, preferring to take a task based view of service health. This disparity between models can lead to ugly workarounds, which can in some case jeopardize the reliability of a service. This talk describes a project that extends a task based scheduler to take shards into account when scheduling. This project has sped up updates and reduced downtime for many services across Facebook, and has a surprisingly diverse set of uses.

BibTeX
@conference {233225,
author = {Laurie Clark-Michalek},
title = {Extending a Scheduler to Better Support Sharded Services},
year = {2019},
address = {Singapore},
publisher = {{USENIX} Association},
month = jun,
}

Presentation Video