Midgress-aware traffic provisioning for content delivery

Authors: 

Aditya Sundarrajan, University of Massachusetts Amherst; Mangesh Kasbekar, Akamai Technologies; Ramesh K. Sitaraman, University of Massachusetts Amherst & Akamai Technologies; Samta Shukla, CVS Health

Abstract: 

Content delivery networks (CDNs) cache and deliver hundreds of trillions of user requests each day from hundreds of thousands of servers around the world. The traffic served by CDNs can be partitioned into hundreds of traffic classes, each with different user access patterns, popularity distributions, object sizes, and performance requirements. Midgress is the cache miss traffic between the CDN's servers and the content provider origins. A major goal of a CDN is to minimize its midgress, since higher midgress translates to higher bandwidth costs and increased user-perceived latency. We propose algorithms that provision traffic classes to servers such that midgress is minimized. Using extensive traces from Akamai's CDN, we show that our midgress-aware traffic provisioning schemes can reduce midgress by nearly 20% in comparison with the midgress-unaware schemes currently in use. We also propose an efficient heuristic for traffic provisioning that achieves near-optimal midgress and is suitable for use in production settings. Further, we show how our algorithms can be extended to other settings that require minimum caching performance per traffic class and minimum content duplication for fault tolerance. Finally, our paper provides a strong case for implementing midgress-aware traffic provisioning in production CDNs.

Open Access Media

USENIX is committed to Open Access to the research presented at our events. Papers and proceedings are freely available to everyone once the event begins. Any video, audio, and/or slides that are posted after the event are also free and open to everyone. Support USENIX and our commitment to Open Access.

BibTeX
@inproceedings {254434,
author = {Aditya Sundarrajan and Mangesh Kasbekar and Ramesh K. Sitaraman and Samta Shukla},
title = {Midgress-aware traffic provisioning for content delivery},
booktitle = {2020 {USENIX} Annual Technical Conference ({USENIX} {ATC} 20)},
year = {2020},
isbn = {978-1-939133-14-4},
pages = {543--557},
url = {https://www.usenix.org/conference/atc20/presentation/sundarrajan},
publisher = {{USENIX} Association},
month = jul,
}

Presentation Video