How We Implemented High Throughput Logging at Spotify

Tuesday, 25 October, 2022 - 15:1015:30 CEST

Lauren Muhlhauser, Spotify

Abstract: 

As a company scales, observability tooling is not always able to scale with it. This talk will cover how we discovered a majority of our logs were unintentionally being dropped and the steps we took to find a logging solution that worked at our scale in a multi-tenant Kubernetes set up. It will also cover steps taken to control throughput and cost once all the logs were able to flood in.

Lauren Muhlhauser, Spotify

Lauren Muhlhauser is the Engineering Manager for the Observability team at Spotify based in New York. She has supported metrics, tracing, and logging infrastructure both internally and open source.

BibTeX
@conference {284597,
author = {Lauren Muhlhauser},
title = {How We Implemented High Throughput Logging at Spotify},
year = {2022},
address = {Amsterdam},
publisher = {USENIX Association},
month = oct
}

Presentation Video