The Challenges of Managing Open Source Infrastructure at Bloomberg

Tuesday, October 29, 2019 - 2:45 pm3:30 pm

Andrew Terng, Bloomberg

Abstract: 

Bloomberg's Engineering team has deployed a Telemetry as a Service infrastructure that collects and processes over 6M metrics per second from tens of thousands of machines and applications, generating 120 TB of logs each day. In this talk, we will discuss when and how our engineers decide which open source software solutions to use. We will also look at some of the recent challenges we faced in using some of this software at scale and discuss how these hurdles were overcome.

Andrew Terng, Bloomberg

Andrew is an engineer at Bloomberg LP where he works on the Telemetry as a Service platform. Currently responsible for the build and automation of the Kubernetes infrastructure along with other OSS that processes 6M metrics per second and over 120TB of logs daily within the organization.

Prior to Bloomberg he worked at Digital Ocean, Tumblr, Yahoo! Search, and more.

BibTeX
@conference {240904,
author = {Andrew Terng},
title = {The Challenges of Managing Open Source Infrastructure at Bloomberg},
year = {2019},
address = {Portland, OR},
publisher = {USENIX Association},
month = oct
}

Presentation Video