Reducing Chaos in Production: Testing vs. Monitoring

Wednesday, October 31, 2018 - 9:30 am10:00 am

Robert Treat, OmniTI


While no one disputes the good in finding and fixing issues before deploying to production, relying on traditional testing methods in the age of data-intensive, internet scale software has proven to be incomplete. The ability to identify and fix production issues quickly is crucial and requires insight into usage patterns and trends across the entire application architecture. This talk touches on deficiencies of common testing methods, provide real-world examples of discovering odd edge cases with both testing and monitoring, and offers recommendations on metric instrumentation to help companies identify and act on business-affecting problems.

Robert Treat, OmniTI

After a career spent building data-intensive, mission-critical systems at fortune 500 companies across the e-commerce, healthcare, financial services, and SaaS industries, Robert currently spends his days as CEO of OmniTI, a technical services firm focused on providing web services and infrastructure management. A long time open source contributor, he is a published author and speaks at conferences worldwide on topics such as open source, databases, and managing operations at scale. He occasionally blogs at

Open Access Media

USENIX is committed to Open Access to the research presented at our events. Papers and proceedings are freely available to everyone once the event begins. Any video, audio, and/or slides that are posted after the event are also free and open to everyone. Support USENIX and our commitment to Open Access.

@conference {221786,
author = {Robert Treat},
title = {Reducing Chaos in Production: Testing vs. Monitoring},
year = {2018},
address = {Nashville, TN},
publisher = {USENIX Association},
month = oct

Presentation Video 

Presentation Audio