Skip to main content
USENIX
  • Conferences
  • Students
Sign in

sponsors

Diamond Sponsor
Gold Sponsor
Bronze Sponsor

connect with us


  •  Twitter
  •  Facebook
  •  LinkedIn
  •  Google+
  •  YouTube

help promote

SREcon15 Europe button

I'm Going to SREcon15 Europe

general information

Venue:
Google
Gordon House
Barrow Street, Dublin 4
Ireland

Questions?
About SREcon?
About Registration?
About Sponsorship?

twitter

Tweets by @SREcon

usenix conference policies

  • Event Code of Conduct
  • Conference Network Policy
  • Statement on Environmental Responsibility Policy

You are here

Home » Continuous Pipelines at Google
Tweet

connect with us

Continuous Pipelines at Google

Thursday, May 14, 2015 - 12:00pm-12:30pm

Dan Dennison, Google, Inc.

Abstract: 

This presentation will focus on the real life challenges of managing data processing pipelines of any depth and complexity. I’ll cover the frequency continuum between periodic pipelines that run very infrequently up through continuous pipelines that never stop running, discussing the discontinuities along the axis that can produce significant operational problems. A fresh take on the master-slave model is presented as a better alternative to the periodic pipeline for reliable Big Data scaling.

Dan Dennison has been a Site Reliability Engineer at Google for the past eight years, working on various large pipelines in Ads Quality. The Ads Quality team at Google improves, expands, and supports one of the world’s largest machine learning deployments. Ads Quality also crawls and indexes all advertisements, and enforces policies on new and existing ads.

Dan Dennison, Google, Inc.

Open Access Media

USENIX is committed to Open Access to the research presented at our events. Papers and proceedings are freely available to everyone once the event begins. Any video, audio, and/or slides that are posted after the event are also free and open to everyone. Support USENIX and our commitment to Open Access.

Dennison PDF

Presentation Video

Presentation Audio

MP3 Download

Download Audio

continuouspipelinesatgooglefinal.pdf
  • Log in or    Register to post comments

Diamond Sponsors

Gold Sponsors

Bronze Sponsors

© USENIX

SREcon is a registered trademark of the USENIX Association.

  • Privacy Policy
  • Contact Us