Operating Elasticsearch with Ease at Scale

Wednesday, June 12, 2019 - 4:00 pm5:00 pm

Aishwarya Sankaravadivel and Vikram Ramakrishnan, PayPal

Abstract: 

Search is ubiquitous! From booking a cab in a ride sharing platform to searching for a job on LinkedIn, Elasticsearch has emerged as a prominent solution for search and has been increasingly adopted for Log analytics and Application Performance monitoring.

In this talk, we would focus on how SRE Partners can leverage Elasticsearch to turn data into actionable insights by helping them to find a needle in a haystack. While Elasticsearch's out of the box defaults works for smaller implementations, the nuances of handling a massive elastic deployment which can scale to serve billions of ingests and millions of searches per day requires a deeper knowledge on Elasticsearch internals.

At PayPal, we have been proficient in managing elastic at this scale and we will share our learnings from our past crunching experiences with specific interesting details around how things can go wrong and effective ways to mitigate them along with demos.

In a gist we will have the following sections:

  • Elasticsearch overview
  • You are not alone! (We will discuss about the common issues that we could face with elastic)
  • Making elastic truly elastic...(We will cover the following sections w.r.t to ingests, searches and monitoring)
    • Handling the dark queries
    • Policing the police
    • Do more with less
  • Elasticsearch in Action! (Demo)

Aishwarya Sankaravadivel, PayPal

A senior software engineer working for the Search Platform at PayPal having deep expertise in managing Elasticsearch for global customers. A passionate woman technologist having intense hands-on coding experience in Scala and Reactive Programming. She has grabbed several awards like CPI India Champion, Wonder Woman, Star of the month for her exemplary work at PayPal and besides work, she is an avid reader and reviewer of many books and novels.

Vikram Ramakrishnan, PayPal

A senior engineering manager at PayPal having 15+ years of experience in the software industry. A very dynamic and a result oriented leader having full-stack software engineering expertise. Hands-on technologist and a problem solver having tremendous interest in large scale distributed systems and Big Data (Hadoop/Spark/Druid/ElasticSearch).

BibTeX
@conference {233295,
author = {Aishwarya Sankaravadivel and Vikram Ramakrishnan},
title = {Operating Elasticsearch with Ease at Scale},
year = {2019},
address = {Singapore},
publisher = {{USENIX} Association},
}