Upgrade to Pro — share decks privately, control downloads, hide ads and more …



Ananth Packkildurai

February 27, 2019

More Decks by Ananth Packkildurai

Other Decks in Programming


  1. Events “An event is a single occurrence within an environment,

    usually involving an attempted state change.”
  2. Me ➢ @ananthdurai ➢ Data Infrastructure Engineer @ Slack ➢

    Passionate about all things related to ethical data management
  3. Public launch: 2014 1000+ employees across 7 countries worldwide HQ

    in San Francisco $841M in capital raised Key investors include Softbank, Accel, a16z, Social Capital, Index, Thrive, GV, Kleiner Perkins, GGV, Horizons, Spark, IVP and DST. Diverse set of industries including software/technology, retail, media, telecom and professional services. About Slack
  4. Murron: Murron is a sidecar running per instance based, collecting

    logs from host and containers • Guarantee at least once message delivery • Support retry, back pressure and configurable dynamic routing • Support Grpc, TCP, Http & unix domain protocol Murron logging agent
  5. UID

  6. Pinot is a realtime distributed OLAP datastore • A column-oriented

    database with various compression schemes such as Run Length, Fixed Bit Length • Pluggable indexing technologies - Sorted Index, Bitmap Index, Inverted Index • Near real time ingestion from Kafka and batch ingestion from Hadoop • SQL like language that supports selection, aggregation, filtering, group by, order by, distinct queries on fact data. • Horizontally scalable and fault tolerant Apache Pinot