Upgrade to Pro — share decks privately, control downloads, hide ads and more …

An Introduction to Apache Zookeeper

Sponsored · Ship Features Fearlessly Turn features on and off without deploys. Used by thousands of Ruby developers.

An Introduction to Apache Zookeeper

An Introduction to Apache Zookeeper, what is it used for ?
How does it work and what is it's architecture ?

Avatar for Mike Frampton

Mike Frampton

July 25, 2013
Tweet

More Decks by Mike Frampton

Other Decks in Technology

Transcript

  1. Apache Zookeeper • What is it ? • How does

    it work ? • Problems • Architecture • Reliability www.semtech-solutions.co.nz [email protected]
  2. Zookeeper – What is it ? • A coordination service

    • For distributed systems • Makes cluster coordination – Fast – Scalable • Runs on a cluster of servers • Offers pre defined functionality • No need to “re invent the wheel” • Best for read dominant work loads www.semtech-solutions.co.nz [email protected]
  3. Zookeeper – How does it work ? • Works via

    an ensemble of servers • Clients write changes to ensemble • Changes processed strictly in order received • Ensemble selects a leader • Leader re elected in case of failure • Designed for small data volumes / meta data www.semtech-solutions.co.nz [email protected]
  4. Zookeeper – How does it work ? • Change considered

    successful if – It reaches a quorum – Quorum is at least half of ensemble • A server will disconnect clients if – It cant contact quorum within a given time • Cluster will function if half of servers up • When a failed server re starts it will – Re sync with the ensemble www.semtech-solutions.co.nz [email protected]
  5. Distributed System Problems What type of problems do distributed systems

    encounter • Inconsistency – Configuration inconsistencies across cluster • Race conditions – Unexpected behaviour due to timing of events • Dead locks – Contention for resources www.semtech-solutions.co.nz [email protected]
  6. Zookeeper – Name Space • Zookeeper nodes use a hierarchical

    name space • Like a file system but for low data volumes • Path elements separated by a slash ( “/” ) • Every node in name space identified by a path www.semtech-solutions.co.nz [email protected]
  7. Contact Us • Feel free to contact us at –

    www.semtech-solutions.co.nz – [email protected] • We offer IT project consultancy • We are happy to hear about your problems • You can just pay for those hours that you need • To solve your problems