Taming Pythons with ZooKeeper
Concurrency is hard. Consistency in distributed systems is hard. And then the whole thing should be highly-available and error resilient.
In the past we used to deploy new indices using sequential scripts, which would move files around in network and then tell services to upgrade their indices via complex command line calls over SSH. As number of services and thus indices and machines grew, this approach came more and more fragile.
To address the fragility, we decided to start providing index distribution as a service. No longer we would need to deal with individual services but aim only to offer robust and trustworthy way of orchestrating the publishing of new indices. Due to the nature of indices, where things need to happen in a certain order, we needed to be able to have consistency over the services inside a datacenter. For this problem, we decided to take the highly consistent ZooKeeper to help us.
With the help of ZooKeeper we built a self-orchestrating fault resilient, distributed system that we now can offer as a service for other teams needing to distribute indices.
The content of the talk will be in three parts: - Introducing our system and problem domain of index distribution - How we used to deal with this in the past - Why did we pick ZooKeeper - How do we built our system on top of primitives provided by ZooKeeper using Python.
This talk is more ZooKeeper and system focused than the equivalent in PyCon Finland.
nailor
sansantech
abemii
barometrica
oracle4engineer
nikkei_engineer_recruiting
shift_evolve
lycorp_recruit_jp
kitsuya0828
cmusudakeisuke
atsushii
amixedcolor
paulrobertlloyd
philnash
moore
trishagee
kevinliebholz
productmarketing
destraynor
panda_program
sferik
trallard
lemiorhan
orderedlist
![Thank you @nailor [email protected]](https://files.speakerdeck.com/presentations/fb1e1b5022b101306909123139161ac1/slide_47.jpg){kind=link}