Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Building Distributed System with Celery on Docker Swarm

Wei Lin
September 22, 2016

Building Distributed System with Celery on Docker Swarm

In this talk, the basic mechanisms of Celery and Docker-Swarm will be explained. With Docker-Swarm , a cluster was built upon two Raspberry Pi machines. Hadoop entry-level "Word Count" program could be re-written in Python and executed parallelly via Celery on the cluster. An example of distributed system modeling neural-network will also be explained.

Wei Lin

September 22, 2016
Tweet

Other Decks in Programming

Transcript