RODRIGUES

my talk @ python meetup amsterdam Juli 2015

Transcript

1. Text Python Meetup Juli 2015 Gijs Molenaar
2. AMA Gijs Molenaar Scientific Software Engineer Amsterdam & Cape Town LOFAR & MeerKAT
8. Big Big Data LOFAR - 50 GB/s SKA - 10 times global Internet traffic
10. Python Used a lot in (radio) astronomy Lot of scientific & numeric libraries Lot of existing software IPython notebooks Python 2.7
11. Docker ‘Containing’ software Managing containers Connecting containers Deploying containers
13. How we use Docker Containing fragile software Service composition
15. R.O.D.R.I.G.U.E.S. RATT Online Deconvolved Radio Image Generation Using Esoteric Software
16. R.O.D.R.I.G.U.E.S. Django Project Parameterised Docker container scheduler https://github.com/ska-sa/rodrigues
17. work cycle Scientist enters parameters Press enter Computer simulates Visualises Analyse repeat
18. Easy to extend https://github.com/ska-sa/rodrigues/tree/master/ scheduler/forms Compute Container API https://github.com/radio-astro/docker-images/wiki/ simulator_api
20. Inception volumes: - /var/run/docker.pid:/var/run/docker.pid - /var/run/docker.sock:/var/run/docker.sock - /var/lib/docker:/var/lib/docker
21. Conclusions Docker very useful But insecure in multi user environment Layered filesystem gets in the way Docker compose still quite young Going to look at other containers and kubernetes
22. Questions? @gijzelaerr http://pythonic.nl