Upgrade to Pro — share decks privately, control downloads, hide ads and more …



my talk @ python meetup amsterdam Juli 2015


Gijs Molenaar

July 16, 2015


  1. Text Python Meetup Juli 2015 Gijs Molenaar

  2. AMA Gijs Molenaar Scientific Software Engineer Amsterdam & Cape Town

    LOFAR & MeerKAT
  3. None
  4. None
  5. None
  6. None
  7. None
  8. Big Big Data LOFAR - 50 GB/s SKA - 10

    times global Internet traffic
  9. None
  10. Python Used a lot in (radio) astronomy Lot of scientific

    & numeric libraries Lot of existing software IPython notebooks Python 2.7
  11. Docker ‘Containing’ software Managing containers Connecting containers Deploying containers

  12. None
  13. How we use Docker Containing fragile software Service composition

  14. None
  15. R.O.D.R.I.G.U.E.S. RATT Online Deconvolved Radio Image Generation Using Esoteric Software

  16. R.O.D.R.I.G.U.E.S. Django Project Parameterised Docker container scheduler https://github.com/ska-sa/rodrigues

  17. work cycle Scientist enters parameters Press enter Computer simulates Visualises

    Analyse repeat
  18. Easy to extend https://github.com/ska-sa/rodrigues/tree/master/ scheduler/forms Compute Container API https://github.com/radio-astro/docker-images/wiki/ simulator_api

  19. None
  20. Inception volumes: - /var/run/docker.pid:/var/run/docker.pid - /var/run/docker.sock:/var/run/docker.sock - /var/lib/docker:/var/lib/docker

  21. Conclusions Docker very useful But insecure in multi user environment

    Layered filesystem gets in the way Docker compose still quite young Going to look at other containers and kubernetes
  22. Questions? @gijzelaerr http://pythonic.nl