Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
RODRIGUES
Search
Gijs Molenaar
July 16, 2015
Science
0
120
RODRIGUES
my talk @ python meetup amsterdam Juli 2015
Gijs Molenaar
July 16, 2015
Tweet
Share
More Decks by Gijs Molenaar
See All by Gijs Molenaar
Machine Learning and Simulations for Asset Management at Alliander
gijzelaerr
1
91
Easy to deploy and easy to modify data reduction pipelines using KERN and CWL
gijzelaerr
1
75
Research Engineering in Radio Astronomy
gijzelaerr
3
120
The story of CWLifying Apercal
gijzelaerr
0
97
Deep Vacuum Cleaner
gijzelaerr
1
74
EOSC LOFAR pilot final presentation
gijzelaerr
1
160
Software packaging and data pipelines
gijzelaerr
1
160
Docker - 3 years later
gijzelaerr
0
170
Radio astronomy data reduction at PyData Amsterdam
gijzelaerr
3
260
Other Decks in Science
See All in Science
機械学習 - 決定木からはじめる機械学習
trycycle
PRO
0
1.1k
高校生就活へのDA導入の提案
shunyanoda
0
6k
Hakonwa-Quaternion
hiranabe
1
140
デジタルアーカイブの教育利用促進を目指したメタデータLOD基盤に関する研究 / Research on a Metadata LOD Platform for Promoting Educational Uses of Digital Archives
masao
0
110
CV_5_3dVision
hachama
0
150
06_浅井雄一郎_株式会社浅井農園代表取締役社長_紹介資料.pdf
sip3ristex
0
670
LayerXにおける業務の完全自動運転化に向けたAI技術活用事例 / layerx-ai-jsai2025
shimacos
2
11k
データベース02: データベースの概念
trycycle
PRO
2
920
My Little Monster
juzishuu
0
160
機械学習 - K-means & 階層的クラスタリング
trycycle
PRO
0
1.1k
点群ライブラリPDALをGoogleColabにて実行する方法の紹介
kentaitakura
1
470
2025-06-11-ai_belgium
sofievl
1
170
Featured
See All Featured
Become a Pro
speakerdeck
PRO
29
5.6k
Done Done
chrislema
185
16k
Optimizing for Happiness
mojombo
379
70k
Optimising Largest Contentful Paint
csswizardry
37
3.5k
The Pragmatic Product Professional
lauravandoore
36
7k
Rails Girls Zürich Keynote
gr2m
95
14k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
tammyeverts
55
3k
Build your cross-platform service in a week with App Engine
jlugia
232
18k
Let's Do A Bunch of Simple Stuff to Make Websites Faster
chriscoyier
508
140k
Product Roadmaps are Hard
iamctodd
PRO
55
11k
Bash Introduction
62gerente
615
210k
Principles of Awesome APIs and How to Build Them.
keavy
127
17k
Transcript
Text Python Meetup Juli 2015 Gijs Molenaar
AMA Gijs Molenaar Scientific Software Engineer Amsterdam & Cape Town
LOFAR & MeerKAT
None
None
None
None
None
Big Big Data LOFAR - 50 GB/s SKA - 10
times global Internet traffic
None
Python Used a lot in (radio) astronomy Lot of scientific
& numeric libraries Lot of existing software IPython notebooks Python 2.7
Docker ‘Containing’ software Managing containers Connecting containers Deploying containers
None
How we use Docker Containing fragile software Service composition
None
R.O.D.R.I.G.U.E.S. RATT Online Deconvolved Radio Image Generation Using Esoteric Software
R.O.D.R.I.G.U.E.S. Django Project Parameterised Docker container scheduler https://github.com/ska-sa/rodrigues
work cycle Scientist enters parameters Press enter Computer simulates Visualises
Analyse repeat
Easy to extend https://github.com/ska-sa/rodrigues/tree/master/ scheduler/forms Compute Container API https://github.com/radio-astro/docker-images/wiki/ simulator_api
None
Inception volumes: - /var/run/docker.pid:/var/run/docker.pid - /var/run/docker.sock:/var/run/docker.sock - /var/lib/docker:/var/lib/docker
Conclusions Docker very useful But insecure in multi user environment
Layered filesystem gets in the way Docker compose still quite young Going to look at other containers and kubernetes
Questions? @gijzelaerr http://pythonic.nl