Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
RODRIGUES
Search
Gijs Molenaar
July 16, 2015
Science
0
120
RODRIGUES
my talk @ python meetup amsterdam Juli 2015
Gijs Molenaar
July 16, 2015
Tweet
Share
More Decks by Gijs Molenaar
See All by Gijs Molenaar
Machine Learning and Simulations for Asset Management at Alliander
gijzelaerr
1
91
Easy to deploy and easy to modify data reduction pipelines using KERN and CWL
gijzelaerr
1
74
Research Engineering in Radio Astronomy
gijzelaerr
3
120
The story of CWLifying Apercal
gijzelaerr
0
97
Deep Vacuum Cleaner
gijzelaerr
1
74
EOSC LOFAR pilot final presentation
gijzelaerr
1
160
Software packaging and data pipelines
gijzelaerr
1
160
Docker - 3 years later
gijzelaerr
0
170
Radio astronomy data reduction at PyData Amsterdam
gijzelaerr
3
260
Other Decks in Science
See All in Science
mathematics of indirect reciprocity
yohm
1
200
AI(人工知能)の過去・現在・未来 —AIは人間を超えるのか—
tagtag
0
110
学術講演会中央大学学員会府中支部
tagtag
0
310
データマイニング - コミュニティ発見
trycycle
PRO
0
160
AI(人工知能)の過去・現在・未来 —AIは人間を超えるのか—
tagtag
1
140
ド文系だった私が、 KaggleのNCAAコンペでソロ金取れるまで
wakamatsu_takumu
2
1.4k
「美は世界を救う」を心理学で実証したい~クラファンを通じた新しい研究方法
jimpe_hitsuwari
1
170
A Guide to Academic Writing Using Generative AI - A Workshop
ks91
PRO
0
140
データベース06: SQL (3/3) 副問い合わせ
trycycle
PRO
1
640
データベース12: 正規化(2/2) - データ従属性に基づく正規化
trycycle
PRO
0
980
白金鉱業Meetup_Vol.20 効果検証ことはじめ / Introduction to Impact Evaluation
brainpadpr
1
990
機械学習 - 授業概要
trycycle
PRO
0
250
Featured
See All Featured
Building Applications with DynamoDB
mza
96
6.7k
YesSQL, Process and Tooling at Scale
rocio
173
14k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
eileencodes
140
34k
Raft: Consensus for Rubyists
vanstee
139
7.1k
Making Projects Easy
brettharned
119
6.4k
Done Done
chrislema
185
16k
Designing Dashboards & Data Visualisations in Web Apps
destraynor
231
53k
Scaling GitHub
holman
463
140k
Designing for humans not robots
tammielis
254
26k
A designer walks into a library…
pauljervisheath
209
24k
Building a Modern Day E-commerce SEO Strategy
aleyda
43
7.7k
The Illustrated Children's Guide to Kubernetes
chrisshort
48
51k
Transcript
Text Python Meetup Juli 2015 Gijs Molenaar
AMA Gijs Molenaar Scientific Software Engineer Amsterdam & Cape Town
LOFAR & MeerKAT
None
None
None
None
None
Big Big Data LOFAR - 50 GB/s SKA - 10
times global Internet traffic
None
Python Used a lot in (radio) astronomy Lot of scientific
& numeric libraries Lot of existing software IPython notebooks Python 2.7
Docker ‘Containing’ software Managing containers Connecting containers Deploying containers
None
How we use Docker Containing fragile software Service composition
None
R.O.D.R.I.G.U.E.S. RATT Online Deconvolved Radio Image Generation Using Esoteric Software
R.O.D.R.I.G.U.E.S. Django Project Parameterised Docker container scheduler https://github.com/ska-sa/rodrigues
work cycle Scientist enters parameters Press enter Computer simulates Visualises
Analyse repeat
Easy to extend https://github.com/ska-sa/rodrigues/tree/master/ scheduler/forms Compute Container API https://github.com/radio-astro/docker-images/wiki/ simulator_api
None
Inception volumes: - /var/run/docker.pid:/var/run/docker.pid - /var/run/docker.sock:/var/run/docker.sock - /var/lib/docker:/var/lib/docker
Conclusions Docker very useful But insecure in multi user environment
Layered filesystem gets in the way Docker compose still quite young Going to look at other containers and kubernetes
Questions? @gijzelaerr http://pythonic.nl