Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Practical DevOps for the busy data scientist
Search
Tania Allard
June 27, 2019
Technology
0
370
Practical DevOps for the busy data scientist
Tania Allard
June 27, 2019
Tweet
Share
More Decks by Tania Allard
See All by Tania Allard
2024_pydata_lndn.pdf
trallard
1
220
The RSE hiring and career progression pipelines: Top tips to navigate them efficiently
trallard
0
260
Mentored Sprints - 2023
trallard
0
230
Mentored Sprints 2022 - kickoff
trallard
3
280
Como participar en el mercado emergente del codigo abierto
trallard
4
300
El presente y futuro del computo cientifico con Python
trallard
0
260
Foss for fun and profit
trallard
3
340
Open source for fun and profit: rethinking the long road of sustainability.
trallard
0
190
Docker and Python: making them play nicely and securely for Ml and DS
trallard
1
640
Other Decks in Technology
See All in Technology
コンピュータビジョンの社会実装について考えていたらゲームを作っていた話
takmin
1
340
滅・サービスクラス🔥 / Destruction Service Class
sinsoku
6
1.6k
エンジニアが加速させるプロダクトディスカバリー 〜最速で価値ある機能を見つける方法〜 / product discovery accelerated by engineers
rince
4
450
ハッキングの世界に迫る~攻撃者の思考で考えるセキュリティ~
nomizone
13
5.3k
PHPで印刷所に入稿できる名札データを作る / Generating Print-Ready Name Tag Data with PHP
tomzoh
0
130
Helm , Kustomize に代わる !? 次世代 k8s パッケージマネージャー Glasskube 入門 / glasskube-entry
parupappa2929
0
260
Developers Summit 2025 浅野卓也(13-B-7 LegalOn Technologies)
legalontechnologies
PRO
1
1.1k
ローカルLLMを活用したコード生成と、ローコード開発ツールへの応用
kazuhitoyokoi
0
100
分解して理解する Aspire
nenonaninu
1
400
Amazon S3 Tablesと外部分析基盤連携について / Amazon S3 Tables and External Data Analytics Platform
nttcom
0
140
Windows の新しい管理者保護モード
murachiakira
0
130
CZII - CryoET Object Identification 参加振り返り・解法共有
tattaka
0
410
Featured
See All Featured
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
jcasabona
32
2.1k
For a Future-Friendly Web
brad_frost
176
9.5k
Designing Experiences People Love
moore
140
23k
Mobile First: as difficult as doing things right
swwweet
223
9.3k
Speed Design
sergeychernyshev
27
800
Fireside Chat
paigeccino
34
3.2k
How to train your dragon (web standard)
notwaldorf
91
5.8k
GitHub's CSS Performance
jonrohan
1030
460k
Build The Right Thing And Hit Your Dates
maggiecrowley
34
2.5k
ピンチをチャンスに:未来をつくるプロダクトロードマップ #pmconf2020
aki_iinuma
114
50k
Save Time (by Creating Custom Rails Generators)
garrettdimon
PRO
29
1k
What's in a price? How to price your products and services
michaelherold
244
12k
Transcript
Tania Allard, PhD @ixek Developer Advocate @Microsoft Practical DevOps for
the busy Data Scientist http://bit.ly/MancML-trallard
2 A bit of background never hurt anyone About us
3 @ixek
4 @ixek
5 Top top view… @ixek Stable model/application ready to be
productised R&D - develop, iterate fast, usually local or cloud Magic Is it live??
6 How I would like everything to work…. @ixek It
works…. now send it over to production R&D - develop, iterate fast, usually local or cloud Push code, tag, tag data* Worry free deployment! Wait and relax
7 @ixek
8
9 @ixek DevOps / DataOps / MLOps
10 DevOps is the union of people, process, and products
to enable continuous delivery of value into production What is DevOps anyway? @ixek
11 Sort of DevOps applied to data-intensive applications. Requires close
collaboration between engineers, data scientists, architects, data engineers and Ops. How does it fit for DS? @ixek
12 @ixek Aims to reduce the end-to-end cycle time of
data analytics/science from the origin of ideas to the creation of data artifacts.
13
14
15 7 steps to DS
16 Keep everything in source control - but allow for
experimentation
17
18 Standardize and define your environments in code (conda, pipfiles,
Docker)
19 Use canonical data sources - always know what data
you are using (where it comes and goes)
20
21 Automate wisely
22 https://xkcd.com/1205/
23
24 Use pipelines for repeatability and explainability
25 Deploy portable models
26
27 Test continuously and monitor production: shift left
28
29 Thank you @ixek http://bit.ly/MancML-trallard