Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
Practical DevOps for the busy data scientist
Search
Tania Allard
June 27, 2019
Technology
430
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
Practical DevOps for the busy data scientist
Tania Allard
June 27, 2019
Transcript
29 slides
Tania Allard, PhD @ixek Developer Advocate @Microsoft Practical DevOps for
the busy Data Scientist http://bit.ly/MancML-trallard
2 A bit of background never hurt anyone About us
3 @ixek
4 @ixek
5 Top top view… @ixek Stable model/application ready to be
productised R&D - develop, iterate fast, usually local or cloud Magic Is it live??
6 How I would like everything to work…. @ixek It
works…. now send it over to production R&D - develop, iterate fast, usually local or cloud Push code, tag, tag data* Worry free deployment! Wait and relax
7 @ixek
8
9 @ixek DevOps / DataOps / MLOps
10 DevOps is the union of people, process, and products
to enable continuous delivery of value into production What is DevOps anyway? @ixek
11 Sort of DevOps applied to data-intensive applications. Requires close
collaboration between engineers, data scientists, architects, data engineers and Ops. How does it fit for DS? @ixek
12 @ixek Aims to reduce the end-to-end cycle time of
data analytics/science from the origin of ideas to the creation of data artifacts.
13
14
15 7 steps to DS
16 Keep everything in source control - but allow for
experimentation
17
18 Standardize and define your environments in code (conda, pipfiles,
Docker)
19 Use canonical data sources - always know what data
you are using (where it comes and goes)
20
21 Automate wisely
22 https://xkcd.com/1205/
23
24 Use pipelines for repeatability and explainability
25 Deploy portable models
26
27 Test continuously and monitor production: shift left
28
29 Thank you @ixek http://bit.ly/MancML-trallard
More Decks by Tania Allard
See All by Tania Allard
Keeping Research Software Relevant for Tomorrow
trallard
0
100
2024_pydata_lndn.pdf
trallard
1
360
The RSE hiring and career progression pipelines: Top tips to navigate them efficiently
trallard
0
430
Mentored Sprints - 2023
trallard
0
360
Mentored Sprints 2022 - kickoff
trallard
3
410
Como participar en el mercado emergente del codigo abierto
trallard
4
420
El presente y futuro del computo cientifico con Python
trallard
0
390
Foss for fun and profit
trallard
3
450
Open source for fun and profit: rethinking the long road of sustainability.
trallard
0
300
Other Decks in Technology
See All in Technology
AWS Client VPNの設定でハマったポイントとその過程での気づき
amarelo_n24
0
310
高品質と高スピードを支える品質のシフトレフトのアプローチ
goyoki
4
1.6k
Oracle Base Database Service 技術詳細
oracle4engineer
PRO
17
120k
閉域網でのAPI公開の選択肢全部比較!
takano0131
2
470
Re:ゼロから始めるシェアハウスのペットな鯖
silmin_
0
240
Context parameters で作る!はじめての型クラス
kworkdev
PRO
1
150
少ない人手 限られた予算 それでも守る 消せない・見つける・戻れる オールハザード型BCP on AWS / 20261107 Mitsutoshi Matsuo
shift_evolve
PRO
0
410
[NW-JAWS DAY]「うちのAWS、インターネット出られないんで」― AWS外の自社サービスをPrivateLinkでシュッと公開する方法
ykimi
2
770
ぼくのClaude Codeの使い方
falken
PRO
5
7.5k
小さなエージェントから始めてみよう!実践コンテキストエンジニアリング
iwamot
PRO
0
130
gem install とrequire のむこうがわ
ydah
0
150
SORACOM × AWS IoT Core でSREする
butadora
0
110
Featured
See All Featured
Designing Experiences People Love
moore
143
24k
First, design no harm
axbom
PRO
2
1.4k
Side Projects
sachag
456
43k
GitHub's CSS Performance
jonrohan
1033
470k
How To Speak Unicorn (iThemes Webinar)
marktimemedia
1
640
Bridging the Design Gap: How Collaborative Modelling removes blockers to flow between stakeholders and teams @FastFlow conf
baasie
0
770
Lightning Talk: Beautiful Slides for Beginners
inesmontani
PRO
2
840
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
35
3.9k
How to Grow Your eCommerce with AI & Automation
katarinadahlin
PRO
2
350
How Fast Is Fast Enough? [PerfNow 2025]
tammyeverts
3
980
The Limits of Empathy - UXLibs8
cassininazir
2
790
Highjacked: Video Game Concept Design
rkendrick25
PRO
2
580