Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Practical DevOps for the busy data scientist
Search
Tania Allard
June 27, 2019
Technology
0
370
Practical DevOps for the busy data scientist
Tania Allard
June 27, 2019
Tweet
Share
More Decks by Tania Allard
See All by Tania Allard
2024_pydata_lndn.pdf
trallard
1
220
The RSE hiring and career progression pipelines: Top tips to navigate them efficiently
trallard
0
260
Mentored Sprints - 2023
trallard
0
230
Mentored Sprints 2022 - kickoff
trallard
3
280
Como participar en el mercado emergente del codigo abierto
trallard
4
290
El presente y futuro del computo cientifico con Python
trallard
0
260
Foss for fun and profit
trallard
3
340
Open source for fun and profit: rethinking the long road of sustainability.
trallard
0
190
Docker and Python: making them play nicely and securely for Ml and DS
trallard
1
640
Other Decks in Technology
See All in Technology
オブザーバビリティの観点でみるAWS / AWS from observability perspective
ymotongpoo
8
1.5k
Swiftの “private” を テストする / Testing Swift "private"
yutailang0119
0
130
開発組織のための セキュアコーディング研修の始め方
flatt_security
3
2.3k
人はなぜISUCONに夢中になるのか
kakehashi
PRO
6
1.6k
N=1から解き明かすAWS ソリューションアーキテクトの魅力
kiiwami
0
130
RSNA2024振り返り
nanachi
0
580
ビジネスモデリング道場 目的と背景
masuda220
PRO
9
520
利用終了したドメイン名の最強終活〜観測環境を育てて、分析・供養している件〜 / The Ultimate End-of-Life Preparation for Discontinued Domain Names
nttcom
2
190
表現を育てる
kiyou77
1
210
Developer Summit 2025 [14-D-1] Yuki Hattori
yuhattor
19
6.2k
管理者しか知らないOutlookの裏側のAIを覗く#AzureTravelers
hirotomotaguchi
2
380
次世代KYC活動報告 / 20250219-BizDay17-KYC-nextgen
oidfj
0
250
Featured
See All Featured
YesSQL, Process and Tooling at Scale
rocio
172
14k
A better future with KSS
kneath
238
17k
Fireside Chat
paigeccino
34
3.2k
Java REST API Framework Comparison - PWX 2021
mraible
28
8.4k
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
panda_program
100
18k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
jcasabona
32
2.1k
No one is an island. Learnings from fostering a developers community.
thoeni
21
3.1k
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
addyosmani
4
330
Building Your Own Lightsaber
phodgson
104
6.2k
RailsConf 2023
tenderlove
29
1k
Visualization
eitanlees
146
15k
VelocityConf: Rendering Performance Case Studies
addyosmani
328
24k
Transcript
Tania Allard, PhD @ixek Developer Advocate @Microsoft Practical DevOps for
the busy Data Scientist http://bit.ly/MancML-trallard
2 A bit of background never hurt anyone About us
3 @ixek
4 @ixek
5 Top top view… @ixek Stable model/application ready to be
productised R&D - develop, iterate fast, usually local or cloud Magic Is it live??
6 How I would like everything to work…. @ixek It
works…. now send it over to production R&D - develop, iterate fast, usually local or cloud Push code, tag, tag data* Worry free deployment! Wait and relax
7 @ixek
8
9 @ixek DevOps / DataOps / MLOps
10 DevOps is the union of people, process, and products
to enable continuous delivery of value into production What is DevOps anyway? @ixek
11 Sort of DevOps applied to data-intensive applications. Requires close
collaboration between engineers, data scientists, architects, data engineers and Ops. How does it fit for DS? @ixek
12 @ixek Aims to reduce the end-to-end cycle time of
data analytics/science from the origin of ideas to the creation of data artifacts.
13
14
15 7 steps to DS
16 Keep everything in source control - but allow for
experimentation
17
18 Standardize and define your environments in code (conda, pipfiles,
Docker)
19 Use canonical data sources - always know what data
you are using (where it comes and goes)
20
21 Automate wisely
22 https://xkcd.com/1205/
23
24 Use pipelines for repeatability and explainability
25 Deploy portable models
26
27 Test continuously and monitor production: shift left
28
29 Thank you @ixek http://bit.ly/MancML-trallard