Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Practical DevOps for the busy data scientist
Search
Tania Allard
June 27, 2019
Technology
0
380
Practical DevOps for the busy data scientist
Tania Allard
June 27, 2019
Tweet
Share
More Decks by Tania Allard
See All by Tania Allard
2024_pydata_lndn.pdf
trallard
1
260
The RSE hiring and career progression pipelines: Top tips to navigate them efficiently
trallard
0
300
Mentored Sprints - 2023
trallard
0
260
Mentored Sprints 2022 - kickoff
trallard
3
320
Como participar en el mercado emergente del codigo abierto
trallard
4
320
El presente y futuro del computo cientifico con Python
trallard
0
290
Foss for fun and profit
trallard
3
370
Open source for fun and profit: rethinking the long road of sustainability.
trallard
0
210
Docker and Python: making them play nicely and securely for Ml and DS
trallard
1
670
Other Decks in Technology
See All in Technology
OPENLOGI Company Profile
hr01
0
67k
ビズリーチにおけるリアーキテクティング実践事例 / JJUG CCC 2025 Spring
visional_engineering_and_design
1
130
AIの全社活用を推進するための安全なレールを敷いた話
shoheimitani
2
520
Delegating the chores of authenticating users to Keycloak
ahus1
0
140
NewSQLや分散データベースを支えるRaftの仕組み - 仕組みを理解して知る得意不得意
hacomono
PRO
2
170
AI専用のリンターを作る #yumemi_patch
bengo4com
5
4.3k
改めてAWS WAFを振り返る~業務で使うためのポイント~
masakiokuda
2
260
United Airlines Customer Service– Call 1-833-341-3142 Now!
airhelp
0
170
Sansanのデータプロダクトマネジメントのアプローチ
sansantech
PRO
0
160
OSSのSNSツール「Misskey」をさわってみよう(右下ワイプで私のOSCの20年を振り返ります) / 20250705-osc2025-do
akkiesoft
0
170
スタートアップに選択肢を 〜生成AIを活用したセカンダリー事業への挑戦〜
nstock
0
210
AI時代の開発生産性を加速させるアーキテクチャ設計
plaidtech
PRO
3
160
Featured
See All Featured
Performance Is Good for Brains [We Love Speed 2024]
tammyeverts
10
950
Fight the Zombie Pattern Library - RWD Summit 2016
marcelosomers
233
17k
Practical Tips for Bootstrapping Information Extraction Pipelines
honnibal
PRO
20
1.3k
Faster Mobile Websites
deanohume
307
31k
Into the Great Unknown - MozCon
thekraken
40
1.9k
Code Review Best Practice
trishagee
69
18k
Stop Working from a Prison Cell
hatefulcrawdad
271
21k
Unsuck your backbone
ammeep
671
58k
How To Stay Up To Date on Web Technology
chriscoyier
790
250k
Side Projects
sachag
455
42k
Bash Introduction
62gerente
613
210k
Embracing the Ebb and Flow
colly
86
4.7k
Transcript
Tania Allard, PhD @ixek Developer Advocate @Microsoft Practical DevOps for
the busy Data Scientist http://bit.ly/MancML-trallard
2 A bit of background never hurt anyone About us
3 @ixek
4 @ixek
5 Top top view… @ixek Stable model/application ready to be
productised R&D - develop, iterate fast, usually local or cloud Magic Is it live??
6 How I would like everything to work…. @ixek It
works…. now send it over to production R&D - develop, iterate fast, usually local or cloud Push code, tag, tag data* Worry free deployment! Wait and relax
7 @ixek
8
9 @ixek DevOps / DataOps / MLOps
10 DevOps is the union of people, process, and products
to enable continuous delivery of value into production What is DevOps anyway? @ixek
11 Sort of DevOps applied to data-intensive applications. Requires close
collaboration between engineers, data scientists, architects, data engineers and Ops. How does it fit for DS? @ixek
12 @ixek Aims to reduce the end-to-end cycle time of
data analytics/science from the origin of ideas to the creation of data artifacts.
13
14
15 7 steps to DS
16 Keep everything in source control - but allow for
experimentation
17
18 Standardize and define your environments in code (conda, pipfiles,
Docker)
19 Use canonical data sources - always know what data
you are using (where it comes and goes)
20
21 Automate wisely
22 https://xkcd.com/1205/
23
24 Use pipelines for repeatability and explainability
25 Deploy portable models
26
27 Test continuously and monitor production: shift left
28
29 Thank you @ixek http://bit.ly/MancML-trallard