Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Practical DevOps for the busy data scientist
Search
Tania Allard
June 27, 2019
Technology
0
380
Practical DevOps for the busy data scientist
Tania Allard
June 27, 2019
Tweet
Share
More Decks by Tania Allard
See All by Tania Allard
Keeping Research Software Relevant for Tomorrow
trallard
0
23
2024_pydata_lndn.pdf
trallard
1
270
The RSE hiring and career progression pipelines: Top tips to navigate them efficiently
trallard
0
320
Mentored Sprints - 2023
trallard
0
280
Mentored Sprints 2022 - kickoff
trallard
3
330
Como participar en el mercado emergente del codigo abierto
trallard
4
340
El presente y futuro del computo cientifico con Python
trallard
0
300
Foss for fun and profit
trallard
3
370
Open source for fun and profit: rethinking the long road of sustainability.
trallard
0
220
Other Decks in Technology
See All in Technology
Claude Code でアプリ開発をオートパイロットにするためのTips集 Zennの場合 / Claude Code Tips in Zenn
wadayusuke
5
2.6k
[ JAWS-UG 東京 CommunityBuilders Night #2 ]SlackとAmazon Q Developerで 運用効率化を模索する
sh_fk2
3
460
未経験者・初心者に贈る!40分でわかるAndroidアプリ開発の今と大事なポイント
operando
6
770
使いやすいプラットフォームの作り方 ー LINEヤフーのKubernetes基盤に学ぶ理論と実践
lycorptech_jp
PRO
1
180
Firestore → Spanner 移行 を成功させた段階的移行プロセス
athug
1
510
Oracle Base Database Service 技術詳細
oracle4engineer
PRO
10
75k
Android Audio: Beyond Winning On It
atsushieno
0
3.6k
KotlinConf 2025_イベントレポート
sony
1
140
COVESA VSSによる車両データモデルの標準化とAWS IoT FleetWiseの活用
osawa
1
400
Generative AI Japan 第一回生成AI実践研究会「AI駆動開発の現在地──ブレイクスルーの鍵を握るのはデータ領域」
shisyu_gaku
0
340
開発者を支える Internal Developer Portal のイマとコレカラ / To-day and To-morrow of Internal Developer Portals: Supporting Developers
aoto
PRO
1
480
Django's GeneratedField by example - DjangoCon US 2025
pauloxnet
0
160
Featured
See All Featured
What’s in a name? Adding method to the madness
productmarketing
PRO
23
3.7k
Why Our Code Smells
bkeepers
PRO
339
57k
Dealing with People You Can't Stand - Big Design 2015
cassininazir
367
27k
Testing 201, or: Great Expectations
jmmastey
45
7.7k
The World Runs on Bad Software
bkeepers
PRO
70
11k
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
sstephenson
162
15k
Build your cross-platform service in a week with App Engine
jlugia
231
18k
GraphQLの誤解/rethinking-graphql
sonatard
72
11k
StorybookのUI Testing Handbookを読んだ
zakiyama
31
6.1k
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
marktimemedia
31
2.5k
Art, The Web, and Tiny UX
lynnandtonic
303
21k
Faster Mobile Websites
deanohume
309
31k
Transcript
Tania Allard, PhD @ixek Developer Advocate @Microsoft Practical DevOps for
the busy Data Scientist http://bit.ly/MancML-trallard
2 A bit of background never hurt anyone About us
3 @ixek
4 @ixek
5 Top top view… @ixek Stable model/application ready to be
productised R&D - develop, iterate fast, usually local or cloud Magic Is it live??
6 How I would like everything to work…. @ixek It
works…. now send it over to production R&D - develop, iterate fast, usually local or cloud Push code, tag, tag data* Worry free deployment! Wait and relax
7 @ixek
8
9 @ixek DevOps / DataOps / MLOps
10 DevOps is the union of people, process, and products
to enable continuous delivery of value into production What is DevOps anyway? @ixek
11 Sort of DevOps applied to data-intensive applications. Requires close
collaboration between engineers, data scientists, architects, data engineers and Ops. How does it fit for DS? @ixek
12 @ixek Aims to reduce the end-to-end cycle time of
data analytics/science from the origin of ideas to the creation of data artifacts.
13
14
15 7 steps to DS
16 Keep everything in source control - but allow for
experimentation
17
18 Standardize and define your environments in code (conda, pipfiles,
Docker)
19 Use canonical data sources - always know what data
you are using (where it comes and goes)
20
21 Automate wisely
22 https://xkcd.com/1205/
23
24 Use pipelines for repeatability and explainability
25 Deploy portable models
26
27 Test continuously and monitor production: shift left
28
29 Thank you @ixek http://bit.ly/MancML-trallard