Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Speaker Deck
PRO
Sign in
Sign up for free
Practical DevOps for the busy data scientist
Tania Allard
June 27, 2019
Technology
0
300
Practical DevOps for the busy data scientist
Tania Allard
June 27, 2019
Tweet
Share
More Decks by Tania Allard
See All by Tania Allard
Mentored Sprints 2022 - kickoff
trallard
1
36
Como participar en el mercado emergente del codigo abierto
trallard
1
47
El presente y futuro del computo cientifico con Python
trallard
0
28
Foss for fun and profit
trallard
2
110
Open source for fun and profit: rethinking the long road of sustainability.
trallard
0
19
Docker and Python: making them play nicely and securely for Ml and DS
trallard
1
330
Python and Docker for ML and Data Science
trallard
1
200
DevOps for data science: automate the boring stuff and leverage the OSS ecosystem
trallard
3
140
Docker and Python
trallard
27
1.6k
Other Decks in Technology
See All in Technology
IBM Cloud Festa Online 2022 Summer
1ftseabass
PRO
0
200
ログ集約基盤をCloudWatchからOpenSearchに変えてみた
yuhta28
0
140
Microsoft Data Analytics trends : ”Lakehouse” , ”Data Mesh"
ryomaru0825
2
130
〇〇みたいな検索作ってと言われたときに考えること / thinking before developing search system like that one
ryook
5
2.7k
ECS on EC2 で Auto Scaling やってみる!
sayjoy
1
250
Red Hat Enterprise Linux 9のリリースノートを読む前に知りたい最近のキーワードをまとめて復習
moriwaka
0
370
EC/CRMの自社サービス開発をマネジメントするようになって1年でやってきたこととこれから / devio2022-takano-sho-road-to-good-development-team-management
masaru_b_cl
0
430
COSCUP x KCD Taiwan 2020 - 那些年我們在開源社群的日子 - Cloud Native Taiwan
pohsien
0
120
第22回 MLOps 勉強会:みてねのMLOps事情
tonouchi510
1
1k
Amazon Comprehendで始める感情分析
46ta
0
200
金融スタートアップの上場準備で大事にしたマインドセット / 2022-08-04-the-mindset-in-preparing-for-ipo
stajima
0
320
Oracle Cloud Infrastructure:2022年7月度サービス・アップデート
oracle4engineer
PRO
0
200
Featured
See All Featured
What's in a price? How to price your products and services
michaelherold
229
9.4k
ピンチをチャンスに:未来をつくるプロダクトロードマップ #pmconf2020
aki_i
25
15k
CSS Pre-Processors: Stylus, Less & Sass
bermonpainter
349
27k
Principles of Awesome APIs and How to Build Them.
keavy
113
15k
Become a Pro
speakerdeck
PRO
3
910
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
soudai
39
13k
Dealing with People You Can't Stand - Big Design 2015
cassininazir
351
21k
Stop Working from a Prison Cell
hatefulcrawdad
262
17k
Agile that works and the tools we love
rasmusluckow
319
19k
Embracing the Ebb and Flow
colly
73
3.4k
Music & Morning Musume
bryan
35
4.3k
The Language of Interfaces
destraynor
148
21k
Transcript
Tania Allard, PhD @ixek Developer Advocate @Microsoft Practical DevOps for
the busy Data Scientist http://bit.ly/MancML-trallard
2 A bit of background never hurt anyone About us
3 @ixek
4 @ixek
5 Top top view… @ixek Stable model/application ready to be
productised R&D - develop, iterate fast, usually local or cloud Magic Is it live??
6 How I would like everything to work…. @ixek It
works…. now send it over to production R&D - develop, iterate fast, usually local or cloud Push code, tag, tag data* Worry free deployment! Wait and relax
7 @ixek
8
9 @ixek DevOps / DataOps / MLOps
10 DevOps is the union of people, process, and products
to enable continuous delivery of value into production What is DevOps anyway? @ixek
11 Sort of DevOps applied to data-intensive applications. Requires close
collaboration between engineers, data scientists, architects, data engineers and Ops. How does it fit for DS? @ixek
12 @ixek Aims to reduce the end-to-end cycle time of
data analytics/science from the origin of ideas to the creation of data artifacts.
13
14
15 7 steps to DS
16 Keep everything in source control - but allow for
experimentation
17
18 Standardize and define your environments in code (conda, pipfiles,
Docker)
19 Use canonical data sources - always know what data
you are using (where it comes and goes)
20
21 Automate wisely
22 https://xkcd.com/1205/
23
24 Use pipelines for repeatability and explainability
25 Deploy portable models
26
27 Test continuously and monitor production: shift left
28
29 Thank you @ixek http://bit.ly/MancML-trallard