Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Practical DevOps for the busy data scientist
Search
Tania Allard
June 27, 2019
Technology
0
350
Practical DevOps for the busy data scientist
Tania Allard
June 27, 2019
Tweet
Share
More Decks by Tania Allard
See All by Tania Allard
The RSE hiring and career progression pipelines: Top tips to navigate them efficiently
trallard
0
150
Mentored Sprints - 2023
trallard
0
150
Mentored Sprints 2022 - kickoff
trallard
3
200
Como participar en el mercado emergente del codigo abierto
trallard
4
210
El presente y futuro del computo cientifico con Python
trallard
0
190
Foss for fun and profit
trallard
3
240
Open source for fun and profit: rethinking the long road of sustainability.
trallard
0
120
Docker and Python: making them play nicely and securely for Ml and DS
trallard
1
540
Python and Docker for ML and Data Science
trallard
1
380
Other Decks in Technology
See All in Technology
The depthes of profiling Ruby - RubyKaigi 2024
osyoyu
0
190
「できる!」を増やすGitHub Copilot活用法 / How to use GitHub Copilot to expand your possibilities
sansan_randd
1
240
YJIT Makes Rails 1.7x faster / RubyKaigi 2024
k0kubun
4
560
Google Cloud Next '24 Recap in ZOZO AIにより変わる開発 運用/Development and operation changed by AI
gachimuchiengineer
0
210
令和版ソフトウェアエンジニアの情報収集術 PHPカンファレンス香川2024
ysknsid25
4
910
TDD - Test Driven Drupal
opdavies
0
3k
スクラムに出会って「できた」を実感できるようになってきた話 / Scrum makes me feel like I can do it
yayoi_dd
2
110
サイボウズ 開発本部採用ピッチ / Cybozu Engineer Recruit
cybozuinsideout
PRO
9
37k
iThome2024 Wailing Wall of Enterprise Security
notsurprised
0
300
TailwindCSSでUIライブラリを作る際のハマりどころ
shuta13
0
230
ハードウェアを動かすTypeScriptの世界
9wick
3
1.2k
Domain-driven Design: A Complete Example
ewolff
2
260
Featured
See All Featured
CSS Pre-Processors: Stylus, Less & Sass
bermonpainter
352
28k
The Success of Rails: Ensuring Growth for the Next 100 Years
eileencodes
34
6.1k
How STYLIGHT went responsive
nonsquared
92
4.9k
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
marktimemedia
20
1.8k
jQuery: Nuts, Bolts and Bling
dougneiner
60
7.2k
Atom: Resistance is Futile
akmur
260
25k
Building Flexible Design Systems
yeseniaperezcruz
320
37k
Fight the Zombie Pattern Library - RWD Summit 2016
marcelosomers
228
16k
How to Ace a Technical Interview
jacobian
273
22k
How To Stay Up To Date on Web Technology
chriscoyier
782
250k
Gamification - CAS2011
davidbonilla
77
4.6k
Fireside Chat
paigeccino
22
2.7k
Transcript
Tania Allard, PhD @ixek Developer Advocate @Microsoft Practical DevOps for
the busy Data Scientist http://bit.ly/MancML-trallard
2 A bit of background never hurt anyone About us
3 @ixek
4 @ixek
5 Top top view… @ixek Stable model/application ready to be
productised R&D - develop, iterate fast, usually local or cloud Magic Is it live??
6 How I would like everything to work…. @ixek It
works…. now send it over to production R&D - develop, iterate fast, usually local or cloud Push code, tag, tag data* Worry free deployment! Wait and relax
7 @ixek
8
9 @ixek DevOps / DataOps / MLOps
10 DevOps is the union of people, process, and products
to enable continuous delivery of value into production What is DevOps anyway? @ixek
11 Sort of DevOps applied to data-intensive applications. Requires close
collaboration between engineers, data scientists, architects, data engineers and Ops. How does it fit for DS? @ixek
12 @ixek Aims to reduce the end-to-end cycle time of
data analytics/science from the origin of ideas to the creation of data artifacts.
13
14
15 7 steps to DS
16 Keep everything in source control - but allow for
experimentation
17
18 Standardize and define your environments in code (conda, pipfiles,
Docker)
19 Use canonical data sources - always know what data
you are using (where it comes and goes)
20
21 Automate wisely
22 https://xkcd.com/1205/
23
24 Use pipelines for repeatability and explainability
25 Deploy portable models
26
27 Test continuously and monitor production: shift left
28
29 Thank you @ixek http://bit.ly/MancML-trallard