Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
MLOps Research
Search
Jungwon Seo
January 20, 2021
0
36
MLOps Research
Jungwon Seo
January 20, 2021
Tweet
Share
More Decks by Jungwon Seo
See All by Jungwon Seo
ISI Programming Course - 07 - Tensorflow
codethief
0
82
ISI Programming Course - 06 - Scikit Learn
codethief
0
28
ISI Programming Course - 05 - Python Data Science Libraries
codethief
0
63
ISI Programming Course - 04 - Python
codethief
0
140
ISI Programming Course - 03 - Javascript
codethief
0
83
ISI Programming Course - 02 - CSS
codethief
0
72
ISI Programming Course - 01 - HTML
codethief
0
130
Let's study web-development
codethief
0
51
Featured
See All Featured
The Illustrated Children's Guide to Kubernetes
chrisshort
31
46k
Designing for humans not robots
tammielis
248
25k
Understanding Cognitive Biases in Performance Measurement
bluesmoon
7
1k
Creatively Recalculating Your Daily Design Routine
revolveconf
210
11k
GraphQLとの向き合い方2022年版
quramy
32
12k
Fight the Zombie Pattern Library - RWD Summit 2016
marcelosomers
227
16k
10 Git Anti Patterns You Should be Aware of
lemiorhan
648
58k
Practical Orchestrator
shlominoach
182
9.7k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
25
2.3k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
tammyeverts
14
1.6k
Clear Off the Table
cherdarchuk
84
310k
Making Projects Easy
brettharned
108
5.5k
Transcript
ࢲਗ 2020.01.20 ML Serving Process Ml f l ow, Sagemaker,
Air f l ow ࣗѐ
ݠन۞ ۄੋ Raw data Preprocessing & Feature Engineering Training Store
& Deploy Serve Model
ݠन۞ ۄੋ ੌױ ೡ ࣻ ח ۽ ߓನܳ ೧ࠁ •
ؘఠ ۽٘ ژח ܀݂ • ܻ റ google driveա local diskী • Colab ژח Localীࢲ ݽ؛ স • Grid Search ਊ೧ࢲ ઁੌ જ ݽ؛ • ೠ ݽ؛ weight ч Flaskীࢲ Load೧ࢲ API ഋక۽ Serve
ݠन۞ ۄੋ MLOps ਃࢿ • ۄ݂߰ػ ࢜۽ ؘఠо ࣘਵ۽ ऺੋ.
(: ఋష) • ࢜۽ ؘఠী ݏח ୭ ೞಌ ۄఠо ׳ۄ ࣻ . • ইפݶ ইফ ࢜۽ ݽ؛ ਃೡ ࣻ ب . • ܲ ਗب ઁա ਬ܂ѱ ݽ؛ਸ పझ ೧ࠁҊ र. • ӒܻҊ Ӓ ݽ؛ ߬झݶ ߄۽ ߓನо عਵݶ ೠ. • API ਃ ݆ইઉ ߓನ ࢲߡ ഛࢿ ਃҳ ؼ ࣻ .
ݠन۞ ۄੋ ળ࠺ޛ • ML f l ow • Sagemaker
• Air f l ow
MLflow ള۲җ ݽ؛ /ߓನী ҙৈ • Tensorboard + Github э
ו՝ • Tracking, Project, Model ࣁо ೨ब ӝמ Raw data Preprocessing & Feature Engineering Training Store & Deploy Serve Model
MLflow Tracking • ӝઓী সೞ؍ python٘ী য়ܲଃҗ э ٘ܳ ୶оೞݶ,
ਃೠ ࠁٜਸ ӝ ۾оמ • ݫݽա ੌݺী ೞಌۄఠܳ ॄ ֬ח ೯ਤܳ ೞ ঋইب ؽ!
MLflow Project • ղо স ೞ؍ ٘ܳ যڌѱ ҕਬೞ? թ
সೞ؍ ٘ܳ যڌѱ ج۰ࠁ? • Dockerۢ ಁః ೡ ࣻ ঋਸө?
MLflow Model • ള۲ػ ݽ؛ٜਸ ੜ ܻ೧ ֬Ҋ যڃ Ѫਸ
ߓನೡ ߄۽ Ҋܳ ࣻ ݶ? • ࢲߡ۽ ߓನܳ ೡ ࣻب Ҋ (ই݃ ۄझ), sagemakerী ৢܻח ݺ۸য/٘ ө ઁҕ ml f l ow models serve -m model -p 1234 ml f l ow sagemaker build-and-push-container [OPTIONS]
MLflow ܻ • ۨਸ ҅ਵ۽ ೡ ࣻ . • ഈসਊਵ۽
ࢎਊद, ml f l ow ࢲߡܳ ٮ۽ ৻ࠗী فযࢲ, п ۽ஸജ҃ ژח ܲ ജ҃ ীࢲ ള۲ೠ Ѿҗޛਸ ೠ Ҕীࢲ ҙܻ ೡ ࣻ .
Sagemaker ݽ؛ ള۲ / ࢲࡂী ҙৈ • ە + ߓನࢲߡ
ו՝ • ݽ؛ ߓನद Ҋ۰ࢎ೦ • औѱ ݽ؛ਸ ߸҃ ೡ ࣻ חо? • ߓನࢲߡ ഛࢿ חо? (Vertically, Horizontally) Raw data Preprocessing & Feature Engineering Training Store & Deploy Serve Model
• җ python sdkܳ ࢎਊೞݶ, ٘۽ ߓನ ࢲߡܳ ҳ୷ ೡ
ࣻ Ҋ, Ӕ оמೠ ূ٘ನ ੋө ઁҕػ. Sagemaker Deploy
Sagemaker নೠ ۨਕܳ Sagemakerী ߓನ • ৻ࠗীࢲ ള۲ೠ ݽ؛ਸ s3dp
স۽٘ೞৈ, җ э ݽ؛ ߓನ ߂ ূ٘ನੋ ҳࢿਸ ೡ ࣻ . https://aws.amazon.com/blogs/machine-learning/deploy-trained-keras-or-tensor f l ow-models-using-amazon-sagemaker/ https://sagemaker.readthedocs.io/en/stable/frameworks/pytorch/using_pytorch.html#deploy-pytorch-models
Sagemaker Auto Scailing ਸ ഝਊೠ ഛ • ߓನػ ݽ؛ਸ ݒܻ
ഛ ೡ ࣻب ݅, ইې৬ э ୭ࣗ-୭ ੋझఢझ ѐࣻܳ ҳࢿೞҊ, য়ܲଃ Ӓܿҗ э ౠ (ٜܳয ূ٘ನੋ ഐ ࣻ)ܳ ೞৈ য়షझ ாੌ݂ਸ Ѧয ֬ਸ ࣻ . ੋझఢझ ࠙ ಣӐ ഐ ࣻ
Airflow ਤ җٜਸ ೠߣী ҙܻ • STT ࢲ࠺झܳ ٜ݅Ҋ о,
ࣘ/ӝਵ۽ ݽ؛ਸ ѐࢶೞӝ ਤ೧ࢲח? • ୶оੋ ؘఠ ਊ • ਃद ࢜۽ ܻ ߑध بੑ • ਃद ࢜۽ ݽ؛ بੑ • ߓನ • җਸ ೠߣ ೡ ٸ݃ ੬ਸ ܙ ࣻח হ ঋо? Raw data Preprocessing & Feature Engineering Training Store & Deploy Serve Model
Airflow ਕ ۽ ҙܻ ۖಬ • ೨ब ஶࣆ • DAG(Directed
Acyclic Graph, ߑೱࢿ ࠺ ࢎ Ӓې): taskٜ ઓࢿ ߂ ࣽࢲܳ Ѿ • Preprocessing -> Training - > Deploying • Operator • BashOperator: Bash ݺ۸যܳ ਊ • PythonOperator: Python ٘ܳ ਊ • SagemakerOperator: Sagemaker SDKܳ ਊ • Schedule • ਃद प೯ ژח ӝ प೯ਸ Ѿ • ౠदӝ ড
Airflow ਕ ۽ ҙܻ ۖಬ • য়ܲଃ ٘ח download, train,
serve ࣁо, झయਵ۽ ҳࢿػ DAG • pythonOperatorܳ ࢎਊೞݶ, python ೣࣻܳ ߄۽ ഐ оמ • BashOperatorח Bash ݺ۸যܳ • depends_on_pastח కझ৬ ઙࣘࢿਸ
ܻ • Air f l owܳ ਊ೧ সਸ ઑਯ
ೞҊ • ML f l owܳ ਊ೧ ള۲Ѿҗܳ ҙܻೞݴ ୭Ҋ ݽ؛ਸ Ҋ • ୭Ҋ ݽ؛ਸ Sagemakerী ߓನী ഛࢿਸ ыח ݽ؛ ࢲߡܳ ҳ୷ೠ. • ٸ dockerա s3৬ э ࢲ࠺झ ߂ ࣗਝযܳ ੜ ࢴযݶ ഻ঁ উҊ ഛࢿ ח ۄੋਸ ҳ୷ ೡࣻ .
ؘݽदো
THE END