Share
Embed
End-To-End MLOps Platform at LINE
Sun Hyeong Hong (LINE Plus / MLU Core TF / Platform Product Manager)
https://tech-verse.me/ja/sessions/49
https://tech-verse.me/en/sessions/49
https://tech-verse.me/ko/sessions/49
Tech-Verse2022
November 17, 2022
Transcript
54 slides
-
Sunhyeong hong (홍선형) What to eat Today MLU Beginner planner
Golf Learning English Travel Platform Product Manager What to drink Today -
Intro Rain Go Out Stay In Too Hot Cable Signal?
Shopping Movie Coffee Shop TV Shows Mode to predict Hong’s Weekend Plan No Yes -
Intro Data sourcing Streaming Sourcing Ingestion Data management Validation Analysis
Segmentation Feature engineering ML-Model development Building Training Evaluation Versioning metadata Application Model deployment Model monitoring Serving API/UI Load balancing Infrastructure Configuration Containerization Logging monitoring CI/CD Pipelines Authentication Hardware/GPUs No. you have to do all this -
Intro These are the skills you need to do ML
Business Programming Statices, ML/AI Communication The business guy The “if” guy The hacker The number cruncher The data translator The ML/AI engineer The perfect Data scientist The salesperson The Data nerd The statistician The Storyteller The good consultant The competence Science professor -
Intro These are the skills you need to do ML
Business Programming Statices, ML/AI Communication Are you okay...? -
Agenda - What is Machine Learning Pipeline? - How to
Build an End-to-End a Machine Learning Pipeline? - Building an End-to-End Pipeline using MLU - Next MLU? -
How to Build an End-to-End a Machine Learning Pipeline? Data
Extraction and Analysis Data Preparation Model Training Model Evaluation and Validation Trained Model Manual experiment steps Offline data Manual ML Pipeline -
How to Build an End-to-End a Machine Learning Pipeline? Data
Extraction and Analysis Data Preparation Model Training Model Evaluation and Validation Model Serving Trained Model Manual experiment steps Offline data Model registry Ops Manual ML Pipeline ML -
How to Build an End-to-End a Machine Learning Pipeline? It's
a new model ML Ops -
How to Build an End-to-End a Machine Learning Pipeline? It's
a new model I checked, but It doesn’t work ML Ops -
How to Build an End-to-End a Machine Learning Pipeline? It's
a new model What? I have no problem I checked, but It doesn’t work ML Ops -
How to Build an End-to-End a Machine Learning Pipeline? It's
a new model What? I have no problem I checked, but It doesn’t work what python do you use? ML Ops -
How to Build an End-to-End a Machine Learning Pipeline? It's
a new model What? I have no problem Ah, My Python version is not compatible , so I uploaded it to 3.8. I checked, but It doesn’t work what python do you use? ML Ops -
How to Build an End-to-End a Machine Learning Pipeline? It's
a new model What? I have no problem Ah, My Python version is not compatible , so I uploaded it to 3.8. I checked, but It doesn’t work what python do you use? Oh… Please send requirements.txt ML Ops -
How to Build an End-to-End a Machine Learning Pipeline? Automation
ML pipeline Data Extraction Data Preparation Model Training Model Evaluation Model Serving Trained Model Code Repository Model registry Model Monitoring Data Validation Model Validation Feature Store Data Analysis And Experimentation Now Code Model registry -
How to Build an End-to-End a Machine Learning Pipeline? Automation
ML pipeline Data Extraction Data Preparation Model Training Model Evaluation Model Serving Trained Model Automated pipeline Code Repository Model registry Model Monitoring Data Validation Model Validation Feature Store Data Analysis And Experimentation Now Code Model registry -
How to Build an End-to-End a Machine Learning Pipeline? Automation
ML pipeline Data Extraction Data Preparation Model Training Model Evaluation Model Serving Trained Model Automated pipeline Code Repository Model registry Model Monitoring Data Validation Model Validation Feature Store Data Analysis And Experimentation Now Code Model registry -
Machine Learning Model Building an End-to-End Pipeline using MLU VOOM
For you recommendation system VOOM public Post Create a recommended candidate group Recommendation candidate data filtering and quality verification Recommendation model Training -
Machine Learning Model Building an End-to-End Pipeline using MLU VOOM
For you recommendation system Create a recommended candidate group Recommendation candidate data filtering and quality verification Recommendation model Training Recommendation model deployment VOOM public Post Recommendation model monitoring -
Machine Learning Model Building an End-to-End Pipeline using MLU VOOM
For you recommendation system Create a recommended candidate group Recommendation candidate data filtering and quality verification Recommendation model Training Recommendation model deployment VOOM public Post User Feedback Recommendation model monitoring -
Building an End-to-End Pipeline using MLU The VOOM recommendation model
process within the MLU architecture Data preprocessing Model training Feature Store Data Interactive Computing Mountable Filesystem Model validation -
Building an End-to-End Pipeline using MLU The VOOM recommendation model
process within the MLU architecture Data preprocessing Model training Feature Store Data Interactive Computing Experiment Management Mountable Filesystem Model validation -
Building an End-to-End Pipeline using MLU The VOOM recommendation model
process within the MLU architecture Data preprocessing Model training Feature Store Data Interactive Computing Experiment Management Mountable Filesystem Model validation Model packaging Model deployment Packaging Management -
Building an End-to-End Pipeline using MLU The VOOM recommendation model
process within the MLU architecture Data preprocessing Model training Feature Store Data Interactive Computing Experiment Management Mountable Filesystem Model validation Model packaging Model deployment Workflow Management Packaging Management -
Building an End-to-End Pipeline using MLU The VOOM recommendation model
process within the MLU architecture Data preprocessing Model training Feature Store Data Interactive Computing Experiment Management Mountable Filesystem Model validation Model packaging Model deployment Workflow Management Packaging Management Model Serving Model Monitoring Serving Management -
Building an End-to-End Pipeline using MLU Improve model performance CTR
25% → 38% (13%↑) Pipeline operation accidents 90%↓ 100%↓ ! 95%↓ ! -
Building an End-to-End Pipeline using MLU MLU Usage Status -
As of October ‘22 Cluster GPU: 504 Cores CPU: 14,886 Cores MEM: 52TB -
Building an End-to-End Pipeline using MLU MLU Usage Status -
As of October ‘22 Cluster GPU: 504 Cores CPU: 14,886 Cores MEM: 52TB User Total Count: 1,111 Company: 33 Team: 386 -
Building an End-to-End Pipeline using MLU MLU Usage Status -
As of October ‘22 Cluster GPU: 504 Cores CPU: 14,886 Cores MEM: 52TB User Total Count: 1,111 Company: 33 Team: 386 Pipeline Pipeline : 300 Serving : 107 -
- Efficient Data management tools - An active community where
everyone can share their knowledge - A Public repository for sharing Models and Datasets Next MLU -
- Efficient Data management tools - An active community where
everyone can share their knowledge - A Public repository for sharing Models and Datasets Next MLU