Upgrade to Pro — share decks privately, control downloads, hide ads and more …

End-To-End MLOps Platform at LINE

End-To-End MLOps Platform at LINE

Sun Hyeong Hong (LINE Plus / MLU Core TF / Platform Product Manager)

https://tech-verse.me/ja/sessions/49
https://tech-verse.me/en/sessions/49
https://tech-verse.me/ko/sessions/49

Tech-Verse2022

November 17, 2022
Tweet

More Decks by Tech-Verse2022

Other Decks in Technology

Transcript

  1. Sunhyeong hong (홍선형) What to eat Today MLU Beginner planner

    Golf Learning English Travel Platform Product Manager What to drink Today
  2. Intro Rain Go Out Stay In Too Hot Cable Signal?

    Shopping Movie Coffee Shop TV Shows Mode to predict Hong’s Weekend Plan No Yes
  3. Intro Data sourcing Streaming Sourcing Ingestion Data management Validation Analysis

    Segmentation Feature engineering ML-Model development Building Training Evaluation Versioning metadata Application Model deployment Model monitoring Serving API/UI Load balancing Infrastructure Configuration Containerization Logging monitoring CI/CD Pipelines Authentication Hardware/GPUs No. you have to do all this
  4. Intro These are the skills you need to do ML

    Business Programming Statices, ML/AI Communication The business guy The “if” guy The hacker The number cruncher The data translator The ML/AI engineer The perfect Data scientist The salesperson The Data nerd The statistician The Storyteller The good consultant The competence Science professor
  5. Intro These are the skills you need to do ML

    Business Programming Statices, ML/AI Communication Are you okay...?
  6. Agenda - What is Machine Learning Pipeline? - How to

    Build an End-to-End a Machine Learning Pipeline? - Building an End-to-End Pipeline using MLU - Next MLU?
  7. How to Build an End-to-End a Machine Learning Pipeline? Data

    Extraction and Analysis Data Preparation Model Training Model Evaluation and Validation Trained Model Manual experiment steps Offline data Manual ML Pipeline
  8. How to Build an End-to-End a Machine Learning Pipeline? Data

    Extraction and Analysis Data Preparation Model Training Model Evaluation and Validation Model Serving Trained Model Manual experiment steps Offline data Model registry Ops Manual ML Pipeline ML
  9. How to Build an End-to-End a Machine Learning Pipeline? It's

    a new model I checked, but It doesn’t work ML Ops
  10. How to Build an End-to-End a Machine Learning Pipeline? It's

    a new model What? I have no problem I checked, but It doesn’t work ML Ops
  11. How to Build an End-to-End a Machine Learning Pipeline? It's

    a new model What? I have no problem I checked, but It doesn’t work what python do you use? ML Ops
  12. How to Build an End-to-End a Machine Learning Pipeline? It's

    a new model What? I have no problem Ah, My Python version is not compatible , so I uploaded it to 3.8. I checked, but It doesn’t work what python do you use? ML Ops
  13. How to Build an End-to-End a Machine Learning Pipeline? It's

    a new model What? I have no problem Ah, My Python version is not compatible , so I uploaded it to 3.8. I checked, but It doesn’t work what python do you use? Oh… Please send requirements.txt ML Ops
  14. How to Build an End-to-End a Machine Learning Pipeline? Automation

    ML pipeline Data Extraction Data Preparation Model Training Model Evaluation Model Serving Trained Model Code Repository Model registry Model Monitoring Data Validation Model Validation Feature Store Data Analysis And Experimentation Now Code Model registry
  15. How to Build an End-to-End a Machine Learning Pipeline? Automation

    ML pipeline Data Extraction Data Preparation Model Training Model Evaluation Model Serving Trained Model Automated pipeline Code Repository Model registry Model Monitoring Data Validation Model Validation Feature Store Data Analysis And Experimentation Now Code Model registry
  16. How to Build an End-to-End a Machine Learning Pipeline? Automation

    ML pipeline Data Extraction Data Preparation Model Training Model Evaluation Model Serving Trained Model Automated pipeline Code Repository Model registry Model Monitoring Data Validation Model Validation Feature Store Data Analysis And Experimentation Now Code Model registry
  17. Machine Learning Model Building an End-to-End Pipeline using MLU VOOM

    For you recommendation system VOOM public Post Create a recommended candidate group Recommendation candidate data filtering and quality verification Recommendation model Training
  18. Machine Learning Model Building an End-to-End Pipeline using MLU VOOM

    For you recommendation system Create a recommended candidate group Recommendation candidate data filtering and quality verification Recommendation model Training Recommendation model deployment VOOM public Post Recommendation model monitoring
  19. Machine Learning Model Building an End-to-End Pipeline using MLU VOOM

    For you recommendation system Create a recommended candidate group Recommendation candidate data filtering and quality verification Recommendation model Training Recommendation model deployment VOOM public Post User Feedback Recommendation model monitoring
  20. MLU

  21. Building an End-to-End Pipeline using MLU The VOOM recommendation model

    process within the MLU architecture Data preprocessing Model training Feature Store Data Interactive Computing Mountable Filesystem Model validation
  22. Building an End-to-End Pipeline using MLU The VOOM recommendation model

    process within the MLU architecture Data preprocessing Model training Feature Store Data Interactive Computing Experiment Management Mountable Filesystem Model validation
  23. Building an End-to-End Pipeline using MLU The VOOM recommendation model

    process within the MLU architecture Data preprocessing Model training Feature Store Data Interactive Computing Experiment Management Mountable Filesystem Model validation Model packaging Model deployment Packaging Management
  24. Building an End-to-End Pipeline using MLU The VOOM recommendation model

    process within the MLU architecture Data preprocessing Model training Feature Store Data Interactive Computing Experiment Management Mountable Filesystem Model validation Model packaging Model deployment Workflow Management Packaging Management
  25. Building an End-to-End Pipeline using MLU The VOOM recommendation model

    process within the MLU architecture Data preprocessing Model training Feature Store Data Interactive Computing Experiment Management Mountable Filesystem Model validation Model packaging Model deployment Workflow Management Packaging Management Model Serving Model Monitoring Serving Management
  26. Building an End-to-End Pipeline using MLU Improve model performance CTR

    25% → 38% (13%↑) Pipeline operation accidents 90%↓ 100%↓ ! 95%↓ !
  27. Building an End-to-End Pipeline using MLU MLU Usage Status -

    As of October ‘22 Cluster GPU: 504 Cores CPU: 14,886 Cores MEM: 52TB
  28. Building an End-to-End Pipeline using MLU MLU Usage Status -

    As of October ‘22 Cluster GPU: 504 Cores CPU: 14,886 Cores MEM: 52TB User Total Count: 1,111 Company: 33 Team: 386
  29. Building an End-to-End Pipeline using MLU MLU Usage Status -

    As of October ‘22 Cluster GPU: 504 Cores CPU: 14,886 Cores MEM: 52TB User Total Count: 1,111 Company: 33 Team: 386 Pipeline Pipeline : 300 Serving : 107
  30. - Efficient Data management tools - An active community where

    everyone can share their knowledge - A Public repository for sharing Models and Datasets Next MLU
  31. - Efficient Data management tools - An active community where

    everyone can share their knowledge - A Public repository for sharing Models and Datasets Next MLU