Jutopia - closing the distance between AI participants

Changqin He
LINE China LINE Service Development Server-side Engineer
https://linedevday.linecorp.com/2020/ja/sessions/9652
https://linedevday.linecorp.com/2020/en/sessions/9652

Transcript

2. Jutopia, ML platform Close the distance between AI participants
3. Agenda › Motivations › What is Jutopia › Components › Status
4. 40% of digital transformation initiatives will use AIML services. AIML spending will grow to $110 billion in 2024. Source: IDC https://www.idc.com/getdoc.jsp?containerId=prUS46794720
5. Machine Learning is Hard! Drinking from a fire hose Supervised/unsupervised/reinforcement learning … Data sourcing, cleanup, tagging & classification Linear/logistic regression, Random forest, Decision tree, … Linear algebra, Statistics, Probability TensorFlow, PyTorch, MXNet, Caffe2, Keras… Python, Julia, R, … Training and evaluating models Distributed training IntelliJ, VSCode, PyCharm, Jupyter notebook Hyperparameter Tuning GPU or CPU MLOps https://happykaty.com/2018/05/15/drinking-from-a-fire-hose/
6. Machine Learning stages Training Test Data Training Data Data ETL Model Deployment Model Serving
7. Contemplations of AI collaboration https://netflixtechblog.com/scheduling-notebooks-348e6c14cfd6
8. Agenda › Motivations › What is Jutopia › Components › Status
9. What is Jutopia? Notebooks Jutopia builds ML pipeline around notebooks to make all stages of ML smoother. You can customize your notebooks and compute resources to suit your data science needs. Multi-framework Jutopia provides support for PyTorch, TF, XGBoost, Keras and other environments. And support you to build a custom ML environment. Model Serving Jutopia is integrated with BentoML, an open-source framework for ML model serving, which package once and deploy anywhere, supporting Docker, K8s, Kuberflow, and more. Jupyter To Pipeline Architecture
10. What is Jutopia? Pipelines Jutopia uses Airflow for deploying and managing ML workflows. A visual pipeline editor to design Airflow DAGs without knowing Python or learning Airflow primitives. Infrastructures Jutopia provides best-of-breed open-source systems as a service for ML, which will be deployed to diverse infrastructures such as Docker, Kubernetes, etc. Open Source Jutopia’s goal is not to rebuild other services, but we will expand open source projects and open source our excellent modules. Jupyter To Pipeline Architecture
11. Architecture & Workflow Data ETL Development Model Training Persistent Storage Record Experiment Sharing Review Scheduling Parametric Notebooks Model Deployment Model Serving Pipeline Persistent Storage Model Serving
12. Agenda › Motivations › What is Jutopia › Components › Status
13. Jutopia Components
14. Jutopia Component-Notebooks Why Jupyter Notebooks? Aggregate Report Build Model Create Dataset Data exploration, Data preparation, Data validation, Productionalization Run code, Explore data, Present results https://netflixtechblog.com/notebook-innovation-591ee3221233
15. Jutopia Component-Notebooks Custom Settings Utilization Monitor Unified Access from Jutopia Portal
16. Jutopia Component-JupyterNBViewer Share Notebooks from Local or S3 Commuter No Web Context Different styles Jupyter_nb_viewer Easy to integrate Line Style https://github.com/line/devday_2020_jupyter_nb_viewer https://github.com/nteract/commuter https://linedevday.linecorp.co/2020/en/sessions/5342
17. Jutopia Component-ReviewNB Notebook Code Reviews Access Control
18. Jutopia Component-Papermill Parameterizing a Notebook Executing a Notebook
19. Jutopia Component-Pipeline Deploy to Airflow View History Push to Git Visual Orchestration
20. Jutopia Component-Airflow Migration from Git Airflow with Kubernetes Executor Log monitoring
21. Jutopia Component-MLflow Experiment on MLflow S3 Persistent Storage
22. Why BentoML for Serving The easiest way to build Machine Learning APIs Core Team Member Features Any ML frameworks Deploy anywhere High-Performance Central hub Modular and flexible https://github.com/bentoml/BentoML
23. Jutopia Component-Serving Auto Serving BentoML Registry Docker Harbor
24. Jutopia Component-Serving BentoML Prediction Service BentoML Pack Manual Serving Service Image YataiService gRPC Server
25. Jutopia Component-Deployment Kubernetes Apply Operator Deployment Management Status Monitor
26. Jutopia Pipeline Workflow
27. Agenda › Motivation › What is Jutopia › Components › Status
28. Who are using Jutopia? LINE Corp LINE Plus Corp LINE China LINE Taiwan LINE Thailand NAVER Organization Statistics
29. Timeline Discover project https://linedevday.linecorp.com/2020/en/sessions/5543
30. Future works Model Deployment API Gateway - A/B test - Multi-armed bandit Distributed training Kuberflow - MPI-job Horovod Hyperparameter tuning Ray Katib
31. Thank you