Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Anyscale Demo: Machine Learning Application from Dev to Prod (Edward Oakes, Anyscale)

Anyscale Demo: Machine Learning Application from Dev to Prod (Edward Oakes, Anyscale)

Edward Oakes, Anyscale Software Engineer, presents the "Anyscale Demo: Machine Learning Application from Dev to Prod".
This demo shows the full machine learning-based application lifecycle on Anyscale. You’ll see how Anyscale makes it seamless both to go from developing on your laptop to running on a cluster and to transition from development to serving in production.

Anyscale

July 14, 2021
Tweet

More Decks by Anyscale

Other Decks in Technology

Transcript

  1. Web Server Model A User Request Model B Per-user State

    Recommendations Custom Service What does it take to build this?
  2. Web Server Model A User Request Model B Per-user State

    Recommendations Periodic Retrainer Deploy New Models User Data Custom Service Custom Service What does it take to build this?
  3. Recs User Request Per-user State Custom Service Web Server User

    Data Model A Model B Production Serving What does it take to build this? Deploy New Models Periodic Retrainer Custom Service
  4. Deploy New Models Parallel Python Processing DB What does it

    take to build this? Recs User Request Per-user State Custom Service Web Server User Data Model A Model B Production Serving Recs Periodic Retrainer Custom Service
  5. Periodic Retrainer Custom Service User Data Deploy New Models Parallel

    Python Processing ML Training/HPO DB What does it take to build this? Recs User Request Per-user State Custom Service Web Server Model A Model B Production Serving
  6. Periodic Retrainer Deploy New Models Parallel Python Processing ML Training/HPO

    What does it take to build this? DB Recs User Request Per-user State Custom Service Web Server User Data Model A Model B Custom Service Production Serving
  7. Distributed computing made simple with Ray & Anyscale Ray Universal

    Distributed Computing API Anyscale Laptop experience with the power of the cloud
  8. Recs Parallel Python Processing ML Training/HPO How can we build

    it with Ray + Anyscale? DB User Request Per-user State Custom Service Periodic Retrainer Web Server User Data Model A Model B Custom Service Production Serving Deploy New Models Ray: Universal Distributed Computing API
  9. Recs Parallel Python Processing ML Training/HPO DB How can we

    build it with Ray + Anyscale? User Request Per-user State Custom Service Periodic Retrainer Web Server User Data Model A Model B Custom Service Production Serving Deploy New Models Ray: Universal Distributed Computing API
  10. Parallel Python Processing ML Training/HPO DB How can we build

    it with Ray + Anyscale? Recs User Request Per-user State Custom Service Periodic Retrainer Web Server User Data Model A Model B Custom Service Production Serving Deploy New Models Ray: Universal Distributed Computing API
  11. Recs User Request Per-user State Periodic Retrainer User Data Model

    A Model B Parallel Python Processing ML Training/HPO DB Production Serving How can we build it with Ray + Anyscale? Deploy New Models Custom Service Custom Service Ray: Universal Distributed Computing API
  12. How can we build it with Ray + Anyscale? Recs

    User Request Per-user State Periodic Retrainer User Data Model A Model B Parallel Python Processing ML Training/HPO DB Production Serving Deploy New Models Ray Actor Ray Actor Ray: Universal Distributed Computing API
  13. Parallel Python Processing ML Training/HPO DB Anyscale: Multi-Cloud Native, Universal

    Computing Platform Recs User Request Per-user State Ray Actor Periodic Retrainer User Data Model A Model B Ray Actor Production Serving Deploy New Models Ray: Universal Distributed Computing API
  14. Per-user State Model A Recs User Request Ray Actor Redeploy

    Model Periodic Retrainer User Data Model B Ray Actor Parallel Python Processing ML Training/HPO DB Production Serving Anyscale: Multi-Cloud Native, Universal Computing Platform Ray: Universal Distributed Computing API
  15. First Model: Cover Image Similarity KNN Search A movie you

    liked Movies with similar colors FAISS
  16. Model A Recs User Request Per-user State Ray Actor Redeploy

    Model Periodic Retrainer User Data Model B Ray Actor Parallel Python Processing ML Training/HPO DB Production Serving Anyscale: Multi-Cloud Native, Universal Computing Platform Ray: Universal Distributed Computing API
  17. Second Model: Plot Similarity using NLP KNN Search A movie

    you liked Movies with similar plots BERT
  18. Second Model: Plot Similarity using NLP KNN Search A movie

    you liked Movies with similar plots BERT Ranking Model 1. 2. 3.
  19. Parallel Python Processing ML Training/HPO DB Recs User Request Per-user

    State Ray Actor Periodic Retrainer User Data Model A Model B Ray Actor Production Serving Deploy New Models Anyscale: Multi-Cloud Native, Universal Computing Platform Ray: Universal Distributed Computing API
  20. Dynamic Model Selection DB Get Recommendations BERT Plot Model Periodic

    Retrainer Per-user State Deploy New Models User Click Data Fine-tuned Embeddings Color Palettes Movie Cover Model
  21. Dynamic Model Selection DB Get Recommendations BERT Plot Model Periodic

    Retrainer Per-user State User Click Data Fine-tuned Embeddings Color Palettes Movie Cover Model Deploy New Models
  22. Dynamic Model Selection DB Get Recommendations BERT Plot Model Periodic

    Retrainer Per-user State User Click Data Fine-tuned Embeddings Color Palettes Movie Cover Model Deploy New Models
  23. Dynamic Model Selection DB HTTP API for Recommendations BERT Plot

    Model Per-user State Movie Info, Fine-tuned Embeddings Movie Info Random Model
  24. Parallel Python Processing ML Training/HPO DB Recs User Request Per-user

    State Ray Actor Periodic Retrainer User Data Model A Model B Ray Actor Production Serving Deploy New Models Anyscale: Multi-Cloud Native, Universal Computing Platform Ray: Universal Distributed Computing API
  25. Thanks for listening! 48 • Visit anyscale.com to sign up

    for the private beta! • Get in touch on the #4-anyscale channel on the Ray Summit slack. • Swing by our Office Hours at 10:55AM on Wednesday or 10:40AM Thursday.