Bay Area Ray June Meetup Community Talks

Our monthly Ray technical talks. This month we have two Ray committers and a Ray user to share with the community:

* How to use Ray for batch inference at scale, comparing solutions against other alternatives such as Apache Spark and SageMaker.
* How Ray Data streaming can be used to further optimize hardware accelerators (CPUs and GPUs) for parallel pipeline execution.
* How Ray is used at Pinterest for workflow-oriented ML development

Transcript

1. Welcome to the Bay Area RAY
   Community talks
   June 21, 2023
   Hosted by Jules S. Damji, Ray Advocacy Team @ Anyscale
   Email: jules@anyscale.com
   Twitter: @2twitme
   

   View Slide

2. Agenda: Meetup
   Talk 0: Announcements, Upcoming events – Jules S. Damji, Anyscale
   Talk 1: Offline batch inference: Comparing Ray, Apache Spark, and
   SageMaker– Amog Kamsetty, Anyscale
   Talk 2: Streaming distributed execution across CPUs and GPUs – Eric
   Liang, Anyscale
   Talk 3: Workflows to interactive pipelines: How Pinterest plans to
   improve ML developer velocity with Ray – Se Won Jang, Pinterest
   

   View Slide

3. Ray 2.5 Released
   

   View Slide

4. Aviary Explorer powered by Ray Serve
   1. Select OSS
   Model
   2. Supply
   prompt
   3. See the LLM
   responses
   aviary.anyscale.com
   

   View Slide

5. LLM Meetup at Anyscale HQ
   https://bit.ly/42Ll3cQ
   

   View Slide

6. Ray Summit 2023 - Early Bird Registration
   https://raysummit.anyscale.com/
   

   View Slide

7. Luminary Keynote Speakers ….
   

   View Slide

8. Ray books …
   https://www.anyscale.com/blog
   

   View Slide

9. https://www.ray.io/community
   

   View Slide

10. View Slide