Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Bay Area Ray June Meetup Community Talks

Bay Area Ray June Meetup Community Talks

Our monthly Ray technical talks. This month we have two Ray committers and a Ray user to share with the community:

* How to use Ray for batch inference at scale, comparing solutions against other alternatives such as Apache Spark and SageMaker.
* How Ray Data streaming can be used to further optimize hardware accelerators (CPUs and GPUs) for parallel pipeline execution.
* How Ray is used at Pinterest for workflow-oriented ML development

Anyscale

June 22, 2023
Tweet

More Decks by Anyscale

Other Decks in Technology

Transcript

  1. Welcome to the Bay Area RAY Community talks June 21,

    2023 Hosted by Jules S. Damji, Ray Advocacy Team @ Anyscale Email: [email protected] Twitter: @2twitme
  2. Agenda: Meetup Talk 0: Announcements, Upcoming events – Jules S.

    Damji, Anyscale Talk 1: Offline batch inference: Comparing Ray, Apache Spark, and SageMaker– Amog Kamsetty, Anyscale Talk 2: Streaming distributed execution across CPUs and GPUs – Eric Liang, Anyscale Talk 3: Workflows to interactive pipelines: How Pinterest plans to improve ML developer velocity with Ray – Se Won Jang, Pinterest
  3. Aviary Explorer powered by Ray Serve 1. Select OSS Model

    2. Supply prompt 3. See the LLM responses aviary.anyscale.com