$30 off During Our Annual Pro Sale. View Details »

Ray Community LLM August Meetup

August 31, 2023

17

Ray Community LLM August Meetup

Introductory remarks, upcoming events, and agenda.

Anyscale
PRO

August 31, 2023

Tweet

More Decks by Anyscale

See All by Anyscale

Ray_Essentials__Introduction_to_Ray_for_machine_learning.pdf

How to build a serverless database cloud service

Multi-Region/Cloud Ray Pipeline with Distributed Caching

Modern Compute Stack for Scaling Large AI/ML/LLM Workloads

5 Painful Lessons using LLMs

How continuous batching enables 23x throughput in LLM inference

Bay Area Ray June Meetup Community Talks

Offline Batch Inference: Comparing Ray, Apache Spark, SageMaker

Streaming distributed execution across. CPUs and GPUs

Other Decks in Programming

See All in Programming

DartによるBFF構築・運用〜 Dart Frog × Melos 〜

Kaggle-Vesuvius-Challenge-Ink-Detection-2nd-Solution

壓力測試大冒險：解鎖應用程式的隱藏性能之謎

Bun がメジャーリリースされたけど、本当にBun はNode.js に取って代わるのか？をAWS Lambda で検証してみた

君たちはどうプログラミングするか

Flutter アプリにおけるテスト戦略の見直しと自動テストの導入

エンジニア秘書が通訳する異文化コミュニケーションのあれこれ / engineer-communication

フロントエンドの書くべきだったテスト、書かなくてよかったテスト

Introducing Kotlin Multiplatform in an existing mobile app - Workshop Edition | DevFest Berlin 23

From Spring Boot 2 to Spring Boot 3 with Java 21 and Jakarta EE

TypeScript_コンパイラの内側に片足を入れる

ChatGPTをソフトウェア開発に活用する

Featured

See All Featured

Design and Strategy: How to Deal with People Who Don’t "Get" Design

Designing for humans not robots

Building Flexible Design Systems

yeseniaperezcruz

Robots, Beer and Maslow

The Cost Of JavaScript in 2023

Designing Dashboards & Data Visualisations in Web Apps

How to Create Impact in a Changing Tech Landscape [PerfNow 2023]

RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub

Adopting Sorbet at Scale

The Brand Is Dead. Long Live the Brand.

XXLCSS - How to scale CSS and keep your sanity

How To Stay Up To Date on Web Technology

Transcript

Welcome to the Bay Area Ray LLMs
Community talks
August 29, 2023
Hosted by Jules S. Damji, Ray Advocacy Team @ Anyscale
Email: [email protected]
X: @2twitme

View Slide
Agenda: Meetup
Talk 0: Announcements & Upcoming events – Jules S. Damji,
Anyscale
● Talk 1: 5 Useful design patterns for production LLM
applications –Waleed Kadous, Anyscale
● Magician 🎩 🪄🧙
● Talk 2: How continuous batching enables 23x throughput in
LLMs inference– Cade Daniels Anyscale
● Magician 🎩 🪄🧙 + 🍷 🍻

View Slide
Ray Summit 2023 - RayJules25
https://raysummit.anyscale.com/

View Slide
Luminary Featured Speakers ….

View Slide
2 days of dedicated LLM tracks sessions

View Slide
1 full day of Ray & LLM training sessions
TBD

View Slide
Ray book signing …
https://www.anyscale.com/blog

View Slide
QConSF Ray + LLM Talks

View Slide
https://www.ray.io/community

View Slide
View Slide