Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Ray Community LLM August Meetup
Search
Anyscale
August 31, 2023
Programming
0
85
Ray Community LLM August Meetup
Introductory remarks, upcoming events, and agenda.
Anyscale
August 31, 2023
Tweet
Share
More Decks by Anyscale
See All by Anyscale
Ray in 2023: Ray in Reflection
anyscale
0
150
Evaluating LLM Applications is hard
anyscale
0
4.2k
Developing and serving RAG-Based LLM applications in production
anyscale
0
140
Ray_Essentials__Introduction_to_Ray_for_machine_learning.pdf
anyscale
0
160
How to build a serverless database cloud service
anyscale
0
110
Multi-Region/Cloud Ray Pipeline with Distributed Caching
anyscale
0
170
Modern Compute Stack for Scaling Large AI/ML/LLM Workloads
anyscale
0
110
5 Painful Lessons using LLMs
anyscale
0
130
How continuous batching enables 23x throughput in LLM inference
anyscale
0
1.3k
Other Decks in Programming
See All in Programming
💎 My RubyKaigi Effect in 2025: Top Ruby Companies 🌐
yasulab
PRO
1
130
がんばりすぎないコーディングルール運用術
tsukakei
1
210
try-catchを使わないエラーハンドリング!? PHPでResult型の考え方を取り入れてみよう
kajitack
3
460
漸進。
ssssota
0
1.7k
Javaに鉄道指向プログラミング (Railway Oriented Pro gramming) のエッセンスを取り入れる/Bringing the Essence of Railway-Oriented Programming to Java
cocet33000
2
500
Devinで実践する!AIエージェントと協働する開発組織の作り方
masahiro_nishimi
6
2.9k
Parallel::Pipesの紹介
skaji
2
900
事業戦略を理解してソフトウェアを設計する
masuda220
PRO
21
5.7k
CSC307 Lecture 17
javiergs
PRO
0
110
単体テストの始め方/作り方
toms74209200
0
380
OpenNext + Hono on Cloudflare でイマドキWeb開発スタックを実現する
rokuosan
0
110
REST API設計の実践 – ベストプラクティスとその落とし穴
kentaroutakeda
2
360
Featured
See All Featured
The Invisible Side of Design
smashingmag
299
50k
What's in a price? How to price your products and services
michaelherold
245
12k
Scaling GitHub
holman
459
140k
Improving Core Web Vitals using Speculation Rules API
sergeychernyshev
15
910
How To Stay Up To Date on Web Technology
chriscoyier
790
250k
The Language of Interfaces
destraynor
158
25k
The Art of Programming - Codeland 2020
erikaheidi
54
13k
A Tale of Four Properties
chriscoyier
159
23k
jQuery: Nuts, Bolts and Bling
dougneiner
63
7.8k
Making the Leap to Tech Lead
cromwellryan
134
9.3k
[RailsConf 2023] Rails as a piece of cake
palkan
55
5.6k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
34
3k
Transcript
Welcome to the Bay Area Ray LLMs Community talks August
29, 2023 Hosted by Jules S. Damji, Ray Advocacy Team @ Anyscale Email:
[email protected]
X: @2twitme
Agenda: Meetup Talk 0: Announcements & Upcoming events – Jules
S. Damji, Anyscale • Talk 1: 5 Useful design patterns for production LLM applications –Waleed Kadous, Anyscale • Magician 🎩 🪄🧙 • Talk 2: How continuous batching enables 23x throughput in LLMs inference– Cade Daniels Anyscale • Magician 🎩 🪄🧙 + 🍷 🍻
Ray Summit 2023 - RayJules25 https://raysummit.anyscale.com/
Luminary Featured Speakers ….
2 days of dedicated LLM tracks sessions
1 full day of Ray & LLM training sessions TBD
Ray book signing … https://www.anyscale.com/blog
QConSF Ray + LLM Talks
https://www.ray.io/community
None