Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Ray Community LLM August Meetup
Search
Anyscale
August 31, 2023
Programming
0
110
Ray Community LLM August Meetup
Introductory remarks, upcoming events, and agenda.
Anyscale
August 31, 2023
Tweet
Share
More Decks by Anyscale
See All by Anyscale
Ray in 2023: Ray in Reflection
anyscale
0
180
Evaluating LLM Applications is hard
anyscale
0
4.3k
Developing and serving RAG-Based LLM applications in production
anyscale
0
160
Ray_Essentials__Introduction_to_Ray_for_machine_learning.pdf
anyscale
0
180
How to build a serverless database cloud service
anyscale
0
120
Multi-Region/Cloud Ray Pipeline with Distributed Caching
anyscale
0
200
Modern Compute Stack for Scaling Large AI/ML/LLM Workloads
anyscale
0
120
5 Painful Lessons using LLMs
anyscale
0
150
How continuous batching enables 23x throughput in LLM inference
anyscale
0
1.5k
Other Decks in Programming
See All in Programming
EMこそClaude Codeでコード調査しよう
shibayu36
0
270
What Spring Developers Should Know About Jakarta EE
ivargrimstad
0
350
CSC509 Lecture 06
javiergs
PRO
0
260
20251016_Rails News ~Rails 8.1の足音を聴く~
morimorihoge
2
630
The Past, Present, and Future of Enterprise Java
ivargrimstad
0
350
『毎日の移動』を支えるGoバックエンド内製開発
yutautsugi
2
270
その面倒な作業、「Dart」にやらせませんか? Flutter開発者のための業務効率化
yordgenome03
1
140
Claude CodeによるAI駆動開発の実践 〜そこから見えてきたこれからのプログラミング〜
iriikeita
0
310
チームの境界をブチ抜いていけ
tokai235
0
200
AI駆動で0→1をやって見えた光と伸びしろ
passion0102
1
640
品質ワークショップをやってみた
nealle
0
580
Cursorハンズオン実践!
eltociear
2
1.2k
Featured
See All Featured
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
marcduiker
34
2.3k
The Illustrated Children's Guide to Kubernetes
chrisshort
49
51k
The Straight Up "How To Draw Better" Workshop
denniskardys
238
140k
A designer walks into a library…
pauljervisheath
209
24k
Context Engineering - Making Every Token Count
addyosmani
7
280
Rails Girls Zürich Keynote
gr2m
95
14k
Optimizing for Happiness
mojombo
379
70k
The Language of Interfaces
destraynor
162
25k
Bash Introduction
62gerente
615
210k
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
eileencodes
37
2.6k
GraphQLの誤解/rethinking-graphql
sonatard
73
11k
10 Git Anti Patterns You Should be Aware of
lemiorhan
PRO
657
61k
Transcript
Welcome to the Bay Area Ray LLMs Community talks August
29, 2023 Hosted by Jules S. Damji, Ray Advocacy Team @ Anyscale Email:
[email protected]
X: @2twitme
Agenda: Meetup Talk 0: Announcements & Upcoming events – Jules
S. Damji, Anyscale • Talk 1: 5 Useful design patterns for production LLM applications –Waleed Kadous, Anyscale • Magician 🎩 🪄🧙 • Talk 2: How continuous batching enables 23x throughput in LLMs inference– Cade Daniels Anyscale • Magician 🎩 🪄🧙 + 🍷 🍻
Ray Summit 2023 - RayJules25 https://raysummit.anyscale.com/
Luminary Featured Speakers ….
2 days of dedicated LLM tracks sessions
1 full day of Ray & LLM training sessions TBD
Ray book signing … https://www.anyscale.com/blog
QConSF Ray + LLM Talks
https://www.ray.io/community
None