Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

Ray Community LLM August Meetup

Sponsored · Ship Features Fearlessly Turn features on and off without deploys. Used by thousands of Ruby developers. →
Avatar for Anyscale Anyscale
August 31, 2023
Programming
200
0

Ray Community LLM August Meetup

Introductory remarks, upcoming events, and agenda.

Avatar for Anyscale

Anyscale

August 31, 2023

More Decks by Anyscale

See All by Anyscale
Ray in 2023: Ray in Reflection
Avatar for Anyscale anyscale
0
260
Evaluating LLM Applications is hard
Avatar for Anyscale anyscale
0
4.5k
Developing and serving RAG-Based LLM applications in production
Avatar for Anyscale anyscale
0
250
Ray_Essentials__Introduction_to_Ray_for_machine_learning.pdf
Avatar for Anyscale anyscale
0
280
How to build a serverless database cloud service
Avatar for Anyscale anyscale
0
190
Multi-Region/Cloud Ray Pipeline with Distributed Caching ​
Avatar for Anyscale anyscale
0
330
Modern Compute Stack for Scaling Large AI/ML/LLM Workloads
Avatar for Anyscale anyscale
0
220
5 Painful Lessons using LLMs
Avatar for Anyscale anyscale
0
260
How continuous batching enables 23x throughput in LLM inference
Avatar for Anyscale anyscale
0
2.5k

Other Decks in Programming

See All in Programming
高橋メソッドでCVE解説シリーズ 〜CVE-2026-112816〜
Avatar for Hakkadaikon hakkadaikon
0
170
Performance Optimization With LLMs
Avatar for xLeitix xleitix
0
230
No More NoSuchMethodError
Avatar for TATSUNO Yasuhiro exoego
1
120
AI主導のプログラミング学習アプリを作ってみた
Avatar for econanringo econanringo
0
210
Seven New Principles of Software Engineering
Avatar for Yegor Bugayenko yegor256
0
400
パスワード再設定メールのURLについて知っておこう
Avatar for uyuki uyuki234
0
200
最近”作らせてる” ローカルAIアプリの話
Avatar for ITO Akihiro akit37
0
530
Modernizing iOS Apps
Avatar for seyfeddin seyfoyun
0
140
Vue.jsで作る空間解析アプリとCapacitorプラグインのData Bridge
Avatar for Hal hal_spidernight
1
140
全ての永続トークンを、生まれる前に消し去りたい！
Avatar for sylph01 sylph01
2
1.6k
AI駆動開発4年目の現在地（『あなたはFDEになるべきか？』イベント資料）
Avatar for 熊井悠 kumaiu
0
110
Lambda durable functionsでHuman in the Loopを楽に…楽に……
Avatar for Har1101 har1101
2
240

Featured

See All Featured
The AI Revolution Will Not Be Monopolized: How open-source beats economies of scale, even for LLMs
Avatar for Ines Montani inesmontani
PRO
3
3.8k
What the history of the web can teach us about the future of AI
Avatar for Ines Montani inesmontani
PRO
2
770
GraphQLの誤解/rethinking-graphql
Avatar for sonatard sonatard
75
12k
[RailsConf 2023 Opening Keynote] The Magic of Rails
Avatar for Eileen M. Uchitelle eileencodes
31
10k
Jamie Indigo - Trashchat’s Guide to Black Boxes: Technical SEO Tactics for LLMs
Avatar for Tech SEO Connect techseoconnect
PRO
0
730
Ruling the World: When Life Gets Gamed
Avatar for Sebastian Deterding codingconduct
0
430
brightonSEO & MeasureFest 2025 - Winning Strategies for Black Friday CRO & PPC - Christian Goodrich
Avatar for Christian Goodrich cargoodrich
3
890
Done Done
Avatar for chrislema chrislema
187
17k
Building AI with AI
Avatar for Ines Montani inesmontani
PRO
1
1.3k
Mozcon NYC 2025: Stop Losing SEO Traffic
Avatar for Sam Torres samtorres
1
590
Why Mistakes Are the Best Teachers: Turning Failure into a Pathway for Growth
Avatar for Umar Saidu Auna auna
0
340
Avoiding the “Bad Training, Faster” Trap in the Age of AI
Avatar for Mike Taylor tmiket
0
290

Transcript

  1. Welcome to the Bay Area Ray LLMs Community talks August

    29, 2023 Hosted by Jules S. Damji, Ray Advocacy Team @ Anyscale Email: [email protected] X: @2twitme

  2. Agenda: Meetup Talk 0: Announcements & Upcoming events – Jules

    S. Damji, Anyscale • Talk 1: 5 Useful design patterns for production LLM applications –Waleed Kadous, Anyscale • Magician 🎩 🪄🧙 • Talk 2: How continuous batching enables 23x throughput in LLMs inference– Cade Daniels Anyscale • Magician 🎩 🪄🧙 + 🍷 🍻

  3. Ray Summit 2023 - RayJules25 https://raysummit.anyscale.com/

  4. Luminary Featured Speakers ….

  5. 2 days of dedicated LLM tracks sessions

  6. 1 full day of Ray & LLM training sessions TBD

  7. Ray book signing … https://www.anyscale.com/blog

  8. QConSF Ray + LLM Talks

  9. https://www.ray.io/community

  10. None