Upgrade to PRO for Only $50/Year—Limited-Time Offer! 🔥

Ray Community LLM August Meetup

Avatar for Anyscale Anyscale
August 31, 2023
Programming
0
120

Ray Community LLM August Meetup

Introductory remarks, upcoming events, and agenda.

Avatar for Anyscale

Anyscale

August 31, 2023
Tweet

More Decks by Anyscale

See All by Anyscale
Ray in 2023: Ray in Reflection
Avatar for Anyscale anyscale
0
200
Evaluating LLM Applications is hard
Avatar for Anyscale anyscale
0
4.3k
Developing and serving RAG-Based LLM applications in production
Avatar for Anyscale anyscale
0
170
Ray_Essentials__Introduction_to_Ray_for_machine_learning.pdf
Avatar for Anyscale anyscale
0
200
How to build a serverless database cloud service
Avatar for Anyscale anyscale
0
130
Multi-Region/Cloud Ray Pipeline with Distributed Caching ​
Avatar for Anyscale anyscale
0
220
Modern Compute Stack for Scaling Large AI/ML/LLM Workloads
Avatar for Anyscale anyscale
0
130
5 Painful Lessons using LLMs
Avatar for Anyscale anyscale
0
160
How continuous batching enables 23x throughput in LLM inference
Avatar for Anyscale anyscale
0
1.6k

Other Decks in Programming

See All in Programming
Full-Cycle Reactivity in Angular: SignalStore mit Signal Forms und Resources
Avatar for Manfred Steyer manfredsteyer
PRO
0
170
re:Invent 2025 のイケてるサービスを紹介する
Avatar for maroon1st maroon1st
0
150
LLM Çağında Backend Olmak: 10 Milyon Prompt'u Milisaniyede Sorgulamak
Avatar for Selçuk Usta selcukusta
0
130
AtCoder Conference 2025「LLM時代のAHC」
Avatar for Yuki Imajuku imjk
2
580
実は歴史的なアップデートだと思う AWS Interconnect - multicloud
Avatar for maroon1st maroon1st
0
260
ゆくKotlin くるRust
Avatar for TATSUNO Yasuhiro exoego
1
160
AIコーディングエージェント（Gemini）
Avatar for kondai kondai24
0
270
これならできる！個人開発のすゝめ
Avatar for Tsubasa SEKIGUCHI tinykitten
PRO
0
130
Spinner 軸ズレ現象を調べたらレンダリング深淵に飲まれた #レバテックMeetup
Avatar for 弁護士ドットコム bengo4com
0
170
[AtCoder Conference 2025] LLMを使った業務AHCの上⼿な解き⽅
Avatar for terry-u16 terryu16
6
720
著者と進める！『AIと個人開発したくなったらまずCursorで要件定義だ！』
Avatar for yasuna yasunacoffee
0
160
tsgolintはいかにしてtypescript-goの非公開APIを呼び出しているのか
Avatar for syumai syumai
7
2.3k

Featured

See All Featured
Accessibility Awareness
Avatar for Sarah Abderemane sabderemane
0
24
Navigating the moral maze — ethical principles for Al-driven product design
Avatar for Skipper Chong Warson skipperchong
1
210
sira's awesome portfolio website redesign presentation
Avatar for ElsiraPls elsirapls
0
89
The Cult of Friendly URLs
Avatar for Andy Hume andyhume
79
6.7k
Art, The Web, and Tiny UX
Avatar for Lynn Fisher lynnandtonic
304
21k
The Language of Interfaces
Avatar for Des Traynor destraynor
162
25k
Taking LLMs out of the black box: A practical guide to human-in-the-loop distillation
Avatar for Ines Montani inesmontani
PRO
3
2k
Highjacked: Video Game Concept Design
Avatar for Ryan Kendrick rkendrick25
PRO
0
250
Understanding Cognitive Biases in Performance Measurement
Avatar for Philip Tellis bluesmoon
32
2.8k
Producing Creativity
Avatar for Steve Smith orderedlist
PRO
348
40k
Writing Fast Ruby
Avatar for Erik Berlin sferik
630
62k
Building Flexible Design Systems
Avatar for Yesenia Perez-Cruz yeseniaperezcruz
330
39k

Transcript

  1. Welcome to the Bay Area Ray LLMs Community talks August

    29, 2023 Hosted by Jules S. Damji, Ray Advocacy Team @ Anyscale Email: [email protected] X: @2twitme

  2. Agenda: Meetup Talk 0: Announcements & Upcoming events – Jules

    S. Damji, Anyscale • Talk 1: 5 Useful design patterns for production LLM applications –Waleed Kadous, Anyscale • Magician 🎩 🪄🧙 • Talk 2: How continuous batching enables 23x throughput in LLMs inference– Cade Daniels Anyscale • Magician 🎩 🪄🧙 + 🍷 🍻

  3. Ray Summit 2023 - RayJules25 https://raysummit.anyscale.com/

  4. Luminary Featured Speakers ….

  5. 2 days of dedicated LLM tracks sessions

  6. 1 full day of Ray & LLM training sessions TBD

  7. Ray book signing … https://www.anyscale.com/blog

  8. QConSF Ray + LLM Talks

  9. https://www.ray.io/community

  10. None