Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ray Community LLM August Meetup

Avatar for Anyscale Anyscale
August 31, 2023
Programming
0
90

Ray Community LLM August Meetup

Introductory remarks, upcoming events, and agenda.
Avatar for Anyscale

Anyscale

August 31, 2023
Tweet

More Decks by Anyscale

See All by Anyscale
Ray in 2023: Ray in Reflection
Avatar for Anyscale anyscale
0
150
Evaluating LLM Applications is hard
Avatar for Anyscale anyscale
0
4.2k
Developing and serving RAG-Based LLM applications in production
Avatar for Anyscale anyscale
0
140
Ray_Essentials__Introduction_to_Ray_for_machine_learning.pdf
Avatar for Anyscale anyscale
0
160
How to build a serverless database cloud service
Avatar for Anyscale anyscale
0
110
Multi-Region/Cloud Ray Pipeline with Distributed Caching ​
Avatar for Anyscale anyscale
0
170
Modern Compute Stack for Scaling Large AI/ML/LLM Workloads
Avatar for Anyscale anyscale
0
110
5 Painful Lessons using LLMs
Avatar for Anyscale anyscale
0
140
How continuous batching enables 23x throughput in LLM inference
Avatar for Anyscale anyscale
0
1.3k

Other Decks in Programming

See All in Programming
Azure AI Foundryではじめてのマルチエージェントワークフロー
Avatar for 瀬尾佳隆 seosoft
0
150
プロダクト志向ってなんなんだろうね
Avatar for RightTouch righttouch
PRO
0
180
datadog dash 2025 LLM observability for reliability and stability
Avatar for 株式会社IVRy（社員登壇資料） ivry_presentationmaterials
0
440
Rubyでやりたい駆動開発 / Ruby driven development
Avatar for chobishiba chobishiba
1
550
AIプログラマーDevinは PHPerの夢を見るか？
Avatar for Shinya Saita shinyasaita
1
190
コードの90%をAIが書く世界で何が待っているのか / What awaits us in a world where 90% of the code is written by AI
Avatar for r-kagaya rkaga
50
32k
Blazing Fast UI Development with Compose Hot Reload (droidcon New York 2025)
Avatar for Márton Braun zsmb
1
280
AWS CDKの推しポイント 〜CloudFormationと比較してみた〜
Avatar for アキキー akihisaikeda
3
320
Goで作る、開発・CI環境
Avatar for Shinpei Mine sin392
0
190
PHPで始める振る舞い駆動開発(Behaviour-Driven Development)
Avatar for uutan1108 ohmori_yusuke
2
250
PHPでWebSocketサーバーを実装しよう2025
Avatar for kubotak kubotak
0
260
AIコーディング道場勉強会#2 君（エンジニア）たちはどう生きるか
Avatar for misaki.otb misakiotb
1
280

Featured

See All Featured
Making the Leap to Tech Lead
Avatar for Ryan Cromwell cromwellryan
134
9.4k
Testing 201, or: Great Expectations
Avatar for Joseph Mastey jmmastey
42
7.6k
Designing for Performance
Avatar for Lara Hogan lara
609
69k
Art, The Web, and Tiny UX
Avatar for Lynn Fisher lynnandtonic
299
21k
Connecting the Dots Between Site Speed, User Experience & Your Business [WebExpo 2025]
Avatar for Tammy Everts tammyeverts
5
240
What's in a price? How to price your products and services
Avatar for Michael Herold michaelherold
246
12k
Fantastic passwords and where to find them - at NoRuKo
Avatar for Phil Nash philnash
51
3.3k
Building Adaptive Systems
Avatar for Chris Keathley keathley
43
2.6k
[RailsConf 2023 Opening Keynote] The Magic of Rails
Avatar for Eileen M. Uchitelle eileencodes
29
9.5k
What’s in a name? Adding method to the madness
Avatar for Product Marketing Alliance productmarketing
PRO
23
3.5k
How To Stay Up To Date on Web Technology
Avatar for Chris Coyier chriscoyier
790
250k
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
Avatar for Eileen M. Uchitelle eileencodes
35
2.4k

Transcript

  1. Welcome to the Bay Area Ray LLMs Community talks August

    29, 2023 Hosted by Jules S. Damji, Ray Advocacy Team @ Anyscale Email: [email protected] X: @2twitme

  2. Agenda: Meetup Talk 0: Announcements & Upcoming events – Jules

    S. Damji, Anyscale • Talk 1: 5 Useful design patterns for production LLM applications –Waleed Kadous, Anyscale • Magician 🎩 🪄🧙 • Talk 2: How continuous batching enables 23x throughput in LLMs inference– Cade Daniels Anyscale • Magician 🎩 🪄🧙 + 🍷 🍻

  3. Ray Summit 2023 - RayJules25 https://raysummit.anyscale.com/

  4. Luminary Featured Speakers ….

  5. 2 days of dedicated LLM tracks sessions

  6. 1 full day of Ray & LLM training sessions TBD

  7. Ray book signing … https://www.anyscale.com/blog

  8. QConSF Ray + LLM Talks

  9. https://www.ray.io/community

  10. None