Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ray Community LLM August Meetup

Avatar for Anyscale Anyscale
August 31, 2023
Programming
0
110

Ray Community LLM August Meetup

Introductory remarks, upcoming events, and agenda.

Avatar for Anyscale

Anyscale

August 31, 2023
Tweet

More Decks by Anyscale

See All by Anyscale
Ray in 2023: Ray in Reflection
Avatar for Anyscale anyscale
0
180
Evaluating LLM Applications is hard
Avatar for Anyscale anyscale
0
4.3k
Developing and serving RAG-Based LLM applications in production
Avatar for Anyscale anyscale
0
160
Ray_Essentials__Introduction_to_Ray_for_machine_learning.pdf
Avatar for Anyscale anyscale
0
190
How to build a serverless database cloud service
Avatar for Anyscale anyscale
0
120
Multi-Region/Cloud Ray Pipeline with Distributed Caching ​
Avatar for Anyscale anyscale
0
200
Modern Compute Stack for Scaling Large AI/ML/LLM Workloads
Avatar for Anyscale anyscale
0
120
5 Painful Lessons using LLMs
Avatar for Anyscale anyscale
0
160
How continuous batching enables 23x throughput in LLM inference
Avatar for Anyscale anyscale
0
1.6k

Other Decks in Programming

See All in Programming
Kotlin + Power-Assert 言語組み込みならではの Assertion Library 採用と運用ベストプラクティス by Kazuki Matsuda/Gen-AX
Avatar for Kazuki MATSUDA / 松田一樹 kazukima
0
110
問題の見方を変える「システム思考」超入門
Avatar for panda_program panda_program
0
200
Private APIの呼び出し方
Avatar for Kishikawa Katsumi kishikawakatsumi
3
880
2026年向け会社紹介資料
Avatar for Yasutaka misu
0
180
PHPライセンス変更の議論を通じて学ぶOSSライセンスの基礎
Avatar for Atsushi Matsuo matsuo_atsushi
0
150
CSC509 Lecture 10
Avatar for Javier Gonzalez-Sanchez javiergs
PRO
0
170
仕様がそのままテストになる！Javaで始める振る舞い駆動開発
Avatar for uutan1108 ohmori_yusuke
8
4.1k
Phronetic Team with AI - Agile Japan 2025 closing
Avatar for Kenji Hiranabe hiranabe
2
590
複数チーム並行開発下でのコード移行アプローチ ~手動 Codemod から「生成AI 活用」への進化
Avatar for ANDPAD inc andpad
0
160
Web エンジニアが JavaScript で AI Agent を作る / JSConf JP 2025 sponsor session
Avatar for Masayuki Izumi izumin5210
4
1.6k
最新のDirectX12で使えるレイトレ周りの機能追加について
Avatar for Pocol projectasura
0
240
自動テストを活かすためのテスト分析・テスト設計の進め方/JaSST25 Shikoku
Avatar for Hiroki Iseri goyoki
3
660

Featured

See All Featured
The Illustrated Children's Guide to Kubernetes
Avatar for Chris Short chrisshort
51
51k
Making Projects Easy
Avatar for Brett Harned brettharned
120
6.5k
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
Avatar for Eileen M. Uchitelle eileencodes
37
2.6k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
Avatar for mongodb mongodb
48
9.8k
The Art of Programming - Codeland 2020
Avatar for Erika Heidi erikaheidi
56
14k
Stop Working from a Prison Cell
Avatar for Chris Michel hatefulcrawdad
272
21k
CSS Pre-Processors: Stylus, Less & Sass
Avatar for Bermon Painter bermonpainter
359
30k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
Avatar for Eileen M. Uchitelle eileencodes
140
34k
Measuring & Analyzing Core Web Vitals
Avatar for Philip Tellis bluesmoon
9
670
Balancing Empowerment & Direction
Avatar for Lara Hogan lara
5
750
Fashionably flexible responsive web design (full day workshop)
Avatar for Andy Clarke malarkey
407
66k
Into the Great Unknown - MozCon
Avatar for Noah Learner thekraken
40
2.2k

Transcript

  1. Welcome to the Bay Area Ray LLMs Community talks August

    29, 2023 Hosted by Jules S. Damji, Ray Advocacy Team @ Anyscale Email: [email protected] X: @2twitme

  2. Agenda: Meetup Talk 0: Announcements & Upcoming events – Jules

    S. Damji, Anyscale • Talk 1: 5 Useful design patterns for production LLM applications –Waleed Kadous, Anyscale • Magician 🎩 🪄🧙 • Talk 2: How continuous batching enables 23x throughput in LLMs inference– Cade Daniels Anyscale • Magician 🎩 🪄🧙 + 🍷 🍻

  3. Ray Summit 2023 - RayJules25 https://raysummit.anyscale.com/

  4. Luminary Featured Speakers ….

  5. 2 days of dedicated LLM tracks sessions

  6. 1 full day of Ray & LLM training sessions TBD

  7. Ray book signing … https://www.anyscale.com/blog

  8. QConSF Ray + LLM Talks

  9. https://www.ray.io/community

  10. None