Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ray Community LLM August Meetup

Avatar for Anyscale Anyscale
August 31, 2023
Programming
0
130

Ray Community LLM August Meetup

Introductory remarks, upcoming events, and agenda.

Avatar for Anyscale

Anyscale

August 31, 2023
Tweet

More Decks by Anyscale

See All by Anyscale
Ray in 2023: Ray in Reflection
Avatar for Anyscale anyscale
0
200
Evaluating LLM Applications is hard
Avatar for Anyscale anyscale
0
4.3k
Developing and serving RAG-Based LLM applications in production
Avatar for Anyscale anyscale
0
170
Ray_Essentials__Introduction_to_Ray_for_machine_learning.pdf
Avatar for Anyscale anyscale
0
200
How to build a serverless database cloud service
Avatar for Anyscale anyscale
0
130
Multi-Region/Cloud Ray Pipeline with Distributed Caching ​
Avatar for Anyscale anyscale
0
220
Modern Compute Stack for Scaling Large AI/ML/LLM Workloads
Avatar for Anyscale anyscale
0
130
5 Painful Lessons using LLMs
Avatar for Anyscale anyscale
0
170
How continuous batching enables 23x throughput in LLM inference
Avatar for Anyscale anyscale
0
1.6k

Other Decks in Programming

See All in Programming
責任感のあるCloudWatchアラームを設計しよう
Avatar for アキキー akihisaikeda
3
120
DevFest Android in Korea 2025 - 개발자 커뮤니티를 통해 얻는 가치
Avatar for Suhyeon Kim wisemuji
0
190
フルサイクルエンジニアリングをAI Agentで全自動化したい 〜構想と現在地〜
Avatar for Kaito Minatoya kamina_zzz
0
370
Basic Architectures
Avatar for Denys Poltorak denyspoltorak
0
500
疑似コードによるプロンプト記述、どのくらい正確に実行される？
Avatar for kokuyouwind kokuyouwind
0
310
AI 駆動開発ライフサイクル(AI-DLC):ソフトウェアエンジニアリングの再構築 / AI-DLC Introduction
Avatar for kanamsasa kanamasa
11
5.7k
カスタマーサクセス業務を変革したヘルススコアの実現と学び
Avatar for Tomoyuki Hamaguchi _hummer0724
0
100
IFSによる形状設計／デモシーンの魅力 @ 慶應大学SFC
Avatar for がむ gam0022
0
240
OSSとなったswift-buildで Xcodeのビルドを差し替えられるため 自分でXcodeを直せる時代になっている ダイアモンド問題編
Avatar for yimajo yimajo
2
360
PostgreSQLで手軽にDuckDBを使う！DuckDB&pg_duckdb入門/osc25hi-duckdb
Avatar for Takahashi Ikki takahashiikki
0
260
高速開発のためのコード整理術
Avatar for sutetotanuki sutetotanuki
1
280
.NET Conf 2025 の興味のあるセッ ションを復習した / dotnet conf 2025 quick recap for backend engineer
Avatar for Tomohisa Takaoka tomohisa
0
120

Featured

See All Featured
Unlocking the hidden potential of vector embeddings in international SEO
Avatar for Frank van Dijk frankvandijk
0
160
30 Presentation Tips
Avatar for Ian Lurie portentint
PRO
1
190
Leveraging Curiosity to Care for An Aging Population
Avatar for Cassini Nazir cassininazir
1
150
brightonSEO & MeasureFest 2025 - Christian Goodrich - Winning strategies for Black Friday CRO & PPC
Avatar for Christian Goodrich cargoodrich
3
84
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
Avatar for panda_program panda_program
122
21k
Leading Effective Engineering Teams in the AI Era
Avatar for Addy Osmani addyosmani
9
1.5k
Product Roadmaps are Hard
Avatar for C. Todd Lombardo iamctodd
PRO
55
12k
Visual Storytelling: How to be a Superhuman Communicator
Avatar for David Neal reverentgeek
2
420
Being A Developer After 40
Avatar for Adrian Kosmaczewski akosma
91
590k
ReactJS: Keep Simple. Everything can be a component!
Avatar for Pedro Nauck pedronauck
666
130k
Done Done
Avatar for chrislema chrislema
186
16k
Fantastic passwords and where to find them - at NoRuKo
Avatar for Phil Nash philnash
52
3.6k

Transcript

  1. Welcome to the Bay Area Ray LLMs Community talks August

    29, 2023 Hosted by Jules S. Damji, Ray Advocacy Team @ Anyscale Email: [email protected] X: @2twitme

  2. Agenda: Meetup Talk 0: Announcements & Upcoming events – Jules

    S. Damji, Anyscale • Talk 1: 5 Useful design patterns for production LLM applications –Waleed Kadous, Anyscale • Magician 🎩 🪄🧙 • Talk 2: How continuous batching enables 23x throughput in LLMs inference– Cade Daniels Anyscale • Magician 🎩 🪄🧙 + 🍷 🍻

  3. Ray Summit 2023 - RayJules25 https://raysummit.anyscale.com/

  4. Luminary Featured Speakers ….

  5. 2 days of dedicated LLM tracks sessions

  6. 1 full day of Ray & LLM training sessions TBD

  7. Ray book signing … https://www.anyscale.com/blog

  8. QConSF Ray + LLM Talks

  9. https://www.ray.io/community

  10. None