Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ray Community LLM August Meetup

Anyscale
PRO
August 31, 2023
Programming
0
32

Ray Community LLM August Meetup

Introductory remarks, upcoming events, and agenda.

Anyscale
PRO

August 31, 2023
Tweet

More Decks by Anyscale

See All by Anyscale
Ray in 2023: Ray in Reflection
anyscale
PRO
0
31
Evaluating LLM Applications is hard
anyscale
PRO
0
42
Developing and serving RAG-Based LLM applications in production
anyscale
PRO
0
47
Ray_Essentials__Introduction_to_Ray_for_machine_learning.pdf
anyscale
PRO
0
73
How to build a serverless database cloud service
anyscale
PRO
0
52
Multi-Region/Cloud Ray Pipeline with Distributed Caching ​
anyscale
PRO
0
64
Modern Compute Stack for Scaling Large AI/ML/LLM Workloads
anyscale
PRO
0
41
5 Painful Lessons using LLMs
anyscale
PRO
0
58
How continuous batching enables 23x throughput in LLM inference
anyscale
PRO
0
620

Other Decks in Programming

See All in Programming
Polars入門
daikikatsuragawa
1
190
Goのmultiple errorsについて (2024年4月版)
syumai
4
1.2k
Site Reliability Engineering for GMO
pyama86
8
1.1k
Kotlin Multiplatform at Stable and Beyond (Android Makers 2024)
zsmb
0
530
The Cutting Edge Of Versioning (LambdaConf 2024)
chriskrycho
0
170
CREってこういうこと？ 体験入社 - 提案資料 - / what-is-cre-trial-employment
shinden
1
550
検証も兼ねて個人開発でHonoとかと向き合った話
hanetsuki
1
1.3k
大規模UIKitベースアプリへのTCAの段階的導入/gradual-adoption-of-tca-in-a-large-scale-uikit-based-app
takehilo
2
210
Git Rebase
bkuhlmann
11
1.6k
効率化に挑戦してみたらモバイル開発が少し快適になった話
ryunakayama
0
140
Ruby Pattern Matching
bkuhlmann
0
930
SwiftUIで使いやすいToastの作り方 / How to build a Toast system which is easy to use in SwiftUI
lovee
3
180

Featured

See All Featured
Building Applications with DynamoDB
mza
88
5.6k
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
marktimemedia
20
1.8k
Large-scale JavaScript Application Architecture
addyosmani
504
110k
The Pragmatic Product Professional
lauravandoore
26
5.8k
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
panda_program
66
14k
The Mythical Team-Month
searls
217
42k
It's Worth the Effort
3n
180
27k
Designing Experiences People Love
moore
136
23k
10 Git Anti Patterns You Should be Aware of
lemiorhan
649
58k
Creatively Recalculating Your Daily Design Routine
revolveconf
211
11k
Design by the Numbers
sachag
274
18k
5 minutes of I Can Smell Your CMS
philhawksworth
199
19k

Transcript

  1. Welcome to the Bay Area Ray LLMs Community talks August

    29, 2023 Hosted by Jules S. Damji, Ray Advocacy Team @ Anyscale Email: [email protected] X: @2twitme

  2. Agenda: Meetup Talk 0: Announcements & Upcoming events – Jules

    S. Damji, Anyscale • Talk 1: 5 Useful design patterns for production LLM applications –Waleed Kadous, Anyscale • Magician 🎩 🪄🧙 • Talk 2: How continuous batching enables 23x throughput in LLMs inference– Cade Daniels Anyscale • Magician 🎩 🪄🧙 + 🍷 🍻

  3. Ray Summit 2023 - RayJules25 https://raysummit.anyscale.com/

  4. Luminary Featured Speakers ….

  5. 2 days of dedicated LLM tracks sessions

  6. 1 full day of Ray & LLM training sessions TBD

  7. Ray book signing … https://www.anyscale.com/blog

  8. QConSF Ray + LLM Talks

  9. https://www.ray.io/community

  10. None