Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ray Community LLM August Meetup

Anyscale
August 31, 2023
Programming
0
50

Ray Community LLM August Meetup

Introductory remarks, upcoming events, and agenda.

Anyscale

August 31, 2023
Tweet

More Decks by Anyscale

See All by Anyscale
Ray in 2023: Ray in Reflection
anyscale
0
91
Evaluating LLM Applications is hard
anyscale
0
4k
Developing and serving RAG-Based LLM applications in production
anyscale
0
110
Ray_Essentials__Introduction_to_Ray_for_machine_learning.pdf
anyscale
0
120
How to build a serverless database cloud service
anyscale
0
82
Multi-Region/Cloud Ray Pipeline with Distributed Caching ​
anyscale
0
110
Modern Compute Stack for Scaling Large AI/ML/LLM Workloads
anyscale
0
69
5 Painful Lessons using LLMs
anyscale
0
94
How continuous batching enables 23x throughput in LLM inference
anyscale
0
1k

Other Decks in Programming

See All in Programming
17年周年のWebアプリケーションにTanStack Queryを導入する / Implementing TanStack Query in a 17th Anniversary Web Application
saitolume
0
250
競技プログラミングへのお誘い@阪大BOOSTセミナー
kotamanegi
0
360
第5回日本眼科AI学会総会_AIコンテスト_３位解法
neilsaw
0
170
暇に任せてProxmoxコンソール 作ってみました
karugamo
1
720
なまけものオバケたち -PHP 8.4 に入った新機能の紹介-
tanakahisateru
1
120
生成AIでGitHubソースコード取得して仕様書を作成
shukob
0
300
testcontainers のススメ
sgash708
1
120
Haze - Real time background blurring
chrisbanes
1
510
今年のアップデートで振り返るCDKセキュリティのシフトレフト/2024-cdk-security-shift-left
tomoki10
0
190
創造的活動から切り拓く新たなキャリア 好きから始めてみる夜勤オペレーターからSREへの転身
yjszk
1
130
これでLambdaが不要に？！Step FunctionsのJSONata対応について
iwatatomoya
2
3.6k
ブラウザ単体でmp4書き出すまで - muddy-web - 2024-12
yue4u
2
460

Featured

See All Featured
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
sstephenson
159
15k
Agile that works and the tools we love
rasmusluckow
328
21k
Distributed Sagas: A Protocol for Coordinating Microservices
caitiem20
330
21k
Site-Speed That Sticks
csswizardry
2
190
Optimizing for Happiness
mojombo
376
70k
Docker and Python
trallard
42
3.1k
BBQ
matthewcrist
85
9.4k
Intergalactic Javascript Robots from Outer Space
tanoku
270
27k
Navigating Team Friction
lara
183
15k
Into the Great Unknown - MozCon
thekraken
33
1.5k
Code Review Best Practice
trishagee
65
17k
Designing on Purpose - Digital PM Summit 2013
jponch
116
7k

Transcript

  1. Welcome to the Bay Area Ray LLMs Community talks August

    29, 2023 Hosted by Jules S. Damji, Ray Advocacy Team @ Anyscale Email: [email protected] X: @2twitme

  2. Agenda: Meetup Talk 0: Announcements & Upcoming events – Jules

    S. Damji, Anyscale • Talk 1: 5 Useful design patterns for production LLM applications –Waleed Kadous, Anyscale • Magician 🎩 🪄🧙 • Talk 2: How continuous batching enables 23x throughput in LLMs inference– Cade Daniels Anyscale • Magician 🎩 🪄🧙 + 🍷 🍻

  3. Ray Summit 2023 - RayJules25 https://raysummit.anyscale.com/

  4. Luminary Featured Speakers ….

  5. 2 days of dedicated LLM tracks sessions

  6. 1 full day of Ray & LLM training sessions TBD

  7. Ray book signing … https://www.anyscale.com/blog

  8. QConSF Ray + LLM Talks

  9. https://www.ray.io/community

  10. None