Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ray Community LLM August Meetup

Anyscale
August 31, 2023
Programming
0
64

Ray Community LLM August Meetup

Introductory remarks, upcoming events, and agenda.

Anyscale

August 31, 2023
Tweet

More Decks by Anyscale

See All by Anyscale
Ray in 2023: Ray in Reflection
anyscale
0
120
Evaluating LLM Applications is hard
anyscale
0
4.1k
Developing and serving RAG-Based LLM applications in production
anyscale
0
120
Ray_Essentials__Introduction_to_Ray_for_machine_learning.pdf
anyscale
0
140
How to build a serverless database cloud service
anyscale
0
92
Multi-Region/Cloud Ray Pipeline with Distributed Caching ​
anyscale
0
140
Modern Compute Stack for Scaling Large AI/ML/LLM Workloads
anyscale
0
95
5 Painful Lessons using LLMs
anyscale
0
110
How continuous batching enables 23x throughput in LLM inference
anyscale
0
1.1k

Other Decks in Programming

See All in Programming
バッチを作らなきゃとなったときに考えること
irof
2
580
「その気にさせる」エンジニアが 最強のリーダーになる理由
gimupop
1
260
『テスト書いた方が開発が早いじゃん』を解き明かす #phpcon_nagoya
o0h
PRO
9
2.7k
CIBMTR振り返り＋敗北から学ぶコンペの取り組み方反省
takanao
1
290
Jakarta EE meets AI
ivargrimstad
0
930
Rails 1.0 のコードで学ぶ find_by* と method_missing の仕組み / Learn how find_by_* and method_missing work in Rails 1.0 code
maimux2x
1
280
CDKを使ったPagerDuty連携インフラのテンプレート化
shibuya_shogo
0
130
React 19アップデートのために必要なこと
uhyo
8
1.6k
コードジェネレーターで 効率的な開発をする / Efficient development with code generators
linyows
0
110
FrontendUp_新規事業で_Remixを採用した理由と対策.pdf
rymizuki
0
100
LINE messaging APIを使ってGoogleカレンダーと連携した予約ツールを作ってみた
takumakoike
0
150
Jakarta EE meets AI
ivargrimstad
0
960

Featured

See All Featured
Save Time (by Creating Custom Rails Generators)
garrettdimon
PRO
29
1.1k
Docker and Python
trallard
44
3.3k
Making Projects Easy
brettharned
116
6.1k
Site-Speed That Sticks
csswizardry
4
420
The Power of CSS Pseudo Elements
geoffreycrofte
75
5.5k
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
panda_program
101
18k
ReactJS: Keep Simple. Everything can be a component!
pedronauck
666
120k
Art, The Web, and Tiny UX
lynnandtonic
298
20k
Dealing with People You Can't Stand - Big Design 2015
cassininazir
366
25k
How to Ace a Technical Interview
jacobian
276
23k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
tammyeverts
49
2.3k
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
sstephenson
160
15k

Transcript

  1. Welcome to the Bay Area Ray LLMs Community talks August

    29, 2023 Hosted by Jules S. Damji, Ray Advocacy Team @ Anyscale Email: [email protected] X: @2twitme

  2. Agenda: Meetup Talk 0: Announcements & Upcoming events – Jules

    S. Damji, Anyscale • Talk 1: 5 Useful design patterns for production LLM applications –Waleed Kadous, Anyscale • Magician 🎩 🪄🧙 • Talk 2: How continuous batching enables 23x throughput in LLMs inference– Cade Daniels Anyscale • Magician 🎩 🪄🧙 + 🍷 🍻

  3. Ray Summit 2023 - RayJules25 https://raysummit.anyscale.com/

  4. Luminary Featured Speakers ….

  5. 2 days of dedicated LLM tracks sessions

  6. 1 full day of Ray & LLM training sessions TBD

  7. Ray book signing … https://www.anyscale.com/blog

  8. QConSF Ray + LLM Talks

  9. https://www.ray.io/community

  10. None