Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ray Community LLM August Meetup

Anyscale
August 31, 2023
Programming
0
53

Ray Community LLM August Meetup

Introductory remarks, upcoming events, and agenda.

Anyscale

August 31, 2023
Tweet

More Decks by Anyscale

See All by Anyscale
Ray in 2023: Ray in Reflection
anyscale
0
100
Evaluating LLM Applications is hard
anyscale
0
4.1k
Developing and serving RAG-Based LLM applications in production
anyscale
0
110
Ray_Essentials__Introduction_to_Ray_for_machine_learning.pdf
anyscale
0
130
How to build a serverless database cloud service
anyscale
0
87
Multi-Region/Cloud Ray Pipeline with Distributed Caching ​
anyscale
0
120
Modern Compute Stack for Scaling Large AI/ML/LLM Workloads
anyscale
0
76
5 Painful Lessons using LLMs
anyscale
0
99
How continuous batching enables 23x throughput in LLM inference
anyscale
0
1.1k

Other Decks in Programming

See All in Programming
Findy Team+ Awardを受賞したかった！ベストプラクティス応募内容をふりかえり、開発生産性向上もふりかえる / Findy Team Plus Award BestPractice and DPE Retrospective 2024
honyanya
0
140
AWS re:Invent 2024個人的まとめ
satoshi256kbyte
0
100
快速入門可觀測性
blueswen
0
500
20年もののレガシープロダクトに 0からPHPStanを入れるまで / phpcon2024
hirobe1999
0
1k
各クラウドサービスにおける.NETの対応と見解
ymd65536
0
250
良いユニットテストを書こう
mototakatsu
11
3.6k
ATDDで素早く安定した デリバリを実現しよう！
tonnsama
1
1.8k
ErdMap: Thinking about a map for Rails applications
makicamel
1
590
PSR-15 はあなたのための ものではない？ - phpcon2024
myamagishi
0
400
盆栽転じて家具となる / Bonsai and Furnitures
aereal
0
1.8k
Запуск 1С:УХ в крупном энтерпрайзе: мечта и реальность ПМа
lamodatech
0
940
サーバーゆる勉強会 DBMS の仕組み編
kj455
1
300

Featured

See All Featured
10 Git Anti Patterns You Should be Aware of
lemiorhan
PRO
656
59k
Scaling GitHub
holman
459
140k
Agile that works and the tools we love
rasmusluckow
328
21k
No one is an island. Learnings from fostering a developers community.
thoeni
19
3.1k
Building a Modern Day 
E-commerce SEO Strategy
aleyda
38
7k
Rails Girls Zürich Keynote
gr2m
94
13k
Sharpening the Axe: The Primacy of Toolmaking
bcantrill
38
1.9k
The MySQL Ecosystem @ GitHub 2015
samlambert
250
12k
Building Your Own Lightsaber
phodgson
104
6.2k
Keith and Marios Guide to Fast Websites
keithpitt
410
22k
Into the Great Unknown - MozCon
thekraken
34
1.6k
How STYLIGHT went responsive
nonsquared
96
5.3k

Transcript

  1. Welcome to the Bay Area Ray LLMs Community talks August

    29, 2023 Hosted by Jules S. Damji, Ray Advocacy Team @ Anyscale Email: [email protected] X: @2twitme

  2. Agenda: Meetup Talk 0: Announcements & Upcoming events – Jules

    S. Damji, Anyscale • Talk 1: 5 Useful design patterns for production LLM applications –Waleed Kadous, Anyscale • Magician 🎩 🪄🧙 • Talk 2: How continuous batching enables 23x throughput in LLMs inference– Cade Daniels Anyscale • Magician 🎩 🪄🧙 + 🍷 🍻

  3. Ray Summit 2023 - RayJules25 https://raysummit.anyscale.com/

  4. Luminary Featured Speakers ….

  5. 2 days of dedicated LLM tracks sessions

  6. 1 full day of Ray & LLM training sessions TBD

  7. Ray book signing … https://www.anyscale.com/blog

  8. QConSF Ray + LLM Talks

  9. https://www.ray.io/community

  10. None