Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ray Community LLM August Meetup

Avatar for Anyscale Anyscale
August 31, 2023
Programming
0
85

Ray Community LLM August Meetup

Introductory remarks, upcoming events, and agenda.
Avatar for Anyscale

Anyscale

August 31, 2023
Tweet

More Decks by Anyscale

See All by Anyscale
Ray in 2023: Ray in Reflection
Avatar for Anyscale anyscale
0
150
Evaluating LLM Applications is hard
Avatar for Anyscale anyscale
0
4.2k
Developing and serving RAG-Based LLM applications in production
Avatar for Anyscale anyscale
0
140
Ray_Essentials__Introduction_to_Ray_for_machine_learning.pdf
Avatar for Anyscale anyscale
0
160
How to build a serverless database cloud service
Avatar for Anyscale anyscale
0
110
Multi-Region/Cloud Ray Pipeline with Distributed Caching ​
Avatar for Anyscale anyscale
0
170
Modern Compute Stack for Scaling Large AI/ML/LLM Workloads
Avatar for Anyscale anyscale
0
110
5 Painful Lessons using LLMs
Avatar for Anyscale anyscale
0
130
How continuous batching enables 23x throughput in LLM inference
Avatar for Anyscale anyscale
0
1.3k

Other Decks in Programming

See All in Programming
CSC307 Lecture 17
Avatar for Javier Gonzalez-Sanchez javiergs
PRO
0
110
アンドパッドの Go 勉強会「 gopher 会」とその内容の紹介
Avatar for ANDPAD inc andpad
0
200
Go1.25からのGOMAXPROCS
Avatar for kuro kuro_kurorrr
1
430
Webからモバイルへ Vue.js × Capacitor 活用事例
Avatar for Naoki Haba naokihaba
0
610
Cloudflare Realtime と Workers でつくるサーバーレス WebRTC
Avatar for Taiyu Yoshizawa nekoya3
0
400
WindowInsetsだってテストしたい
Avatar for RyuNen344 ryunen344
1
140
try-catchを使わないエラーハンドリング！？ PHPでResult型の考え方を取り入れてみよう
Avatar for Takuma Kajikawa kajitack
3
510
iOSアプリ開発で 関数型プログラミングを実現する The Composable Architectureの紹介
Avatar for yimajo yimajo
2
210
Claude Codeの使い方
Avatar for ttnyt8701 ttnyt8701
1
110
Prism.parseで 300本以上あるエンドポイントに 接続できる権限の一覧表を作ってみた
Avatar for hatsu hatsu38
1
110
Blueskyのプラグインを作ってみた
Avatar for Hakkadaikon hakkadaikon
1
540
TypeScript LSP の今までとこれから
Avatar for Yosuke Kurami quramy
1
500

Featured

See All Featured
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
Avatar for Addy Osmani addyosmani
6
690
"I'm Feeling Lucky" - Building Great Search Experiences for Today's Users (#IAC19)
Avatar for Dan Newman danielanewman
228
22k
The Art of Delivering Value - GDevCon NA Keynote
Avatar for David Neal reverentgeek
15
1.5k
KATA
Avatar for Megan Lloyd mclloyd
29
14k
The Psychology of Web Performance [Beyond Tellerrand 2023]
Avatar for Tammy Everts tammyeverts
47
2.8k
Being A Developer After 40
Avatar for Adrian Kosmaczewski akosma
90
590k
Practical Orchestrator
Avatar for Shlomi Noach shlominoach
188
11k
Fashionably flexible responsive web design (full day workshop)
Avatar for Andy Clarke malarkey
407
66k
Building a Scalable Design System with Sketch
Avatar for Laura Van Doore lauravandoore
462
33k
Unsuck your backbone
Avatar for Amy Palamountain ammeep
671
58k
Learning to Love Humans: Emotional Interface Design
Avatar for Aarron Walter aarron
273
40k
Understanding Cognitive Biases in Performance Measurement
Avatar for Philip Tellis bluesmoon
29
1.8k

Transcript

  1. Welcome to the Bay Area Ray LLMs Community talks August

    29, 2023 Hosted by Jules S. Damji, Ray Advocacy Team @ Anyscale Email: [email protected] X: @2twitme

  2. Agenda: Meetup Talk 0: Announcements & Upcoming events – Jules

    S. Damji, Anyscale • Talk 1: 5 Useful design patterns for production LLM applications –Waleed Kadous, Anyscale • Magician 🎩 🪄🧙 • Talk 2: How continuous batching enables 23x throughput in LLMs inference– Cade Daniels Anyscale • Magician 🎩 🪄🧙 + 🍷 🍻

  3. Ray Summit 2023 - RayJules25 https://raysummit.anyscale.com/

  4. Luminary Featured Speakers ….

  5. 2 days of dedicated LLM tracks sessions

  6. 1 full day of Ray & LLM training sessions TBD

  7. Ray book signing … https://www.anyscale.com/blog

  8. QConSF Ray + LLM Talks

  9. https://www.ray.io/community

  10. None