Lock in $30 Savings on PRO—Offer Ends Soon! ⏳

Ray Community LLM August Meetup

Avatar for Anyscale Anyscale
August 31, 2023
Programming
0
120

Ray Community LLM August Meetup

Introductory remarks, upcoming events, and agenda.

Avatar for Anyscale

Anyscale

August 31, 2023
Tweet

More Decks by Anyscale

See All by Anyscale
Ray in 2023: Ray in Reflection
Avatar for Anyscale anyscale
0
200
Evaluating LLM Applications is hard
Avatar for Anyscale anyscale
0
4.3k
Developing and serving RAG-Based LLM applications in production
Avatar for Anyscale anyscale
0
170
Ray_Essentials__Introduction_to_Ray_for_machine_learning.pdf
Avatar for Anyscale anyscale
0
200
How to build a serverless database cloud service
Avatar for Anyscale anyscale
0
130
Multi-Region/Cloud Ray Pipeline with Distributed Caching ​
Avatar for Anyscale anyscale
0
220
Modern Compute Stack for Scaling Large AI/ML/LLM Workloads
Avatar for Anyscale anyscale
0
130
5 Painful Lessons using LLMs
Avatar for Anyscale anyscale
0
160
How continuous batching enables 23x throughput in LLM inference
Avatar for Anyscale anyscale
0
1.6k

Other Decks in Programming

See All in Programming
Socio-Technical Evolution: Growing an Architecture and Its Organization for Fast Flow
Avatar for Chris Richardson cer
PRO
0
390
Patterns of Patterns
Avatar for Denys Poltorak denyspoltorak
0
240
クラウドに依存しないS3を使った開発術
Avatar for しめさば simesaba80
0
150
AtCoder Conference 2025「LLM時代のAHC」
Avatar for Yuki Imajuku imjk
2
570
Vibe codingでおすすめの言語と開発手法
Avatar for uyuki uyuki234
0
110
Go コードベースの構成と AI コンテキスト定義
Avatar for ANDPAD inc andpad
0
130
從冷知識到漏洞，你不懂的 Web，駭客懂 - Huli @ WebConf Taiwan 2025
Avatar for Huli aszx87410
2
2.9k
TerraformとStrands AgentsでAmazon Bedrock AgentCoreのSSO認証付きエージェントを量産しよう！
Avatar for neruneruo neruneruo
4
1.6k
ゲームの物理 剛体編
Avatar for Fadis fadis
0
370
DevFest Android in Korea 2025 - 개발자 커뮤니티를 통해 얻는 가치
Avatar for Suhyeon Kim wisemuji
0
170
ZJIT: The Ruby 4 JIT Compiler / Ruby Release 30th Anniversary Party
Avatar for Takashi Kokubun k0kubun
0
250
Python札幌 LT資料
Avatar for t3tra t3tra
6
1k

Featured

See All Featured
Avoiding the “Bad Training, Faster” Trap in the Age of AI
Avatar for Mike Taylor tmiket
0
34
Why Your Marketing Sucks and What You Can Do About It - Sophie Logan
Avatar for Sophie Logan marketingsoph
0
41
Music & Morning Musume
Avatar for Bryan Veloso bryan
46
7k
Typedesign – Prime Four
Avatar for Hannes Fritz hannesfritz
42
2.9k
Skip the Path - Find Your Career Trail
Avatar for Mark Kilby mkilby
0
25
The SEO Collaboration Effect
Avatar for Kristina Bergwall kristinabergwall1
0
300
Making the Leap to Tech Lead
Avatar for Ryan Cromwell cromwellryan
135
9.7k
jQuery: Nuts, Bolts and Bling
Avatar for Doug Neiner dougneiner
65
8.3k
Digital Ethics as a Driver of Design Innovation
Avatar for Per Axbom axbom
PRO
0
130
Put a Button on it: Removing Barriers to Going Fast.
Avatar for kastner kastner
60
4.1k
CSS Pre-Processors: Stylus, Less & Sass
Avatar for Bermon Painter bermonpainter
359
30k
AI in Enterprises - Java and Open Source to the Rescue
Avatar for ivargrimstad ivargrimstad
0
1k

Transcript

  1. Welcome to the Bay Area Ray LLMs Community talks August

    29, 2023 Hosted by Jules S. Damji, Ray Advocacy Team @ Anyscale Email: [email protected] X: @2twitme

  2. Agenda: Meetup Talk 0: Announcements & Upcoming events – Jules

    S. Damji, Anyscale • Talk 1: 5 Useful design patterns for production LLM applications –Waleed Kadous, Anyscale • Magician 🎩 🪄🧙 • Talk 2: How continuous batching enables 23x throughput in LLMs inference– Cade Daniels Anyscale • Magician 🎩 🪄🧙 + 🍷 🍻

  3. Ray Summit 2023 - RayJules25 https://raysummit.anyscale.com/

  4. Luminary Featured Speakers ….

  5. 2 days of dedicated LLM tracks sessions

  6. 1 full day of Ray & LLM training sessions TBD

  7. Ray book signing … https://www.anyscale.com/blog

  8. QConSF Ray + LLM Talks

  9. https://www.ray.io/community

  10. None