Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ray Community LLM August Meetup

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for Anyscale Anyscale
August 31, 2023
Programming
0
130

Ray Community LLM August Meetup

Introductory remarks, upcoming events, and agenda.

Avatar for Anyscale

Anyscale

August 31, 2023
Tweet

More Decks by Anyscale

See All by Anyscale
Ray in 2023: Ray in Reflection
Avatar for Anyscale anyscale
0
200
Evaluating LLM Applications is hard
Avatar for Anyscale anyscale
0
4.3k
Developing and serving RAG-Based LLM applications in production
Avatar for Anyscale anyscale
0
180
Ray_Essentials__Introduction_to_Ray_for_machine_learning.pdf
Avatar for Anyscale anyscale
0
210
How to build a serverless database cloud service
Avatar for Anyscale anyscale
0
130
Multi-Region/Cloud Ray Pipeline with Distributed Caching ​
Avatar for Anyscale anyscale
0
220
Modern Compute Stack for Scaling Large AI/ML/LLM Workloads
Avatar for Anyscale anyscale
0
140
5 Painful Lessons using LLMs
Avatar for Anyscale anyscale
0
170
How continuous batching enables 23x throughput in LLM inference
Avatar for Anyscale anyscale
0
1.7k

Other Decks in Programming

See All in Programming
AWS re:Invent 2025参加 直前 Seattle-Tacoma Airport(SEA)におけるハードウェア紛失インシデントLT
Avatar for tetutetu214 tetutetu214
2
120
組織で育むオブザーバビリティ
Avatar for ryotaro kobayashi ryota_hnk
0
180
CSC307 Lecture 05
Avatar for Javier Gonzalez-Sanchez javiergs
PRO
0
500
React 19でつくる「気持ちいいUI」- 楽観的UIのすすめ
Avatar for Hiroshi Morishige himorishige
11
7.5k
AI Schema Enrichment for your Oracle AI Database
Avatar for thatjeffsmith thatjeffsmith
0
310
「ブロックテーマでは再現できない」は本当か？
Avatar for Takashi Kitajima inc2734
0
1k
Amazon Bedrockを活用したRAGの品質管理パイプライン構築
Avatar for とすり tosuri13
5
770
izumin5210のプロポーザルのネタ探し #tskaigi_msup
Avatar for izumin5210 izumin5210
1
140
CSC307 Lecture 04
Avatar for Javier Gonzalez-Sanchez javiergs
PRO
0
660
そのAIレビュー、レビューしてますか？ / Are you reviewing those AI reviews?
Avatar for r-kagaya rkaga
6
4.6k
疑似コードによるプロンプト記述、どのくらい正確に実行される？
Avatar for kokuyouwind kokuyouwind
0
390
Best-Practices-for-Cortex-Analyst-and-AI-Agent
Avatar for ryotaro.ikeda@finatext.com ryotaroikeda
1
110

Featured

See All Featured
Building a A Zero-Code AI SEO Workflow
Avatar for Ian Lurie portentint
PRO
0
320
Lightning talk: Run Django tests with GitHub Actions
Avatar for Sarah Abderemane sabderemane
0
120
How to make the Groovebox
Avatar for あそなす asonas
2
1.9k
16th Malabo Montpellier Forum Presentation
Avatar for AKADEMIYA2063 akademiya2063
PRO
0
52
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
Avatar for Marc Duiker marcduiker
35
2.4k
The Director’s Chair: Orchestrating AI for Truly Effective Learning
Avatar for Mike Taylor tmiket
1
97
Navigating the Design Leadership Dip - Product Design Week Design Leaders+ Conference 2024
Avatar for Andy Polaine apolaine
0
180
"I'm Feeling Lucky" - Building Great Search Experiences for Today's Users (#IAC19)
Avatar for Dan Newman danielanewman
231
22k
How Fast Is Fast Enough? [PerfNow 2025]
Avatar for Tammy Everts tammyeverts
3
450
Bash Introduction
Avatar for André Augusto Costa Santos 62gerente
615
210k
Measuring & Analyzing Core Web Vitals
Avatar for Philip Tellis bluesmoon
9
760
Ethics towards AI in product and experience design
Avatar for Skipper Chong Warson skipperchong
2
200

Transcript

  1. Welcome to the Bay Area Ray LLMs Community talks August

    29, 2023 Hosted by Jules S. Damji, Ray Advocacy Team @ Anyscale Email: [email protected] X: @2twitme

  2. Agenda: Meetup Talk 0: Announcements & Upcoming events – Jules

    S. Damji, Anyscale • Talk 1: 5 Useful design patterns for production LLM applications –Waleed Kadous, Anyscale • Magician 🎩 🪄🧙 • Talk 2: How continuous batching enables 23x throughput in LLMs inference– Cade Daniels Anyscale • Magician 🎩 🪄🧙 + 🍷 🍻

  3. Ray Summit 2023 - RayJules25 https://raysummit.anyscale.com/

  4. Luminary Featured Speakers ….

  5. 2 days of dedicated LLM tracks sessions

  6. 1 full day of Ray & LLM training sessions TBD

  7. Ray book signing … https://www.anyscale.com/blog

  8. QConSF Ray + LLM Talks

  9. https://www.ray.io/community

  10. None