Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ray Community LLM August Meetup

Avatar for Anyscale Anyscale
August 31, 2023
Programming
0
110

Ray Community LLM August Meetup

Introductory remarks, upcoming events, and agenda.

Avatar for Anyscale

Anyscale

August 31, 2023
Tweet

More Decks by Anyscale

See All by Anyscale
Ray in 2023: Ray in Reflection
Avatar for Anyscale anyscale
0
180
Evaluating LLM Applications is hard
Avatar for Anyscale anyscale
0
4.3k
Developing and serving RAG-Based LLM applications in production
Avatar for Anyscale anyscale
0
160
Ray_Essentials__Introduction_to_Ray_for_machine_learning.pdf
Avatar for Anyscale anyscale
0
180
How to build a serverless database cloud service
Avatar for Anyscale anyscale
0
120
Multi-Region/Cloud Ray Pipeline with Distributed Caching ​
Avatar for Anyscale anyscale
0
200
Modern Compute Stack for Scaling Large AI/ML/LLM Workloads
Avatar for Anyscale anyscale
0
120
5 Painful Lessons using LLMs
Avatar for Anyscale anyscale
0
150
How continuous batching enables 23x throughput in LLM inference
Avatar for Anyscale anyscale
0
1.5k

Other Decks in Programming

See All in Programming
EMこそClaude Codeでコード調査しよう
Avatar for shibayu36 shibayu36
0
270
What Spring Developers Should Know About Jakarta EE
Avatar for ivargrimstad ivargrimstad
0
350
CSC509 Lecture 06
Avatar for Javier Gonzalez-Sanchez javiergs
PRO
0
260
20251016_Rails News ～Rails 8.1の足音を聴く～
Avatar for Masato Mori morimorihoge
2
630
The Past, Present, and Future of Enterprise Java
Avatar for ivargrimstad ivargrimstad
0
350
『毎日の移動』を支えるGoバックエンド内製開発
Avatar for yutautsugi yutautsugi
2
270
その面倒な作業、「Dart」にやらせませんか？ Flutter開発者のための業務効率化
Avatar for YomEngine yordgenome03
1
140
Claude CodeによるAI駆動開発の実践 〜そこから見えてきたこれからのプログラミング〜
Avatar for 入井 啓太 iriikeita
0
310
チームの境界をブチ抜いていけ
Avatar for tokai235 tokai235
0
200
AI駆動で0→1をやって見えた光と伸びしろ
Avatar for passion😎 passion0102
1
640
品質ワークショップをやってみた
Avatar for Nealle nealle
0
580
Cursorハンズオン実践！
Avatar for Ikko Eltociear Ashimine eltociear
2
1.2k

Featured

See All Featured
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
Avatar for Marc Duiker marcduiker
34
2.3k
The Illustrated Children's Guide to Kubernetes
Avatar for Chris Short chrisshort
49
51k
The Straight Up "How To Draw Better" Workshop
Avatar for Dennis Kardys denniskardys
238
140k
A designer walks into a library…
Avatar for Paul Jervis Heath pauljervisheath
209
24k
Context Engineering - Making Every Token Count
Avatar for Addy Osmani addyosmani
7
280
Rails Girls Zürich Keynote
Avatar for Gregor Martynus gr2m
95
14k
Optimizing for Happiness
Avatar for Tom Preston-Werner mojombo
379
70k
The Language of Interfaces
Avatar for Des Traynor destraynor
162
25k
Bash Introduction
Avatar for André Augusto Costa Santos 62gerente
615
210k
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
Avatar for Eileen M. Uchitelle eileencodes
37
2.6k
GraphQLの誤解/rethinking-graphql
Avatar for sonatard sonatard
73
11k
10 Git Anti Patterns You Should be Aware of
Avatar for Lemi Orhan Ergin lemiorhan
PRO
657
61k

Transcript

  1. Welcome to the Bay Area Ray LLMs Community talks August

    29, 2023 Hosted by Jules S. Damji, Ray Advocacy Team @ Anyscale Email: [email protected] X: @2twitme

  2. Agenda: Meetup Talk 0: Announcements & Upcoming events – Jules

    S. Damji, Anyscale • Talk 1: 5 Useful design patterns for production LLM applications –Waleed Kadous, Anyscale • Magician 🎩 🪄🧙 • Talk 2: How continuous batching enables 23x throughput in LLMs inference– Cade Daniels Anyscale • Magician 🎩 🪄🧙 + 🍷 🍻

  3. Ray Summit 2023 - RayJules25 https://raysummit.anyscale.com/

  4. Luminary Featured Speakers ….

  5. 2 days of dedicated LLM tracks sessions

  6. 1 full day of Ray & LLM training sessions TBD

  7. Ray book signing … https://www.anyscale.com/blog

  8. QConSF Ray + LLM Talks

  9. https://www.ray.io/community

  10. None