Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

Ray Community LLM August Meetup

Avatar for Anyscale Anyscale
August 31, 2023
Programming
200
0

Ray Community LLM August Meetup

Introductory remarks, upcoming events, and agenda.

Avatar for Anyscale

Anyscale

August 31, 2023

More Decks by Anyscale

See All by Anyscale
Ray in 2023: Ray in Reflection
Avatar for Anyscale anyscale
0
260
Evaluating LLM Applications is hard
Avatar for Anyscale anyscale
0
4.5k
Developing and serving RAG-Based LLM applications in production
Avatar for Anyscale anyscale
0
240
Ray_Essentials__Introduction_to_Ray_for_machine_learning.pdf
Avatar for Anyscale anyscale
0
270
How to build a serverless database cloud service
Avatar for Anyscale anyscale
0
190
Multi-Region/Cloud Ray Pipeline with Distributed Caching ​
Avatar for Anyscale anyscale
0
320
Modern Compute Stack for Scaling Large AI/ML/LLM Workloads
Avatar for Anyscale anyscale
0
220
5 Painful Lessons using LLMs
Avatar for Anyscale anyscale
0
250
How continuous batching enables 23x throughput in LLM inference
Avatar for Anyscale anyscale
0
2.4k

Other Decks in Programming

See All in Programming
Java 27新機能 / Java 27 new features
Avatar for Naoki Kishida kishida
2
220
When benchmarks go bad - what I learned from measuring performance wrong
Avatar for Holly Cummins hollycummins
0
200
AWSに止められる覚悟してますか？
Avatar for モリゾー morizo_1984
2
530
Apple Intelligence を用いた個人情報誤送信防止、及びユーザーリクエスト体験の改善について
Avatar for Yuki Kuwashima yukiny
0
330
Turning Architecture into Unit Tests in the AI Era (NSSpain XIV)
Avatar for Stelios Frantzeskakis steliosf
PRO
1
140
ジョジョの世界をXRで再現する
Avatar for mofurune mofurune
0
150
Embedded Swiftで作る自作USBデバイス によるiOSデバイスの自動テスト / iOSDC Japan 2026 glassfiber
Avatar for glassfiber glassfiber
0
320
Compiling a real-world CLI tool to native with Static Hermes
Avatar for Tzvetan Mikov tmikov2023
0
110
golang-bob.pdf
Avatar for Yura Iwatsuka iwatsukayura
0
120
JRuby: Past, Present, and Future
Avatar for headius headius
0
230
RAG の “R” を Swift で覗いてみる 〜「意味から探す」検索の仕組み〜
Avatar for Nao-RandD nao_randd
0
140
モデルのリファクタリングが難しいと思ったら、そもそも複雑だったのはビジネス仕様だった ? / is-the-business-domain-the-real-complexity
Avatar for hatsu hatsu38
0
460

Featured

See All Featured
The Spectacular Lies of Maps
Avatar for Per Axbom axbom
PRO
1
1.1k
Visual Storytelling: How to be a Superhuman Communicator
Avatar for David Neal reverentgeek
2
710
Are puppies a ranking factor?
Avatar for Jono Alderson jonoalderson
2
4k
Save Time (by Creating Custom Rails Generators)
Avatar for Garrett Dimon garrettdimon
PRO
33
5.2k
Prompt Engineering for Job Search
Avatar for Mfonobong Umondia mfonobong
0
500
A Guide to Academic Writing Using Generative AI - A Workshop
Avatar for Kenji Saito ks91
PRO
1
510
How People are Using Generative and Agentic AI to Supercharge Their Products, Projects, Services and Value Streams Today
Avatar for Helen Beal helenjbeal
2
360
Navigating the moral maze — ethical principles for Al-driven product design
Avatar for Skipper Chong Warson skipperchong
2
620
The Impact of AI in SEO - AI Overviews June 2024 Edition
Avatar for Aleyda Solis aleyda
6
1.2k
We Are The Robots
Avatar for Honza Javorek honzajavorek
0
390
The Curse of the Amulet
Avatar for Matthew Lei leimatthew05
3
15k
For a Future-Friendly Web
Avatar for Brad Frost brad_frost
184
10k

Transcript

  1. Welcome to the Bay Area Ray LLMs Community talks August

    29, 2023 Hosted by Jules S. Damji, Ray Advocacy Team @ Anyscale Email: [email protected] X: @2twitme

  2. Agenda: Meetup Talk 0: Announcements & Upcoming events – Jules

    S. Damji, Anyscale • Talk 1: 5 Useful design patterns for production LLM applications –Waleed Kadous, Anyscale • Magician 🎩 🪄🧙 • Talk 2: How continuous batching enables 23x throughput in LLMs inference– Cade Daniels Anyscale • Magician 🎩 🪄🧙 + 🍷 🍻

  3. Ray Summit 2023 - RayJules25 https://raysummit.anyscale.com/

  4. Luminary Featured Speakers ….

  5. 2 days of dedicated LLM tracks sessions

  6. 1 full day of Ray & LLM training sessions TBD

  7. Ray book signing … https://www.anyscale.com/blog

  8. QConSF Ray + LLM Talks

  9. https://www.ray.io/community

  10. None