Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ray Community LLM August Meetup

Anyscale
August 31, 2023
Programming
0
58

Ray Community LLM August Meetup

Introductory remarks, upcoming events, and agenda.

Anyscale

August 31, 2023
Tweet

More Decks by Anyscale

See All by Anyscale
Ray in 2023: Ray in Reflection
anyscale
0
120
Evaluating LLM Applications is hard
anyscale
0
4.1k
Developing and serving RAG-Based LLM applications in production
anyscale
0
120
Ray_Essentials__Introduction_to_Ray_for_machine_learning.pdf
anyscale
0
140
How to build a serverless database cloud service
anyscale
0
88
Multi-Region/Cloud Ray Pipeline with Distributed Caching ​
anyscale
0
130
Modern Compute Stack for Scaling Large AI/ML/LLM Workloads
anyscale
0
89
5 Painful Lessons using LLMs
anyscale
0
100
How continuous batching enables 23x throughput in LLM inference
anyscale
0
1.1k

Other Decks in Programming

See All in Programming
責務と認知負荷を整える! 抽象レベルを意識した関心の分離
yahiru
8
1.3k
Pulsar2 を雰囲気で使ってみよう
anoken
0
250
dbt Pythonモデルで実現するSnowflake活用術
trsnium
0
230
How mixi2 Uses TiDB for SNS Scalability and Performance
kanmo
40
16k
密集、ドキュメントのコロケーション with AWS Lambda
satoshi256kbyte
1
210
Amazon Q Developer Proで効率化するAPI開発入門
seike460
PRO
0
120
Kubernetes History Inspector(KHI)を触ってみた
bells17
0
250
Datadog Workflow Automation で圧倒的価値提供
showwin
1
100
メンテが命: PHPフレームワークのコンテナ化とアップグレード戦略
shunta27
0
280
一休.com のログイン体験を支える技術 〜Web Components x Vue.js 活用事例と最適化について〜
atsumim
0
750
ARA Ansible for the teams
kksat
0
170
sappoRo.R #12 初心者セッション
kosugitti
0
270

Featured

See All Featured
Fantastic passwords and where to find them - at NoRuKo
philnash
51
3k
Thoughts on Productivity
jonyablonski
69
4.5k
Into the Great Unknown - MozCon
thekraken
35
1.6k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
stephaniewalter
280
13k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
morganepeng
129
19k
Building Better People: How to give real-time feedback that sticks.
wjessup
367
19k
Bash Introduction
62gerente
611
210k
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
sstephenson
160
15k
StorybookのUI Testing Handbookを読んだ
zakiyama
28
5.5k
Designing for Performance
lara
604
68k
Art, The Web, and Tiny UX
lynnandtonic
298
20k
Intergalactic Javascript Robots from Outer Space
tanoku
270
27k

Transcript

  1. Welcome to the Bay Area Ray LLMs Community talks August

    29, 2023 Hosted by Jules S. Damji, Ray Advocacy Team @ Anyscale Email: [email protected] X: @2twitme

  2. Agenda: Meetup Talk 0: Announcements & Upcoming events – Jules

    S. Damji, Anyscale • Talk 1: 5 Useful design patterns for production LLM applications –Waleed Kadous, Anyscale • Magician 🎩 🪄🧙 • Talk 2: How continuous batching enables 23x throughput in LLMs inference– Cade Daniels Anyscale • Magician 🎩 🪄🧙 + 🍷 🍻

  3. Ray Summit 2023 - RayJules25 https://raysummit.anyscale.com/

  4. Luminary Featured Speakers ….

  5. 2 days of dedicated LLM tracks sessions

  6. 1 full day of Ray & LLM training sessions TBD

  7. Ray book signing … https://www.anyscale.com/blog

  8. QConSF Ray + LLM Talks

  9. https://www.ray.io/community

  10. None