Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Message Queues by Mathias Meyer
Search
Railsberry
April 22, 2013
Technology
1
140
Message Queues by Mathias Meyer
Watch the video here:
https://vimeo.com/68698333
Railsberry
April 22, 2013
Tweet
Share
More Decks by Railsberry
See All by Railsberry
Shipping Post-PC by Antek Piechnik & Marcin Bunsch
railsberry
0
140
Nodecopter by Felix Geisendoerfer
railsberry
0
93
Creative machines by Joseph Wilk
railsberry
1
130
Internal tools by Keavy McMinn
railsberry
1
160
Solid as diamond by Paolo Perego
railsberry
1
160
Future of Online Education by Gregg Pollack
railsberry
3
150
Lessons from the Masters by Geoffrey Grosenbach
railsberry
0
89
Go - a simple programming environment by Andrew Gerrand
railsberry
12
2.7k
Zero-confidence by Katrina Owen
railsberry
4
1.1k
Other Decks in Technology
See All in Technology
公共領域から学ぶ クラウド移行についてエンジニアが意識していること
kawakawa2222
0
140
Luupの開発組織におけるインシデントマネジメントの変遷 ver.RoadtoSRENEXT2024
grimoh
1
270
頼られるのが大好きな 皆さんへ - 支援相手との期待の合わせ方、突き放し方 -/For_people_who_like_to_be_relied_on
naitosatoshi
1
290
dxd2024-生成AIに振り回された3か月間の成功と失敗/dxd2024-link-and-motivation
lmi
2
260
OSSコミットしてZennの課題を解決した話
dyoshikawa1993
0
150
運用改善、不都合な真実 / 20240722-ssmjp-kaizen
opelab
17
8.2k
年間一億円削減した時系列データベースのアーキテクチャ改善~不確実性の高いプロジェクトへの挑戦~
lycorptech_jp
PRO
3
2.9k
20240724_cm_odyssey_hibiyatech
hiashisan
0
110
大規模ドラレコデータ収集・機械学習基盤を支える AWS CDK 〜導入・運用事例紹介〜
pemugi
0
110
Git 研修 Advanced【MIXI 24新卒技術研修】
mixi_engineers
PRO
0
200
E2Eテスト自動化プラットフォームにおけるAIの活用
shift_evolve
0
190
ゆめみのアクセシビリティの現在地と今後
ryokatsuse
3
290
Featured
See All Featured
Practical Orchestrator
shlominoach
185
10k
Side Projects
sachag
451
42k
Become a Pro
speakerdeck
PRO
15
4.8k
The Pragmatic Product Professional
lauravandoore
29
6.1k
Mobile First: as difficult as doing things right
swwweet
219
8.8k
YesSQL, Process and Tooling at Scale
rocio
166
14k
A Modern Web Designer's Workflow
chriscoyier
689
190k
CSS Pre-Processors: Stylus, Less & Sass
bermonpainter
353
29k
Build The Right Thing And Hit Your Dates
maggiecrowley
28
2.2k
The Success of Rails: Ensuring Growth for the Next 100 Years
eileencodes
35
6.3k
Bootstrapping a Software Product
garrettdimon
PRO
304
110k
Why Our Code Smells
bkeepers
PRO
332
56k
Transcript
the message queue is dead railsberry 2013, mathias meyer, @roidrage
travis-ci.org
None
None
None
the golden rules of message queues
#1 everything is a queue
www email upload live updates
rabbitmq activemq mqseries nsq beanstalkd sqs gearman qless kafka kestrel
qpid sidekiq resque zeromq celery mqseries stormmq amqp jms hornetq swiftmq delayed_job
tasks
publish/subscribe
publish/subscribe
broker
None
log streaming databass
None
unbounded queues
#2 a queue is either empty or infinitely full
the art of capacity planning
50 msg * 60 seconds * 30 minutes = 90000
msg
peak capacity: 120 msg/s
90000 msg / 120 msg/s = 12,5 min
None
#3 whenever something breaks, it's a queue backing up or
dropping messages
None
databass x x P x
None
retry databass x x P x
exponential backoff databass x x P x
handling queues involves business decisions
a thought experiment
message queues introduce tight coupling
hide the queue api
api
api
the queue is dead, long live the queue
no berries were harmed © railsberry