Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Scaling CANDDi
Search
coldclimate
July 29, 2013
Technology
0
260
Scaling CANDDi
for
http://www.supermondays.org/
coldclimate
July 29, 2013
Tweet
Share
More Decks by coldclimate
See All by coldclimate
You don't scale like servers scale
coldclimate
0
130
Quick and dirty load testing with Vegeta
coldclimate
3
4.1k
Continuously deploying https served statically compiled sites to S3 with canonical domains
coldclimate
0
71
Scripting creating AWS based servers
coldclimate
0
270
refactoring
coldclimate
1
130
Other Decks in Technology
See All in Technology
SpannerとAurora DSQLの同時実行制御の違いに想いを馳せる
masakikato5
0
470
VISITS_20250311_こねくとあいとりおす.pdf
iotcomjpadmin
0
220
3/26 クラウド食堂LT #2 GenU案件を通して学んだ教訓 登壇資料
ymae
1
120
Amazon Q Developer 他⽣成AIと⽐較してみた
takano0131
1
110
モンテカルロ木探索のパフォーマンスを予測する Kaggleコンペ解説 〜生成AIによる未知のゲーム生成〜
rist
3
820
空が堕ち、大地が割れ、海が涸れた日~もしも愛用しているフレームワークが開発停止したら?~ #phperkaigi 2025
77web
2
960
AIエージェント完全に理解した
segavvy
4
210
チームの性質によって変わる ADR との向き合い方と、生成 AI 時代のこれから / How to deal with ADR depends on the characteristics of the team
mh4gf
4
280
Redefine_Possible
upsider_tech
0
160
RubyKaigi 2025でプロポーザルが初めて採択されるまでにやったこと
yuuu
1
270
[CATS]Amazon Bedrock GenUハンズオン座学資料 #2 GenU環境でRAGを体験してみよう
tsukuboshi
0
120
AI・LLM事業部のSREとタスクの自動運転
shinyorke
PRO
0
260
Featured
See All Featured
The Pragmatic Product Professional
lauravandoore
33
6.5k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
45
9.5k
Side Projects
sachag
452
42k
Adopting Sorbet at Scale
ufuk
75
9.3k
Fantastic passwords and where to find them - at NoRuKo
philnash
51
3.1k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
jcasabona
32
2.2k
Testing 201, or: Great Expectations
jmmastey
42
7.3k
JavaScript: Past, Present, and Future - NDC Porto 2020
reverentgeek
47
5.3k
How to Ace a Technical Interview
jacobian
276
23k
Distributed Sagas: A Protocol for Coordinating Microservices
caitiem20
331
21k
The Web Performance Landscape in 2024 [PerfNow 2024]
tammyeverts
4
490
Understanding Cognitive Biases in Performance Measurement
bluesmoon
27
1.6k
Transcript
Scaling CANDDi oli wood @coldclimate
history
measure things that matter
back of a fag packet if good enough
have somewhere to test which is not live
use realistic data
ab/siege + ec2 instances
there are no silver bullets
aim for a silver shotgun cartridge
define the scenarios
build a pipeline view
identify symptoms but solve problems
symptoms are what you can see
problems are what you can solve
bad new: the problem is your code
good news: thus you can fix it
do less big things less often
do frequent things much faster
avoid waiting
pull less data
cache the painful things
cache: in memory
cache: redis/memcache
cache: url/browser cache
hunt collisions
use the tools
iostat
sar -P
strace -p
iftop
xdebug + webgrind
statsd
mongotop
mongosniff
tail -100000 mongodb. log | awk -F' ' '{print $NF}'
| grep ms$ | sed 's/ms//g' |sort -n | tail -20 | xargs -I {} grep {} ms$ mongodb.log
and the big gestures
nginx
nodejs
redis
aim: loosely coupled components which are horizontally scalable both on
box and by box
BULLSHIT
aim: fast enough for medium term business needs
aim: not to waste time in a geek circle jerk
result: 10x the throughput
result: 2000 non- trivial inbound events a second
good luck