Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Scaling CANDDi
Search
coldclimate
July 29, 2013
Technology
0
200
Scaling CANDDi
for
http://www.supermondays.org/
coldclimate
July 29, 2013
Tweet
Share
More Decks by coldclimate
See All by coldclimate
You don't scale like servers scale
coldclimate
0
100
Quick and dirty load testing with Vegeta
coldclimate
3
3.9k
Continuously deploying https served statically compiled sites to S3 with canonical domains
coldclimate
0
59
Scripting creating AWS based servers
coldclimate
0
210
refactoring
coldclimate
1
120
Other Decks in Technology
See All in Technology
カオナビの利用実績をアウトカムへつなげる旅 / example-of-data-management-startup-in-kaonavi
kaonavi
0
110
2024/4/26 コンピュータ歴史博物館解説告知
toshi_atsumi
0
190
Hands-on / Kaname Frusawa / Cloud Compare Users Meetup 2024 at University of Tokyo on April 17
paraworld
2
470
疲弊しない!AWSセキュリティ統制の考え方 #devio_osakaday1
masahirokawahara
6
5.8k
Tableau事例紹介 / Tableau Case Study of Eureka
kazuya_araki_tokyo
1
170
The AI Revolution Will Not Be Monopolized: How open-source beats economies of scale, even for LLMs
inesmontani
PRO
1
630
日本におけるデータエンジニアリングのこれまでとこれから
foursue
9
1.9k
TransitGatewayの基礎
toru_kubota
0
230
DevOpsDays History and my DevOps story
kawaguti
PRO
7
1.3k
転移学習とドメイン適応の基礎
kmatsui
2
570
[2024年3月版] Databricksのシステムアーキテクチャ
databricksjapan
7
1.9k
強みを伸ばすキャリアデザイン
yug1224
0
200
Featured
See All Featured
Facilitating Awesome Meetings
lara
40
5.6k
Docker and Python
trallard
33
2.7k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
24
2.3k
XXLCSS - How to scale CSS and keep your sanity
sugarenia
240
1.2M
A Philosophy of Restraint
colly
195
16k
How GitHub Uses GitHub to Build GitHub
holman
468
290k
StorybookのUI Testing Handbookを読んだ
zakiyama
10
4.5k
Principles of Awesome APIs and How to Build Them.
keavy
119
16k
How to Ace a Technical Interview
jacobian
272
22k
A better future with KSS
kneath
230
16k
The Cult of Friendly URLs
andyhume
73
5.7k
Faster Mobile Websites
deanohume
296
30k
Transcript
Scaling CANDDi oli wood @coldclimate
history
measure things that matter
back of a fag packet if good enough
have somewhere to test which is not live
use realistic data
ab/siege + ec2 instances
there are no silver bullets
aim for a silver shotgun cartridge
define the scenarios
build a pipeline view
identify symptoms but solve problems
symptoms are what you can see
problems are what you can solve
bad new: the problem is your code
good news: thus you can fix it
do less big things less often
do frequent things much faster
avoid waiting
pull less data
cache the painful things
cache: in memory
cache: redis/memcache
cache: url/browser cache
hunt collisions
use the tools
iostat
sar -P
strace -p
iftop
xdebug + webgrind
statsd
mongotop
mongosniff
tail -100000 mongodb. log | awk -F' ' '{print $NF}'
| grep ms$ | sed 's/ms//g' |sort -n | tail -20 | xargs -I {} grep {} ms$ mongodb.log
and the big gestures
nginx
nodejs
redis
aim: loosely coupled components which are horizontally scalable both on
box and by box
BULLSHIT
aim: fast enough for medium term business needs
aim: not to waste time in a geek circle jerk
result: 10x the throughput
result: 2000 non- trivial inbound events a second
good luck