Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
To a thousand servers and beyond: scaling a massive PHP application
Search
Nikolay Bachiyski
February 25, 2012
Programming
3
1.2k
To a thousand servers and beyond: scaling a massive PHP application
Stories of abstraction and scaling WordPress.com. And what they have in common.
Nikolay Bachiyski
February 25, 2012
Tweet
Share
More Decks by Nikolay Bachiyski
See All by Nikolay Bachiyski
React.js for WordPress Developers
nb
0
220
Building Calypso-like Applications
nb
3
620
Else Considered Harmful
nb
2
790
On Learning
nb
2
590
WordPress: To OOP or not to OOP
nb
4
7.6k
On Creeds and Manifestos
nb
2
150
Welcome to the Chaos – The Distributed Workplace
nb
3
180
Взимане на продуктови решения (Making product decisions)
nb
0
100
Other Decks in Programming
See All in Programming
プールにゆこう
irof
2
120
ログラスを支える設計標準について / loglass-design-standards
urmot
10
2.1k
Elm 0.19.0 Changes
bkuhlmann
0
480
Ruby Function Composition
bkuhlmann
1
330
Semantic search with Django and pgvector
pauloxnet
0
240
本格ローグライク制作にEbitengineを選んでみた
nagainaganawa
0
290
1인 개발자로 행복하게 살기 - GDG 송도 헬로월드 2024
benjaminkim
1
5.6k
What We Can Learn From OSS
inouehi
0
400
StoreKit2によるiOSのアプリ内課金のリニューアル
kangnux
0
100
0→1と1→10の狭間で Javaという技術選定を振り返る/Reflecting on the Decision to Choose Java Between Scaling from 0 to 1 and 1 to 10
jaguar_imo
2
370
今の SmartHR にエンジニアで入社するとどうなるの?
daisukeshinoku
5
4.6k
脱・初心者!脱・マネコン!AWS CDKを使ってみませんか!?
har1101
0
300
Featured
See All Featured
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
eileencodes
124
32k
Gamification - CAS2011
davidbonilla
76
4.6k
Fight the Zombie Pattern Library - RWD Summit 2016
marcelosomers
226
16k
Navigating Team Friction
lara
177
13k
What's in a price? How to price your products and services
michaelherold
237
11k
A Modern Web Designer's Workflow
chriscoyier
688
190k
The Mythical Team-Month
searls
215
42k
How STYLIGHT went responsive
nonsquared
92
4.8k
Ruby is Unlike a Banana
tanoku
96
10k
Fontdeck: Realign not Redesign
paulrobertlloyd
76
4.9k
Build The Right Thing And Hit Your Dates
maggiecrowley
23
2k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
24
2.3k
Transcript
To 1000 servers and beyond Nikolay Bachiyski PHPUK 2012
http://extrapolate.me/ @nikolayb
None
None
None
Stinson Beach, July 2007
Budapest, Oct 2011
Jul, 2007 65MM Feb, 2011 800MM PV
2 stories
Story #1
Deep Pink Meet
Don’t like?
Beer Beheader =
None
None
Abstraction
None
Beer Theory
None
Want to be better?
Get to know the abstraction below
Servers are below
Story #2 Scaling WordPress.com
None
X
Deep Pink SAD
None
X
Deep Pink SAD
None
None
Users Blogs Blogs
No joins :(
None
SELECT * FROM wp_users WHERE id=43315 SELECT * FROM wp_posts
LIMIT 10
HyperDB
None
SELECT * FROM wp_users WHERE id=43315
Query parsing
add_db_table('user', 'wp_users') Dataset Table name
add_db_server('user', 0, 1, 0,
'db42.wordpress.com',…) Dataset Partition Read Write Slave
Failover X
Can work without
http://wordpress.org/extend/plugins/hyperdb/
None
None
C C C C
$count = wp_cache_get('posts', 'counts'); if ( false !== $count )
return $count; $count = $wpdb-‐>get_results($complex_query);
Output caching
10% 90% reads writes
C C C C
C C C C
Deep Pink SAD
Datacenter
C C sane sane
C C crazy sane Update
C C crazy sane Stale!
C C crazy crazy
Deploy
trunk/
Branch in code
~100 commits a day
~100 deploys a day
to ~1000 servers
One-click
None
Fast!
wpdev@nikolay:~$ deploy wpcom Going to update from 47127 to 47128
Syncing wpcom SVN Mirrors ORD (0s)... LUV (0s)... SAT (0s)... Deploying wpcom revision 47128 ORD (3s)... SAT (5s)... LUV (6s)... Revision 47128 successfully deployed (8s)
None
None
Yeah, immediately!
Push to twitter
Push to Facebok
Stats
Spam checks
Index for search
Invalidate caches
Publish the post
ASYNC JOBS
None
$job_id = queue_async_job($data, 'encode_video');
Priorities
Deferred jobs
None
PHP & MySQL
http://code.trac.wordpress.org/wiki/JobsDocs http://code.trac.wordpress.org/browser/jobs
Integration
Hacking
None