Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
To a thousand servers and beyond: scaling a massive PHP application
Search
Nikolay Bachiyski
February 25, 2012
Programming
3
1.3k
To a thousand servers and beyond: scaling a massive PHP application
Stories of abstraction and scaling WordPress.com. And what they have in common.
Nikolay Bachiyski
February 25, 2012
Tweet
Share
More Decks by Nikolay Bachiyski
See All by Nikolay Bachiyski
React.js for WordPress Developers
nb
0
230
Building Calypso-like Applications
nb
3
670
Else Considered Harmful
nb
2
820
On Learning
nb
2
640
WordPress: To OOP or not to OOP
nb
4
7.7k
On Creeds and Manifestos
nb
2
150
Welcome to the Chaos – The Distributed Workplace
nb
3
180
Взимане на продуктови решения (Making product decisions)
nb
0
110
Other Decks in Programming
See All in Programming
20240706_CDKConf
takuyay0ne
0
1.2k
実用的かつリーズナブルな 「Azure × Gemini × LINE」~キャラクターBot 実装ライブデモ~
tomodo_ysys
1
170
Exploring the Gradually Lost Technical Skills in the Cloud Native Era
hwchiu
2
3.9k
みんなのオブザーバビリティプラットフォームを作ってるんだがパフォーマンスがやばい #mackerelio #srenext
ne_sachirou
0
380
コード生成を伴うLLMエージェント - 2024.07.18 Tokyo AI
smiyawaki0820
11
4.1k
今こそ始める、CDKコンストラクトライブラリ開発 ― 入門から実践まで
tmokmss
1
930
Modern Angular: Renovation for Your Applications
manfredsteyer
PRO
0
140
データカタログ運用物語 〜令和6年夏の理想と現実〜
kuro_kurorrr
0
110
Findy - エンジニア向け会社紹介 / Findy Letter for Engineers
findyinc
2
81k
I/O Extended Android in Korea 2024 ~ Whats new in Android development tools
pluu
0
250
小さな開発会社を作った理由
polidog
0
1.9k
Advanced App Shrinking Techniques
cbeyls
2
150
Featured
See All Featured
How To Stay Up To Date on Web Technology
chriscoyier
784
250k
Testing 201, or: Great Expectations
jmmastey
33
6.9k
How to Think Like a Performance Engineer
csswizardry
4
590
Build The Right Thing And Hit Your Dates
maggiecrowley
28
2.2k
What's new in Ruby 2.0
geeforr
338
31k
Making the Leap to Tech Lead
cromwellryan
127
8.7k
Faster Mobile Websites
deanohume
303
30k
Fantastic passwords and where to find them - at NoRuKo
philnash
42
2.7k
Writing Fast Ruby
sferik
623
60k
Bootstrapping a Software Product
garrettdimon
PRO
304
110k
What's in a price? How to price your products and services
michaelherold
239
11k
Understanding Cognitive Biases in Performance Measurement
bluesmoon
18
1.2k
Transcript
To 1000 servers and beyond Nikolay Bachiyski PHPUK 2012
http://extrapolate.me/ @nikolayb
None
None
None
Stinson Beach, July 2007
Budapest, Oct 2011
Jul, 2007 65MM Feb, 2011 800MM PV
2 stories
Story #1
Deep Pink Meet
Don’t like?
Beer Beheader =
None
None
Abstraction
None
Beer Theory
None
Want to be better?
Get to know the abstraction below
Servers are below
Story #2 Scaling WordPress.com
None
X
Deep Pink SAD
None
X
Deep Pink SAD
None
None
Users Blogs Blogs
No joins :(
None
SELECT * FROM wp_users WHERE id=43315 SELECT * FROM wp_posts
LIMIT 10
HyperDB
None
SELECT * FROM wp_users WHERE id=43315
Query parsing
add_db_table('user', 'wp_users') Dataset Table name
add_db_server('user', 0, 1, 0,
'db42.wordpress.com',…) Dataset Partition Read Write Slave
Failover X
Can work without
http://wordpress.org/extend/plugins/hyperdb/
None
None
C C C C
$count = wp_cache_get('posts', 'counts'); if ( false !== $count )
return $count; $count = $wpdb-‐>get_results($complex_query);
Output caching
10% 90% reads writes
C C C C
C C C C
Deep Pink SAD
Datacenter
C C sane sane
C C crazy sane Update
C C crazy sane Stale!
C C crazy crazy
Deploy
trunk/
Branch in code
~100 commits a day
~100 deploys a day
to ~1000 servers
One-click
None
Fast!
wpdev@nikolay:~$ deploy wpcom Going to update from 47127 to 47128
Syncing wpcom SVN Mirrors ORD (0s)... LUV (0s)... SAT (0s)... Deploying wpcom revision 47128 ORD (3s)... SAT (5s)... LUV (6s)... Revision 47128 successfully deployed (8s)
None
None
Yeah, immediately!
Push to twitter
Push to Facebok
Stats
Spam checks
Index for search
Invalidate caches
Publish the post
ASYNC JOBS
None
$job_id = queue_async_job($data, 'encode_video');
Priorities
Deferred jobs
None
PHP & MySQL
http://code.trac.wordpress.org/wiki/JobsDocs http://code.trac.wordpress.org/browser/jobs
Integration
Hacking
None