Upgrade to Pro — share decks privately, control downloads, hide ads and more …

To a thousand servers and beyond: scaling a mas...

Avatar for Nikolay Bachiyski Nikolay Bachiyski
February 25, 2012
Programming
1.5k
3

To a thousand servers and beyond: scaling a massive PHP application

Stories of abstraction and scaling WordPress.com. And what they have in common.

Avatar for Nikolay Bachiyski

Nikolay Bachiyski

February 25, 2012

More Decks by Nikolay Bachiyski

See All by Nikolay Bachiyski
React.js for WordPress Developers
Avatar for Nikolay Bachiyski nb
0
290
Building Calypso-like Applications
Avatar for Nikolay Bachiyski nb
3
870
Else Considered Harmful
Avatar for Nikolay Bachiyski nb
2
1.1k
On Learning
Avatar for Nikolay Bachiyski nb
2
820
WordPress: To OOP or not to OOP
Avatar for Nikolay Bachiyski nb
4
8.1k
On Creeds and Manifestos
Avatar for Nikolay Bachiyski nb
2
230
Welcome to the Chaos – The Distributed Workplace
Avatar for Nikolay Bachiyski nb
3
240
Взимане на продуктови решения (Making product decisions)
Avatar for Nikolay Bachiyski nb
0
170

Other Decks in Programming

See All in Programming
【SRE NEXT 2026 Lunch Session】一人目専任SREの立ち上げを加速する ― AIと進めたオンボーディングで2分を0.04秒にした話
Avatar for PKSHA Technology（パークシャテクノロジー） pkshadeck
PRO
0
2.9k
AIエージェントで 変わるAndroid開発環境
Avatar for takahirom takahirom
2
700
全PRの83%がAIレビューだけでマージできるようになった開発組織はその後どうなったか
Avatar for a-thug athug
0
280
1年で人数1.5倍、PR数5.5倍増。 品質とアウトカムはどうなったか、 何が効いたか
Avatar for ike ike002jp
0
140
FDEが実現するAI駆動経営の現在地
Avatar for ryuta sakamoto gonta
2
200
【やさしく解説 設計編・中級 #4】ルールの寿命と、システムの年輪
Avatar for HideyukiKitao panda728
PRO
2
160
【やさしく解説 設計編・中級 #1】一つの車に、運転手は一人　～ある倉庫システムの事例から～
Avatar for HideyukiKitao panda728
PRO
0
190
Built Our Own Background Agent at LayerX #aidevex_findy
Avatar for LayerX layerx
PRO
8
3k
鹿野さんに聞く！『TypeScriptコードレシピ集』で磨く実践力
Avatar for tonkotsuboy_com tonkotsuboy_com
4
1.1k
Augmenting AI with the Power of Jakarta EE
Avatar for ivargrimstad ivargrimstad
0
140
継続モナドとリアクティブプログラミング
Avatar for ゆきくらげ yukikurage
3
620
ビデオ通話が繋がる0.2秒で何が起きているのか
Avatar for Miyamoto Naoyuki supurazako
2
150

Featured

See All Featured
[SF Ruby Conf 2025] Rails X
Avatar for Vladimir Dementyev palkan
2
1.2k
The State of eCommerce SEO: How to Win in Today's Products SERPs - #SEOweek
Avatar for Aleyda Solis aleyda
2
11k
The untapped power of vector embeddings
Avatar for Frank van Dijk frankvandijk
2
1.8k
A designer walks into a library…
Avatar for Paul Jervis Heath pauljervisheath
211
24k
Done Done
Avatar for chrislema chrislema
186
16k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
Avatar for mongodb mongodb
49
10k
Ruling the World: When Life Gets Gamed
Avatar for Sebastian Deterding codingconduct
0
290
Efficient Content Optimization with Google Search Console & Apps Script
Avatar for Katarina Dahlin katarinadahlin
PRO
1
730
Winning Ecommerce Organic Search in an AI Era - #searchnstuff2025
Avatar for Aleyda Solis aleyda
1
2.1k
The agentic SEO stack - context over prompts
Avatar for schlessera schlessera
0
850
SEO Brein meetup: CTRL+C is not how to scale international SEO
Avatar for Linda Hogenes lindahogenes
1
2.8k
Testing 201, or: Great Expectations
Avatar for Joseph Mastey jmmastey
46
8.2k

Transcript

  1. To 1000 servers and beyond Nikolay Bachiyski PHPUK 2012

  2. http://extrapolate.me/ @nikolayb

  3. None
  4. None
  5. None

  6. Stinson Beach, July 2007

  7. Budapest, Oct 2011

  8. Jul, 2007 65MM Feb, 2011 800MM PV

  9. 2 stories

  10. Story #1

  11. Deep Pink Meet

  12. Don’t like?

  13. Beer Beheader =

  14. None
  15. None

  16. Abstraction

  17. None

  18. Beer Theory

  19. None

  20. Want to be better?

  21. Get to know the abstraction below

  22. Servers are below

  23. Story #2 Scaling WordPress.com

  24. None

  25. X

  26. Deep Pink SAD

  27. None

  28. X

  29. Deep Pink SAD

  30. None
  31. None

  32. Users Blogs Blogs

  33. No joins :(

  34. None

  35. SELECT  *  FROM  wp_users  WHERE  id=43315 SELECT  *  FROM  wp_posts

     LIMIT  10

  36. HyperDB

  37. None

  38. SELECT  *  FROM  wp_users  WHERE  id=43315

  39. Query parsing

  40. add_db_table('user',  'wp_users') Dataset Table name

  41. add_db_server('user',  0,  1,  0,            

    'db42.wordpress.com',…) Dataset Partition Read Write Slave

  42. Failover X

  43. Can work without

  44. http://wordpress.org/extend/plugins/hyperdb/

  45. None
  46. None

  47. C C C C

  48. $count  =  wp_cache_get('posts',  'counts'); if  (  false  !==  $count  )

           return  $count; $count  =  $wpdb-­‐>get_results($complex_query);

  49. Output caching

  50. 10% 90% reads writes

  51. C C C C

  52. C C C C

  53. Deep Pink SAD

  54. Datacenter

  55. C C sane sane

  56. C C crazy sane Update

  57. C C crazy sane Stale!

  58. C C crazy crazy

  59. Deploy

  60. trunk/

  61. Branch in code

  62. ~100 commits a day

  63. ~100 deploys a day

  64. to ~1000 servers

  65. One-click

  66. None

  67. Fast!

  68. wpdev@nikolay:~$  deploy  wpcom Going  to  update  from  47127  to  47128

    Syncing  wpcom  SVN  Mirrors   ORD  (0s)...   LUV  (0s)...   SAT  (0s)... Deploying  wpcom    revision  47128   ORD  (3s)...   SAT  (5s)...   LUV  (6s)... Revision  47128  successfully  deployed  (8s)
  69. None
  70. None

  71. Yeah, immediately!

  72. Push to twitter

  73. Push to Facebok

  74. Stats

  75. Spam checks

  76. Index for search

  77. Invalidate caches

  78. Publish the post

  79. ASYNC JOBS

  80. None

  81. $job_id  =  queue_async_job($data,  'encode_video');

  82. Priorities

  83. Deferred jobs

  84. None

  85. PHP & MySQL

  86. http://code.trac.wordpress.org/wiki/JobsDocs http://code.trac.wordpress.org/browser/jobs

  87. Integration

  88. Hacking

  89. None