Upgrade to Pro — share decks privately, control downloads, hide ads and more …

To a thousand servers and beyond: scaling a massive PHP application

75fb365927cb3f5f7b677682d6249406?s=47 Nikolay Bachiyski
February 25, 2012
Programming
3
900

To a thousand servers and beyond: scaling a massive PHP application

Stories of abstraction and scaling WordPress.com. And what they have in common.

75fb365927cb3f5f7b677682d6249406?s=128

Nikolay Bachiyski

February 25, 2012
Tweet

More Decks by Nikolay Bachiyski

See All by Nikolay Bachiyski
75fb365927cb3f5f7b677682d6249406?s=48 nb
0
170
75fb365927cb3f5f7b677682d6249406?s=48 nb
3
410
75fb365927cb3f5f7b677682d6249406?s=48 nb
2
690
75fb365927cb3f5f7b677682d6249406?s=48 nb
2
260
75fb365927cb3f5f7b677682d6249406?s=48 nb
4
6.7k
75fb365927cb3f5f7b677682d6249406?s=48 nb
2
120
75fb365927cb3f5f7b677682d6249406?s=48 nb
3
150
75fb365927cb3f5f7b677682d6249406?s=48 nb
0
91

Other Decks in Programming

See All in Programming
Eae7b6aeee72d3081b01d09a2d675f9a?s=48 akkeylab
0
330
9eca6d3a5658ef22998083a3d8e7ec44?s=48 shigeruoda
0
460
A7a5efde86e0137d32a93d8609b7a022?s=48 yumcyawiz
4
610
A1b4b398630bbd32b77a82cbc37fae9a?s=48 freekmurze
0
200
8c870088e1f657062e661fdaf5ce6ec3?s=48 nauleyco
0
200
15934fa2aa7b2ce21f091e9b7cffa856?s=48 manfredsteyer
PRO
0
250
6ef7914944df6af99a2ca81e98087332?s=48 taoshotaro
1
360
3742ae4f74e584aed4f41c405232c3bb?s=48 yaamaa
0
410
E473e5af1263c050599921981db46068?s=48 akatsukinewgrad
0
150
Fa54d97af93719f9aa82873de3acb3b3?s=48 decoc
1
320
91b77d9a98b86e27838b183407270bc0?s=48 supikiti
3
1.3k
E37b4344ef4bfd0fc4826c04971e54fb?s=48 nrslib
20
13k

Featured

See All Featured
Fde6c3a50ca518a909ef35c22c0ee0e4?s=48 destraynor
146
19k
245cee81a9c424266e5e401d844ea881?s=48 lara
16
2.6k
1b8ad785acdd1ce1c99914b1c2a4e10e?s=48 sugarenia
233
830k
E76911cbe088e5b850d966de3fc7435b?s=48 robhawkes
52
2.8k
3ab1249be442027903e1180025340b3f?s=48 reverentgeek
27
1.9k
Eb8975af8e49e19e3dd6b6b84a542e26?s=48 qrush
285
18k
B3d6434763caa0ef5dc4b792662c49f7?s=48 smashingmag
283
47k
B3ace07412a5178ea778e7eec161fc0a?s=48 jcasabona
7
520
9fa239b3154a0169d99ab7bf1422dd12?s=48 marcelosomers
220
15k
64827b31aef81498662e8af4bd6d5157?s=48 jonrohan
1021
380k
91cefdf141106fa10674aae74ce05890?s=48 yeseniaperezcruz
302
31k
433acaea1012b25d97ae66da9b998dad?s=48 malarkey
393
60k

Transcript

  1. To 1000 servers and beyond Nikolay Bachiyski PHPUK 2012

  2. http://extrapolate.me/ @nikolayb

  3. None
  4. None
  5. None

  6. Stinson Beach, July 2007

  7. Budapest, Oct 2011

  8. Jul, 2007 65MM Feb, 2011 800MM PV

  9. 2 stories

  10. Story #1

  11. Deep Pink Meet

  12. Don’t like?

  13. Beer Beheader =

  14. None
  15. None

  16. Abstraction

  17. None

  18. Beer Theory

  19. None

  20. Want to be better?

  21. Get to know the abstraction below

  22. Servers are below

  23. Story #2 Scaling WordPress.com

  24. None

  25. X

  26. Deep Pink SAD

  27. None

  28. X

  29. Deep Pink SAD

  30. None
  31. None

  32. Users Blogs Blogs

  33. No joins :(

  34. None

  35. SELECT  *  FROM  wp_users  WHERE  id=43315 SELECT  *  FROM  wp_posts

     LIMIT  10

  36. HyperDB

  37. None

  38. SELECT  *  FROM  wp_users  WHERE  id=43315

  39. Query parsing

  40. add_db_table('user',  'wp_users') Dataset Table name

  41. add_db_server('user',  0,  1,  0,            

    'db42.wordpress.com',…) Dataset Partition Read Write Slave

  42. Failover X

  43. Can work without

  44. http://wordpress.org/extend/plugins/hyperdb/

  45. None
  46. None

  47. C C C C

  48. $count  =  wp_cache_get('posts',  'counts'); if  (  false  !==  $count  )

           return  $count; $count  =  $wpdb-­‐>get_results($complex_query);

  49. Output caching

  50. 10% 90% reads writes

  51. C C C C

  52. C C C C

  53. Deep Pink SAD

  54. Datacenter

  55. C C sane sane

  56. C C crazy sane Update

  57. C C crazy sane Stale!

  58. C C crazy crazy

  59. Deploy

  60. trunk/

  61. Branch in code

  62. ~100 commits a day

  63. ~100 deploys a day

  64. to ~1000 servers

  65. One-click

  66. None

  67. Fast!

  68. wpdev@nikolay:~$  deploy  wpcom Going  to  update  from  47127  to  47128

    Syncing  wpcom  SVN  Mirrors   ORD  (0s)...   LUV  (0s)...   SAT  (0s)... Deploying  wpcom    revision  47128   ORD  (3s)...   SAT  (5s)...   LUV  (6s)... Revision  47128  successfully  deployed  (8s)
  69. None
  70. None

  71. Yeah, immediately!

  72. Push to twitter

  73. Push to Facebok

  74. Stats

  75. Spam checks

  76. Index for search

  77. Invalidate caches

  78. Publish the post

  79. ASYNC JOBS

  80. None

  81. $job_id  =  queue_async_job($data,  'encode_video');

  82. Priorities

  83. Deferred jobs

  84. None

  85. PHP & MySQL

  86. http://code.trac.wordpress.org/wiki/JobsDocs http://code.trac.wordpress.org/browser/jobs

  87. Integration

  88. Hacking

  89. None