Upgrade to Pro — share decks privately, control downloads, hide ads and more …

To a thousand servers and beyond: scaling a mas...

Sponsored · SiteGround - Reliable hosting with speed, security, and support you can count on. →
Avatar for Nikolay Bachiyski Nikolay Bachiyski
February 25, 2012
Programming
1.5k
3

To a thousand servers and beyond: scaling a massive PHP application

Stories of abstraction and scaling WordPress.com. And what they have in common.

Avatar for Nikolay Bachiyski

Nikolay Bachiyski

February 25, 2012

More Decks by Nikolay Bachiyski

See All by Nikolay Bachiyski
React.js for WordPress Developers
Avatar for Nikolay Bachiyski nb
0
290
Building Calypso-like Applications
Avatar for Nikolay Bachiyski nb
3
860
Else Considered Harmful
Avatar for Nikolay Bachiyski nb
2
1.1k
On Learning
Avatar for Nikolay Bachiyski nb
2
810
WordPress: To OOP or not to OOP
Avatar for Nikolay Bachiyski nb
4
8.1k
On Creeds and Manifestos
Avatar for Nikolay Bachiyski nb
2
220
Welcome to the Chaos – The Distributed Workplace
Avatar for Nikolay Bachiyski nb
3
230
Взимане на продуктови решения (Making product decisions)
Avatar for Nikolay Bachiyski nb
0
160

Other Decks in Programming

See All in Programming
SPMマルチモジュールで テストカバレッジを取得する技法
Avatar for yosshi yosshi4486
0
140
メソッドのジェネリクスでGoの夢は広がるか？ / Kyoto.go #65
Avatar for utagawa kiki utgwkk
2
360
AI時代の仕事技芸論 — ソフトウェア開発で「遊ぶように働く」職人的熟達のすすめ
Avatar for Yoshihito Kuranuki / 倉貫義人 kuranuki
1
580
サーバーレスで作る、動画データ管理基盤
Avatar for Keigo Ibaraki oyasumipants
0
340
Oxcを導入して開発体験が向上した話
Avatar for Yuji Yamaguchi yug1224
4
270
PHPで使える日時の表現と、その知り方 #frontend_phpcon_do
Avatar for hideki kinjyo o0h
PRO
0
170
AI時代のUIはどこへ行く？その2！
Avatar for Yusuke Wada yusukebe
19
6.2k
Oxlintはいかにしてtsgolintのlint ruleを呼び出しているのか
Avatar for syumai syumai
2
1.1k
プラグインで拡張される Context をtype-safe にする難しさと設計判断
Avatar for kazupon kazupon
2
540
inferと仲良くなる10分間
Avatar for ryokatsuse ryokatsuse
1
330
ユニットテストの先へ：テスト技法で要求・仕様を整理するJava開発実践 / Beyond_Unit_Testing_Practical_Java_Development_Techniques_for_Organizing_Requirements_and_Specifications
Avatar for SHIMANE, Yoshikazu shimashima35
0
320
生成AI時代にこそ効くGo | Why Go Works in the Age of Generative AI
Avatar for mom0tomo mom0tomo
8
3.1k

Featured

See All Featured
[RailsConf 2023 Opening Keynote] The Magic of Rails
Avatar for Eileen M. Uchitelle eileencodes
31
10k
Discover your Explorer Soul
Avatar for Emna emna__ayadi
2
1.1k
BBQ
Avatar for Matthew Crist matthewcrist
89
10k
Learning to Love Humans: Emotional Interface Design
Avatar for Aarron Walter aarron
275
41k
Code Reviewing Like a Champion
Avatar for maltzj maltzj
528
40k
The Director’s Chair: Orchestrating AI for Truly Effective Learning
Avatar for Mike Taylor tmiket
1
180
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
Avatar for Kevin Liebholz kevinliebholz
37
6.5k
ラッコキーワード サービス紹介資料
Avatar for ラッコ株式会社 rakko
1
3.5M
Helping Users Find Their Own Way: Creating Modern Search Experiences
Avatar for Dan Newman danielanewman
31
3.2k
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
Avatar for panda_program panda_program
122
22k
The State of eCommerce SEO: How to Win in Today's Products SERPs - #SEOweek
Avatar for Aleyda Solis aleyda
2
11k
Understanding Cognitive Biases in Performance Measurement
Avatar for Philip Tellis bluesmoon
32
2.9k

Transcript

  1. To 1000 servers and beyond Nikolay Bachiyski PHPUK 2012

  2. http://extrapolate.me/ @nikolayb

  3. None
  4. None
  5. None

  6. Stinson Beach, July 2007

  7. Budapest, Oct 2011

  8. Jul, 2007 65MM Feb, 2011 800MM PV

  9. 2 stories

  10. Story #1

  11. Deep Pink Meet

  12. Don’t like?

  13. Beer Beheader =

  14. None
  15. None

  16. Abstraction

  17. None

  18. Beer Theory

  19. None

  20. Want to be better?

  21. Get to know the abstraction below

  22. Servers are below

  23. Story #2 Scaling WordPress.com

  24. None

  25. X

  26. Deep Pink SAD

  27. None

  28. X

  29. Deep Pink SAD

  30. None
  31. None

  32. Users Blogs Blogs

  33. No joins :(

  34. None

  35. SELECT  *  FROM  wp_users  WHERE  id=43315 SELECT  *  FROM  wp_posts

     LIMIT  10

  36. HyperDB

  37. None

  38. SELECT  *  FROM  wp_users  WHERE  id=43315

  39. Query parsing

  40. add_db_table('user',  'wp_users') Dataset Table name

  41. add_db_server('user',  0,  1,  0,            

    'db42.wordpress.com',…) Dataset Partition Read Write Slave

  42. Failover X

  43. Can work without

  44. http://wordpress.org/extend/plugins/hyperdb/

  45. None
  46. None

  47. C C C C

  48. $count  =  wp_cache_get('posts',  'counts'); if  (  false  !==  $count  )

           return  $count; $count  =  $wpdb-­‐>get_results($complex_query);

  49. Output caching

  50. 10% 90% reads writes

  51. C C C C

  52. C C C C

  53. Deep Pink SAD

  54. Datacenter

  55. C C sane sane

  56. C C crazy sane Update

  57. C C crazy sane Stale!

  58. C C crazy crazy

  59. Deploy

  60. trunk/

  61. Branch in code

  62. ~100 commits a day

  63. ~100 deploys a day

  64. to ~1000 servers

  65. One-click

  66. None

  67. Fast!

  68. wpdev@nikolay:~$  deploy  wpcom Going  to  update  from  47127  to  47128

    Syncing  wpcom  SVN  Mirrors   ORD  (0s)...   LUV  (0s)...   SAT  (0s)... Deploying  wpcom    revision  47128   ORD  (3s)...   SAT  (5s)...   LUV  (6s)... Revision  47128  successfully  deployed  (8s)
  69. None
  70. None

  71. Yeah, immediately!

  72. Push to twitter

  73. Push to Facebok

  74. Stats

  75. Spam checks

  76. Index for search

  77. Invalidate caches

  78. Publish the post

  79. ASYNC JOBS

  80. None

  81. $job_id  =  queue_async_job($data,  'encode_video');

  82. Priorities

  83. Deferred jobs

  84. None

  85. PHP & MySQL

  86. http://code.trac.wordpress.org/wiki/JobsDocs http://code.trac.wordpress.org/browser/jobs

  87. Integration

  88. Hacking

  89. None