Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Scale the Google Way

Avatar for Terrence Ryan Terrence Ryan
July 30, 2015
Technology
120
1

Scale the Google Way

A discussion of issues with Google scaling technologies

Avatar for Terrence Ryan

Terrence Ryan

July 30, 2015

More Decks by Terrence Ryan

See All by Terrence Ryan
Vms, Serverless, or Containers
Avatar for Terrence Ryan tpryan
0
660
Go for PHP Developers
Avatar for Terrence Ryan tpryan
2
1.1k
Navigating Google Cloud Platform
Avatar for Terrence Ryan tpryan
0
460
Which Engine?
Avatar for Terrence Ryan tpryan
0
410
Introduction to Containers and Kubernetes
Avatar for Terrence Ryan tpryan
2
410
Cloud Next 2017 Roundup
Avatar for Terrence Ryan tpryan
2
200
LAMP in Containers
Avatar for Terrence Ryan tpryan
1
320
GCP and IoT
Avatar for Terrence Ryan tpryan
0
510
30,000,000 Requests in a Hour in the Cloud
Avatar for Terrence Ryan tpryan
2
410

Other Decks in Technology

See All in Technology
タクシーアプリ『GO』の実践的データ活用
Avatar for GO Inc. dev mot_techtalk
3
190
MIERUNE JCT 発表資料「宇宙から伊能忠敬ごっこ」
Avatar for じゃらしまる syuchimu
0
200
AWSシリコン最前線 〜AI時代のチップ選択を読み解く〜
Avatar for Hiroshi Tokoyo htokoyo
2
390
日本 Fintech 未来予測レポート 2027〜2028年（オリジナル版）
Avatar for 8maki 8maki
0
1.3k
自律型AIエージェントは何を破壊するのか
Avatar for kojira kojira
0
150
なぜ Platform Engineering の土台に Kubernetes を選ぶのか
Avatar for Ray r4ynode
1
560
失敗を経て、Harness Engineering で 大切にしたいことを考える / Learning from Failure: What Matters in Harness Engineering
Avatar for 株式会社ビットキー / Bitkey Inc. bitkey
PRO
1
290
手塩にかけりゃいいってもんじゃない
Avatar for ming ming_ayami
0
240
2026.06.13_AI時代に事業会社が「SIer出身エンジニア」を求める理由 / Why Businesses Seek Engineers with a System Integrator Background in the AI ​​Era
Avatar for jumpei_ikegami jumtech
0
1k
Oracle AI Database@AWS：サービス概要のご紹介
Avatar for oracle4engineer oracle4engineer
PRO
4
2.9k
エンジニアリング戦略の作り方 / Crafting Engineering Strategy
Avatar for iwashi iwashi86
19
6.4k
AI-DLCを活用した高品質・安全なAI駆動開発実践 / AI Driven Development with AI-DLC
Avatar for 吉田真吾 yoshidashingo
0
170

Featured

See All Featured
Leadership Guide Workshop - DevTernity 2021
Avatar for David Neal reverentgeek
1
300
Conquering PDFs: document understanding beyond plain text
Avatar for Ines Montani inesmontani
PRO
4
2.8k
Bridging the Design Gap: How Collaborative Modelling removes blockers to flow between stakeholders and teams @FastFlow conf
Avatar for Kenny Baas-Schwegler baasie
0
580
Git: the NoSQL Database
Avatar for Brandon Keepers bkeepers
PRO
432
67k
End of SEO as We Know It (SMX Advanced Version)
Avatar for Michael King ipullrank
3
4.2k
The SEO identity crisis: Don't let AI make you average
Avatar for Varn varn
0
490
世界の人気アプリ100個を分析して見えたペイウォール設計の心得
Avatar for Akihiro Kokubo akihiro_kokubo
PRO
71
40k
How to build an LLM SEO readiness audit: a practical framework
Avatar for Nick Samuel nmsamuel
1
770
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
Avatar for soudai sone soudai
PRO
201
75k
Winning Ecommerce Organic Search in an AI Era - #searchnstuff2025
Avatar for Aleyda Solis aleyda
1
2k
Tell your own story through comics
Avatar for letsgokoyo letsgokoyo
1
950
WENDY [Excerpt]
Avatar for Tessa Abrams tessaabrams
11
38k

Transcript

  1. @tpryan Scale the Google Way Terry Ryan Developer Advocate

  2. @tpryan Who are you?

  3. None
  4. None
  5. None
  6. None
  7. None
  8. None
  9. None

  10. @tpryan First Cluster History

  11. @tpryan First Cluster •Every machine had a role History

  12. @tpryan First Cluster •Every machine had a role •Every machine

    had a name History

  13. @tpryan First Rack History

  14. @tpryan First Rack •Machines belong to groups History

  15. @tpryan First Rack •Machines belong to groups •Slack capacity goes

    to waste History

  16. November 1998 December 1998 January 1999 February 1999 March 1999

    April 1999

  17. November 1998 December 1998 January 1999 February 1999 March 1999

    April 1999 December 1998 50,000

  18. November 1998 December 1998 January 1999 February 1999 March 1999

    April 1999 December 1998 50,000 January 1999 150,000

  19. November 1998 December 1998 January 1999 February 1999 March 1999

    April 1999 December 1998 50,000 January 1999 150,000 April 1999 500,000

  20. @tpryan Today’s Numbers History

  21. @tpryan Today’s Numbers •Over 3 Billion searches a day History

  22. @tpryan Today’s Numbers •Over 3 Billion searches a day •On

    a universe of over 60 Trillion urls. History

  23. @tpryan Today’s Numbers •Over 3 Billion searches a day •On

    a universe of over 60 Trillion urls. •We index over 20 billion a day History

  24. @tpryan Today’s Numbers •Over 3 Billion searches a day •On

    a universe of over 60 Trillion urls. •We index over 20 billion a day •Average time to deliver under 250ms History

  25. @tpryan Handling this growth took fundamental changes

  26. Networking

  27. 70 POP’s 33 Countries B4 WAN

  28. Jupiter Superblock

  29. Jupiter Superblock • 1 Petabit/sec

  30. Jupiter Superblock • 1 Petabit/sec • 100,000 Servers at 10GB/s

  31. Jupiter Superblock • 1 Petabit/sec • 100,000 Servers at 10GB/s

    • 10 Libraries of Congress a second

  32. Storage

  33. Colossus Datacenter wide storage

  34. Processing

  35. Productionized Containers

  36. Productionized Containers • Developed as only practical way to manage

    Google-scale compute

  37. Productionized Containers • Developed as only practical way to manage

    Google-scale compute • Everything at Google runs in a container

  38. Productionized Containers • Developed as only practical way to manage

    Google-scale compute • Everything at Google runs in a container • We launch over 2 Billion containers per week.

  39. @tpryan What does this mean for you?

  40. @tpryan

  41. @tpryan Big Table

  42. @tpryan Big Table

  43. @tpryan Big Table MapReduce

  44. @tpryan Big Table MapReduce

  45. @tpryan Big Table Dremel MapReduce

  46. @tpryan Big Table Dremel MapReduce

  47. @tpryan Big Table Borg Dremel MapReduce

  48. @tpryan Big Table Borg Dremel MapReduce

  49. @tpryan

  50. @tpryan Google Cloud Platform

  51. @tpryan Google Cloud Platform Compute

  52. @tpryan Google Cloud Platform Compute Storage

  53. @tpryan Google Cloud Platform Compute Connectivity Storage

  54. @tpryan Google Cloud Platform Compute Connectivity Big Data Storage

  55. @tpryan Google Cloud Platform Compute Connectivity Developer Tools Mobile Big

    Data Storage Management

  56. @tpryan Conclusions

  57. None
  58. None

  59. Your App Here

  60. @tpryan Thank You! terrenceryan.com @tpryan This preso: http://bit.ly/tpryan-scale This work

    is licensed under a Creative Commons Attribution 2.0 Generic License.