Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Scale the Google Way
Search
Terrence Ryan
July 30, 2015
Technology
1
93
Scale the Google Way
A discussion of issues with Google scaling technologies
Terrence Ryan
July 30, 2015
Tweet
Share
More Decks by Terrence Ryan
See All by Terrence Ryan
Vms, Serverless, or Containers
tpryan
0
610
Go for PHP Developers
tpryan
2
1k
Navigating Google Cloud Platform
tpryan
0
410
Which Engine?
tpryan
0
370
Introduction to Containers and Kubernetes
tpryan
2
360
Cloud Next 2017 Roundup
tpryan
2
160
LAMP in Containers
tpryan
1
270
GCP and IoT
tpryan
0
400
30,000,000 Requests in a Hour in the Cloud
tpryan
2
360
Other Decks in Technology
See All in Technology
AIのグローバルトレンド2025 #scrummikawa / global ai trend
kyonmm
PRO
1
310
新アイテムをどう使っていくか?みんなであーだこーだ言ってみよう / 20250911-rpi-jam-tokyo
akkiesoft
0
340
CDK CLIで使ってたあの機能、CDK Toolkit Libraryではどうやるの?
smt7174
4
190
Terraformで構築する セルフサービス型データプラットフォーム / terraform-self-service-data-platform
pei0804
1
190
「どこから読む?」コードとカルチャーに最速で馴染むための実践ガイド
zozotech
PRO
0
560
下手な強制、ダメ!絶対! 「ガードレール」を「檻」にさせない"ガバナンス"の取り方とは?
tsukaman
2
460
OCI Oracle Database Services新機能アップデート(2025/06-2025/08)
oracle4engineer
PRO
0
180
RSCの時代にReactとフレームワークの境界を探る
uhyo
10
3.5k
COVESA VSSによる車両データモデルの標準化とAWS IoT FleetWiseの活用
osawa
1
390
AI時代を生き抜くエンジニアキャリアの築き方 (AI-Native 時代、エンジニアという道は 「最大の挑戦の場」となる) / Building an Engineering Career to Thrive in the Age of AI (In the AI-Native Era, the Path of Engineering Becomes the Ultimate Arena of Challenge)
jeongjaesoon
0
240
💡Ruby 川辺で灯すPicoRubyからの光
bash0c7
0
120
20250913_JAWS_sysad_kobe
takuyay0ne
2
250
Featured
See All Featured
Building an army of robots
kneath
306
46k
Keith and Marios Guide to Fast Websites
keithpitt
411
22k
Music & Morning Musume
bryan
46
6.8k
Sharpening the Axe: The Primacy of Toolmaking
bcantrill
44
2.5k
Reflections from 52 weeks, 52 projects
jeffersonlam
352
21k
The Pragmatic Product Professional
lauravandoore
36
6.9k
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
marktimemedia
31
2.5k
Intergalactic Javascript Robots from Outer Space
tanoku
272
27k
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
sstephenson
162
15k
Let's Do A Bunch of Simple Stuff to Make Websites Faster
chriscoyier
507
140k
StorybookのUI Testing Handbookを読んだ
zakiyama
31
6.1k
Measuring & Analyzing Core Web Vitals
bluesmoon
9
580
Transcript
@tpryan Scale the Google Way Terry Ryan Developer Advocate
@tpryan Who are you?
None
None
None
None
None
None
None
@tpryan First Cluster History
@tpryan First Cluster •Every machine had a role History
@tpryan First Cluster •Every machine had a role •Every machine
had a name History
@tpryan First Rack History
@tpryan First Rack •Machines belong to groups History
@tpryan First Rack •Machines belong to groups •Slack capacity goes
to waste History
November 1998 December 1998 January 1999 February 1999 March 1999
April 1999
November 1998 December 1998 January 1999 February 1999 March 1999
April 1999 December 1998 50,000
November 1998 December 1998 January 1999 February 1999 March 1999
April 1999 December 1998 50,000 January 1999 150,000
November 1998 December 1998 January 1999 February 1999 March 1999
April 1999 December 1998 50,000 January 1999 150,000 April 1999 500,000
@tpryan Today’s Numbers History
@tpryan Today’s Numbers •Over 3 Billion searches a day History
@tpryan Today’s Numbers •Over 3 Billion searches a day •On
a universe of over 60 Trillion urls. History
@tpryan Today’s Numbers •Over 3 Billion searches a day •On
a universe of over 60 Trillion urls. •We index over 20 billion a day History
@tpryan Today’s Numbers •Over 3 Billion searches a day •On
a universe of over 60 Trillion urls. •We index over 20 billion a day •Average time to deliver under 250ms History
@tpryan Handling this growth took fundamental changes
Networking
70 POP’s 33 Countries B4 WAN
Jupiter Superblock
Jupiter Superblock • 1 Petabit/sec
Jupiter Superblock • 1 Petabit/sec • 100,000 Servers at 10GB/s
Jupiter Superblock • 1 Petabit/sec • 100,000 Servers at 10GB/s
• 10 Libraries of Congress a second
Storage
Colossus Datacenter wide storage
Processing
Productionized Containers
Productionized Containers • Developed as only practical way to manage
Google-scale compute
Productionized Containers • Developed as only practical way to manage
Google-scale compute • Everything at Google runs in a container
Productionized Containers • Developed as only practical way to manage
Google-scale compute • Everything at Google runs in a container • We launch over 2 Billion containers per week.
@tpryan What does this mean for you?
@tpryan
@tpryan Big Table
@tpryan Big Table
@tpryan Big Table MapReduce
@tpryan Big Table MapReduce
@tpryan Big Table Dremel MapReduce
@tpryan Big Table Dremel MapReduce
@tpryan Big Table Borg Dremel MapReduce
@tpryan Big Table Borg Dremel MapReduce
@tpryan
@tpryan Google Cloud Platform
@tpryan Google Cloud Platform Compute
@tpryan Google Cloud Platform Compute Storage
@tpryan Google Cloud Platform Compute Connectivity Storage
@tpryan Google Cloud Platform Compute Connectivity Big Data Storage
@tpryan Google Cloud Platform Compute Connectivity Developer Tools Mobile Big
Data Storage Management
@tpryan Conclusions
None
None
Your App Here
@tpryan Thank You! terrenceryan.com @tpryan This preso: http://bit.ly/tpryan-scale This work
is licensed under a Creative Commons Attribution 2.0 Generic License.