The Datacenter as a Computer
An Introduction to the Design of
Warehouse-Scale Machines
http://www.cs.berkeley.edu/~rxin/db-papers/WarehouseScaleComputing.pdf
CPU Mem Disk Net
Cooling
Circuits
Power
App
OS User
Silicon
Slide 14
Slide 14 text
CPU Mem Disk Net
Cooling
Circuits
Power
App
OS User
Silicon
Slide 15
Slide 15 text
CPU Mem Disk Net App
OS
Slide 16
Slide 16 text
App
OS
CPU Mem Disk Net
Slide 17
Slide 17 text
CPU Mem Disk Net Data
Batch
Biz logic
Resource mgmt
Abstraction Index
Slide 18
Slide 18 text
CPU Mem Disk Net Data
Batch
Biz logic
Resource mgmt
Abstraction Index
Slide 19
Slide 19 text
CPU Mem Disk Net Data
Batch
Biz logic
Resource mgmt
Compute
resources
Distributed storage
Local
disk
Physical
network
Software
defined
network
Abstraction Index
Slide 20
Slide 20 text
CPU Mem Disk Net Data
Batch
Biz logic
Resource mgmt
Compute
resources
Distributed storage
Local
disk
Physical
network
Software
defined
network
Scheduler
Service discovery
Config mgmt
Abstraction
Virtualization
Index
Slide 21
Slide 21 text
CPU Mem Disk Net Data
Batch
Biz logic
Resource mgmt
Compute
resources
Distributed storage
Local
disk
Physical
network
Software
defined
network
Scheduler
Service discovery
Config mgmt
Abstraction
Virtualization
Database
Data
warehouse
Biz logic
Index
Slide 22
Slide 22 text
Compute
resources
Distributed storage
Local
disk
Physical
network
Software
defined
network
Scheduler
Service discovery
Config mgmt
Virtualization
Database
Data
warehouse
Biz logic
Slide 23
Slide 23 text
Compute
resources
Distributed storage
Local
disk
Physical
network
Software
defined
network
Virtualization
Database
Data
warehouse
Biz logic
Scheduler
Service discovery
Config mgmt
Slide 24
Slide 24 text
Compute
resources
Distributed storage
Local
disk
Physical
network
Software
defined
network
Virtualization
Database
Data
warehouse
Biz logic
Scheduler
Config mgmt
Service discovery
Slide 25
Slide 25 text
Database
RDBMS AP CP Document Transactional
Oracle
MySQL
Postgres
Dynamo
Voldemort
Cassandra
Riak
Chubby
ZooKeeper
etcd
Consul
Mongo
Couch
Redis
F1
Cockroach
Rethink
Slide 26
Slide 26 text
Data warehouse
Hadoop RedShift BigQuery
Spark Mahout
Hbase Pig ···
Compute
resources
Distributed storage
Local
disk
Physical
network
Software
defined
network
Virtualization
Database
Data
warehouse
Biz logic
Scheduler
Config mgmt
Service discovery
Slide 29
Slide 29 text
Compute
resources
Distributed storage
Local
disk
Physical
network
Software
defined
network
Virtualization
Data Biz logic
Scheduler
Service discovery
Config mgmt
Slide 30
Slide 30 text
Compute
resources
Distributed storage
Local
disk
Physical
network
Software
defined
network
Virtualization
Data Biz logic
Scheduler
Service discovery
Config mgmt
Slide 31
Slide 31 text
Biz logic
Monolith
Slide 32
Slide 32 text
Biz logic
Foo
service
Bar
service
Baz
service
Users
service
Auth
service
Search
service
Reports
service
Audit
service
Slide 33
Slide 33 text
Biz logic
Foo
service
Bar
service
Baz
service
Users
service
Auth
service
Search
service
Reports
service
Audit
service
Slide 34
Slide 34 text
Biz logic
Foo
service
Bar
service
Baz
service
Users
service
Auth
service
Search
service
Reports
service
Audit
service
Continuous
delivery
Continuous
integration
Monitoring
Tracing
Safety
Application logging Event sourcing
Slide 35
Slide 35 text
Sean Treadway, SoundCloud
Slide 36
Slide 36 text
Sean Treadway, SoundCloud
Slide 37
Slide 37 text
Sean Treadway, SoundCloud
Slide 38
Slide 38 text
Sean Treadway, SoundCloud
Slide 39
Slide 39 text
Compute
resources
Distributed storage
Local
disk
Physical
network
Software
defined
network
Scheduler
Service discovery
Config mgmt
Virtualization
Data Biz logic
Slide 40
Slide 40 text
Monitoring
Compute
resources
Distributed storage
Local
disk
Physical
network
Software
defined
network
Scheduler
Service discovery
Config mgmt
Virtualization
Data Biz logic
Slide 41
Slide 41 text
Virtualization
Distributed
storage
Local
disk
Physical
network
Software
defined
network
Scheduler
Biz logic
Service discovery
Config mgmt Data
Monitoring
Compute
resources
Slide 42
Slide 42 text
Virtualization
Distributed
storage
Local
disk
Physical
network
Software
defined
network
Scheduler
Biz logic
Service discovery
Config mgmt
Data
Monitoring
Compute
resources
Slide 43
Slide 43 text
Physical
network
Virtualization
Distributed
storage
Local
(scratch
Software defined
network
Scheduler
Biz logic
Service discovery
Config mgmt
Data
Monitoring
Compute
resources
Slide 44
Slide 44 text
Compute
resources Distributed storage
Software defined network
Scheduler
Biz logic
Service discovery
Config mgmt
Data
Monitoring
Virtualization
Slide 45
Slide 45 text
Application
Platform
Infrastructure
Compute
resources Distributed storage
Software defined network
Scheduler
Biz logic
Service discovery
Config mgmt
Data
Monitoring
Virtualization
Compute
resources
Distributed storage
Software defined network
Scheduler
Biz logic
Service discovery
Config mgmt
Data
Monitoring
API server
Kubelet
Kubelet
Kubelet
etcd
SkyDNS
Various
Volume mounts
Controllers