Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Managing Terrabytes on AWS
Search
Baruch Sadogursky
February 19, 2013
0
240
Managing Terrabytes on AWS
Talk by Fred Simon at DevNexus 2013
Baruch Sadogursky
February 19, 2013
Tweet
Share
More Decks by Baruch Sadogursky
See All by Baruch Sadogursky
Silicon Valley Chainsaw Massacre (how I spent my last Friday night on-call) as presented at DevOops 2017
jbaruch
0
700
DevOps @ scale — greek tragedy in three acts as presented at Devoops 2017
jbaruch
0
550
Building a Massively Scalable Cloud Service from the Grounds Up
jbaruch
0
300
Groovy DSL для plugin-ов - Расширения человеческим языком
jbaruch
0
370
Найти Сятой Грааль, и оттестировать его как следует
jbaruch
1
340
Plugging the users in - extend your application with pluggable Groovy DSL
jbaruch
0
240
Open/Closed Software - Developing freemium application using Spring Framework
jbaruch
0
250
Search for the Holy Grail (and test it once found)
jbaruch
0
150
Разработка модулярного софта — добро пожаловать в АД!
jbaruch
0
110
Featured
See All Featured
Building an army of robots
kneath
300
41k
Distributed Sagas: A Protocol for Coordinating Microservices
caitiem20
322
20k
Producing Creativity
orderedlist
PRO
337
39k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
tammyeverts
14
1.6k
RailsConf 2023
tenderlove
4
540
Building a Scalable Design System with Sketch
lauravandoore
456
32k
Making the Leap to Tech Lead
cromwellryan
124
8.5k
Bootstrapping a Software Product
garrettdimon
PRO
302
110k
WebSockets: Embracing the real-time Web
robhawkes
59
7k
BBQ
matthewcrist
80
8.8k
How to train your dragon (web standard)
notwaldorf
73
5.2k
Six Lessons from altMBA
skipperchong
21
3k
Transcript
None
None
None
None
None
None
None
None
None
None
None
None
Request Storage File Listing Checksum Storage
Request Storage File Listing Checksum Storage Metadata requests Cache check,
FS request DB request
Request Storage File Listing Checksum Storage Metadata requests Cache check,
FS request DB request HEAD requests Cache check, FS request DB request
Request Storage File Listing Checksum Storage Metadata requests Cache check,
FS request DB request HEAD requests Cache check, FS request DB request GET request Cache check, FS request DB + FS request
Request Storage File Listing Checksum Storage Metadata requests Cache check,
FS request DB request HEAD requests Cache check, FS request DB request GET request Cache check, FS request DB + FS request PUT request FS request DB + FS request
None
None
None
None
None
None
None
None
None
None
None
None
None
None
None
None
None
None
None
None
EBS + LVM = WIN!
/data 250GB 250GB
/data 250GB 250GB 250GB 250GB
/data 250GB 250GB 250GB 250GB 250GB 250GB
None
None
None
None
None
None
None
None
None
Backup files
Backup files Backup database
Backup files Backup database Keep them in sync!
Backup files Backup database Keep them in sync!
Backup only deltas
Backup only deltas Manage threads to ec2 efficiently
Backup only deltas Manage threads to ec2 efficiently Keep the
data isolated
Backup only deltas Manage threads to ec2 efficiently Keep the
data isolated
None
None
None
None
None
None
Customer EBS Customer EBS Customer EBS
De- duped EBS HA Storage Customer EBS Customer EBS Customer
EBS
None
De- duped Glacier De- duped EBS Backup HA Storage Customer
EBS Customer EBS Customer EBS
None
None
None
None
None
Create empty Artifactory instance
Create empty Artifactory instance Populate from back storage on demand
Create empty Artifactory instance Populate from back storage on demand
Drink Cosmopolitan
Conclusions time 1. Be lazy.
None
Conclusions time 1. Be lazy. 2. Be smart.
Conclusions time 1. Be lazy. 2. Be smart. 3. Be
agile.
Drink Cosmopolitan