Upgrade to Pro — share decks privately, control downloads, hide ads and more …

design for cloud - jax 2012

Sponsored · SiteGround - Reliable hosting with speed, security, and support you can count on. →
Avatar for Mathias Meyer Mathias Meyer
April 18, 2012
Programming
2
310

design for cloud - jax 2012

Avatar for Mathias Meyer

Mathias Meyer

April 18, 2012
Tweet

More Decks by Mathias Meyer

See All by Mathias Meyer
Building and Scaling an Distributed and Inclusive Team
Avatar for Mathias Meyer roidrage
0
1.4k
cooking infrastructure with chef
Avatar for Mathias Meyer roidrage
4
240
The Message Queue is Dead, Long Live the Message Queue
Avatar for Mathias Meyer roidrage
4
710
riak-js
Avatar for Mathias Meyer roidrage
1
290
designing for concurrency with riak
Avatar for Mathias Meyer roidrage
11
1.9k
metrics, monitoring, logging
Avatar for Mathias Meyer roidrage
82
15k
A Riak Query Tale
Avatar for Mathias Meyer roidrage
5
1k
Don't Use NoSQL
Avatar for Mathias Meyer roidrage
10
1.1k
Designing Applications for Amazon Web Services (GOTO Aarhus)
Avatar for Mathias Meyer roidrage
6
370

Other Decks in Programming

See All in Programming
Apache Iceberg V3 and migration to V3
Avatar for Tomohiro Tanaka tomtanaka
0
160
【卒業研究】会話ログ分析によるユーザーごとの関心に応じた話題提案手法
Avatar for MomokoShirakawa momok47
0
200
Data-Centric Kaggle
Avatar for ねぼすけAI isax1015
2
770
The Past, Present, and Future of Enterprise Java
Avatar for ivargrimstad ivargrimstad
0
550
AIによる高速開発をどう制御するか？ ガードレール設置で開発速度と品質を両立させたチームの事例
Avatar for tonkotsuboy_com tonkotsuboy_com
7
2.3k
プロダクトオーナーから見たSOC2 _SOC2ゆるミートアップ#2
Avatar for Kenta Suzuki kekekenta
0
210
Architectural Extensions
Avatar for Denys Poltorak denyspoltorak
0
280
フロントエンド開発の勘所 -複数事業を経験して見えた判断軸の違い-
Avatar for Yoichiro Kubo heimusu
7
2.8k
AIエージェント、”どう作るか”で差は出るか？ / AI Agents: Does the "How" Make a Difference?
Avatar for r-kagaya rkaga
4
2k
例外処理とどう使い分ける？Result型を使ったエラー設計 #burikaigi
Avatar for Takuma Kajikawa kajitack
16
6k
組織で育むオブザーバビリティ
Avatar for ryotaro kobayashi ryota_hnk
0
170
AWS re:Invent 2025参加 直前 Seattle-Tacoma Airport(SEA)におけるハードウェア紛失インシデントLT
Avatar for tetutetu214 tetutetu214
2
110

Featured

See All Featured
HDC tutorial
Avatar for Michiel Stock michielstock
1
370
Navigating Team Friction
Avatar for Lara Hogan lara
192
16k
What Being in a Rock Band Can Teach Us About Real World SEO
Avatar for Ade Holder 427marketing
0
170
What does AI have to do with Human Rights?
Avatar for Per Axbom axbom
PRO
0
2k
The Illustrated Guide to Node.js - THAT Conference 2024
Avatar for David Neal reverentgeek
0
250
Organizational Design Perspectives: An Ontology of Organizational Design Elements
Avatar for Dr. Kim W Petersen kimpetersen
PRO
1
180
Easily Structure & Communicate Ideas using Wireframe
Avatar for Afnizar Nur Ghifari afnizarnur
194
17k
No one is an island. Learnings from fostering a developers community.
Avatar for Antonio thoeni
21
3.6k
A Guide to Academic Writing Using Generative AI - A Workshop
Avatar for Kenji Saito ks91
PRO
0
200
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
Avatar for Tammy Everts tammyeverts
55
3.2k
ピンチをチャンスに：未来をつくるプロダクトロードマップ #pmconf2020
Avatar for Aki / @LoveIdahoBurger aki_iinuma
128
55k
JAMstack: Web Apps at Ludicrous Speed - All Things Open 2022
Avatar for David Neal reverentgeek
1
330

Transcript

  1. design for cloud mathias meyer, jax 2012

  2. None

  3. Me — infrastructure — code — databases @roidrage www.paperplanes.de

  4. None

  5. the cloud

  6. None
  7. None
  8. None

  9. 10,000 feet

  10. amazon web services

  11. ec2

  12. on-demand computing

  13. api

  14. pay as you go

  15. multiple regions

  16. multiple datacenters

  17. high cpu vs. high memory

  18. elastic block store

  19. more aws products s3 cloudfront cloudformation cloudwatch rds auto scaling

    simpledb route 53 load balancing queue service notification service elastic mapreduce

  20. what’s scalarium?

  21. automates: setup configuration one-click deploy

  22. ...for ec2 ...on ec2

  23. the dream: configure a cluster push a button boom!

  24. None
  25. None

  26. configuration + cookbooks/manifests + chef/puppet = configured cluster

  27. configuration: chef server rightscale json scalarium

  28. None

  29. in the beginning...

  30. Scalarium

  31. None
  32. None
  33. None

  34. ec2 is not a traditional datacenter

  35. None
  36. None

  37. multi-tenant

  38. high chance of failure

  39. faulty instances

  40. datacenter outage

  41. network partition

  42. more instances = higher chance of failure

  43. mtbf

  44. 21/04/2011

  45. None

  46. 7/8/2011

  47. None

  48. don’t fear failure

  49. plan for failure

  50. test failure

  51. None

  52. plan for recovery

  53. mttr

  54. None

  55. disaster recovery plan

  56. multi-datacenter deployments

  57. replication

  58. None

  59. multi-region deployments

  60. $$$

  61. relax consistency requirements

  62. latency

  63. keep data local

  64. None

  65. keep data in memory

  66. cache is king

  67. use raids for ebs

  68. use local storage

  69. use bigger instances

  70. scalarium is ~monolithic

  71. cloud ≠ monolithic

  72. cloud ☠ centralized

  73. small, independent services

  74. self-contained

  75. independently deployable

  76. well defined apis

  77. http/json thrift protocol buffers

  78. sinatra dropwizard spark scalatra

  79. fail fast

  80. retry

  81. internal queues

  82. design for resilience

  83. “think about your software running.” theo schlossnagle, omniti

  84. understand your code’s breaking points

  85. isn’t all that what you do at large scale?

  86. cloud == large scale

  87. scalarium today

  88. scalarium runs on scalarium

  89. None
  90. None
  91. None

  92. lack of visibility

  93. don’t fall for service level agreements

  94. amazon only handles infrastructure

  95. how you build on it is up to you

  96. fun fact

  97. amazon.com is served off ec2

  98. thank you!