Upgrade to Pro — share decks privately, control downloads, hide ads and more …

design for cloud - jax 2012

Avatar for Mathias Meyer Mathias Meyer
April 18, 2012
Programming
2
300

design for cloud - jax 2012

Avatar for Mathias Meyer

Mathias Meyer

April 18, 2012
Tweet

More Decks by Mathias Meyer

See All by Mathias Meyer
Building and Scaling an Distributed and Inclusive Team
Avatar for Mathias Meyer roidrage
0
1.3k
cooking infrastructure with chef
Avatar for Mathias Meyer roidrage
4
230
The Message Queue is Dead, Long Live the Message Queue
Avatar for Mathias Meyer roidrage
4
700
riak-js
Avatar for Mathias Meyer roidrage
1
280
designing for concurrency with riak
Avatar for Mathias Meyer roidrage
11
1.8k
metrics, monitoring, logging
Avatar for Mathias Meyer roidrage
82
15k
A Riak Query Tale
Avatar for Mathias Meyer roidrage
5
1k
Don't Use NoSQL
Avatar for Mathias Meyer roidrage
10
1.1k
Designing Applications for Amazon Web Services (GOTO Aarhus)
Avatar for Mathias Meyer roidrage
6
360

Other Decks in Programming

See All in Programming
「次に何を学べばいいか分からない」あなたへ──若手エンジニアのための学習地図
Avatar for panda_program panda_program
3
630
Caude codeで爆速開発
Avatar for codelynx codelynx
0
100
The Niche of CDK Grant オブジェクトって何者？/the-niche-of-cdk-what-isgrant-object
Avatar for hassaku63 hassaku63
1
680
Android 16KBページサイズ対応をはじめからていねいに
Avatar for mine2424 mine2424
0
640
CDK引数設計道場100本ノック
Avatar for kazuho cryer-shinozuka badmintoncryer
2
550
ISUCON研修おかわり会 講義スライド
Avatar for Yuki Yata arfes0e2b3c
1
480
猫と暮らす Google Nest Cam生活🐈 / WebRTC with Google Nest Cam
Avatar for Yutaro Muta yutailang0119
0
180
CIを整備してメンテナンスを生成AIに任せる
Avatar for Hazumi Ichijo hazumirr
0
180
Workers を定期実行する方法は一つじゃない
Avatar for rokuosan rokuosan
0
130
Claude Code + Container Use と Cursor で作る ローカル並列開発環境のススメ / ccc local dev
Avatar for Yuichi Maekawa kaelaela
12
7.4k
AI駆動のマルチエージェントによる業務フロー自動化の設計と実践
Avatar for 岡本秀明 h_okkah
0
290
Jakarta EE Meets AI
Avatar for ivargrimstad ivargrimstad
0
250

Featured

See All Featured
Building Better People: How to give real-time feedback that sticks.
Avatar for Will Jessup wjessup
367
19k
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
Avatar for Eileen M. Uchitelle eileencodes
35
2.5k
CSS Pre-Processors: Stylus, Less & Sass
Avatar for Bermon Painter bermonpainter
357
30k
Producing Creativity
Avatar for Steve Smith orderedlist
PRO
346
40k
Site-Speed That Sticks
Avatar for Harry Roberts csswizardry
10
710
Large-scale JavaScript Application Architecture
Avatar for Addy Osmani addyosmani
512
110k
Done Done
Avatar for chrislema chrislema
184
16k
jQuery: Nuts, Bolts and Bling
Avatar for Doug Neiner dougneiner
63
7.8k
Stop Working from a Prison Cell
Avatar for Chris Michel hatefulcrawdad
271
21k
Put a Button on it: Removing Barriers to Going Fast.
Avatar for kastner kastner
60
3.9k
Keith and Marios Guide to Fast Websites
Avatar for Keith Pitt keithpitt
411
22k
ピンチをチャンスに：未来をつくるプロダクトロードマップ #pmconf2020
Avatar for Aki / @LoveIdahoBurger aki_iinuma
126
53k

Transcript

  1. design for cloud mathias meyer, jax 2012

  2. None

  3. Me — infrastructure — code — databases @roidrage www.paperplanes.de

  4. None

  5. the cloud

  6. None
  7. None
  8. None

  9. 10,000 feet

  10. amazon web services

  11. ec2

  12. on-demand computing

  13. api

  14. pay as you go

  15. multiple regions

  16. multiple datacenters

  17. high cpu vs. high memory

  18. elastic block store

  19. more aws products s3 cloudfront cloudformation cloudwatch rds auto scaling

    simpledb route 53 load balancing queue service notification service elastic mapreduce

  20. what’s scalarium?

  21. automates: setup configuration one-click deploy

  22. ...for ec2 ...on ec2

  23. the dream: configure a cluster push a button boom!

  24. None
  25. None

  26. configuration + cookbooks/manifests + chef/puppet = configured cluster

  27. configuration: chef server rightscale json scalarium

  28. None

  29. in the beginning...

  30. Scalarium

  31. None
  32. None
  33. None

  34. ec2 is not a traditional datacenter

  35. None
  36. None

  37. multi-tenant

  38. high chance of failure

  39. faulty instances

  40. datacenter outage

  41. network partition

  42. more instances = higher chance of failure

  43. mtbf

  44. 21/04/2011

  45. None

  46. 7/8/2011

  47. None

  48. don’t fear failure

  49. plan for failure

  50. test failure

  51. None

  52. plan for recovery

  53. mttr

  54. None

  55. disaster recovery plan

  56. multi-datacenter deployments

  57. replication

  58. None

  59. multi-region deployments

  60. $$$

  61. relax consistency requirements

  62. latency

  63. keep data local

  64. None

  65. keep data in memory

  66. cache is king

  67. use raids for ebs

  68. use local storage

  69. use bigger instances

  70. scalarium is ~monolithic

  71. cloud ≠ monolithic

  72. cloud ☠ centralized

  73. small, independent services

  74. self-contained

  75. independently deployable

  76. well defined apis

  77. http/json thrift protocol buffers

  78. sinatra dropwizard spark scalatra

  79. fail fast

  80. retry

  81. internal queues

  82. design for resilience

  83. “think about your software running.” theo schlossnagle, omniti

  84. understand your code’s breaking points

  85. isn’t all that what you do at large scale?

  86. cloud == large scale

  87. scalarium today

  88. scalarium runs on scalarium

  89. None
  90. None
  91. None

  92. lack of visibility

  93. don’t fall for service level agreements

  94. amazon only handles infrastructure

  95. how you build on it is up to you

  96. fun fact

  97. amazon.com is served off ec2

  98. thank you!