Upgrade to Pro — share decks privately, control downloads, hide ads and more …

design for cloud - jax 2012

Sponsored · Ship Features Fearlessly Turn features on and off without deploys. Used by thousands of Ruby developers. →
Avatar for Mathias Meyer Mathias Meyer
April 18, 2012
Programming
330
2

design for cloud - jax 2012

Avatar for Mathias Meyer

Mathias Meyer

April 18, 2012

More Decks by Mathias Meyer

See All by Mathias Meyer
Building and Scaling an Distributed and Inclusive Team
Avatar for Mathias Meyer roidrage
0
1.4k
cooking infrastructure with chef
Avatar for Mathias Meyer roidrage
4
250
The Message Queue is Dead, Long Live the Message Queue
Avatar for Mathias Meyer roidrage
4
720
riak-js
Avatar for Mathias Meyer roidrage
1
320
designing for concurrency with riak
Avatar for Mathias Meyer roidrage
11
1.9k
metrics, monitoring, logging
Avatar for Mathias Meyer roidrage
82
15k
A Riak Query Tale
Avatar for Mathias Meyer roidrage
5
1k
Don't Use NoSQL
Avatar for Mathias Meyer roidrage
10
1.1k
Designing Applications for Amazon Web Services (GOTO Aarhus)
Avatar for Mathias Meyer roidrage
6
370

Other Decks in Programming

See All in Programming
AIとASP.NET Coreで雑Webアプリを作った話
Avatar for Mayuki Sawatari mayuki
0
160
TypeScript+Orvalで実現する型安全かつ堅牢でスケーラブルなマルチチャネル通知基盤 / TSKaigi Night talks ~after conference~
Avatar for doriven d0riven
0
150
Make SRE Operations Easier with Azure SRE Agent
Avatar for KAMEGAWA Kazushi kkamegawa
0
3.4k
oxlintはeslint/typescript-eslintを置き換えられるのか
Avatar for shoma-fujita shomafujita
2
310
SPMマルチモジュールで テストカバレッジを取得する技法
Avatar for yosshi yosshi4486
0
140
Java × distroless で 軽量なコンテナイメージを / Java on Distroless
Avatar for Daisuke Garaike contour_gara
0
470
LLM Plugin for Node-REDの利用方法と開発について
Avatar for 404background 404background
0
160
dRuby over BLE
Avatar for makicamel makicamel
2
300
Stage 3 Decorators でできること / できないこと / TSKaigi 2026
Avatar for Susisu susisu
1
1.5k
TAKTでAI駆動開発の品質を設計する
Avatar for かとじゅん j5ik2o
6
700
メソッドのジェネリクスでGoの夢は広がるか？ / Kyoto.go #65
Avatar for utagawa kiki utgwkk
3
440
net-httpのHTTP/2対応について
Avatar for NARUSE, Yui naruse
0
430

Featured

See All Featured
svc-hook: hooking system calls on ARM64 by binary rewriting
Avatar for Akira Moroo retrage
2
280
Stewardship and Sustainability of Urban and Community Forests
Avatar for Eric Wiseman pwiseman
0
220
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
Avatar for panda_program panda_program
122
22k
Helping Users Find Their Own Way: Creating Modern Search Experiences
Avatar for Dan Newman danielanewman
31
3.2k
Tell your own story through comics
Avatar for letsgokoyo letsgokoyo
1
940
Making Projects Easy
Avatar for Brett Harned brettharned
120
6.7k
Visual Storytelling: How to be a Superhuman Communicator
Avatar for David Neal reverentgeek
2
550
State of Search Keynote: SEO is Dead Long Live SEO
Avatar for Ryan Jones ryanjones
0
200
B2B Lead Gen: Tactics, Traps & Triumph
Avatar for Sophie Logan marketingsoph
0
130
The Curious Case for Waylosing
Avatar for Cassini Nazir cassininazir
1
370
Designing for Timeless Needs
Avatar for Cassini Nazir cassininazir
1
250
ReactJS: Keep Simple. Everything can be a component!
Avatar for Pedro Nauck pedronauck
666
130k

Transcript

  1. design for cloud mathias meyer, jax 2012

  2. None

  3. Me — infrastructure — code — databases @roidrage www.paperplanes.de

  4. None

  5. the cloud

  6. None
  7. None
  8. None

  9. 10,000 feet

  10. amazon web services

  11. ec2

  12. on-demand computing

  13. api

  14. pay as you go

  15. multiple regions

  16. multiple datacenters

  17. high cpu vs. high memory

  18. elastic block store

  19. more aws products s3 cloudfront cloudformation cloudwatch rds auto scaling

    simpledb route 53 load balancing queue service notification service elastic mapreduce

  20. what’s scalarium?

  21. automates: setup configuration one-click deploy

  22. ...for ec2 ...on ec2

  23. the dream: configure a cluster push a button boom!

  24. None
  25. None

  26. configuration + cookbooks/manifests + chef/puppet = configured cluster

  27. configuration: chef server rightscale json scalarium

  28. None

  29. in the beginning...

  30. Scalarium

  31. None
  32. None
  33. None

  34. ec2 is not a traditional datacenter

  35. None
  36. None

  37. multi-tenant

  38. high chance of failure

  39. faulty instances

  40. datacenter outage

  41. network partition

  42. more instances = higher chance of failure

  43. mtbf

  44. 21/04/2011

  45. None

  46. 7/8/2011

  47. None

  48. don’t fear failure

  49. plan for failure

  50. test failure

  51. None

  52. plan for recovery

  53. mttr

  54. None

  55. disaster recovery plan

  56. multi-datacenter deployments

  57. replication

  58. None

  59. multi-region deployments

  60. $$$

  61. relax consistency requirements

  62. latency

  63. keep data local

  64. None

  65. keep data in memory

  66. cache is king

  67. use raids for ebs

  68. use local storage

  69. use bigger instances

  70. scalarium is ~monolithic

  71. cloud ≠ monolithic

  72. cloud ☠ centralized

  73. small, independent services

  74. self-contained

  75. independently deployable

  76. well defined apis

  77. http/json thrift protocol buffers

  78. sinatra dropwizard spark scalatra

  79. fail fast

  80. retry

  81. internal queues

  82. design for resilience

  83. “think about your software running.” theo schlossnagle, omniti

  84. understand your code’s breaking points

  85. isn’t all that what you do at large scale?

  86. cloud == large scale

  87. scalarium today

  88. scalarium runs on scalarium

  89. None
  90. None
  91. None

  92. lack of visibility

  93. don’t fall for service level agreements

  94. amazon only handles infrastructure

  95. how you build on it is up to you

  96. fun fact

  97. amazon.com is served off ec2

  98. thank you!