Addicted to Stable

E13c31390e0369fcd5972292ce0e7b92?s=47 John Nunemaker
September 01, 2012

Addicted to Stable

Closing keynote for RubyConf Brazil.

E13c31390e0369fcd5972292ce0e7b92?s=128

John Nunemaker

September 01, 2012
Tweet

Transcript

  1. 2.
  2. 3.
  3. 4.
  4. 5.
  5. 6.
  6. 7.
  7. 8.
  8. 17.

    ?

  9. 21.

    YES

  10. 25.
  11. 26.
  12. 29.
  13. 36.
  14. 37.
  15. 40.
  16. 41.
  17. 47.
  18. 49.
  19. 59.
  20. 60.
  21. 63.
  22. 64.
  23. 65.
  24. 66.
  25. 67.
  26. 68.
  27. 70.
  28. 71.
  29. 72.
  30. 73.
  31. 80.

    Tracking app3 app4 app5 app6 web1 web2 class PulseApp <

    Sinatra::Base get '/pulse/tracking' do pulse :kestrel end end
  32. 82.

    Tracking app3 app4 app5 app6 web1 web2 app1 app2 Reporting

    - option httpchk GET /pulse/reporting
  33. 83.

    Tracking app3 app4 app5 app6 web1 web2 app1 app2 Reporting

    class PulseApp < Sinatra::Base get '/pulse/reporting' do pulse :mongo end end
  34. 85.
  35. 92.
  36. 93.
  37. 95.
  38. 97.
  39. 99.
  40. 100.
  41. 101.
  42. 105.
  43. 106.
  44. 110.
  45. 111.
  46. 112.
  47. 115.
  48. 117.
  49. 118.
  50. 120.
  51. 124.
  52. 132.
  53. 133.
  54. 136.
  55. 137.
  56. 138.
  57. 139.
  58. 141.
  59. 142.
  60. 143.
  61. 144.
  62. 146.
  63. 147.
  64. 148.
  65. 151.
  66. 152.

    “ On Saturday, June 2nd, we had a perfect storm

    of cascading failures resulting in around four hours of lost tracking data.
  67. 153.

    “ We have commissioned a new database cluster with automatic

    failover that we hope to be using sometime next week.
  68. 154.

    “ We hate that we lost your data. Know that

    we have learned from this and will rise from the ashes of your data loss like a GLORIOUS PHOENIX.
  69. 156.
  70. 157.
  71. 158.
  72. 159.
  73. 160.

    automate testing, backing up, restoring, deploying, collect exceptions, metrics, send

    alerts, fail gracefully, collaborate, communicate, document all the things, empower, get feedback, provide awesome support, communicate, celebrate
  74. 161.