Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Addicted to Stable
Search
John Nunemaker
PRO
September 01, 2012
Programming
32
2.5k
Addicted to Stable
Closing keynote for RubyConf Brazil.
John Nunemaker
PRO
September 01, 2012
Tweet
Share
More Decks by John Nunemaker
See All by John Nunemaker
Atom
jnunemaker
PRO
10
4.2k
MongoDB for Analytics
jnunemaker
PRO
11
870
MongoDB for Analytics
jnunemaker
PRO
21
2.2k
MongoDB for Analytics
jnunemaker
PRO
16
30k
Why You Should Never Use an ORM
jnunemaker
PRO
55
9.3k
Why NoSQL?
jnunemaker
PRO
10
920
Don't Repeat Yourself, Repeat Others
jnunemaker
PRO
7
3.3k
I Have No Talent
jnunemaker
PRO
14
950
Why MongoDB Is Awesome
jnunemaker
PRO
18
4.4k
Other Decks in Programming
See All in Programming
SLI/SLOの設定を進めるその前に アラート品質の改善に取り組んだ話
tanden
2
630
20250326_生成AIによる_レビュー承認システムの実現.pdf
takahiromatsui
15
4.4k
2025/3/18 サービスの成長で生じる幅広いパフォーマンスの問題を、 AIで手軽に解決する
shirahama_x
0
150
AIエージェントを活用したアプリ開発手法の模索
kumamotone
1
730
Go1.24で testing.B.Loopが爆誕
kuro_kurorrr
0
140
PHPによる"非"構造化プログラミング入門 -本当に熱いスパゲティコードを求めて- #phperkaigi
o0h
PRO
0
870
Return of the Full-Stack Developer
simas
PRO
1
300
Devin , 正しい付き合い方と使い方 / Living and Working with Devin
yukinagae
1
500
安全に倒し切るリリースをするために:15年来レガシーシステムのフルリプレイス挑戦記
sakuraikotone
5
2.1k
ベクトル検索システムの気持ち
monochromegane
28
7.9k
PsySHから紐解くREPLの仕組み
muno92
PRO
1
490
CTFのWebにおける⾼難易度問題について
hamayanhamayan
1
920
Featured
See All Featured
Optimising Largest Contentful Paint
csswizardry
34
3.1k
Docker and Python
trallard
44
3.3k
Designing for humans not robots
tammielis
250
25k
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
marktimemedia
30
2.3k
Let's Do A Bunch of Simple Stuff to Make Websites Faster
chriscoyier
507
140k
Building an army of robots
kneath
304
45k
Facilitating Awesome Meetings
lara
53
6.3k
Building Applications with DynamoDB
mza
94
6.3k
StorybookのUI Testing Handbookを読んだ
zakiyama
28
5.6k
GraphQLとの向き合い方2022年版
quramy
45
14k
A Modern Web Designer's Workflow
chriscoyier
693
190k
Bash Introduction
62gerente
611
210k
Transcript
Addicted to Stable a.k.a how to sleep like an octocat
None
None
None
None
None
None
None
Hundreds of Sites
Hundreds of Sites Thousands of Decks
Hundreds of Sites Thousands of Decks Millions of People
Hundreds of Sites Thousands of Decks Millions of People Billions
of Views
“ People want features, but need stability.
Sta·ble Not likely to change or fail
App Code and Servers
Testing Automate
?
? test/unit
? rspec test/unit
? rspec test/unit minitest
YES
design YES
design YES change
design YES change regression
None
None
Work by me
Work by me Pushed code fix
None
Work by robots
Work by robots Closed issue
Work by robots Closed issue Ran test suite
Work by robots Closed issue Ran test suite Deployed code
Backup and Restore Automate
A Single Server Never trust
None
Replicate
Replicate Promote
Replicate Promote Practice
“ Me, at 8pm on a Saturday I’m confirming the
steps and order of commands.
None
Deleted Everything I accidentally Sincerely, Your Employee
Deleted Everything I accidentally Sincerely, Your Customer
users users.archived gauges gauges.archived
hubot restore <repo>
Deleted Everything I accidentally Sincerely, You
None
Deployment Automate
None
hubot deploy github
hubot deploy speakerdeck
hubot deploy gauges
hubot deploy gauges/my-branch
puppet https://github.com/puppetlabs/puppet
moonshine https://github.com/railsmachine/moonshine
HOSTFILTER=‘app7.foo.com’ \ cap production deploy:setup
HOSTFILTER=‘app7.foo.com’ \ cap production deploy
Exceptions Collect and Fix
None
None
< 1 exception per million page views (gauges)
Metrics Collect and Graph
None
None
None
None
None
None
Alerts Email, Push and SMS
None
None
None
Nagios
Pingdom Nagios
Pager Duty Pingdom Nagios
Failover Automate
web1 web2 haproxy/heartbeat
Tracking app3 app4 app5 app6 web1 web2
Tracking app3 app4 app5 app6 web1 web2 - option httpchk
GET /pulse/tracking
Tracking app3 app4 app5 app6 web1 web2 class PulseApp <
Sinatra::Base get '/pulse/tracking' do pulse :kestrel end end
Tracking app3 app4 app5 app6 web1 web2 app1 app2 Reporting
Tracking app3 app4 app5 app6 web1 web2 app1 app2 Reporting
- option httpchk GET /pulse/reporting
Tracking app3 app4 app5 app6 web1 web2 app1 app2 Reporting
class PulseApp < Sinatra::Base get '/pulse/reporting' do pulse :mongo end end
Tracking app3 app4 app5 app6 web1 web2 q1 q2 app1
app2 Reporting
Tracking app3 app4 app5 app6 web1 web2 q1 q2 Workers
db1 db2 db3 app1 app2 Reporting
Team Collaboration and Freedom
46 hubbers When I started in December
115 hubbers As of August 31, 2012 at 10:43am EST
How is that stable???
Collaborate Always
Pull Requests Discussion + ❤
None
None
Chat Campfire to your phone
None
Video Face to face and Pairing
None
Internal Tools Ideas, Hiring, Music and more!
None
None
300+ ideas
300+ ideas 3000+ comments
300+ ideas 3000+ comments 100+ people
Communicate Always
None
None
4300+ statuses
4300+ statuses 4200+ comments
4300+ statuses 4200+ comments 100+ people
None
None
170 talks
170 talks 112 people
170 talks 112 people 2 summits/year
None
Document Always
None
None
Empower Always
None
Anyone can view
Anyone can view Anyone can commit
Anyone can view Anyone can commit Anyone can deploy
None
296 branches
296 branches 2980 commits
296 branches 2980 commits 307 issues
IN ONE MONTH
ONLY THE WEB APP
Brand Surprise and Delight
Feedback Stupid Easy
None
None
support@github.com speakerdeck@github.com gauges@github.com
Support Fast and Friendly
None
None
None
None
Documentation Useful and Thorough
None
None
None
None
Communication Honest and Open
None
None
None
If you present, GitHub covers the bill for you.
If you present, GitHub covers the bill for you and
a buddy.
None
“ On Saturday, June 2nd, we had a perfect storm
of cascading failures resulting in around four hours of lost tracking data.
“ We have commissioned a new database cluster with automatic
failover that we hope to be using sometime next week.
“ We hate that we lost your data. Know that
we have learned from this and will rise from the ashes of your data loss like a GLORIOUS PHOENIX.
Celebration Public and Genuine
None
None
None
None
automate testing, backing up, restoring, deploying, collect exceptions, metrics, send
alerts, fail gracefully, collaborate, communicate, document all the things, empower, get feedback, provide awesome support, communicate, celebrate
The End.