Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Aaron Suggs - Keynote - Context & Contingency: ...
Search
devopsdaysraleigh
October 07, 2016
Technology
0
84
Aaron Suggs - Keynote - Context & Contingency: Patterns for choosing good tools
devopsdaysraleigh
October 07, 2016
Tweet
Share
More Decks by devopsdaysraleigh
See All by devopsdaysraleigh
Chris Collins - Embracing the Container
devopsdaysrdu
0
57
Rebecca Fernandez & Jen Krieger - How to be more open, collaborative, and inclusive at work
devopsdaysrdu
0
160
Josh Atwell - How to Evolve Ops Skills to a DevOps World
devopsdaysrdu
0
130
Leon Fayer - Ignite - Oncall for developers
devopsdaysrdu
0
82
Maggie Gourlay - Ignite - My Gaming Days Weren’t Wasted: How Gaming Trained Me for Testing in DevOps
devopsdaysrdu
0
100
Fraser Pollock - Ignite - Data Before DevOps
devopsdaysrdu
0
63
Dylan Schowengerdt - Ignite - Customer Success: The Missing Link in the Feedback Loop to Engineering
devopsdaysrdu
0
210
Eric Sigler - "Is there any strong objection?"
devopsdaysrdu
0
72
Michael DeHaan - Keynote - Speaking for the Dead: Is "Waterfall" and "Monolithic" Actually Good?
devopsdaysrdu
0
66
Other Decks in Technology
See All in Technology
Amazon SNSサブスクリプションの誤解除を防ぐ
y_sakata
3
200
Step Functions First - サーバーレスアーキテクチャの新しいパラダイム
taikis
1
260
RapidPen: AIエージェントによる高度なペネトレーションテスト自動化の研究開発
laysakura
1
370
スプリントゴール未達症候群に送る処方箋
kakehashi
PRO
1
180
MCPに潜むセキュリティリスクを考えてみる
milix_m
0
530
本当にわかりやすいAIエージェント入門
segavvy
10
5.6k
20250718_ITSurf_“Bet AI”を支える文化とコストマネジメント
helosshi
1
190
OTel 公式ドキュメント翻訳 PJ から始めるコミュニティ活動/Community activities starting with the OTel official document translation project
msksgm
0
170
M365アカウント侵害時の初動対応
lhazy
5
4.1k
DATA+AI SummitとSnowflake Summit: ユーザから見た共通点と相違点 / DATA+AI Summit and Snowflake Summit
nttcom
0
150
複数のGemini CLIが同時開発する狂気 - Jujutsuが実現するAIエージェント協調の新世界
gunta
11
2.8k
AWS Well-Architected から考えるオブザーバビリティの勘所 / Considering the Essentials of Observability from AWS Well-Architected
sms_tech
1
820
Featured
See All Featured
Code Review Best Practice
trishagee
69
19k
The Invisible Side of Design
smashingmag
301
51k
Embracing the Ebb and Flow
colly
86
4.8k
GraphQLとの向き合い方2022年版
quramy
49
14k
Keith and Marios Guide to Fast Websites
keithpitt
411
22k
The Illustrated Children's Guide to Kubernetes
chrisshort
48
50k
Java REST API Framework Comparison - PWX 2021
mraible
31
8.7k
The Myth of the Modular Monolith - Day 2 Keynote - Rails World 2024
eileencodes
26
2.9k
Agile that works and the tools we love
rasmusluckow
329
21k
The World Runs on Bad Software
bkeepers
PRO
70
11k
A Modern Web Designer's Workflow
chriscoyier
695
190k
ピンチをチャンスに:未来をつくるプロダクトロードマップ #pmconf2020
aki_iinuma
126
53k
Transcript
Context & Contingency Aaron Suggs
Thank you Jen, Joe, Ann Marie, Kaete, Chris, Mark, and
Katie!
Aaron Suggs ktheory Ops Engineering
helps creative projects come to life
1. ELK 2. Management
“It’s not a promotion, it’s a career change” — Lindsay
Holmwood MGMT 101
Kyle Burckhard built it @talaris
Business Requirements
“Look at the massive explosion in operational software offerings over
the past 5-6 years.” — Charity Majors
Hosted SAAS
Maybe Splunk?
ELK
None
App logs Vendor logs lograge S3 Event filebeat SQS worker
logstash (+S3) logstash AWS Elasticsearch Service (with Kibana)
Proof of concept
!
filebeat with real data!
filebeat with real data! “Do no harm”
Trivia Time!
Trivia Time! Why might a disk be 100% full after
you delete several large files?
Answer " A process has open file handles (use lsof)
What to do?
What to do? - Upgrade it! Thx GitHub.
What to do? - Upgrade it! Thx GitHub. - Restart
it.
What to do? - Upgrade it! Thx GitHub. - Restart
it.
AWS Elasticsearch vs. DIY on EC2
None
AWS Elasticsearch DIY on EC2
AWS Elasticsearch DIY on EC2 Less dev attention* More dev
attention
AWS Elasticsearch DIY on EC2 Less dev attention* More dev
attention ✅
AWS Elasticsearch DIY on EC2 Less dev attention* More dev
attention Less flexible Flexible, adaptable ✅
AWS Elasticsearch DIY on EC2 Less dev attention* More dev
attention Less flexible Flexible, adaptable ✅ ✅
AWS Elasticsearch DIY on EC2 Less dev attention* More dev
attention Less flexible Flexible, adaptable Hard to debug Lots of visibility ✅ ✅
AWS Elasticsearch DIY on EC2 Less dev attention* More dev
attention Less flexible Flexible, adaptable Hard to debug Lots of visibility ✅ ✅ ✅
AWS Elasticsearch DIY on EC2 Less dev attention* More dev
attention Less flexible Flexible, adaptable Hard to debug Lots of visibility Aligned w/ our use ✅ ✅ ✅
AWS Elasticsearch DIY on EC2 Less dev attention* More dev
attention Less flexible Flexible, adaptable Hard to debug Lots of visibility Aligned w/ our use ✅ ✅ ✅ ✅
Rails log & Logstash
Rails log & Logstash
Lograge github.com/roidrage/lograge
When you show devs Kibana
When you show devs Kibana
MVP = better than alternative
T-Shaped skills
T-Shaped skills Me AWS Ruby
T-Shaped skills Me AWS Ruby Kyle AWS Ruby Docker
T-Shaped skills Me AWS Ruby Kyle AWS Ruby Docker ?
Distributed systems Go
Ingesting vendor logs - S3 access logs - CDN access
logs - CloudTrail logs
S3 Events -> SQS -> shoryuken ruby worker -> logstash
S3 Events -> SQS -> shoryuken ruby worker -> logstash
re-import old logs
Autoscaling!
Trivia Time!
Trivia Time! What’s the bottleneck after you scale logstash?
Answer " 100% Elasticsearch CPU
Answer " Then it crashes. $ 100% Elasticsearch CPU
None
Mitigating Burnout MGMT 102
Solution: Pairing 1. Fosters career growth 2. Cross-training 3. Team
bonding
Summary
Summary 1. Mind the skills of your team
Summary 1. Mind the skills of your team 2. Know
the next-best alternative
Summary 1. Mind the skills of your team 2. Know
the next-best alternative 3. Consider a tool’s community
Thank you! ktheory