Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Aaron Suggs - Keynote - Context & Contingency: Patterns for choosing good tools
Search
devopsdaysraleigh
October 07, 2016
Technology
0
64
Aaron Suggs - Keynote - Context & Contingency: Patterns for choosing good tools
devopsdaysraleigh
October 07, 2016
Tweet
Share
More Decks by devopsdaysraleigh
See All by devopsdaysraleigh
Chris Collins - Embracing the Container
devopsdaysrdu
0
48
Rebecca Fernandez & Jen Krieger - How to be more open, collaborative, and inclusive at work
devopsdaysrdu
0
88
Josh Atwell - How to Evolve Ops Skills to a DevOps World
devopsdaysrdu
0
110
Leon Fayer - Ignite - Oncall for developers
devopsdaysrdu
0
73
Maggie Gourlay - Ignite - My Gaming Days Weren’t Wasted: How Gaming Trained Me for Testing in DevOps
devopsdaysrdu
0
79
Fraser Pollock - Ignite - Data Before DevOps
devopsdaysrdu
0
38
Dylan Schowengerdt - Ignite - Customer Success: The Missing Link in the Feedback Loop to Engineering
devopsdaysrdu
0
110
Eric Sigler - "Is there any strong objection?"
devopsdaysrdu
0
67
Michael DeHaan - Keynote - Speaking for the Dead: Is "Waterfall" and "Monolithic" Actually Good?
devopsdaysrdu
0
50
Other Decks in Technology
See All in Technology
〜小さく始めて大きく育てる〜データ分析基盤の開発から活用まで
kniino
0
2.1k
4年前、あるじゃん老害エンジニアLT合戦に登壇、米国西海岸コンピュータ歴史博物館体験記の続編
toshi_atsumi
0
220
WebアプリケーションにおけるPDOの使い方入門 / phpcon odawara 2024
meihei3
2
440
Databricks:『生成AI World Cup』のご案内
databricksjapan
2
170
コードを書く隙間を見つけて生きていく技術/Findy 思考の現在地
fujiwara3
27
5.8k
データベース02: データベースの概念
trycycle
0
140
Compose Compiler Metricsを使った実践的なコードレビュー
tomorrowkey
1
210
Cracking the KubeCon CfP
inductor
2
200
プラットフォームってつくることより計測することが重要なんじゃないかという話 / Platform Engineering Meetup #8
taishin
0
330
2024/4/26 コンピュータ歴史博物館解説告知
toshi_atsumi
0
210
SIEMを用いて、セキュリティログ分析の可視化と分析を実現し、PDCAサイクルを回してみた
coconala_engineer
0
270
Oracle Cloud Infrastructure:2024年4月度サービス・アップデート
oracle4engineer
PRO
1
180
Featured
See All Featured
Infographics Made Easy
chrislema
238
18k
XXLCSS - How to scale CSS and keep your sanity
sugarenia
240
1.2M
Sharpening the Axe: The Primacy of Toolmaking
bcantrill
16
1.4k
Into the Great Unknown - MozCon
thekraken
10
990
Documentation Writing (for coders)
carmenintech
59
3.9k
The Pragmatic Product Professional
lauravandoore
24
5.8k
GraphQLの誤解/rethinking-graphql
sonatard
50
9.2k
What’s in a name? Adding method to the madness
productmarketing
PRO
15
2.6k
Designing Dashboards & Data Visualisations in Web Apps
destraynor
226
51k
jQuery: Nuts, Bolts and Bling
dougneiner
59
7.1k
Building Effective Engineering Teams - LeadDev
addyosmani
28
1.8k
Agile that works and the tools we love
rasmusluckow
324
20k
Transcript
Context & Contingency Aaron Suggs
Thank you Jen, Joe, Ann Marie, Kaete, Chris, Mark, and
Katie!
Aaron Suggs ktheory Ops Engineering
helps creative projects come to life
1. ELK 2. Management
“It’s not a promotion, it’s a career change” — Lindsay
Holmwood MGMT 101
Kyle Burckhard built it @talaris
Business Requirements
“Look at the massive explosion in operational software offerings over
the past 5-6 years.” — Charity Majors
Hosted SAAS
Maybe Splunk?
ELK
None
App logs Vendor logs lograge S3 Event filebeat SQS worker
logstash (+S3) logstash AWS Elasticsearch Service (with Kibana)
Proof of concept
!
filebeat with real data!
filebeat with real data! “Do no harm”
Trivia Time!
Trivia Time! Why might a disk be 100% full after
you delete several large files?
Answer " A process has open file handles (use lsof)
What to do?
What to do? - Upgrade it! Thx GitHub.
What to do? - Upgrade it! Thx GitHub. - Restart
it.
What to do? - Upgrade it! Thx GitHub. - Restart
it.
AWS Elasticsearch vs. DIY on EC2
None
AWS Elasticsearch DIY on EC2
AWS Elasticsearch DIY on EC2 Less dev attention* More dev
attention
AWS Elasticsearch DIY on EC2 Less dev attention* More dev
attention ✅
AWS Elasticsearch DIY on EC2 Less dev attention* More dev
attention Less flexible Flexible, adaptable ✅
AWS Elasticsearch DIY on EC2 Less dev attention* More dev
attention Less flexible Flexible, adaptable ✅ ✅
AWS Elasticsearch DIY on EC2 Less dev attention* More dev
attention Less flexible Flexible, adaptable Hard to debug Lots of visibility ✅ ✅
AWS Elasticsearch DIY on EC2 Less dev attention* More dev
attention Less flexible Flexible, adaptable Hard to debug Lots of visibility ✅ ✅ ✅
AWS Elasticsearch DIY on EC2 Less dev attention* More dev
attention Less flexible Flexible, adaptable Hard to debug Lots of visibility Aligned w/ our use ✅ ✅ ✅
AWS Elasticsearch DIY on EC2 Less dev attention* More dev
attention Less flexible Flexible, adaptable Hard to debug Lots of visibility Aligned w/ our use ✅ ✅ ✅ ✅
Rails log & Logstash
Rails log & Logstash
Lograge github.com/roidrage/lograge
When you show devs Kibana
When you show devs Kibana
MVP = better than alternative
T-Shaped skills
T-Shaped skills Me AWS Ruby
T-Shaped skills Me AWS Ruby Kyle AWS Ruby Docker
T-Shaped skills Me AWS Ruby Kyle AWS Ruby Docker ?
Distributed systems Go
Ingesting vendor logs - S3 access logs - CDN access
logs - CloudTrail logs
S3 Events -> SQS -> shoryuken ruby worker -> logstash
S3 Events -> SQS -> shoryuken ruby worker -> logstash
re-import old logs
Autoscaling!
Trivia Time!
Trivia Time! What’s the bottleneck after you scale logstash?
Answer " 100% Elasticsearch CPU
Answer " Then it crashes. $ 100% Elasticsearch CPU
None
Mitigating Burnout MGMT 102
Solution: Pairing 1. Fosters career growth 2. Cross-training 3. Team
bonding
Summary
Summary 1. Mind the skills of your team
Summary 1. Mind the skills of your team 2. Know
the next-best alternative
Summary 1. Mind the skills of your team 2. Know
the next-best alternative 3. Consider a tool’s community
Thank you! ktheory