Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
Aaron Suggs - Keynote - Context & Contingency: ...
Search
devopsdaysraleigh
October 07, 2016
Technology
110
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
Aaron Suggs - Keynote - Context & Contingency: Patterns for choosing good tools
devopsdaysraleigh
October 07, 2016
Transcript
62 slides
Context & Contingency Aaron Suggs
Thank you Jen, Joe, Ann Marie, Kaete, Chris, Mark, and
Katie!
Aaron Suggs ktheory Ops Engineering
helps creative projects come to life
1. ELK 2. Management
“It’s not a promotion, it’s a career change” — Lindsay
Holmwood MGMT 101
Kyle Burckhard built it @talaris
Business Requirements
“Look at the massive explosion in operational software offerings over
the past 5-6 years.” — Charity Majors
Hosted SAAS
Maybe Splunk?
ELK
None
App logs Vendor logs lograge S3 Event filebeat SQS worker
logstash (+S3) logstash AWS Elasticsearch Service (with Kibana)
Proof of concept
!
filebeat with real data!
filebeat with real data! “Do no harm”
Trivia Time!
Trivia Time! Why might a disk be 100% full after
you delete several large files?
Answer " A process has open file handles (use lsof)
What to do?
What to do? - Upgrade it! Thx GitHub.
What to do? - Upgrade it! Thx GitHub. - Restart
it.
What to do? - Upgrade it! Thx GitHub. - Restart
it.
AWS Elasticsearch vs. DIY on EC2
None
AWS Elasticsearch DIY on EC2
AWS Elasticsearch DIY on EC2 Less dev attention* More dev
attention
AWS Elasticsearch DIY on EC2 Less dev attention* More dev
attention ✅
AWS Elasticsearch DIY on EC2 Less dev attention* More dev
attention Less flexible Flexible, adaptable ✅
AWS Elasticsearch DIY on EC2 Less dev attention* More dev
attention Less flexible Flexible, adaptable ✅ ✅
AWS Elasticsearch DIY on EC2 Less dev attention* More dev
attention Less flexible Flexible, adaptable Hard to debug Lots of visibility ✅ ✅
AWS Elasticsearch DIY on EC2 Less dev attention* More dev
attention Less flexible Flexible, adaptable Hard to debug Lots of visibility ✅ ✅ ✅
AWS Elasticsearch DIY on EC2 Less dev attention* More dev
attention Less flexible Flexible, adaptable Hard to debug Lots of visibility Aligned w/ our use ✅ ✅ ✅
AWS Elasticsearch DIY on EC2 Less dev attention* More dev
attention Less flexible Flexible, adaptable Hard to debug Lots of visibility Aligned w/ our use ✅ ✅ ✅ ✅
Rails log & Logstash
Rails log & Logstash
Lograge github.com/roidrage/lograge
When you show devs Kibana
When you show devs Kibana
MVP = better than alternative
T-Shaped skills
T-Shaped skills Me AWS Ruby
T-Shaped skills Me AWS Ruby Kyle AWS Ruby Docker
T-Shaped skills Me AWS Ruby Kyle AWS Ruby Docker ?
Distributed systems Go
Ingesting vendor logs - S3 access logs - CDN access
logs - CloudTrail logs
S3 Events -> SQS -> shoryuken ruby worker -> logstash
S3 Events -> SQS -> shoryuken ruby worker -> logstash
re-import old logs
Autoscaling!
Trivia Time!
Trivia Time! What’s the bottleneck after you scale logstash?
Answer " 100% Elasticsearch CPU
Answer " Then it crashes. $ 100% Elasticsearch CPU
None
Mitigating Burnout MGMT 102
Solution: Pairing 1. Fosters career growth 2. Cross-training 3. Team
bonding
Summary
Summary 1. Mind the skills of your team
Summary 1. Mind the skills of your team 2. Know
the next-best alternative
Summary 1. Mind the skills of your team 2. Know
the next-best alternative 3. Consider a tool’s community
Thank you! ktheory
More Decks by devopsdaysraleigh
See All by devopsdaysraleigh
Chris Collins - Embracing the Container
devopsdaysrdu
0
98
Rebecca Fernandez & Jen Krieger - How to be more open, collaborative, and inclusive at work
devopsdaysrdu
0
190
Josh Atwell - How to Evolve Ops Skills to a DevOps World
devopsdaysrdu
0
170
Leon Fayer - Ignite - Oncall for developers
devopsdaysrdu
0
110
Maggie Gourlay - Ignite - My Gaming Days Weren’t Wasted: How Gaming Trained Me for Testing in DevOps
devopsdaysrdu
0
140
Fraser Pollock - Ignite - Data Before DevOps
devopsdaysrdu
0
86
Dylan Schowengerdt - Ignite - Customer Success: The Missing Link in the Feedback Loop to Engineering
devopsdaysrdu
0
280
Eric Sigler - "Is there any strong objection?"
devopsdaysrdu
0
110
Michael DeHaan - Keynote - Speaking for the Dead: Is "Waterfall" and "Monolithic" Actually Good?
devopsdaysrdu
0
100
Other Decks in Technology
See All in Technology
AI-Ready なデータ基盤ってなに? & 新卒未経験が、いま考えていること
imuta
0
1.1k
[関西Kaggler会 20261113] 続・コミュニティコンペのススメ
nejumi
0
200
その修正で本当に速くなったのか? k6とOpenTelemetryで確かめる性能改善 / Performance review with k6 and OpenTelemetry
ymotongpoo
3
430
Agent Routerで作るマルチテナント 推論基盤 #CNDW2026 / Building Multi-Tenant Inference Platform with Agent Router #CNDW2026
everpeace
5
600
E2E Test というハーネス — AI時代の自動テスト民主化
daishukojima
10
6k
サーバーラックは作る時代! 3Dプリンターで作る10インチラックのススメ
jacopen
2
510
ポケモンバトルのAIエージェント
koji_kawamura
0
150
Amazon Bedrock AgentCore の基礎とセキュリティ・ガバナンス
ren8k
0
270
【Oracle AI SPOTLIGHT ウェビナー】AI時代、狙われるデータと止められない業務をどう守るか?
oracle4engineer
PRO
1
140
SBOM 生成ツールで 2026 Minimum Elements はどこまで満たせるのか
gokken
0
150
信頼性を犠牲にせず、PR マージからデプロイまで人の介入を完全にゼロにするまでの道のり
knwoop
4
2.1k
メルカリの小規模チーム「Pod」で、 エンジニアがデータアナリストなしで、 AIを使ってデータ分析の自走を目指す取り組み
jackojacko_
1
340
Featured
See All Featured
State of Search Keynote: SEO is Dead Long Live SEO
ryanjones
0
360
Building the Perfect Custom Keyboard
takai
2
970
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
50
10k
技術選定の審美眼(2025年版) / Understanding the Spiral of Technologies 2025 edition
twada
PRO
121
130k
Rebuilding a faster, lazier Slack
samanthasiow
85
9.8k
"I'm Feeling Lucky" - Building Great Search Experiences for Today's Users (#IAC19)
danielanewman
230
23k
Responsive Adventures: Dirty Tricks From The Dark Corners of Front-End
smashingmag
254
23k
A Soul's Torment
seathinner
9
3.9k
Visual Storytelling: How to be a Superhuman Communicator
reverentgeek
2
750
[Rails World 2026] Durable orchestration on Rails: from continuation to workflow
palkan
4
1.3k
Hiding What from Whom? A Critical Review of the History of Programming languages for Music
tomoyanonymous
3
1.5k
A Guide to Academic Writing Using Generative AI - A Workshop
ks91
PRO
1
580