Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Tool Time with John
Search
John Vincent
February 16, 2012
Technology
1
400
Tool Time with John
Presentation at Atlanta Puppet User's Group
John Vincent
February 16, 2012
Tweet
Share
More Decks by John Vincent
See All by John Vincent
Configuration management is a solved problem?
lusis
1
850
Everything about devops from metal
lusis
0
350
The Magic Omnibus
lusis
7
1.8k
Why Riak Matters
lusis
1
280
Monitorama 2013
lusis
7
1.9k
A Boy and His Logs
lusis
5
2.1k
Cross node orchestration with Chef and Noah
lusis
3
1.9k
Logging Patterns with Logstash and Chef
lusis
14
5.2k
The UnNamed Talk
lusis
7
1.4k
Other Decks in Technology
See All in Technology
AI によるドキュメント処理を加速するためのOCR 結果の永続化と再利用戦略
tomoaki25
0
390
GMOペパボのデータ基盤とデータ活用の現在地 / Current State of GMO Pepabo's Data Infrastructure and Data Utilization
zaimy
3
190
金融サービスにおける高速な価値提供とAIの役割 #BetAIDay
layerx
PRO
1
720
ロールが細分化された組織でSREと協働するインフラエンジニアは何をするか? / SRE Lounge #18
kossykinto
0
110
Segment Anything Modelの最新動向:SAM2とその発展系
tenten0727
0
230
Tableau API連携の罠!?脱スプシを夢見たはずが、逆に依存を深めた話
cuebic9bic
3
210
リリース2ヶ月で収益化した話
kent_code3
1
180
データ基盤の管理者からGoogle Cloud全体の管理者になっていた話
zozotech
PRO
0
320
AIのグローバルトレンド 2025 / ai global trend 2025
kyonmm
PRO
1
120
解消したはずが…技術と人間のエラーが交錯する恐怖体験
lamaglama39
0
190
마라톤 끝의 단거리 스퍼트: 2025년의 AI
inureyes
PRO
1
670
AI関数が早くなったので試してみよう
kumakura
0
110
Featured
See All Featured
"I'm Feeling Lucky" - Building Great Search Experiences for Today's Users (#IAC19)
danielanewman
229
22k
Fantastic passwords and where to find them - at NoRuKo
philnash
51
3.4k
Why Our Code Smells
bkeepers
PRO
337
57k
Building Adaptive Systems
keathley
43
2.7k
The Invisible Side of Design
smashingmag
301
51k
Easily Structure & Communicate Ideas using Wireframe
afnizarnur
194
16k
Distributed Sagas: A Protocol for Coordinating Microservices
caitiem20
332
22k
The Cost Of JavaScript in 2023
addyosmani
51
8.7k
Docker and Python
trallard
45
3.5k
XXLCSS - How to scale CSS and keep your sanity
sugarenia
248
1.3M
Faster Mobile Websites
deanohume
308
31k
JavaScript: Past, Present, and Future - NDC Porto 2020
reverentgeek
50
5.5k
Transcript
Tool Time with John! SE Puppet Users Group 02/16/2012
Everyone needs a tool belt
Why? • To fix things • To make things •
To keep your pants up
Caveats
There are tools
There are the right tools for a given job
Then there's “butterknifing a phillips head”
Fixing Things
Logging is Broken(ish) • Commercial options are expensive • Syslog
isn't flexible enough • Log lines are just data points with a timestamp (event)
Enter Logstash
Logstash • Unix pipe on steroids • If it has
a timestamp, send it to Logstash • Slice it, Dice it, Munge it, Transform it • Now spit it out • This isn't a Logstash talk.
Simple Sample Configuration
More complex (inputs)
More complex (filters)
More complex (outputs)
12 inputs, 11 filters, 21 outputs
Building stuff
Build something • Sockets the way you think sockets should
work • Usable from almost every language • Flow independent • Captures common patterns • Freaking fast
Logstash Filters with ZeroMQ • You need to do something
unique? • There's not a plugin yet? • Specific to your company? • Don't know Ruby? Write your own! (in whatever language you like)
Example – Logstash config
Example – External Filter
End Result
(don't get caught with your) Pants on the Ground
Statsd • Open sourced by Etsy last year • Simple
UDP proxy to Graphite • Different “data types” • Client and Server implementations in almost every language
Graphite • Open sourced by Orbitz • Makes pretty pictures
of data • Does dashboards • Simple API • Does realtime updates • Alternate dashboards available and easy to create
Logstash Configuration
End Result
Recap • Always be adding tools to your toolbelt •
See a cool project? Bookmark it • Evernote/Read it Later are your friends • Always be hacking. Keep your skills fresh.
Links! • Logstash – http://logstash.net • ZeroMQ – http://zeromq.org •
Statsd – http://github.com/etsy/statsd • Graphite – http://graphite.wikidot.com • Evernote – http://evernote.com
Thanks! • Twitter - @lusis • Github – lusis •
Email –
[email protected]