Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Speaker Deck
PRO
Sign in
Sign up for free
Tool Time with John
John Vincent
February 16, 2012
Technology
1
370
Tool Time with John
Presentation at Atlanta Puppet User's Group
John Vincent
February 16, 2012
Tweet
Share
More Decks by John Vincent
See All by John Vincent
Configuration management is a solved problem?
lusis
1
670
Everything about devops from metal
lusis
0
300
The Magic Omnibus
lusis
7
1.6k
Why Riak Matters
lusis
1
260
Monitorama 2013
lusis
7
1.7k
A Boy and His Logs
lusis
5
2.1k
Cross node orchestration with Chef and Noah
lusis
3
1.7k
Logging Patterns with Logstash and Chef
lusis
14
5k
The UnNamed Talk
lusis
7
1.3k
Other Decks in Technology
See All in Technology
マイクロサービス宣言から8年 振り返りとこれから / Eight Years After the Microservices Declaration A Look Back and A Look Ahead
eisuke
2
150
01_ユーザーリサーチ実施の進め方
kouzoukaikaku
0
410
230125 古いタブレットの活用 かーでぃさん
comucal
PRO
0
15k
API連携に伴う規制と対応 / Regulations and responses to API linkage
moneyforward
0
150
ECテックカンファレンス2023 EC事業部のモバイル開発2023
tatsumi0000
0
290
AWS re:Invent 2022で発表された新機能を試してみた ~Cloud OperationとSecurity~ / New Cloud Operation and Security Features Announced at AWS reInvent 2022
yuj1osm
1
200
Deep dive in Reserved Instance ~脳死推奨量購入からの脱却~
kzkmaeda
0
530
組織に対してSREを適用するとどうなるか
kuniim
7
2.4k
証明書って何だっけ? 〜AWSの中間CA移行に備える〜
minorun365
3
2.1k
Logbii(ログビー) 会社紹介
logbii
0
120
PHPのimmutable arrayとは
hnw
1
150
03_ユーザビリティテスト
kouzoukaikaku
0
390
Featured
See All Featured
Design and Strategy: How to Deal with People Who Don’t "Get" Design
morganepeng
109
16k
Art Directing for the Web. Five minutes with CSS Template Areas
malarkey
196
9.8k
Typedesign – Prime Four
hannesfritz
34
1.5k
GitHub's CSS Performance
jonrohan
1020
430k
Why You Should Never Use an ORM
jnunemaker
PRO
49
7.9k
Design by the Numbers
sachag
271
18k
Happy Clients
brianwarren
90
5.8k
Easily Structure & Communicate Ideas using Wireframe
afnizarnur
182
15k
Building Your Own Lightsaber
phodgson
96
4.9k
Making the Leap to Tech Lead
cromwellryan
117
7.7k
4 Signs Your Business is Dying
shpigford
171
20k
Dealing with People You Can't Stand - Big Design 2015
cassininazir
351
21k
Transcript
Tool Time with John! SE Puppet Users Group 02/16/2012
Everyone needs a tool belt
Why? • To fix things • To make things •
To keep your pants up
Caveats
There are tools
There are the right tools for a given job
Then there's “butterknifing a phillips head”
Fixing Things
Logging is Broken(ish) • Commercial options are expensive • Syslog
isn't flexible enough • Log lines are just data points with a timestamp (event)
Enter Logstash
Logstash • Unix pipe on steroids • If it has
a timestamp, send it to Logstash • Slice it, Dice it, Munge it, Transform it • Now spit it out • This isn't a Logstash talk.
Simple Sample Configuration
More complex (inputs)
More complex (filters)
More complex (outputs)
12 inputs, 11 filters, 21 outputs
Building stuff
Build something • Sockets the way you think sockets should
work • Usable from almost every language • Flow independent • Captures common patterns • Freaking fast
Logstash Filters with ZeroMQ • You need to do something
unique? • There's not a plugin yet? • Specific to your company? • Don't know Ruby? Write your own! (in whatever language you like)
Example – Logstash config
Example – External Filter
End Result
(don't get caught with your) Pants on the Ground
Statsd • Open sourced by Etsy last year • Simple
UDP proxy to Graphite • Different “data types” • Client and Server implementations in almost every language
Graphite • Open sourced by Orbitz • Makes pretty pictures
of data • Does dashboards • Simple API • Does realtime updates • Alternate dashboards available and easy to create
Logstash Configuration
End Result
Recap • Always be adding tools to your toolbelt •
See a cool project? Bookmark it • Evernote/Read it Later are your friends • Always be hacking. Keep your skills fresh.
Links! • Logstash – http://logstash.net • ZeroMQ – http://zeromq.org •
Statsd – http://github.com/etsy/statsd • Graphite – http://graphite.wikidot.com • Evernote – http://evernote.com
Thanks! • Twitter - @lusis • Github – lusis •
Email –
[email protected]