Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
Fluentd を導入した話
Search
Kazuma Muramatsu
December 25, 2012
460
3
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
Fluentd を導入した話
社内向け
Kazuma Muramatsu
December 25, 2012
Transcript
49 slides
Fluentd を 導入した話
@m_zuma Kazuma Hinami work at OCC Co., Ltd. service engineer
γεςϜαʔόͰ ग़ྗ͞Ε͍ͯΔϩά
ීஈ͋·Γͬͯͳ͍
ීஈ͋·Γͬͯͳ͍ Τϥʔ࣌ʹTTIͰHSFQ͢Δ͘Β͍
׆༻͍ͨ͠
ϩάʹు͔ΕͯΔ ใ͔ΒαʔϏε վળϢʔβ͕ ΉͷΛݟग़͢
ग़ྗ͞Ε͍ͯΔϩ άΛλʔϛφϧͰ ͳ͘ϒϥβ͔ Β֬ೝͰ͖ΔΑ͏ ʹ͢Δ
✔ Path ✔ Traffic ✔ Agent List ✔ Response Time
etc...
log analysis data mining
͔͠͠
Apache nginx syslog etc...
Apache nginx syslog etc... format ga tigau!
? Apache nginx syslog
Fluentd Apache nginx syslog ?
Fluentd ?
Fluentd is a lightweight and flexible log collector.
None
made of
Pluggable
None
$ gem list -r “fluent-plugin-” | wc -l 86
parse JSON
JSON “127.0.0.1 - [2012-11-15 9:00:00 -0900] 200 "GET /index.php HTTP...”
access_log.message { “ip”:“127.0.0.1”, “date”:“[2012-11-15 9:00:00 -0900]”, ... } JSON “127.0.0.1
- [2012-11-15 9:00:00 -0900] 200 "GET /index.php HTTP...”
“127.0.0.1 - [2012-11-15 9:00:00 -0900] 200 "GET /index.php HTTP...” JSON
format /^(?<ip>[^ ]+) (?<date>[^ ]+) (?<status>[ ^]+) ... / access_log.message { “ip”:“127.0.0.1”, “date”:“[2012-11-15 9:00:00 -0900]”, ... }
Fluentd Apache nginx syslog ?
Fluentd JSON Apache nginx syslog
Apache Fluentd nginx syslog JSON
JSON
JSON
JSON stdout file plugin
JSON stdout file plugin
JSON stdout file plugin stdout file plugin
JSON stdout file plugin stdout file plugin
Usage ?
App Server Fluentd App Server DB Server DB Graph log
parse, count etc... output forward
My team
Fluentd ↓sshfs App Server file GrowthForecast datacounter copy forest
Fluentd ↓sshfs App Server file GrowthForecast 1Server copy datacounter forest
とある事情で
Demo
ϩάʹు͔ΕͯΔ ใ͔ΒαʔϏε վળϢʔβ͕ ΉͷΛݟग़͢
ग़ྗ͞Ε͍ͯΔϩ άΛλʔϛφϧͰ ͳ͘ϒϥβ͔ Β֬ೝ͢Δ
Future...
✔ ;BCCJYͷಋೖ ✔ 8FC͔ΒΤϥʔՕॴΛղੳ
✔ ;BCCJYͷಋೖ ✔ 8FC͔ΒΤϥʔՕॴΛղੳ インストールはした!
None
#3E4146 #ACA264 #A63180 #322117 このスライドで 使ってるカラー
End.
More Decks by Kazuma Muramatsu
See All by Kazuma Muramatsu
SSLサーバ証明書のお話
m_zuma
0
300
Natto
m_zuma
2
450
ランチョンミートの話をしよう
m_zuma
4
2k
Featured
See All Featured
Being A Developer After 40
akosma
PRO
92
590k
<Decoding/> the Language of Devs - We Love SEO 2024
nikkihalliwell
1
380
brightonSEO & MeasureFest 2025 - Winning Strategies for Black Friday CRO & PPC - Christian Goodrich
cargoodrich
3
900
Testing 201, or: Great Expectations
jmmastey
46
8.4k
Art, The Web, and Tiny UX
lynnandtonic
304
22k
30 Presentation Tips
portentint
PRO
1
470
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
addyosmani
10
1.4k
Impact Scores and Hybrid Strategies: The future of link building
tamaranovitovic
0
490
Dealing with People You Can't Stand - Big Design 2015
cassininazir
367
27k
A Guide to Academic Writing Using Generative AI - A Workshop
ks91
PRO
1
570
How to Build an AI Search Optimization Roadmap - Criteria and Steps to Take #SEOIRL
aleyda
1
2.3k
Imperfection Machines: The Place of Print at Facebook
scottboms
270
14k