Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Fluentd を導入した話
Search
Kazuma Muramatsu
December 25, 2012
3
450
Fluentd を導入した話
社内向け
Kazuma Muramatsu
December 25, 2012
Tweet
Share
More Decks by Kazuma Muramatsu
See All by Kazuma Muramatsu
SSLサーバ証明書のお話
m_zuma
0
290
Natto
m_zuma
2
420
ランチョンミートの話をしよう
m_zuma
4
1.9k
Featured
See All Featured
The Myth of the Modular Monolith - Day 2 Keynote - Rails World 2024
eileencodes
26
2.9k
Git: the NoSQL Database
bkeepers
PRO
431
65k
Designing Experiences People Love
moore
142
24k
Documentation Writing (for coders)
carmenintech
72
4.9k
Keith and Marios Guide to Fast Websites
keithpitt
411
22k
A designer walks into a library…
pauljervisheath
207
24k
A Modern Web Designer's Workflow
chriscoyier
695
190k
Dealing with People You Can't Stand - Big Design 2015
cassininazir
367
26k
4 Signs Your Business is Dying
shpigford
184
22k
The Cult of Friendly URLs
andyhume
79
6.5k
CSS Pre-Processors: Stylus, Less & Sass
bermonpainter
357
30k
Automating Front-end Workflow
addyosmani
1370
200k
Transcript
Fluentd を 導入した話
@m_zuma Kazuma Hinami work at OCC Co., Ltd. service engineer
γεςϜαʔόͰ ग़ྗ͞Ε͍ͯΔϩά
ීஈ͋·Γͬͯͳ͍
ීஈ͋·Γͬͯͳ͍ Τϥʔ࣌ʹTTIͰHSFQ͢Δ͘Β͍
׆༻͍ͨ͠
ϩάʹు͔ΕͯΔ ใ͔ΒαʔϏε վળϢʔβ͕ ΉͷΛݟग़͢
ग़ྗ͞Ε͍ͯΔϩ άΛλʔϛφϧͰ ͳ͘ϒϥβ͔ Β֬ೝͰ͖ΔΑ͏ ʹ͢Δ
✔ Path ✔ Traffic ✔ Agent List ✔ Response Time
etc...
log analysis data mining
͔͠͠
Apache nginx syslog etc...
Apache nginx syslog etc... format ga tigau!
? Apache nginx syslog
Fluentd Apache nginx syslog ?
Fluentd ?
Fluentd is a lightweight and flexible log collector.
None
made of
Pluggable
None
$ gem list -r “fluent-plugin-” | wc -l 86
parse JSON
JSON “127.0.0.1 - [2012-11-15 9:00:00 -0900] 200 "GET /index.php HTTP...”
access_log.message { “ip”:“127.0.0.1”, “date”:“[2012-11-15 9:00:00 -0900]”, ... } JSON “127.0.0.1
- [2012-11-15 9:00:00 -0900] 200 "GET /index.php HTTP...”
“127.0.0.1 - [2012-11-15 9:00:00 -0900] 200 "GET /index.php HTTP...” JSON
format /^(?<ip>[^ ]+) (?<date>[^ ]+) (?<status>[ ^]+) ... / access_log.message { “ip”:“127.0.0.1”, “date”:“[2012-11-15 9:00:00 -0900]”, ... }
Fluentd Apache nginx syslog ?
Fluentd JSON Apache nginx syslog
Apache Fluentd nginx syslog JSON
JSON
JSON
JSON stdout file plugin
JSON stdout file plugin
JSON stdout file plugin stdout file plugin
JSON stdout file plugin stdout file plugin
Usage ?
App Server Fluentd App Server DB Server DB Graph log
parse, count etc... output forward
My team
Fluentd ↓sshfs App Server file GrowthForecast datacounter copy forest
Fluentd ↓sshfs App Server file GrowthForecast 1Server copy datacounter forest
とある事情で
Demo
ϩάʹు͔ΕͯΔ ใ͔ΒαʔϏε վળϢʔβ͕ ΉͷΛݟग़͢
ग़ྗ͞Ε͍ͯΔϩ άΛλʔϛφϧͰ ͳ͘ϒϥβ͔ Β֬ೝ͢Δ
Future...
✔ ;BCCJYͷಋೖ ✔ 8FC͔ΒΤϥʔՕॴΛղੳ
✔ ;BCCJYͷಋೖ ✔ 8FC͔ΒΤϥʔՕॴΛղੳ インストールはした!
None
#3E4146 #ACA264 #A63180 #322117 このスライドで 使ってるカラー
End.