Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Fluentd を導入した話
Search
Kazuma Muramatsu
December 25, 2012
3
450
Fluentd を導入した話
社内向け
Kazuma Muramatsu
December 25, 2012
Tweet
Share
More Decks by Kazuma Muramatsu
See All by Kazuma Muramatsu
SSLサーバ証明書のお話
m_zuma
0
290
Natto
m_zuma
2
420
ランチョンミートの話をしよう
m_zuma
4
1.9k
Featured
See All Featured
RailsConf 2023
tenderlove
30
1.1k
Java REST API Framework Comparison - PWX 2021
mraible
31
8.7k
What's in a price? How to price your products and services
michaelherold
246
12k
Faster Mobile Websites
deanohume
307
31k
Music & Morning Musume
bryan
46
6.6k
GitHub's CSS Performance
jonrohan
1031
460k
Improving Core Web Vitals using Speculation Rules API
sergeychernyshev
17
950
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
addyosmani
7
720
Fashionably flexible responsive web design (full day workshop)
malarkey
407
66k
JavaScript: Past, Present, and Future - NDC Porto 2020
reverentgeek
48
5.4k
Bootstrapping a Software Product
garrettdimon
PRO
307
110k
Designing Dashboards & Data Visualisations in Web Apps
destraynor
231
53k
Transcript
Fluentd を 導入した話
@m_zuma Kazuma Hinami work at OCC Co., Ltd. service engineer
γεςϜαʔόͰ ग़ྗ͞Ε͍ͯΔϩά
ීஈ͋·Γͬͯͳ͍
ීஈ͋·Γͬͯͳ͍ Τϥʔ࣌ʹTTIͰHSFQ͢Δ͘Β͍
׆༻͍ͨ͠
ϩάʹు͔ΕͯΔ ใ͔ΒαʔϏε վળϢʔβ͕ ΉͷΛݟग़͢
ग़ྗ͞Ε͍ͯΔϩ άΛλʔϛφϧͰ ͳ͘ϒϥβ͔ Β֬ೝͰ͖ΔΑ͏ ʹ͢Δ
✔ Path ✔ Traffic ✔ Agent List ✔ Response Time
etc...
log analysis data mining
͔͠͠
Apache nginx syslog etc...
Apache nginx syslog etc... format ga tigau!
? Apache nginx syslog
Fluentd Apache nginx syslog ?
Fluentd ?
Fluentd is a lightweight and flexible log collector.
None
made of
Pluggable
None
$ gem list -r “fluent-plugin-” | wc -l 86
parse JSON
JSON “127.0.0.1 - [2012-11-15 9:00:00 -0900] 200 "GET /index.php HTTP...”
access_log.message { “ip”:“127.0.0.1”, “date”:“[2012-11-15 9:00:00 -0900]”, ... } JSON “127.0.0.1
- [2012-11-15 9:00:00 -0900] 200 "GET /index.php HTTP...”
“127.0.0.1 - [2012-11-15 9:00:00 -0900] 200 "GET /index.php HTTP...” JSON
format /^(?<ip>[^ ]+) (?<date>[^ ]+) (?<status>[ ^]+) ... / access_log.message { “ip”:“127.0.0.1”, “date”:“[2012-11-15 9:00:00 -0900]”, ... }
Fluentd Apache nginx syslog ?
Fluentd JSON Apache nginx syslog
Apache Fluentd nginx syslog JSON
JSON
JSON
JSON stdout file plugin
JSON stdout file plugin
JSON stdout file plugin stdout file plugin
JSON stdout file plugin stdout file plugin
Usage ?
App Server Fluentd App Server DB Server DB Graph log
parse, count etc... output forward
My team
Fluentd ↓sshfs App Server file GrowthForecast datacounter copy forest
Fluentd ↓sshfs App Server file GrowthForecast 1Server copy datacounter forest
とある事情で
Demo
ϩάʹు͔ΕͯΔ ใ͔ΒαʔϏε վળϢʔβ͕ ΉͷΛݟग़͢
ग़ྗ͞Ε͍ͯΔϩ άΛλʔϛφϧͰ ͳ͘ϒϥβ͔ Β֬ೝ͢Δ
Future...
✔ ;BCCJYͷಋೖ ✔ 8FC͔ΒΤϥʔՕॴΛղੳ
✔ ;BCCJYͷಋೖ ✔ 8FC͔ΒΤϥʔՕॴΛղੳ インストールはした!
None
#3E4146 #ACA264 #A63180 #322117 このスライドで 使ってるカラー
End.