Fluentd を導入した話

社内向け

Transcript

1. Fluentd を 導入した話
2. @m_zuma Kazuma Hinami work at OCC Co., Ltd. service engineer
3. γεςϜ΍αʔόͰ ग़ྗ͞Ε͍ͯΔϩά
4. ීஈ͸͋·Γ࢖ͬͯͳ͍
5. ීஈ͸͋·Γ࢖ͬͯͳ͍ Τϥʔ࣌ʹ
   TTI
   Ͱ
   HSFQ
   ͢Δ͘Β͍
6. ׆༻͍ͨ͠
7. ϩάʹు͔ΕͯΔ ৘ใ͔ΒαʔϏε վળ΍Ϣʔβ͕๬ Ή΋ͷΛݟग़͢
8. ग़ྗ͞Ε͍ͯΔϩ άΛλʔϛφϧͰ ͸ͳ͘ϒϥ΢β͔ Β֬ೝͰ͖ΔΑ͏ ʹ͢Δ
9. ✔ Path ✔ Traffic ✔ Agent List ✔ Response Time etc...
10. log analysis data mining
11. ͔͠͠
12. Apache nginx syslog etc...
13. Apache nginx syslog etc... format ga tigau!
14. ? Apache nginx syslog
15. Fluentd Apache nginx syslog ?
16. Fluentd ?
17. Fluentd is a lightweight and flexible log collector.
19. made of
20. Pluggable
22. $ gem list -r “fluent-plugin-” | wc -l 86
23. parse JSON
24. JSON “127.0.0.1 - [2012-11-15 9:00:00 -0900] 200 "GET /index.php HTTP...”
25. access_log.message { “ip”:“127.0.0.1”, “date”:“[2012-11-15 9:00:00 -0900]”, ... } JSON “127.0.0.1 - [2012-11-15 9:00:00 -0900] 200 "GET /index.php HTTP...”
26. “127.0.0.1 - [2012-11-15 9:00:00 -0900] 200 "GET /index.php HTTP...” JSON format /^(?<ip>[^ ]+) (?<date>[^ ]+) (?<status>[ ^]+) ... / access_log.message { “ip”:“127.0.0.1”, “date”:“[2012-11-15 9:00:00 -0900]”, ... }
27. Fluentd Apache nginx syslog ?
28. Fluentd JSON Apache nginx syslog
29. Apache Fluentd nginx syslog JSON
30. JSON
31. JSON
32. JSON stdout file plugin
33. JSON stdout file plugin
34. JSON stdout file plugin stdout file plugin
35. JSON stdout file plugin stdout file plugin
36. Usage ?
37. App Server Fluentd App Server DB Server DB Graph log parse, count etc... output forward
38. My team
39. Fluentd ↓sshfs App Server file GrowthForecast datacounter copy forest
40. Fluentd ↓sshfs App Server file GrowthForecast 1Server copy datacounter forest とある事情で
41. Demo
42. ϩάʹు͔ΕͯΔ ৘ใ͔ΒαʔϏε վળ΍Ϣʔβ͕๬ Ή΋ͷΛݟग़͢
43. ग़ྗ͞Ε͍ͯΔϩ άΛλʔϛφϧͰ ͸ͳ͘ϒϥ΢β͔ Β֬ೝ͢Δ
44. Future...
45. ✔ ;BCCJY
    ͷಋೖ ✔ 8FC
    ͔ΒΤϥʔՕॴΛղੳ
46. ✔ ;BCCJY
    ͷಋೖ ✔ 8FC
    ͔ΒΤϥʔՕॴΛղੳ インストールはした！
48. #3E4146 #ACA264 #A63180 #322117 このスライドで 使ってるカラー
49. End.