GKEのログ収集の仕組み

社内10分LT

Transcript

1. gkeͷϩάऩूͷ࢓૊Έ ʢࣾ಺LTʣ
2. ࿩͢಺༰ • gkeͷϩάऩूͷ࢓૊Έ • logging driverͱ͸ • ࣾ಺γεςϜࣄྫ
3. gke্Ͱίϯςφͷϩά͸Ͳ͏΍ͬͯऩ ू͞ΕΔ͔ʁ
4. ؆୯ʹ͍͏ͱ • GKEͷίϯςφ্Ͱඪ४ग़ྗͨ͠ϩά͸ɺdocker ͷlogging driverػೳͱgoogle͕ఏڙ͍ͯ͠Δ fluentdʹΑͬͯstackdriver Loggingʹ֨ೲ͞ΕΔ
5. Stack driver loggingͱ͸ • ϩάͷετϨʔδ΍ϩάϏϡʔΞΛఏڙ͢ΔαʔϏε
6. ϩάऩूͷৄࡉͳ࢓૊Έ
7. Nginxͷίϯςφ fluentdͷίϯςφ (google-fluentd) dockerϩάϑΝΠϧ Logging driverͷઃఆͰɺjson ϩάϑΝΠϧΛϗετʹग़ྗ fluentdίϯςφ͔Βϗ ετͷjsonϩάΛϚ΢ϯτ͠ɺಡΈ ࠐΉ Stack driver logging fluentdͷઃఆͰɺstackdriver loggingʹϩάΛૹ৴ ϩάऩूͷ࢓૊Έ
8. logging driverͱ͸
9. Logging driver • Docker 1.6͔Β௥Ճ͞Εͨػೳ • dockerͷग़ྗͷ੍ޚΛ͢Δػೳ
10. Logging driverͷछྨ
11. gke(docker)ͷઃఆ
12. Logging driverͷछྨ Json-fileҎ֎ͷ࢖͍ํʢྫʣ ɾawsͷ৔߹͸logging driverʹawslogsΛࢦఆͯ͠ cloudwatchʹϩάऩूͳͲ ɾlogging driverʹfluentdΛࢦఆͯ͠ɺ͔ͦ͜Βelastic searchʹ ೖΕͯkibanaͰϩάՄࢹԽͳͲ
13. ࣾ಺γεςϜࣄྫ
14. ࣾ಺γεςϜࣄྫ Nginxͷίϯςφ IPSͷίϯςφ nginxϩάϑΝΠϧ Logging driverͷઃఆͰɺjson ϩάϑΝΠϧΛϗετʹग़ྗ nginxϩάΛϚ΢ϯτ͠ɺϩά ΛಡΈࠐΈɺո͍͠ΞΫηεݕ஌ fluentdΛΧελϚΠζ ͠ɺnginxͷϩάΛಡΈࠐΈɺ stackdriver loggingʹૹ৴ fluentdͷίϯςφ (google-fluentd)
15. secure.anypay.jpʁͷ৔߹ Nginxͷίϯςφ IPSͷίϯςφ nginxϩάϑΝΠϧ Logging driverͷઃఆͰɺjson ϩάϑΝΠϧΛϗετʹग़ྗ nginxϩάΛϚ΢ϯτ͠ɺϩά ΛಡΈࠐΈɺո͍͠ΞΫηεݕ஌ fluentdͷઃఆͰɺnginx ͷϩάΛಡΈࠐΈɺstackdriver loggingʹૹ৴ fluentdͷίϯςφ GKEͷfluentdͷઃఆมߋํ๏ ɾGKEΫϥελ࡞੒࣌ʹ--no-enable-cloud-loggingʹͯɺࣗಈͰfluentdίϯςφ͕࡞੒͞Εͳ͘ ͢Δ ɾҎԼgithub͔ΒιʔεΛclone͠ɺfluentdͷઃఆʹඞཁͳॲཧΛ௥Ճ͠ɺkubectlίϚϯυͰख ಈσϓϩΠ https://github.com/GoogleCloudPlatform/container-engine-customize-fluentd
16. ·ͱΊ • GKEͷ৔߹͸ɺجຊ͸ϩάΛඪ४ग़ྗͰग़ྗ͠ɺࣗಈతʹlogging driverʹ ࣋ͬͯߦͬͨ΄͏͕͍͍ • ϩάϑΝΠϧʹग़ྗ͞ΕͨϩάΛऩू͢ΔɺfluentdͷϓϥάΠϯΛ࢖੍ͬͯ ޚ͍ͨ͜͠ͱ͕͋ΔͳͲͷ৔߹͸ɺΫϥελ࡞੒࣌ʹfluentdͷίϯςφΛoff ʹͯ͠ɺमਖ਼ͯࣗ͠෼ͰσϓϩΠ͢Δ