Golangでリクエストごとのクエリログが見たい！！ kamakura.go #4 / go-query-and-request-logger

kamakura.go #4 LT枠

https://serinuntius.hatenablog.jp/entry/2018/05/01/083000

Transcript

1. GolangͰϦΫΤετ͝ͱͷ ΫΤϦϩά͕Έ͍ͨʂʂ 2018-05-25 kamakura.go #4 LT ໘ന๏ਓΧϠοΫ ۔઒Ѯ @_serinuntius
2. ஫ҙ
 ⚠ܕ੒෼গͳΊͰ͢⚠
3. Ξϯέʔτ
4. ISUCON ஌ͬͯΒͬ͠ΌΔํʙ
5. ISUCON ग़ͨ͜ͱ͋ΔΑͬͯํʙ
6. ISUCONͱ͸ʁ
7. ͓୊ͱͳΔWebαʔϏεΛ
 ܾΊΒΕͨϨΪϡϨʔγϣϯͷதͰ
 ݶք·Ͱߴ଎ԽΛਤΔ
 νϡʔχϯάότϧɺ
 ͦΕ͕ISUCONͰ͢ɻ ISUCONެࣜBlogͷdescriptionΑΓ
8. ͪͳΈʹ๻͸ ࣾ಺ISUCON͔͠ ग़ͨ͜ͱ͋Γ·ͤΜ
9. ࣾ಺ISUCONͰݟ͑ͨ՝୊ • ΫΤϦͷൃߦճ਺Λߟྀ͠ͳ͚Ε͹͍͚ͳ͍
 (ൃߦճ਺͕গͳ͍ɺ஗͍͚ͩͷΫΤϦ΋͋Δ) w w • Ͳ͜ͰΫΤϦ͕ൃߦ͞Ε͍ͯΔ͔΋஌Γ͍ͨ • ΋ͬͱݴ͑͹ͲͷϦΫΤετͰ
 ͲΕ͚ͩݺ͹ΕͯΔ͔΋஌Γ͍ͨ • GoͰग़͍ͨ(ܕ͕͋ͬͨํ͕ΞϓϦͷϦϑΝΫλ͕͠қ͍)
10. ࣾ಺ISUCONͰͷ ൓লΛ׆͔ͨ͢Ίʹ
11. ΞΫηεϩΨʔ
 ͱ ΫΤϦϩΨʔΛ࡞ͬͨ
12. github.com/serinuntius/graqt
 ര஀
13. ࢖͍ํ εςοϓ1~import~ • 2ͭͷύοέʔδΛimport͢Δ
14. ࢖͍ํ εςοϓ2
 ~driverΛ؀ڥม਺Ͱ੾Γସ͑Δ~ • driver੾Γସ͑ͱtraceΛΦϯΦϑ͢Δ
15. ࢖͍ํ εςοϓ3
 ~middleware௥Ճ~ • aliceΛ࢖͏
16. ࢖͍ํ εςοϓ4
 ~SQLݺͼग़͠ݩͷcontextରԠ~ • http.Request͔ΒcontextऔΓग़ͯ͠ɺ
 ݺͼग़͢ͱ͖ʹ౉͢
17. ٕज़తͳ͜ͱ
18. ϦΫΤετʹUUIDΛຒΊࠐΉ • middleware.go UUID=>ϦΫΤετͱΫΤϦΛඥ෇͚ΔͨΊ
19. ϦΫΤετʹUUIDΛຒΊࠐΉ • middleware.go UUID=>ϦΫΤετͱΫΤϦΛඥ෇͚ΔͨΊ ίϯςΩετʹೖΕΔཧ༝
 =>ޙͰΫΤϦͱUUIDΛඥ෇͚ΔͨΊ
20. ϋΠύϑΥʔϚϯεͳ ߏ଄ԽϩΨʔ • uber-go/zap • RLogger͕request༻ͷzapͷLogger ࠓճͷਃ͠༁ఔ౓ͷܕཁૉ
21. ϋΠύϑΥʔϚϯεͳ ߏ଄ԽϩΨʔ {"level":"info", "ts":1525082389.1337767, "caller":"graqt/middleware.go:25", "msg":"",
 "time":0.011566198, "request_id":"5914e629-6746-42c5- z342-702f224f48e1", "path":"/user", "method":"POST" } • ܕΛࢦఆͯ͠Δ͔Β଎͍
22. ΫΤϦΛτϨʔε͢Δ • shogo82148/go-sql-proxy • database/sql͸ͲΜͳDBʹ΋ରԠͰ͖ΔΑ͏ʹͳͬͯ ͍Δ • database/sql/driverʹ͋ΔinterfaceΛຬͨͯ͠Ε͹OK • ϓϩΩγ࡞ͬͯͦͷ··౉ͤ͹ϩάΛు͚ΔͷͰ͸ʁ • ͱ͍͏ൃ૝Ͱ࡞ΒΕͨΒ͍͠Ͱ͢*1 *1GoݴޠͰSQLͷτϨʔεΛ͢Δ
 https://shogo82148.github.io/blog/2015/05/13/golang-sql-proxy/
23. ௒φΠεͳinterfaceͩʂʂ
 (਒͑੠) ࠓճͷืूཁ߲ˠ
24. ΫΤϦΛτϨʔε͢Δ • go-sql-proxyʹ͸ඪ४ͰΫΤϦϩΨʔ͕͋Δ • ࠓճ͸UUIDΛϩάʹు͖͍ͨؔ܎Ͱ
 ࣗલͰఆٛ
25. ΫΤϦτϨʔαʔͷ࣮૷ • tracer.go
26. ΫΤϦτϨʔαʔͷ࣮૷ • preܥͰݱࡏ࣌ࠁΛฦ͢ • cͷcontextʹrequestͷuuid͕ೖ͍ͬͯΔ • ctxʹpreܥͷݱࡏ࣌ࠁ͕ೖ͍ͬͯΔ
27. ࣮ࡍʹు͔ΕΔϩά • request.log
 {"level":"info","ts":1525082389.1337767,"caller":"graqt/middleware.go: 25","msg":"","time":0.011566198,"request_id":"5914e629-6746-42c5- b342-702f224f48e1","path":"/user","method":"POST"} • query.log
 {"level":"info","ts":1525082389.1336403,"caller":"graqt/tracer.go: 20","msg":"Exec","query":"INSERT INTO `user` (email,age) VALUES (?, ?)","args":[{"Name":"","Ordinal": 1,"Value":"hoge1525082389130688404@hoge.com"}, {"Name":"","Ordinal":2,"Value":57}],"time": 0.001157627,"request_id":"5914e629-6746-42c5-b342-702f224f48e1"}
28. ͑ɺϩάు͚ͩ͘ʁ • ͪΐͬͱ଴ͬͯͯ • alpΈ͍ͨͳϩάΛूܭ͢ΔCLIΛ੡࡞த • ϦΫΤετ͝ͱʹΫΤϦ΋ݟΕΔΑ͏ʹ͠·͢ • tigΛΊͬͪΌγϯϓϧʹͨ͠ૢ࡞ײͷΠϝʔδ
29. ϩʔυϚοϓ ϩά͕ग़ΔΑ͏ʹͳͬͨ Kamakura.goͰLT (ΠϚίί)
30. ϩʔυϚοϓ ϩά͕ग़ΔΑ͏ʹͳͬͨ Kamakura.goͰLT (ΠϚίί) viewerͷ࡞੒
31. ϩʔυϚοϓ ϩά͕ग़ΔΑ͏ʹͳͬͨ Kamakura.goͰLT (ΠϚίί) viewerͷ࡞੒ ISUCON༧બ௨աͯ͠
 ϒϩάͰ঺հ͢Δ
32. ϩʔυϚοϓ ϩά͕ग़ΔΑ͏ʹͳͬͨ Kamakura.goͰLT (ΠϚίί) viewerͷ࡞੒ ISUCON༧બ௨աͯ͠
 ϒϩάͰ঺հ͢Δ (୭͔͕graqt࢖ͬͯ) 
 ISUCON༏উ͢Δ
33. ϩʔυϚοϓ ϩά͕ग़ΔΑ͏ʹͳͬͨ Kamakura.goͰLT (ΠϚίί) viewerͷ࡞੒ ISUCON༧બ௨աͯ͠
 ϒϩάͰ঺հ͢Δ (୭͔͕graqt࢖ͬͯ) 
 ISUCON༏উ͢Δ 100ສͰ๻ʹ
 ম೑ᇋͬͯ͘ΕΔ
34. ·ͱΊ • serinuntius/graqtΛ࢖͑͹ɺ
 ISUCONʹศརͦ͏ͳϩά͕ు͚Δ • ISUCONҎ֎ʹ΋΋ͪΖΜ࢖͑Δ • OSSͳͷͰποίϛͱ͔ؾܰʹͲ͏ͧ • ISUCON༏উͯ͠ম೑ᇋͬͯ͘Ε