Profiling Go Application

Transcript

1. Profiling
   Go Application
   Go Conference 2018 Autumn #gocon #gocon_a
   @orisano
   

   View Slide

2. ࣗݾ঺հ
   • @orisano
   • ۦ͚ग़͠ΞϓϦέʔγϣϯΤϯδχΞ
   • ޮ཰తͳdocker buildΛ໨ࢦ͍ͯ͠Δ
   • ύϑΥʔϚϯεʹڵຯ͕͋Δ
   

   View Slide

3. ࠓ೔࿩͢͜ͱ
   • ߴ଎Խ΍, ϓϩϑΝΠϦϯάΛߦ͖࣮ͬͯͨྫ
   • Ͳ͏͍͏վળΛ͢Δͷ͔
   • Ͳ͏͍͏ϓϩηεͳͷ͔
   

   View Slide

4. ը૾ม׵αʔόͷ࿩
   kubeletͷ࿩
   go-swaggerͷ࿩
   

   View Slide

5. ը૾ม׵αʔόͷ࿩
   kubeletͷ࿩
   go-swaggerͷ࿩
   

   View Slide

6. ৄղ
   γεςϜɾύϑΥʔϚϯε
   ྠಡձ
   

   View Slide

7. ୊ࡐͱͯ͠؆୯ͳ
   ը૾ม׵αʔόΛѻͬͨ
   

   View Slide

8. ෛՙΛ͔͚Δͱ
   ΞϓϦέʔγϣϯ͕མͪͨ
   

   View Slide

9. topΛΈͨ
   

   View Slide

10. མͪͨݪҼ͸
    ϝϞϦͷ࢖༻ྔ
    

    View Slide

11. ϝϞϦϦʔΫʁ
    

    View Slide

12. pprofΛ࢖͏
    GODEBUG=allocfreetrace=1
    ͢Δ
    

    View Slide

13. runtimeʹखΛೖΕΔ
    

    View Slide

14. GC͍ͯ͠Δͱ͖ʹ
    ࢀরgraphΛdump͢ΔΑ͏
    ʹͨ͠
    

    View Slide

15. View Slide

16. ͪΌΜͱpprofͷmemory
    goroutineͷ਺ΛݟΔ
    

    View Slide

17. ಉ࣌ม׵਺ʹ੍ݶΛ͚ͭΔ
    

    View Slide

18. ແࣄ໰୊͸ղܾͨ͠
    

    View Slide

19. ͋ͱ͸ߴ଎Խ
    

    View Slide

20. disintegration/imaging
    

    View Slide

21. Boundary Check
    Elimination
    

    View Slide

22. Go͸جຊఴࣈΞΫηε͢Δͱ
    ൣғνΣοΫ͕ೖΔ
    

    View Slide

23. ίϯύΠϥ͕҆શͩͱ
    ൑அ͢Δͱফ͑Δ
    

    View Slide

24. ͜ΕΛ
    Boundary Check
    Elimination (BCE)ͱ͍͏
    

    View Slide

25. ͜ΕΛ
    Boundary Check
    Elimination (BCE)ͱ͍͏
    ref: https://go101.org/article/bounds-check-elimination.html
    

    View Slide

26. goͷඪ४ϥΠϒϥϦͰ
    ͦͦ͜͜ݟΔ
    

    View Slide

27. ը૾ͷಡΈࠐΈ, ม׵ͳͲ
    heavyʹఴࣈΞΫηε͢Δ
    ৔߹ͩͱޮՌ͕େ͖͍
    

    View Slide

28. https://github.com/
    disintegration/imaging/
    pull/81
    

    View Slide

29. https://github.com/
    disintegration/imaging/
    pull/81
    

    View Slide

30. View Slide

31. pprofͳͲͰ
    ݪҼΛಛఆͨ͠Β
    

    View Slide

32. ·ͣ
    BenchmarkΛॻ͜͏
    *testing.B
    

    View Slide

33. Benchmarkͷ݁ՌΛ
    ͪΌΜͱݟΔ
    

    View Slide

34. golang.org/x/tools/cmd/
    benchcmp
    golang.org/x/perf/cmd/
    benchstat
    

    View Slide

35. https://github.com/
    disintegration/imaging/
    pull/81
    

    View Slide

36. ը૾ม׵αʔόͷ࿩
    kubeletͷ࿩
    go-swaggerͷ࿩
    

    View Slide

37. kubeletͷCPU͕ෛՙ͕ߴ͍
    ͱ૬ஊΛड͚ͨ
    

    View Slide

38. Datadog͕ୟ͍ͯΔ
    Metrics༻ͷEndpoint͕
    ݪҼͳͷͰ͸ͱ͍͏࿩ͩͬͨ
    

    View Slide

39. kubelet͸net/http/pprofΛ
    import͍ͯ͠Δ
    

    View Slide

40. ໰୊͕ى͖͍ͯΔ؀ڥͷ
    ৘ใ͕औͬͯ͜ΕΔ
    

    View Slide

41. View Slide

42. prometheus/common
    google/cadvisor
    ͷҰ෦͕ॏ͍
    

    View Slide

43. View Slide

44. ౰֘Օॴ
    https://github.com/prometheus/
    common/pull/148
    ൃ֮ͷ1िؒલ͘Β͍ʹ
    allocation freeʹͳͬͯ
    2ഒ͘Β͍ૣ͘ͳ͍ͬͯͨ
    

    View Slide

45. View Slide

46. ͳΜ͔չ͔ͬͨ͠ͷͰ
    https://github.com/prometheus/
    common/pull/150
    ߋʹͦΕΛ2ഒ͘Β͍ૣ͘͠·ͨ͠
    

    View Slide

47. View Slide

48. ७ਮʹWrite͕ଟ͔ͬͨ
    

    View Slide

49. strings.Replacerʹ͸
    WriteString͕͋Γ·͢
    

    View Slide

50. ஔ׵ର৅ՕॴҎ֎͸
    ·ͱΊͯWriteͯ͘͠ΕΔ
    

    View Slide

51. allocation΋ى͜Βͳ͍ͷͰ࠷ߴ
    

    View Slide

52. ࣍ʹ
    

    View Slide

53. google/cadvisorͷ
    ListContainers͕ॏ͍
    

    View Slide

54. View Slide

55. google/cadvisorͷ
    ListContainers͕ॏ͍
    https://github.com/google/cadvisor/blob/8faf19092784b75fce10ce190d37e66f89de3612/container/common/helpers.go
    

    View Slide

56. ioutil.ReadDirͱsyscall
    ͕ॏ͍ʁ
    

    View Slide

57. ioutil.ReadDirͷத਎ΛݟͯΈΔ
    

    View Slide

58. ref: https://golang.org/src/io/ioutil/ioutil.go
    

    View Slide

59. ref: https://golang.org/src/os/dir_unix.go
    

    View Slide

60. ͳΜ͔ҎԼʹ͋ΔϑΝΠϧશ෦ʹ
    lstatൃߦ͍ͯ͠Δ
    

    View Slide

61. ref: https://golang.org/src/os/dir_unix.go
    

    View Slide

62. readdirentͬͯ΍͕ͭ͋Δ
    

    View Slide

63. Ͳ͏΍Β͜Ε͸
    entryͷtypeΛฦͯ͘͠ΕΔΒ͍͠
    

    View Slide

64. google/cadvisorͷ
    ListContainers͕ॏ͍
    https://github.com/google/cadvisor/blob/8faf19092784b75fce10ce190d37e66f89de3612/container/common/helpers.go
    

    View Slide

65. readdirentΛ͏·͘࢖͑Ε͹
    syscallͷճ਺ΛݮΒͤΔ
    

    View Slide

66. ͔͠͠
    golangඪ४ͷreaddirent͸
    typeΛऔಘͰ͖ͳ͍
    

    View Slide

67. ͔͠΋
    ࣮૷ʹඞཁͳॾʑ͕
    privateʹͳ͍ͬͯΔ
    

    View Slide

68. ඪ४͔Βͦ͜Λίϐϖ͢Δͱ
    cadvisorͷ
    LICENSE Checkʹ௨Βͳ͍
    

    View Slide

69. ࣮͸͜ͷํ๏
    ͍ΖΜͳϥΠϒϥϦͰ࢖ΘΕ͍ͯΔ
    goimports/internal/fastwalk
    ֎෦͔Βར༻Ͱ͖ͳ͍
    

    View Slide

70. ѹ౗తʹ֎෦͔Βར༻Ͱ͖ͳ͍
    

    View Slide

71. github.com/karrick/godirwalk
    Α͏΍͘ݟ͚ͭͨ
    

    View Slide

72. https://github.com/google/
    cadvisor/pull/2085
    

    View Slide

73. View Slide

74. Memoryܥͷऔಘ͚ͩ΍ͨΒ஗͍
    

    View Slide

75. https://lkml.org/lkml/
    2018/7/3/101
    cgroups v1ܥͷ໰୊Β͍͠
    kernelͷversionΛ͋͛Α͏
    

    View Slide

76. ը૾ม׵αʔόͷ࿩
    kubeletͷ࿩
    go-swaggerͷ࿩
    

    View Slide

77. ࣗಈੜ੒Λ݁ߏ࢖͍ͬͯΔͷͰ͕͢
    

    View Slide

78. go-swagger͕஗͍
    

    View Slide

79. ૣ͘͠Α͏
    

    View Slide

80. cliܥͷϓϩϑΝΠϦϯάʹ͸
    pkg/profile͕ศར
    

    View Slide

81. View Slide

82. https://github.com/go-openapi/
    swag/pull/25
    

    View Slide

83. View Slide

84. ಺෦Ͱຖճ
    MustCompileͯͨ͠
    

    View Slide

85. View Slide

86. https://github.com/go-openapi/
    loads/pull/19
    

    View Slide

87. View Slide

88. ஗͍json.UnmarshalΛ
    deepcopyͷͨΊʹ2ճͯͨ͠
    

    View Slide

89. json.Unmarshal 1ճ
    {de,en}coding/gob
    Ͱ͓஡Λ୙ͨ͠
    

    View Slide

90. View Slide

91. ·ͱΊ
    

    View Slide

92. ීஈ࢖͍ͬͯΔ΋ͷͰ΋
    ΧϦΧϦʹνϡʔχϯά
    ͞Ε͍ͯΔΘ͚Ͱ͸ͳ͍
    

    View Slide

93. ࣗ෼͕஗͍ͱײͨ͡Β
    ܭଌͯ͠ΈΔ
    վળͯ͠ΈΔ
    

    View Slide

94. cliͳΒpkg/profileΛ࢓ࠐΜͰݟΔ
    

    View Slide

95. serverͳΒnet/http/pprofΛ࢖͏
    

    View Slide

96. ݪҼͷಛఆͷखॿ͚ͷͨΊʹ
    svgʹͨ͠Γ
    uber/go-torchΛ࢖ͬͯ
    flamegraphʹͨ͠Γ
    flamescopeΛ࢖ͬͨΓ
    

    View Slide

97. ݪҼΛಛఆͨ͠Β
    BenchmarkΛॻ͘
    

    View Slide

98. -count=10ͳͲΛ࢖ͬͨ͋ͱʹ
    benchcmp or benchstat
    ͯ͠ޮՌ͕ग़͍ͯΔ͜ͱΛ֬ೝ
    

    View Slide

99. ͋ͱ͸PRΛ౤͛Δ
    

    View Slide

100. ͜Μͳʹ
     ύϑΥʔϚϯενϡʔχϯά
     ͠΍͍͢ݴޠଞʹͳ͍
     

     View Slide

101. ΍͍ͬͯ͜͏
     

     View Slide

102. ඞཁΛײ͡Δ·Ͱ͸
     νϡʔχϯά͠ͳ͍
     

     View Slide

103. Ͱ΋
     ܭଌ͕Ͱ͖Δ؀ڥ͸༻ҙ͢΂͖
     

     View Slide