Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Profiling Go Application

orisano
November 25, 2018

Profiling Go Application

orisano

November 25, 2018
Tweet

More Decks by orisano

Other Decks in Technology

Transcript

  1. Profiling
    Go Application
    Go Conference 2018 Autumn #gocon #gocon_a
    @orisano

    View Slide

  2. ࣗݾ঺հ
    • @orisano
    • ۦ͚ग़͠ΞϓϦέʔγϣϯΤϯδχΞ
    • ޮ཰తͳdocker buildΛ໨ࢦ͍ͯ͠Δ
    • ύϑΥʔϚϯεʹڵຯ͕͋Δ

    View Slide

  3. ࠓ೔࿩͢͜ͱ
    • ߴ଎Խ΍, ϓϩϑΝΠϦϯάΛߦ͖࣮ͬͯͨྫ
    • Ͳ͏͍͏վળΛ͢Δͷ͔
    • Ͳ͏͍͏ϓϩηεͳͷ͔

    View Slide

  4. ը૾ม׵αʔόͷ࿩
    kubeletͷ࿩
    go-swaggerͷ࿩

    View Slide

  5. ը૾ม׵αʔόͷ࿩
    kubeletͷ࿩
    go-swaggerͷ࿩

    View Slide

  6. ৄղ
    γεςϜɾύϑΥʔϚϯε
    ྠಡձ

    View Slide

  7. ୊ࡐͱͯ͠؆୯ͳ
    ը૾ม׵αʔόΛѻͬͨ

    View Slide

  8. ෛՙΛ͔͚Δͱ
    ΞϓϦέʔγϣϯ͕མͪͨ

    View Slide

  9. topΛΈͨ

    View Slide

  10. མͪͨݪҼ͸
    ϝϞϦͷ࢖༻ྔ

    View Slide

  11. ϝϞϦϦʔΫʁ

    View Slide

  12. pprofΛ࢖͏
    GODEBUG=allocfreetrace=1
    ͢Δ

    View Slide

  13. runtimeʹखΛೖΕΔ

    View Slide

  14. GC͍ͯ͠Δͱ͖ʹ
    ࢀরgraphΛdump͢ΔΑ͏
    ʹͨ͠

    View Slide

  15. View Slide

  16. ͪΌΜͱpprofͷmemory
    goroutineͷ਺ΛݟΔ

    View Slide

  17. ಉ࣌ม׵਺ʹ੍ݶΛ͚ͭΔ

    View Slide

  18. ແࣄ໰୊͸ղܾͨ͠

    View Slide

  19. ͋ͱ͸ߴ଎Խ

    View Slide

  20. disintegration/imaging

    View Slide

  21. Boundary Check
    Elimination

    View Slide

  22. Go͸جຊఴࣈΞΫηε͢Δͱ
    ൣғνΣοΫ͕ೖΔ

    View Slide

  23. ίϯύΠϥ͕҆શͩͱ
    ൑அ͢Δͱফ͑Δ

    View Slide

  24. ͜ΕΛ
    Boundary Check
    Elimination (BCE)ͱ͍͏

    View Slide

  25. ͜ΕΛ
    Boundary Check
    Elimination (BCE)ͱ͍͏
    ref: https://go101.org/article/bounds-check-elimination.html

    View Slide

  26. goͷඪ४ϥΠϒϥϦͰ
    ͦͦ͜͜ݟΔ

    View Slide

  27. ը૾ͷಡΈࠐΈ, ม׵ͳͲ
    heavyʹఴࣈΞΫηε͢Δ
    ৔߹ͩͱޮՌ͕େ͖͍

    View Slide

  28. https://github.com/
    disintegration/imaging/
    pull/81

    View Slide

  29. https://github.com/
    disintegration/imaging/
    pull/81

    View Slide

  30. View Slide

  31. pprofͳͲͰ
    ݪҼΛಛఆͨ͠Β

    View Slide

  32. ·ͣ
    BenchmarkΛॻ͜͏
    *testing.B

    View Slide

  33. Benchmarkͷ݁ՌΛ
    ͪΌΜͱݟΔ

    View Slide

  34. golang.org/x/tools/cmd/
    benchcmp
    golang.org/x/perf/cmd/
    benchstat

    View Slide

  35. https://github.com/
    disintegration/imaging/
    pull/81

    View Slide

  36. ը૾ม׵αʔόͷ࿩
    kubeletͷ࿩
    go-swaggerͷ࿩

    View Slide

  37. kubeletͷCPU͕ෛՙ͕ߴ͍
    ͱ૬ஊΛड͚ͨ

    View Slide

  38. Datadog͕ୟ͍ͯΔ
    Metrics༻ͷEndpoint͕
    ݪҼͳͷͰ͸ͱ͍͏࿩ͩͬͨ

    View Slide

  39. kubelet͸net/http/pprofΛ
    import͍ͯ͠Δ

    View Slide

  40. ໰୊͕ى͖͍ͯΔ؀ڥͷ
    ৘ใ͕औͬͯ͜ΕΔ

    View Slide

  41. View Slide

  42. prometheus/common
    google/cadvisor
    ͷҰ෦͕ॏ͍

    View Slide

  43. View Slide

  44. ౰֘Օॴ
    https://github.com/prometheus/
    common/pull/148
    ൃ֮ͷ1िؒલ͘Β͍ʹ
    allocation freeʹͳͬͯ
    2ഒ͘Β͍ૣ͘ͳ͍ͬͯͨ

    View Slide

  45. View Slide

  46. ͳΜ͔չ͔ͬͨ͠ͷͰ
    https://github.com/prometheus/
    common/pull/150
    ߋʹͦΕΛ2ഒ͘Β͍ૣ͘͠·ͨ͠

    View Slide

  47. View Slide

  48. ७ਮʹWrite͕ଟ͔ͬͨ

    View Slide

  49. strings.Replacerʹ͸
    WriteString͕͋Γ·͢

    View Slide

  50. ஔ׵ର৅ՕॴҎ֎͸
    ·ͱΊͯWriteͯ͘͠ΕΔ

    View Slide

  51. allocation΋ى͜Βͳ͍ͷͰ࠷ߴ

    View Slide

  52. ࣍ʹ

    View Slide

  53. google/cadvisorͷ
    ListContainers͕ॏ͍

    View Slide

  54. View Slide

  55. google/cadvisorͷ
    ListContainers͕ॏ͍
    https://github.com/google/cadvisor/blob/8faf19092784b75fce10ce190d37e66f89de3612/container/common/helpers.go

    View Slide

  56. ioutil.ReadDirͱsyscall
    ͕ॏ͍ʁ

    View Slide

  57. ioutil.ReadDirͷத਎ΛݟͯΈΔ

    View Slide

  58. ref: https://golang.org/src/io/ioutil/ioutil.go

    View Slide

  59. ref: https://golang.org/src/os/dir_unix.go

    View Slide

  60. ͳΜ͔ҎԼʹ͋ΔϑΝΠϧશ෦ʹ
    lstatൃߦ͍ͯ͠Δ

    View Slide

  61. ref: https://golang.org/src/os/dir_unix.go

    View Slide

  62. readdirentͬͯ΍͕ͭ͋Δ

    View Slide

  63. Ͳ͏΍Β͜Ε͸
    entryͷtypeΛฦͯ͘͠ΕΔΒ͍͠

    View Slide

  64. google/cadvisorͷ
    ListContainers͕ॏ͍
    https://github.com/google/cadvisor/blob/8faf19092784b75fce10ce190d37e66f89de3612/container/common/helpers.go

    View Slide

  65. readdirentΛ͏·͘࢖͑Ε͹
    syscallͷճ਺ΛݮΒͤΔ

    View Slide

  66. ͔͠͠
    golangඪ४ͷreaddirent͸
    typeΛऔಘͰ͖ͳ͍

    View Slide

  67. ͔͠΋
    ࣮૷ʹඞཁͳॾʑ͕
    privateʹͳ͍ͬͯΔ

    View Slide

  68. ඪ४͔Βͦ͜Λίϐϖ͢Δͱ
    cadvisorͷ
    LICENSE Checkʹ௨Βͳ͍

    View Slide

  69. ࣮͸͜ͷํ๏
    ͍ΖΜͳϥΠϒϥϦͰ࢖ΘΕ͍ͯΔ
    goimports/internal/fastwalk
    ֎෦͔Βར༻Ͱ͖ͳ͍

    View Slide

  70. ѹ౗తʹ֎෦͔Βར༻Ͱ͖ͳ͍

    View Slide

  71. github.com/karrick/godirwalk
    Α͏΍͘ݟ͚ͭͨ

    View Slide

  72. https://github.com/google/
    cadvisor/pull/2085

    View Slide

  73. View Slide

  74. Memoryܥͷऔಘ͚ͩ΍ͨΒ஗͍

    View Slide

  75. https://lkml.org/lkml/
    2018/7/3/101
    cgroups v1ܥͷ໰୊Β͍͠
    kernelͷversionΛ͋͛Α͏

    View Slide

  76. ը૾ม׵αʔόͷ࿩
    kubeletͷ࿩
    go-swaggerͷ࿩

    View Slide

  77. ࣗಈੜ੒Λ݁ߏ࢖͍ͬͯΔͷͰ͕͢

    View Slide

  78. go-swagger͕஗͍

    View Slide

  79. ૣ͘͠Α͏

    View Slide

  80. cliܥͷϓϩϑΝΠϦϯάʹ͸
    pkg/profile͕ศར

    View Slide

  81. View Slide

  82. https://github.com/go-openapi/
    swag/pull/25

    View Slide

  83. View Slide

  84. ಺෦Ͱຖճ
    MustCompileͯͨ͠

    View Slide

  85. View Slide

  86. https://github.com/go-openapi/
    loads/pull/19

    View Slide

  87. View Slide

  88. ஗͍json.UnmarshalΛ
    deepcopyͷͨΊʹ2ճͯͨ͠

    View Slide

  89. json.Unmarshal 1ճ
    {de,en}coding/gob
    Ͱ͓஡Λ୙ͨ͠

    View Slide

  90. View Slide

  91. ·ͱΊ

    View Slide

  92. ීஈ࢖͍ͬͯΔ΋ͷͰ΋
    ΧϦΧϦʹνϡʔχϯά
    ͞Ε͍ͯΔΘ͚Ͱ͸ͳ͍

    View Slide

  93. ࣗ෼͕஗͍ͱײͨ͡Β
    ܭଌͯ͠ΈΔ
    վળͯ͠ΈΔ

    View Slide

  94. cliͳΒpkg/profileΛ࢓ࠐΜͰݟΔ

    View Slide

  95. serverͳΒnet/http/pprofΛ࢖͏

    View Slide

  96. ݪҼͷಛఆͷखॿ͚ͷͨΊʹ
    svgʹͨ͠Γ
    uber/go-torchΛ࢖ͬͯ
    flamegraphʹͨ͠Γ
    flamescopeΛ࢖ͬͨΓ

    View Slide

  97. ݪҼΛಛఆͨ͠Β
    BenchmarkΛॻ͘

    View Slide

  98. -count=10ͳͲΛ࢖ͬͨ͋ͱʹ
    benchcmp or benchstat
    ͯ͠ޮՌ͕ग़͍ͯΔ͜ͱΛ֬ೝ

    View Slide

  99. ͋ͱ͸PRΛ౤͛Δ

    View Slide

  100. ͜Μͳʹ
    ύϑΥʔϚϯενϡʔχϯά
    ͠΍͍͢ݴޠଞʹͳ͍

    View Slide

  101. ΍͍ͬͯ͜͏

    View Slide

  102. ඞཁΛײ͡Δ·Ͱ͸
    νϡʔχϯά͠ͳ͍

    View Slide

  103. Ͱ΋
    ܭଌ͕Ͱ͖Δ؀ڥ͸༻ҙ͢΂͖

    View Slide