Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Profiling Go Application

orisano
November 25, 2018
Technology
11
6.7k

Profiling Go Application

orisano

November 25, 2018
Tweet

More Decks by orisano

See All by orisano
OSS Performance Tuning Tips
orisano
8
4.7k
Docker-Compose & BuildKit
orisano
4
680
Container Build Talk
orisano
3
2.3k
dockerignore talk
orisano
2
6k
Better docker image+
orisano
6
4.7k
Socket.IO Introduction
orisano
0
2.3k
Multi-stage Builds Patterns & Practice
orisano
6
4.4k
better docker image
orisano
22
26k
the world of characters
orisano
8
1.2k

Other Decks in Technology

See All in Technology
OCI DevOps 概要 / OCI DevOps overview
oracle4engineer
PRO
0
500
【Λ（らむだ）】WinActorから始めるいつのまにリスキリング / WinAtorライトニングトーク大会20230123
lambda
0
120
NGINXENG JP#2 - 2-NGINXの動作の詳細
hiropo20
1
140
IoTを始めたきっかけの話と個人でできるIoTの今後 / 新年LT会「私の愛するIoT 2023」
you
0
240
Multi-Cloud Gatewayでデータを統治せよ！/ Data Federation with MCG
tutsunom
1
300
NGINXENG JP#2 - 3-NGINX Plus・プロダクトのアップデート
hiropo20
0
250
AWS re:Invent 2022で発表された新機能を試してみた ～Cloud OperationとSecurity～ / New Cloud Operation and Security Features Announced at AWS reInvent 2022
yuj1osm
1
210
Logbii(ログビー) 会社紹介
logbii
0
140
ML PM, DS PMってどんな仕事をしているの？
line_developers
PRO
1
240
OpenShift.Run2023_create-aro-with-terraform
ishiitaiki20fixer
1
310
NGINXENG JP#2 - 1-NGINX-エンジニアリング勉強会-きょうの見どころ
hiropo20
0
110
Periodic Multi-Agent Path Planning
hziwara
0
120

Featured

See All Featured
Design and Strategy: How to Deal with People Who Don’t "Get" Design
morganepeng
109
16k
Fight the Zombie Pattern Library - RWD Summit 2016
marcelosomers
227
16k
The Pragmatic Product Professional
lauravandoore
21
3.4k
Robots, Beer and Maslow
schacon
154
7.3k
GraphQLの誤解/rethinking-graphql
sonatard
39
7.8k
Navigating Team Friction
lara
177
12k
Designing with Data
zakiwarfel
91
4.2k
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
sstephenson
152
13k
Building Your Own Lightsaber
phodgson
96
4.9k
jQuery: Nuts, Bolts and Bling
dougneiner
57
6.6k
KATA
mclloyd
12
9.7k
Ruby is Unlike a Banana
tanoku
93
9.5k

Transcript

  1. Profiling Go Application Go Conference 2018 Autumn #gocon #gocon_a @orisano

  2. ࣗݾ঺հ • @orisano • ۦ͚ग़͠ΞϓϦέʔγϣϯΤϯδχΞ • ޮ཰తͳdocker buildΛ໨ࢦ͍ͯ͠Δ • ύϑΥʔϚϯεʹڵຯ͕͋Δ

  3. ࠓ೔࿩͢͜ͱ • ߴ଎Խ΍, ϓϩϑΝΠϦϯάΛߦ͖࣮ͬͯͨྫ • Ͳ͏͍͏վળΛ͢Δͷ͔ • Ͳ͏͍͏ϓϩηεͳͷ͔

  4. ը૾ม׵αʔόͷ࿩ kubeletͷ࿩ go-swaggerͷ࿩

  5. ը૾ม׵αʔόͷ࿩ kubeletͷ࿩ go-swaggerͷ࿩

  6. ৄղ γεςϜɾύϑΥʔϚϯε ྠಡձ

  7. ୊ࡐͱͯ͠؆୯ͳ ը૾ม׵αʔόΛѻͬͨ

  8. ෛՙΛ͔͚Δͱ ΞϓϦέʔγϣϯ͕མͪͨ

  9. topΛΈͨ

  10. མͪͨݪҼ͸ ϝϞϦͷ࢖༻ྔ

  11. ϝϞϦϦʔΫʁ

  12. pprofΛ࢖͏ GODEBUG=allocfreetrace=1 ͢Δ

  13. runtimeʹखΛೖΕΔ

  14. GC͍ͯ͠Δͱ͖ʹ ࢀরgraphΛdump͢ΔΑ͏ ʹͨ͠

  15. None

  16. ͪΌΜͱpprofͷmemory goroutineͷ਺ΛݟΔ

  17. ಉ࣌ม׵਺ʹ੍ݶΛ͚ͭΔ

  18. ແࣄ໰୊͸ղܾͨ͠

  19. ͋ͱ͸ߴ଎Խ

  20. disintegration/imaging

  21. Boundary Check Elimination

  22. Go͸جຊఴࣈΞΫηε͢Δͱ ൣғνΣοΫ͕ೖΔ

  23. ίϯύΠϥ͕҆શͩͱ ൑அ͢Δͱফ͑Δ

  24. ͜ΕΛ Boundary Check Elimination (BCE)ͱ͍͏

  25. ͜ΕΛ Boundary Check Elimination (BCE)ͱ͍͏ ref: https://go101.org/article/bounds-check-elimination.html

  26. goͷඪ४ϥΠϒϥϦͰ ͦͦ͜͜ݟΔ

  27. ը૾ͷಡΈࠐΈ, ม׵ͳͲ heavyʹఴࣈΞΫηε͢Δ ৔߹ͩͱޮՌ͕େ͖͍

  28. https://github.com/ disintegration/imaging/ pull/81

  29. https://github.com/ disintegration/imaging/ pull/81

  30. None

  31. pprofͳͲͰ ݪҼΛಛఆͨ͠Β

  32. ·ͣ BenchmarkΛॻ͜͏ *testing.B

  33. Benchmarkͷ݁ՌΛ ͪΌΜͱݟΔ

  34. golang.org/x/tools/cmd/ benchcmp golang.org/x/perf/cmd/ benchstat

  35. https://github.com/ disintegration/imaging/ pull/81

  36. ը૾ม׵αʔόͷ࿩ kubeletͷ࿩ go-swaggerͷ࿩

  37. kubeletͷCPU͕ෛՙ͕ߴ͍ ͱ૬ஊΛड͚ͨ

  38. Datadog͕ୟ͍ͯΔ Metrics༻ͷEndpoint͕ ݪҼͳͷͰ͸ͱ͍͏࿩ͩͬͨ

  39. kubelet͸net/http/pprofΛ import͍ͯ͠Δ

  40. ໰୊͕ى͖͍ͯΔ؀ڥͷ ৘ใ͕औͬͯ͜ΕΔ

  41. None

  42. prometheus/common google/cadvisor ͷҰ෦͕ॏ͍

  43. None

  44. ౰֘Օॴ https://github.com/prometheus/ common/pull/148 ൃ֮ͷ1िؒલ͘Β͍ʹ allocation freeʹͳͬͯ 2ഒ͘Β͍ૣ͘ͳ͍ͬͯͨ

  45. None

  46. ͳΜ͔չ͔ͬͨ͠ͷͰ https://github.com/prometheus/ common/pull/150 ߋʹͦΕΛ2ഒ͘Β͍ૣ͘͠·ͨ͠

  47. None

  48. ७ਮʹWrite͕ଟ͔ͬͨ

  49. strings.Replacerʹ͸ WriteString͕͋Γ·͢

  50. ஔ׵ର৅ՕॴҎ֎͸ ·ͱΊͯWriteͯ͘͠ΕΔ

  51. allocation΋ى͜Βͳ͍ͷͰ࠷ߴ

  52. ࣍ʹ

  53. google/cadvisorͷ ListContainers͕ॏ͍

  54. None

  55. google/cadvisorͷ ListContainers͕ॏ͍ https://github.com/google/cadvisor/blob/8faf19092784b75fce10ce190d37e66f89de3612/container/common/helpers.go

  56. ioutil.ReadDirͱsyscall ͕ॏ͍ʁ

  57. ioutil.ReadDirͷத਎ΛݟͯΈΔ

  58. ref: https://golang.org/src/io/ioutil/ioutil.go

  59. ref: https://golang.org/src/os/dir_unix.go

  60. ͳΜ͔ҎԼʹ͋ΔϑΝΠϧશ෦ʹ lstatൃߦ͍ͯ͠Δ

  61. ref: https://golang.org/src/os/dir_unix.go

  62. readdirentͬͯ΍͕ͭ͋Δ

  63. Ͳ͏΍Β͜Ε͸ entryͷtypeΛฦͯ͘͠ΕΔΒ͍͠

  64. google/cadvisorͷ ListContainers͕ॏ͍ https://github.com/google/cadvisor/blob/8faf19092784b75fce10ce190d37e66f89de3612/container/common/helpers.go

  65. readdirentΛ͏·͘࢖͑Ε͹ syscallͷճ਺ΛݮΒͤΔ

  66. ͔͠͠ golangඪ४ͷreaddirent͸ typeΛऔಘͰ͖ͳ͍

  67. ͔͠΋ ࣮૷ʹඞཁͳॾʑ͕ privateʹͳ͍ͬͯΔ

  68. ඪ४͔Βͦ͜Λίϐϖ͢Δͱ cadvisorͷ LICENSE Checkʹ௨Βͳ͍

  69. ࣮͸͜ͷํ๏ ͍ΖΜͳϥΠϒϥϦͰ࢖ΘΕ͍ͯΔ goimports/internal/fastwalk ֎෦͔Βར༻Ͱ͖ͳ͍

  70. ѹ౗తʹ֎෦͔Βར༻Ͱ͖ͳ͍

  71. github.com/karrick/godirwalk Α͏΍͘ݟ͚ͭͨ

  72. https://github.com/google/ cadvisor/pull/2085

  73. None

  74. Memoryܥͷऔಘ͚ͩ΍ͨΒ஗͍

  75. https://lkml.org/lkml/ 2018/7/3/101 cgroups v1ܥͷ໰୊Β͍͠ kernelͷversionΛ͋͛Α͏

  76. ը૾ม׵αʔόͷ࿩ kubeletͷ࿩ go-swaggerͷ࿩

  77. ࣗಈੜ੒Λ݁ߏ࢖͍ͬͯΔͷͰ͕͢

  78. go-swagger͕஗͍

  79. ૣ͘͠Α͏

  80. cliܥͷϓϩϑΝΠϦϯάʹ͸ pkg/profile͕ศར

  81. None

  82. https://github.com/go-openapi/ swag/pull/25

  83. None

  84. ಺෦Ͱຖճ MustCompileͯͨ͠

  85. None

  86. https://github.com/go-openapi/ loads/pull/19

  87. None

  88. ஗͍json.UnmarshalΛ deepcopyͷͨΊʹ2ճͯͨ͠

  89. json.Unmarshal 1ճ {de,en}coding/gob Ͱ͓஡Λ୙ͨ͠

  90. None

  91. ·ͱΊ

  92. ීஈ࢖͍ͬͯΔ΋ͷͰ΋ ΧϦΧϦʹνϡʔχϯά ͞Ε͍ͯΔΘ͚Ͱ͸ͳ͍

  93. ࣗ෼͕஗͍ͱײͨ͡Β ܭଌͯ͠ΈΔ վળͯ͠ΈΔ

  94. cliͳΒpkg/profileΛ࢓ࠐΜͰݟΔ

  95. serverͳΒnet/http/pprofΛ࢖͏

  96. ݪҼͷಛఆͷखॿ͚ͷͨΊʹ svgʹͨ͠Γ uber/go-torchΛ࢖ͬͯ flamegraphʹͨ͠Γ flamescopeΛ࢖ͬͨΓ

  97. ݪҼΛಛఆͨ͠Β BenchmarkΛॻ͘

  98. -count=10ͳͲΛ࢖ͬͨ͋ͱʹ benchcmp or benchstat ͯ͠ޮՌ͕ग़͍ͯΔ͜ͱΛ֬ೝ

  99. ͋ͱ͸PRΛ౤͛Δ

  100. ͜Μͳʹ ύϑΥʔϚϯενϡʔχϯά ͠΍͍͢ݴޠଞʹͳ͍

  101. ΍͍ͬͯ͜͏

  102. ඞཁΛײ͡Δ·Ͱ͸ νϡʔχϯά͠ͳ͍

  103. Ͱ΋ ܭଌ͕Ͱ͖Δ؀ڥ͸༻ҙ͢΂͖