Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
計装を見直してアプリケーションパフォーマンスを改善させた話
Search
Kazuki Obata
May 16, 2025
Technology
2
350
計装を見直してアプリケーションパフォーマンスを改善させた話
3-shake SRE Tech Talk #12 オンサイト LT
https://3-shake.connpass.com/event/351861/
Kazuki Obata
May 16, 2025
Tweet
Share
More Decks by Kazuki Obata
See All by Kazuki Obata
自分だけの仮想クラスタを高速かつ効率的に作る kubefork
donkomura
0
170
散らばったトレースを繋げる技術
donkomura
1
660
ウォンテッドリーのインフラチームに加わってみて
donkomura
0
170
AWS CLI で気軽にコスト改善やってみた
donkomura
1
170
入門 KRR
donkomura
0
260
Other Decks in Technology
See All in Technology
(新URLに移行しました)FASTと向き合うことで見えた、大規模アジャイルの難しさと楽しさ
wooootack
0
490
New Cache Hierarchy for Container Images and OCI Artifacts in Kubernetes Clusters using Containerd / KubeCon + CloudNativeCon Japan
pfn
PRO
0
130
Introduction to Bill One Development Engineer
sansan33
PRO
0
250
kotlin-lsp を Emacs で使えるようにしてみた / use kotlin-lsp in Emacs
nabeo
0
110
現場で役立つAPIデザイン
nagix
1
220
医療業界に特化した音声認識モデル構築のためのアノテーションの実態
thickstem
0
520
Agent Development Kit によるエージェント開発入門
enakai00
19
2.8k
AI とペアプロしてわかった 3 つのヒューマンエラー
takahiroikegawa
1
600
Whats_new_in_Podman_and_CRI-O_2025-06
orimanabu
3
160
OpenTelemetry Collector internals
ymotongpoo
4
490
ai bot got sick (abc 2025s version)
kojira
0
160
ハッカー視点で学ぶサイバー攻撃と防御の基本
nomizone
0
950
Featured
See All Featured
RailsConf 2023
tenderlove
30
1.1k
XXLCSS - How to scale CSS and keep your sanity
sugarenia
248
1.3M
CSS Pre-Processors: Stylus, Less & Sass
bermonpainter
357
30k
Practical Orchestrator
shlominoach
188
11k
Typedesign – Prime Four
hannesfritz
42
2.7k
Visualization
eitanlees
146
16k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
34
3k
Faster Mobile Websites
deanohume
307
31k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
tammyeverts
52
2.8k
Helping Users Find Their Own Way: Creating Modern Search Experiences
danielanewman
29
2.6k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
stephaniewalter
280
13k
Building a Scalable Design System with Sketch
lauravandoore
462
33k
Transcript
© 2025 Wantedly, Inc. ܭΛݟͯ͠ΞϓϦέʔγϣϯ ύϑΥʔϚϯεΛվળͤͨ͞ 3-shake SRE Tech Talk
#12 LT May.16 2025 - Kazuki Obata 1
© 2025 Wantedly, Inc. Takeaways • ܭͷݟ͠ͰύϑΥʔϚϯεվળͷޮՌ͕͋Δ ◦ ෆཁͳܭΛऔΓআ͍ͨ݁ՌɺฏۉϨΠςϯγ͕ 1%
վળ • ܭଌେࣄ • ٕज़తෛ࠴ͷղফύϑΥʔϚϯεվળͷ༗ޮͳखஈʹͳΓ͏Δ 2
© 2025 Wantedly, Inc. ࣍ 01 ͳͥܭΛऔΓআ͘ͷ͔ 02 తͱૂ͍ 03
ޮՌଌఆͷํ๏ 04 ݁Ռ 05 ·ͱΊͱֶͼ 3
© 2025 Wantedly, Inc. ͳͥܭΛऔΓআ͘ͷ͔ 01 4
© 2025 Wantedly, Inc. ͳͥܭΛऔΓআ͘ͷ͔ • ࡢͷ12݄͝Ζʹ New Relic ͔Β
Datadog Ҡߦͨ͠ • New Relic ͷܭࣗମෆཁʹͳͬͨ ◦ ΞϥʔτҠߦʹ͍ͭͯʹॻ͍ͨϒϩάͰগ͠৮Ε͍ͯΔ 5 - Datadog ͷҠߦ
© 2025 Wantedly, Inc. ͳͥܭΛऔΓআ͘ͷ͔ • ܭϥΠϒϥϦ͕িಥͯ͠ΞοϓσʔτΛ્͍ͯͨ͠ ◦ ৽͍͠ػೳΛ͑ͳ͍ ◦
։ൃऀͷੜ࢈ੑ͕ଛͳΘΕ͍ͯΔ • ΞϓϦέʔγϣϯͷΦʔόʔϔου͕ͬͨ··ʹͳΔ ◦ ෆཁͳͷͰऔΓআ͖͍ͨ ◦ ύϑΥʔϚϯε͕վળ͞ΕΔ...͔ʁ 6 - ͬͨ՝
© 2025 Wantedly, Inc. ܭআ٫ͷతͱૂ͍ 02 7
© 2025 Wantedly, Inc. త • ґଘϥΠϒϥϦ͕όʔδϣϯΞοϓͰ͖ΔΑ͏ʹ͢Δ ◦ ܭΛऔΓআ͍ͯϥΠϒϥϦΛഇࢭ •
͋ΘΑ͘ΞϓϦέʔγϣϯύϑΥʔϚϯεͷվળ 8
© 2025 Wantedly, Inc. త • ґଘϥΠϒϥϦ͕όʔδϣϯΞοϓͰ͖ΔΑ͏ʹ͢Δ ◦ ܭΛऔΓআ͍ͯϥΠϒϥϦΛഇࢭ •
͋ΘΑ͘ΞϓϦέʔγϣϯύϑΥʔϚϯεͷվળ 9 Ͳ͏ͬͯҠߦ͔ͨ͠ ผͷػձʹ͓͠·͢
© 2025 Wantedly, Inc. ޮՌଌఆͷํ๏ 03 10
© 2025 Wantedly, Inc. ܭଌ͢Δͱ͜Ζ • ͲΕΛଌΔͷ͔ ◦ ΘΕ͍ͯΔαʔϏε͔ΒϐοΫΞοϓͯ͠ܭଌ ▪
ݴޠ͝ͱʹ͕ࠩͰΔͱݴΘΕ͍ͯΔ ◦ New Relic APM agent ΛೖΕ͍ͯͨฐࣾαʔϏε • ࢦඪ ◦ ֤αʔϏεͷฏۉϨεϙϯελΠϜ 11
© 2025 Wantedly, Inc. Ͳ͏ͬͯଌΔͷ͔ • Istio ͷτϨʔεϝτϦΫεΛར༻ ◦ 15ϲ݄ΔͷͰൺֱ͕Γ͍͢
▪ Indexed span ͩͱอ࣋ظؒ15 12 a = sum:istio.mesh.request.duration.milliseconds.sum.total {namespace: wantedly, env:production, reporter:source}.as_count() b = sum:istio.mesh.request.count.total {namespace: wantedly, env:production , reporter:source}.as_count() ฏۉϨεϙϯελΠϜ: a / b
© 2025 Wantedly, Inc. ݁Ռ 04 13
© 2025 Wantedly, Inc. 14 ݁Ռ • ඪͱͨ͠ฏۉϨεϙϯελΠϜ 1% վળΛୡ
🎉 ◦ શαʔϏεฏۉͰ࠷େ6%վળ͍ͯͨ͠ ◦ αʔϏε͝ͱͰ࠷େͰ 98.7% վળ͍ͯͨ͠
© 2025 Wantedly, Inc. ⚠ ͯ͢ͷΞϓϦέʔγϣϯͰվળͨ͠༁Ͱແ͍ 15 • ࠓݟͤͨͷมԽͷେ͖͔ͬͨҰ෦ͷαʔϏε •
ΞΫηεͷଟ͍αʔϏεͰ͋·Γվળ͕ݟ͑ͳ͔ͬͨ • ਫ਼ࠪग़དྷ͍ͯͳ͍͕ݴޠ͝ͱͷࠩ͋Δʁ ◦ େ͖͘վળ͞Ε͍ͯͨɿRuby, ΞΫηεසͷগͳ͍ ▪ Ruby ʹ͍ͭͯଞͷਓݴٴ͍ͯ͠ΔͷͰͦ͏͍͏ʹ͋Δʁ ◦ ͋·Γվળ͞Ε͍ͯͳ͔ͬͨɿPython, Go, Node.js
© 2025 Wantedly, Inc. ·ͱΊͱֶͼ 05 16
© 2025 Wantedly, Inc. ·ͱΊͱֶͼ 17 • ܭͷݟ͠ͰύϑΥʔϚϯεվળͷޮՌ͕͋ͬͨ ◦ ͋·Γظ͍ͯ͠ͳ͔͕ͬͨͦΕͳΓʹޮՌ͋ͬͨ
• ܭଌେࣄ ◦ ఆྔతʹධՁͰ͖ΔΑ͏ʹ͓ͯ͘͠ ◦ Istio ͱ Datadog ͷ͓ӄͰύοͱݟΕΔঢ়ଶ • ٕज़తෛ࠴ͷղফύϑΥʔϚϯεվળͷखஈͷͻͱͭʹͳΔ ◦ ܶతͳมԽͰͳ͘ͱಓͳෛ࠴ฦࡁʹՁ͋Δ