Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
JCConf 2020 Observing in Microservices
Search
Shihyu Ho
November 18, 2020
Programming
0
630
JCConf 2020 Observing in Microservices
Lessons learned observing in Microservices
Shihyu Ho
November 18, 2020
Tweet
Share
More Decks by Shihyu Ho
See All by Shihyu Ho
JCConf 2022 - Using ArchUnit to test your architecture
shihyuho
0
120
hybrid-cloud-seminar.pdf
shihyuho
0
76
JCConf 2021 Access Kubernetes API in Java
shihyuho
0
100
iThome Kubernetes Summit 2018
shihyuho
0
45
JCConf 2016 zookeeper
shihyuho
0
49
Other Decks in Programming
See All in Programming
DDDを志して3年経ったら「DDDの皮を被ったクリーンアーキテクチャ」になった話【デブサミ2024夏】
texmeijin
1
620
CSC307 Lecture 10
javiergs
PRO
0
310
Jetpack for KMP
fornewid
1
290
Trial
cairolibrary720
1
130
Javaの現状2024夏 / Java current status 2024 summer
kishida
4
1.4k
【Go言語】ジェネリクス
tomo1227
0
170
OpenAI/Gemini APIを使って EPUBを翻訳するCLIツールをつくってみた
tomiyan
0
790
CSC307 Lecture 06
javiergs
PRO
0
360
SRE チーム立ち上げ前に考えたこと・取り組んだこと / Considerations and Preparations Before Establishing an SRE Team
mackey0225
3
320
大規模マルチテナントを解決するYugabyteDBという選択肢
nnaka2992
1
250
Architectures with Lightweight Stores: New Rules and Options
manfredsteyer
PRO
0
100
Play Billing Library 7.0.0 変更点まとめ@potatotips#88
kako351
0
160
Featured
See All Featured
Code Review Best Practice
trishagee
58
16k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
stephaniewalter
277
13k
Music & Morning Musume
bryan
43
5.9k
Optimising Largest Contentful Paint
csswizardry
18
2.6k
Producing Creativity
orderedlist
PRO
340
39k
The Mythical Team-Month
searls
217
43k
Teambox: Starting and Learning
jrom
130
8.6k
The Success of Rails: Ensuring Growth for the Next 100 Years
eileencodes
35
6.3k
Documentation Writing (for coders)
carmenintech
63
4.2k
Why Our Code Smells
bkeepers
PRO
332
56k
10 Git Anti Patterns You Should be Aware of
lemiorhan
652
58k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
29
2.5k
Transcript
Lessons learned observing in Microservices Matt Ho
SoftLeader RD Matt Ho https://github.com/shihyuho
Microservices!
Move from Spring Cloud to Kubernetes native!
好多 App, 平常沒事, But...
Infrastructure 0
Tracing App App App container platform
Monitoring App App App container platform cpu/memory/VM heap … cpu/memory/VM
heap …
Loggin g App App App container platform
Kubernetes on-premises
原⽣的, ⼀裝好什麼都沒有!
不能客製呦!
不是在做比較
Tracing 1
Using OpenTracing #
github.com/opentracing-contrib/ java-spring-cloud
Put tracing in response #
App filter response request api add trace info
Add tracing in logger MDC #
App A log MDC
None
None
None
None
None
Create your Spans #
time Span A Span B Span C Span D 外部呼叫
trace
None
Propagating messages #
None
App A App B App C App D Queue Baggage
App A App B App C App D REST gRPC
Queue Enqueue Dequeue Baggage
None
Monitoring 2
Prometheus & exporters #
- node-exporter - Hardware/OS metric s - cAdvisor - Container
metric s - kube-state-metrics - Kubernetes Object metrics 環境類 exporters
github.com/prometheus-operator/ kube-prometheus
None
None
None
- blackbox - Probing over HTTP, HTTPS, DNS … -
micrometer.io - Java app metrics 服務類 exporters
None
None
https://grafana.com/grafana/ dashboards
Logging 3
Define logging format #
JSON logging format
github.com/logstash/ logstash-logback-encoder
Append app information #
app_name, app_version…
None
None
ES index strategy #
By namespace and date
None
Forwarding logs from { … } #
Fluentd Forward Log format OCP DockerSwarm Forward Other Cluster
App App App App App App
好多 App, 平常沒事, But...
Thanks