Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

Observability_at_Google_--_OSCON.pdf

Avatar for JBD JBD
July 23, 2018
Programming
290
1

 Observability_at_Google_--_OSCON.pdf

Avatar for JBD

JBD

July 23, 2018

More Decks by JBD

See All by JBD
eBPF in Microservices Observability at eBPF Day
Avatar for JBD rakyll
1
2.3k
eBPF in Microservices Observability
Avatar for JBD rakyll
1
1.8k
OpenTelemetry at AWS
Avatar for JBD rakyll
1
1.9k
Debugging Code Generation in Go
Avatar for JBD rakyll
5
1.7k
Are you ready for production?
Avatar for JBD rakyll
8
3k
Servers are doomed to fail
Avatar for JBD rakyll
3
1.6k
Serverless Containers
Avatar for JBD rakyll
1
310
Critical Path Analysis
Avatar for JBD rakyll
0
720
Monitoring and Debugging Containers
Avatar for JBD rakyll
2
1.2k

Other Decks in Programming

See All in Programming
現場と育てるRailsモデリング 〜Spreadsheetから始めたモデル設計〜
Avatar for siroemk siroemk
2
820
作って学ぶSpring BootのAuto Configuration / JJUG Night Seminar 2026-10-19
Avatar for Ryo Shindo rshindo
0
200
S3 TablesのIcebergデータに、AIエージェントからアクセスしてみた / 20261016developersio2026joetsu-accessing-iceberg-in-s3tables-via-agent
Avatar for kasacchiful kasacchiful
PRO
0
190
コードで差別化できない時代の ソフトウェアエンジニアリング / Software Engineering in an Era Where Code Doesn’t Differentiate
Avatar for Naoki Kishida kishida
2
180
FactoryBotをやめればRSpecは速くなるのか？
Avatar for nissyi yuta_onishi_97
0
970
Augmenting AI with the Power of Jakarta EE
Avatar for ivargrimstad ivargrimstad
0
310
Seven New Principles of Software Engineering
Avatar for Yegor Bugayenko yegor256
0
170
When benchmarks go bad - what I learned from measuring performance wrong
Avatar for Holly Cummins hollycummins
0
230
AmebaブログはKMPから卒業します
Avatar for 伊藤光次郎 kmars0605
0
210
IBM Bob でAI駆動開発『QC-Playbook』
Avatar for 1kano ichirokano2
0
120
Unity6 URPによる海底をテーマにしたVJシステムの解説 | Unity Shader 完全に理解した 勉強会
Avatar for がむ gam0022
0
370
Web Framework Benchmark Battle 2026, Any%
Avatar for Akira Matsuda a_matsuda
2
2.7k

Featured

See All Featured
Fantastic passwords and where to find them - at NoRuKo
Avatar for Phil Nash philnash
53
4k
Unlocking the hidden potential of vector embeddings in international SEO
Avatar for Frank van Dijk frankvandijk
0
1k
Un-Boring Meetings
Avatar for Sebastian Deterding codingconduct
0
460
HU Berlin: Industrial-Strength Natural Language Processing with spaCy and Prodigy
Avatar for Ines Montani inesmontani
PRO
0
760
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
Avatar for Rebecca Miller-Webster rmw
35
3.9k
The Illustrated Children's Guide to Kubernetes
Avatar for Chris Short chrisshort
51
53k
jQuery: Nuts, Bolts and Bling
Avatar for Doug Neiner dougneiner
66
8.6k
Taking LLMs out of the black box: A practical guide to human-in-the-loop distillation
Avatar for Ines Montani inesmontani
PRO
3
2.5k
The Language of Interfaces
Avatar for Des Traynor destraynor
162
27k
Introduction to Domain-Driven Design and Collaborative software design
Avatar for Kenny Baas-Schwegler baasie
1
1k
A Tale of Four Properties
Avatar for Chris Coyier chriscoyier
163
24k
10 Git Anti Patterns You Should be Aware of
Avatar for Lemi Orhan Ergin lemiorhan
PRO
659
62k

Transcript

  1. Observability at Google JBD, Google (@rakyll)

  2. @rakyll History Long history of distributed systems 10ks of different

    services built by 100s of teams Many backends/analysis tools invented here ™

  3. @rakyll

  4. @rakyll 100% availability (is a lie)

  5. “ @rakyll A service is available if users cannot tell

    there is an outage.

  6. “ @rakyll Google Load Balancers are available if users cannot

    tell there is an outage.

  7. @rakyll Principled way of saying what level of downtime is

    acceptable. • Error rate • Latency expectations SLOs

  8. @rakyll An observable system tells more than its availability.

  9. @rakyll Context, status, expectations, debuggability

  10. @rakyll How? Observe by collecting signals Export them to analysis

    tools Correlate and analyze to find root cause

  11. @rakyll

  12. @rakyll

  13. @rakyll

  14. @rakyll

  15. @rakyll This is hard Must have integrations for web, RPC,

    and storage clients Must support all languages Must be context aware (e.g. canary vs prod) Must support many analysis tools Developers need to add custom instrumentation

  16. @rakyll This is too hard!

  17. @rakyll Borg Stubby Census

  18. opencensus.io

  19. @rakyll

  20. @rakyll

  21. @rakyll

  22. @rakyll

  23. @rakyll Z-Pages • Allows processes report their own dashboards. •

    Z-Pages have no sampling.

  24. @rakyll Try! import “go.opencensus.io/plugin/ocgrpc” s := grpc.NewServer(grpc.StatsHandler(&ocgrpc.ServerHandler{})) if err :=

    s.Serve(lis); err != nil { log.Fatalf("Failed to serve: %v", err) }

  25. @rakyll import ( “go.opencensus.io/stats/view” “go.opencensus.io/trace” “contrib.go.opencensus.io/exporter/stackdriver” ) exporter, err :=

    stackdriver.NewExporter(stackdriver.Options{ … }) if err != nil { log.Fatal(err) } view.RegisterExporter(exporter) trace.RegisterExporter(exporter)

  26. @rakyll

  27. @rakyll

  28. @rakyll Roadmap Stable libraries in 8+ languages Exporter daemon Cluster-wide

    Z-Pages Smart sampling Exemplars Framework, database, MQ integrations

  29. opencensus.io

  30. Thank you! opencensus.io JBD, Google [email protected] @rakyll