2023-04-06 Devnexus - Observability for Modern Spring Applications

Transcript

1. Jonatan Ivanov 2023-04-06 To Production and Beyond Observability for Modern Spring Applications
2. About Me - Spring Team - Micrometer - Spring Cloud, Spring Boot - “Spring Observability” - Seattle Java User Group - develotters.com - @jonatan_ivanov
3. What is Observability? Why do we need it?
4. Various Opinions 3 pillars: Logging, Metrics, Distributed Tracing 4 pillars: + Events/Lineage(?)/Context/Metadata 6 pillars: + Profiles + Exceptions Arbitrary Wide Events, Signals But what about: /health, /info, etc. Service Registry/Discoverability, API Discoverability
5. What is Observability? How well we can understand the internals of a system based on its outputs (Providing meaningful information about what happens inside)
6. Why do we need Observability? Today's systems are insanely complex (cloud) (Death Star Architecture, Big Ball of Mud)
7. Environments can be chaotic (You turn a knob here a little and services are going down there) We need to deal with unknown unknowns (We can’t know everything) Things can be perceived differently by observers (Everything is broken for the users but seems ok to you) Why do we need Observability?
8. Logging What happened (why)? Emitting events Metrics What is the context? Aggregating data Distributed Tracing Why happened? Recording causal ordering of events Logging - Metrics - Distributed Tracing
9. Examples Latency Logging Processing took 140ms Metrics P99.999: 140ms Max: 150 ms Distributed Tracing DB was slow (lot of data was requested) Error Logging Processing failed (stacktrace?) Metrics The error rate is 0.001/sec 2 errors in the last 30 minutes Distributed Tracing DB call failed (invalid input)
10. Logging With Spring
11. SLF4J with Logback comes pre-configured SLF4J (Simple Logging Façade for Java) Simple API for logging libraries Logback Natively implements the SLF4J API If you want Log4j2 instead of Logback: - spring-boot-starter-logging + spring-boot-starter-log4j2 Logging with Spring: SLF4J + Logback
12. Logging with Spring: Payload, Access, GC Payload logs: Logbook (not yet for Boot 3) + logbook-spring-boot-starter (auto-configured) Access logs: server.tomcat.accesslog.enabled=true server.jetty.accesslog.enabled=true server.undertow.accesslog.enabled=true GC logs: JVM args
13. Metrics With Spring
14. Metrics with Spring: Micrometer Popular Metrics library on the JVM Like SLF4J, but for metrics Simple API Supports the most popular metric backends Comes with spring-boot-actuator Spring projects are instrumented using Micrometer A lot of third-party libraries use Micrometer
15. Like SLF4J, but for metrics … Ganglia Graphite Humio InfluxDB JMX KairosDB New Relic (/actuator/metrics) OpenTSDB OTLP Prometheus SignalFx Stackdriver (GCP) StatsD Wavefront (VMware) AppOptics Atlas Azure Monitor CloudWatch (AWS) Datadog Dynatrace Elastic
16. Distributed Tracing With Spring
17. Distributed Tracing with Spring Boot 2.x: Spring Cloud Sleuth Boot 3.x: Micrometer Tracing (Sleuth w/o Spring dependencies) Provide an abstraction layer on top of tracing libraries - Brave (OpenZipkin), default - OpenTelemetry (CNCF), experimental Instrumentation for Spring Projects, 3rd party libraries, your app Support for various backends
18. Observation API And “Spring Observability”
19. • Add logs (application logs) • Add metrics ◦ Increment Counters ◦ Start/Stop Timers • Add Distributed Tracing ◦ Start/Stop Spans ◦ Log Correlation ◦ Context Propagation You want to instrument your application…
20. Observation API (Micrometer 1.10) Observation observation = Observation.start("talk",registry); try { // TODO: scope Thread.sleep(1000); } catch (Exception exception) { observation.error(exception); throw exception; } finally { // TODO: attach tags (key-value) observation.stop(); }
21. Observation API (Micrometer 1.10) ObservationRegistry registry = ObservationRegistry.create(); registry.observationConfig() .observationHandler(new MeterHandler(...)) .observationHandler(new TracingHandler(...)) .observationHandler(new LoggingHandler(...)) .observationHandler(new AuditEventHandler(...)); Observation observation = Observation.start("talk",registry); // let the fun begin… observation.stop();
22. Observation API (Micrometer 1.10) Observation.createNotStarted("talk",registry) .lowCardinalityKeyValue("conference", "DN") .highCardinalityKeyValue("uid", userId) .observe(this::talk); @Observed
23. DEMO
24. Tea Service 💻 Tealeaf Service Water Service Eureka Architecture Tealeaf DB Water DB Spring Boot Admin
25. spring-boot-starter-web spring-boot-starter-data-jpa spring-cloud-starter-openfeign spring-boot-starter-actuator (micrometer-observation) micrometer-registry-prometheus micrometer-tracing-bridge-brave + zipkin-reporter-brave net.ttddyy.observation:datasource-micrometer-spring-boot
26. Let’s make some tea!
27. through traces TraceID ❮ Exemplars Tags ❯ metrics logs traces
28. Health Endpoint Is my app healthy (k8s probes)? Dependencies? Info Endpoint Build Info (name, version, git commit, build time): Boot 2.x Java Info (JRE/JVM name, version, vendor): Boot 2.6 OS Info (name, arch, version): Boot 2.7 Cloud Info (instanceId, region, account) CPU Cores, Total Memory, GC Info, TLS cert chain Timezone, Current Time, Language, Start Time, Uptime Spring Boot Actuator
29. Service Discoverability, API Discoverability How many service instances do we have? Where? (host/ip, port, instanceId, region, account) What versions are deployed? (by environment) Eureka, Spring Boot Admin How to call/use them? Spring REST Docs Spring Cloud Contract + Pact Broker Swagger / OpenAPI + ReDoc Spring HATEOAS + HAL Explorer
30. Our Vision Empower Spring developers to continuously learn, innovate, and solve complex problems. Core Features • Project-based courses with hands-on labs • In-browser code editing and debugging • Certification prep courses • Spring Certified Professional Certification Sign Up Today Get started for free at https://spring.academy For Conference Attendees: Use DEVNEXUS at checkout by April 10th for a 20% discount on a Spring Academy Pro subscription!
31. Thank you! @jonatan_ivanov develotters.com github.com/jonatan-ivanov/teahouse