API World 2020 Pro Stage Talk

Microservice Debugging

Transcript

1. WAKING UP IN THE WEEDS OF MICROSERVICES, HOW TO DIAGNOSE YOUR FIRST BUG.
2. ABOUT ME • Senior Software Engineer at Adobe • Interested in open source, cloud and technology evangelism • Open Source Advocate and Contributor to 20 + Open Source Projects (Hystrix, Servo, Contour, Spinnaker, OpenTracing, Istio, Liferay etc.) • Founder of Sunnyvale Java User Group, GDG Sunnyvale • Docker Mentor • Presented into various conferences (OSCon, APIStrategy, JavaOne,API World, DockerCon, ScaleByTheBay) about microservice debugging, resilient system design, Cloud native Applications, API best practices. @mukteshkrmishra @mukteshkrmishra
3. MICROSERVICE ARCHITECTURE: A SYMPHONY HETEROGENOUS DISTRIBUTED RESOURCES MULTI-PASS https://medium.com/free-code-camp/a-note- on-distributed-systems-3c796f1eb0a0 https://medium.com/@hemantchhonkar/this- article-mainly-focuses-on-the-basics-about- microservices-be1917ddaaf1 https://medium.com/@tomasz_96685/saga- pattern-and-microservices-architecture- d4b46071afcf
4. ENOUGH OF THE PROBLEMS, WHAT CAN WE DO? I need enough information I need visibility I should stop bad guys ASAP Who is the bad guy? https://geektyrant.com/news/new-clip-from-avengers-endgame-shows-the-team-planning-to-take-down-thanos
5. DEVELOP CODE AND INFRA WITH OPERATIONAL EXCELLENCE MINDSET Logging Structured Common Formatted https://geektyrant.com/news/new-clip-from-avengers-endgame-shows-the-team- planning-to-take-down-thanos https://cloud.google.com/logging/docs/structured-logging
6. DEVELOP CODE AND INFRA WITH OPERATIONAL EXCELLENCE MINDSET Observability Distributed Tracing Call Graphs https://geektyrant.com/news/new-clip-from-avengers-endgame-shows-the-team- planning-to-take-down-thanos
7. DEVELOP CODE AND INFRA WITH OPERATIONAL EXCELLENCE MINDSET Control Switches, bounded architectural contexts Aware about surroundings • Participant systems • Know the limits • Leverage Throttling Controlled Blast radius • Feature Flags • Circuit Breakers https://geektyrant.com/news/new-clip-from-avengers-endgame-shows-the-team- planning-to-take-down-thanos
8. DEVELOP CODE AND INFRA WITH OPERATIONAL EXCELLENCE MINDSET Well defined SLXs Reduce noise • Audit alerts • Validate alerts Know System boundaries • Define SLOs and SLIS from scratch Smart and actionable Alerts • All alerts should be actionable • Operational rigor should be logged https://geektyrant.com/news/new-clip-from-avengers-endgame-shows-the-team- planning-to-take-down-thanos
9. WHAT DID WE LEARN THEN? • Loggers and information is important • Architecture consists of components • Call graphs should be traceable • Service Level Notations should be a part of design (shift left) https://geektyrant.com/news/new-clip-from-avengers-endgame-shows-the-team- planning-to-take-down-thanos
10. IMPORTANT LINKS • https://cloud.google.com/logging/docs/structured-logging • https://opentracing.io/ • https://apifriends.com/api-management/microservice-whodunit/ • https://howtodoinjava.com/log4j2/log4j-2-json-configuration-example/ • https://github.com/thangbn/json-logging-python Code on Github: https://github.com/MyRestServices/Microse rvicesDemo.git References: