Upgrade to Pro — share decks privately, control downloads, hide ads and more …

eBPF in Microservices Observability at eBPF Day

Avatar for JBD JBD
October 11, 2021
Programming
1
2.1k

eBPF in Microservices Observability at eBPF Day

Avatar for JBD

JBD

October 11, 2021
Tweet

More Decks by JBD

See All by JBD
eBPF in Microservices Observability
Avatar for JBD rakyll
1
1.7k
OpenTelemetry at AWS
Avatar for JBD rakyll
1
1.8k
Debugging Code Generation in Go
Avatar for JBD rakyll
5
1.6k
Are you ready for production?
Avatar for JBD rakyll
8
2.8k
Servers are doomed to fail
Avatar for JBD rakyll
3
1.5k
Serverless Containers
Avatar for JBD rakyll
1
250
Critical Path Analysis
Avatar for JBD rakyll
0
600
Monitoring and Debugging Containers
Avatar for JBD rakyll
2
1.1k
CPDD
Avatar for JBD rakyll
0
4.2k

Other Decks in Programming

See All in Programming
Go Modules: From Basics to Beyond / Go Modulesの基本とその先へ
Avatar for kuro kuro_kurorrr
0
110
SODA - FACT BOOK
Avatar for SODA inc. sodainc
1
820
生成AIで日々のエラー調査を進めたい
Avatar for aboy yuyaabo
0
520
Effect の双対、Coeffect
Avatar for ゆきくらげ yukikurage
4
1.3k
Webからモバイルへ Vue.js × Capacitor 活用事例
Avatar for Naoki Haba naokihaba
0
520
つよそうにふるまい、つよい成果を出すのなら、つよいのかもしれない
Avatar for irof irof
1
280
インターフェース設計のコツとツボ
Avatar for おぎ togishima
2
690
Beyond Portability: Live Migration for Evolving WebAssembly Workloads
Avatar for Yuki Nakata chikuwait chikuwait
0
340
AWS CDKの推しポイント 〜CloudFormationと比較してみた〜
Avatar for アキキー akihisaikeda
2
140
レガシーシステムの機能調査・開発におけるAI利活用
Avatar for takuya ohtonari takuya_ohtonari
0
580
KotlinConf 2025 現地で感じたServer-Side Kotlin
Avatar for Takehata Naoto n_takehata
1
180
業務自動化をJavaとSeleniumとAWS Lambdaで実現した方法
Avatar for GreenFlagProject greenflagproject
1
100

Featured

See All Featured
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
Avatar for Addy Osmani addyosmani
6
690
Connecting the Dots Between Site Speed, User Experience & Your Business [WebExpo 2025]
Avatar for Tammy Everts tammyeverts
4
130
KATA
Avatar for Megan Lloyd mclloyd
29
14k
Build The Right Thing And Hit Your Dates
Avatar for Maggie C. maggiecrowley
36
2.7k
Let's Do A Bunch of Simple Stuff to Make Websites Faster
Avatar for Chris Coyier chriscoyier
507
140k
Docker and Python
Avatar for Tania Allard trallard
44
3.4k
Designing Dashboards & Data Visualisations in Web Apps
Avatar for Des Traynor destraynor
231
53k
Gamification - CAS2011
Avatar for David Bonilla davidbonilla
81
5.3k
Fireside Chat
Avatar for paigeccino paigeccino
37
3.5k
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
Avatar for Irina Nazarova irinanazarova
8
780
Put a Button on it: Removing Barriers to Going Fast.
Avatar for kastner kastner
60
3.9k
Stop Working from a Prison Cell
Avatar for Chris Michel hatefulcrawdad
269
20k

Transcript

  1. @rakyll eBPF in Microservices Observability Jaana Dogan Principal Engineer, AWS

    [email protected]

  2. @rakyll About me • Not a Linux developer. • Working

    on monitoring, observability and performance. • Multi-tenancy and microservices focus.

  3. @rakyll

  4. @rakyll How does eBPF work? process JIT compiler Verifier Sockets

    TCP/IP BPF Maps code (accessible from the user space)

  5. @rakyll Where can eBPF hook into? - Kernel and user

    functions - System calls - Network events - Kernel tracepoints

  6. @rakyll Challenges in microservices

  7. @rakyll Challenges in microservices We don’t just monitor VMs or

    processes. We monitor critical paths.

  8. @rakyll What’s next? service service database storage service

  9. @rakyll What’s next? service service database storage service

  10. @rakyll Challenges in microservices Context matters. Downstream stack don’t have

    context.

  11. @rakyll What’s next? process Linux kernel process process M:N Problem

  12. @rakyll What’s next? process Linux kernel process process RPCs M:N

    Problem

  13. @rakyll What’s next? process Linux kernel process process RPCs container

    container M:N Problem

  14. @rakyll What’s next? process Linux kernel process process RPCs container

    container Kubernetes pod, ECS task M:N Problem

  15. @rakyll Challenges in microservices First, we debug the path of

    the request. We debug functions or syscalls secondarily.

  16. @rakyll Challenges in microservices Too much data. Need runtime controls

    to modify the collection.

  17. @rakyll Challenges in microservices Instrumentation is a two-year roadmap. Data

    is not consistent.

  18. @rakyll Recap Out of the box instrumentation is critical. Networking

    observability is essential. Extensibility in runtime is needed. Decoration and enrichment is needed.

  19. @rakyll How does eBPF help?

  20. @rakyll Network Diagnostics TCP, UDP, HTTP, gRPC metrics Inspect protocols

    (MySQL, Postgres, ...)

  21. @rakyll Network Diagnostics TCP, UDP, HTTP, gRPC metrics Inspect protocols

    (MySQL, Postgres, ...)

  22. @rakyll Service Maps

  23. @rakyll Distributed Traces Automatically create trace span if a trace

    header is present. Your job is to generate and propagate the header. GET /users HTTP/1.1 Host: users.service Accept-Encoding: gzip, deflate Connection: Keep-Alive Traceparent: 00-4bf92f3577b34da6a3ce929d0e0e4736-00f067aa0ba902b7-01

  24. @rakyll Continuous Profiling

  25. @rakyll Extensibility

  26. @rakyll Decorating with Context eBPF agent process JIT compiler Verifier

    Sockets TCP/IP BPF Maps API Server

  27. @rakyll Decorating with Context

  28. @rakyll Several projects... - Cillium/Hubble - Pixie - Flowmill -

    Prodfiler - Parca

  29. @rakyll What’s next? - High level language? - More platforms

    supporting eBPF? - Reusable eBPF event processors? - Signed programs?

  30. @rakyll Thank you Jaana Dogan [email protected]

  31. @rakyll After party? Pixie KubeCon Happy Hour hosted by New

    Relic Tomorrow, 8:30 PM PDT RSVP: pixiehh.eventbrite.com

  32. @rakyll Runtime Extensibility eBPF agent process JIT compiler Verifier Sockets

    TCP/IP BPF Maps code