Distributed Request Tracing

Overview of tracing in a distributed system from a Ruby / Rails perspective

Transcript

1. DISTRIBUTED REQUEST TRACING
2. Kenny Hoxworth
3. Request Profiler Request Lifecycle (40ms) WebService (25ms) AuthService (15ms) DB (3ms) Worker (13ms)
4. SMS Trace
5. SMS Trace
6. SMS Trace
7. Performance 500 ms
8. Bad Nodes
9. Cats as a service
10. Catspammer API web
11. Catspammer API AUTH PurrMQ Social Media Workers web
12. Catspammer API AUTH PurrMQ Social Media Workers web
13. Tracing done Right
14. Low Overhead Goal 1.
15. Scalable Goal 2.
16. Transparent Instrumentation Goal 3.
17. X-Trace, Magpie, Pinpoint
18. Request Lifecycle (40ms) WebService (25ms) AuthService (15ms) DB (3ms) Worker (13ms) trace id
19. Request Lifecycle (40ms) WebService (25ms) AuthService (15ms) DB (3ms) Worker (13ms) span id
20. Dapper
21. Dapper Architecture Instrumented Services Dapper Collectors Dapper UI
22. Zipkin
23. Zipkin Pluggable Datastore Scribe Collector Highly configurable
25. Zipkin Example
26. System Setup Zipkin
27. System Setup Zipkin $> git clone https://github.com/twitter/zipkin.git $> ./zipkin/bin/collector & $> ./zipkin/bin/query & $> ./zipkin/bin/web &
28. Scribe Ruby Setup finagle-thrift zipkin-tracer
29. gemfile.rb gem 'scribe' gem 'finagle-thrift' gem 'zipkin-tracer', :git => ‘git@github.com:mszenher/zipkin- tracer.git', :require => 'zipkin-tracer', :tag => 'v0.4.0'
30. config/initializers/zipkin.rb config = Rails.application.config ! zipkin_tracer_config = { service_name: 'catspammer', service_port: 9410, sample_rate: 1, scribe_server: '127.0.0.1:9410' } ! config.middleware.use ZipkinTracer::RackHandler, zipkin_tracer_config
31. ActiveRecord? Redis? Trace.record(Trace::Annotation.new(Trace::Annotation::CLIENT_SEND, Trace.default_endpoint)) Trace.record(Trace::Annotation.new(Trace::Annotation::CLIENT_RECV, Trace.default_endpoint)) Cat.where(:fur => “orange”)
32. Demo
33. Questions?
34. catspammer.com
35. Thanks! @hoxworth :: http://github.com/hoxworth