Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Visual Load Testing

Sponsored · Ship Features Fearlessly Turn features on and off without deploys. Used by thousands of Ruby developers. →
Avatar for Marc Huffnagle Marc Huffnagle
April 08, 2013
Programming
0
150

Visual Load Testing

A talk I gave to Data Science Maryland on using visualization in load testing.

Avatar for Marc Huffnagle

Marc Huffnagle

April 08, 2013
Tweet

Other Decks in Programming

See All in Programming
副作用をどこに置くか問題：オブジェクト指向で整理する設計判断ツリー
Avatar for Koya Masuda koxya
1
600
生成AIを使ったコードレビューで定性的に品質カバー
Avatar for Chiaki Okamoto chiilog
1
250
360° Signals in Angular: Signal Forms with SignalStore & Resources @ngLondon 01/2026
Avatar for Manfred Steyer manfredsteyer
PRO
0
120
責任感のあるCloudWatchアラームを設計しよう
Avatar for アキキー akihisaikeda
3
160
CSC307 Lecture 09
Avatar for Javier Gonzalez-Sanchez javiergs
PRO
1
830
CSC307 Lecture 05
Avatar for Javier Gonzalez-Sanchez javiergs
PRO
0
500
SourceGeneratorのススメ
Avatar for tkym htkym
0
190
AtCoder Conference 2025
Avatar for shindannin shindannin
0
1k
AI Agent Tool のためのバックエンドアーキテクチャを考える #encraft
Avatar for izumin5210 izumin5210
6
1.8k
Spinner 軸ズレ現象を調べたらレンダリング深淵に飲まれた #レバテックMeetup
Avatar for 弁護士ドットコム bengo4com
1
230
Patterns of Patterns
Avatar for Denys Poltorak denyspoltorak
0
1.4k
CSC307 Lecture 03
Avatar for Javier Gonzalez-Sanchez javiergs
PRO
1
490

Featured

See All Featured
Gemini Prompt Engineering: Practical Techniques for Tangible AI Outcomes
Avatar for Mfonobong Umondia mfonobong
2
280
Tips & Tricks on How to Get Your First Job In Tech
Avatar for Honza Javorek honzajavorek
0
430
The Cost Of JavaScript in 2023
Avatar for Addy Osmani addyosmani
55
9.5k
Save Time (by Creating Custom Rails Generators)
Avatar for Garrett Dimon garrettdimon
PRO
32
2.1k
Redefining SEO in the New Era of Traffic Generation
Avatar for Szymon szymonslowik
1
210
Why Our Code Smells
Avatar for Brandon Keepers bkeepers
PRO
340
58k
The innovator’s Mindset - 
Leading Through an Era of Exponential Change - McGill University 2025
Avatar for Jean-Marc De Jonghe jdejongh
PRO
1
88
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
Avatar for panda_program panda_program
122
21k
Faster Mobile Websites
Avatar for Dean Hume deanohume
310
31k
Bootstrapping a Software Product
Avatar for Garrett Dimon garrettdimon
PRO
307
120k
Are puppies a ranking factor?
Avatar for Jono Alderson jonoalderson
1
2.7k
Abbi's Birthday
Avatar for Violet Bock coloredviolet
1
4.7k

Transcript

  1. Copyright 2013 Visual Load Testing Marc Huffnagle [email protected] Tuesday, April

    9, 13

  2. My background Tuesday, April 9, 13

  3. My background ✤ Developer Tuesday, April 9, 13

  4. My background ✤ Developer ✤ Sysadmin Tuesday, April 9, 13

  5. My background ✤ Developer ✤ Sysadmin ✤ Tester Tuesday, April

    9, 13

  6. My background ✤ Developer ✤ Sysadmin ✤ Tester ✤ Developer

    Tuesday, April 9, 13

  7. My background ✤ Developer ✤ Sysadmin ✤ Tester ✤ Developer

    ✤ Tester Tuesday, April 9, 13

  8. My background ✤ Developer ✤ Sysadmin ✤ Tester ✤ Developer

    ✤ Tester ✤ Sysadmin Tuesday, April 9, 13

  9. My background ✤ Developer ✤ Sysadmin ✤ Tester ✤ Developer

    ✤ Tester ✤ Sysadmin ✤ Developer ... Tuesday, April 9, 13

  10. Goals Tuesday, April 9, 13

  11. Goals ✤ Show how we use visualization when load testing

    ECHO Tuesday, April 9, 13

  12. Goals ✤ Show how we use visualization when load testing

    ECHO ✤ Demonstrate how you can use some of the same techniques Tuesday, April 9, 13

  13. Goals ✤ Show how we use visualization when load testing

    ECHO ✤ Demonstrate how you can use some of the same techniques ✤ Convince you that visualization can be easy Tuesday, April 9, 13

  14. What is ECHO? Earth Observing System Clearing HOuse Tuesday, April

    9, 13

  15. NASA Earth Observing System Tuesday, April 9, 13

  16. https://reverb.echo.nasa.gov/ ECHO Reverb Tuesday, April 9, 13

  17. Our load testing goals Tuesday, April 9, 13

  18. Our load testing goals http://ircimg.net/skeleton-computer-guy.jpg Tuesday, April 9, 13

  19. Our load testing goals http://www.recareered.com/files/2011/03/Turtle-Creative-Commons.jpg Tuesday, April 9, 13

  20. Our load testing goals http://tinyurl.com/cnb5quc Tuesday, April 9, 13

  21. Our load testing goals http://bees.chrisinch.com/wp-content/uploads/2012/04/MoneyBag.jpg Tuesday, April 9, 13

  22. Load Test Environment http://storylineblog.com/wp-content/uploads/2013/03/baby-computer-full.jpg Tuesday, April 9, 13

  23. Load Test Environment Producer Thread Work Queue Worker Thread Worker

    Thread Worker Thread Ruby Process Tuesday, April 9, 13

  24. Sidekiq http://sidekiq.org Simple, efficient message processing for Ruby. Tuesday, April

    9, 13

  25. Tuesday, April 9, 13

  26. Tuesday, April 9, 13

  27. Tuesday, April 9, 13

  28. Load Test Environment Load Test Driver Redis Sidekiq Worker Sidekiq

    Worker Sidekiq Worker Tuesday, April 9, 13

  29. http://farm5.static.flickr.com/4023/4548711373_d70fd58836_o.jpg Tuesday, April 9, 13

  30. We’ll be using visualization for two things: Tuesday, April 9,

    13

  31. We’ll be using visualization for two things: Monitoring Tuesday, April

    9, 13

  32. We’ll be using visualization for two things: Monitoring Metrics Tuesday,

    April 9, 13

  33. Nagios http://www.nagios.org/ Tuesday, April 9, 13

  34. Tuesday, April 9, 13

  35. Graphs of completed jobs Tuesday, April 9, 13

  36. Number of jobs processed Tuesday, April 9, 13

  37. Number of failed jobs Tuesday, April 9, 13

  38. Number of jobs currently running Tuesday, April 9, 13

  39. Number of jobs in the backlog Tuesday, April 9, 13

  40. http://4.bp.blogspot.com/_K4gm2yzgfeo/TJRYOHMNR2I/AAAAAAAAAKM/is6CjOkIIvk/s1600/flight-recorder.jpg Tuesday, April 9, 13

  41. Types of metrics we collect Tuesday, April 9, 13

  42. Types of metrics we collect ✤ Numeric time-series data Tuesday,

    April 9, 13

  43. Types of metrics we collect ✤ Numeric time-series data ✤

    Event-based data Tuesday, April 9, 13

  44. Operational System Load Test System Data Collection Tuesday, April 9,

    13

  45. Very important point: Keep your metrics collection as loosely coupled

    from your system as possible. Tuesday, April 9, 13

  46. It was this guy. Very important point: Keep your metrics

    collection as loosely coupled from your system as possible. Tuesday, April 9, 13

  47. Graphite http://graphite.wikidot.com Tuesday, April 9, 13

  48. What should I store in Graphite? Tuesday, April 9, 13

  49. What should I store in Graphite? Tuesday, April 9, 13

  50. How do I get data into Graphite? ✤ collectd -

    http://collectd.org ✤ logstash - http://www.logstash.net ✤ Anything that can open a socket ✤ echo “my-stat-name 1234 $(date +%s)” | nc graphite-host 2003 Tuesday, April 9, 13

  51. Tuesday, April 9, 13

  52. Tuesday, April 9, 13

  53. Tuesday, April 9, 13

  54. What about those event-based metrics? Tuesday, April 9, 13

  55. http://farm3.static.flickr.com/2799/4481372869_e5ccb9af5d_o.jpg Tuesday, April 9, 13

  56. http://upload.wikimedia.org/wikipedia/commons/c/c7/Logs.jpg Tuesday, April 9, 13

  57. http://upload.wikimedia.org/wikipedia/commons/f/fb/A_few_logs_-_geograph.org.uk_-_57580.jpg Tuesday, April 9, 13

  58. 2013-03-26T13:24:18.012 “GET /catalog-rest/echo_catalog/datasets.xml” 200 1234 1024 Sample Apache access log

    message Tuesday, April 9, 13

  59. 2013-03-26T13:24:18.012 “GET /catalog-rest/echo_catalog/datasets.xml” 200 1234 1024 Sample Apache access log

    message Timestamp Tuesday, April 9, 13

  60. 2013-03-26T13:24:18.012 “GET /catalog-rest/echo_catalog/datasets.xml” 200 1234 1024 Sample Apache access log

    message Timestamp Request Method Tuesday, April 9, 13

  61. 2013-03-26T13:24:18.012 “GET /catalog-rest/echo_catalog/datasets.xml” 200 1234 1024 Sample Apache access log

    message Timestamp Request Method Request Path Tuesday, April 9, 13

  62. 2013-03-26T13:24:18.012 “GET /catalog-rest/echo_catalog/datasets.xml” 200 1234 1024 Sample Apache access log

    message Timestamp Request Method Request Path Status Code Tuesday, April 9, 13

  63. 2013-03-26T13:24:18.012 “GET /catalog-rest/echo_catalog/datasets.xml” 200 1234 1024 Sample Apache access log

    message Timestamp Request Method Request Path Status Code Response Size Tuesday, April 9, 13

  64. 2013-03-26T13:24:18.012 “GET /catalog-rest/echo_catalog/datasets.xml” 200 1234 1024 Sample Apache access log

    message Timestamp Request Method Request Path Status Code Response Size Response Time Tuesday, April 9, 13

  65. 2013-03-26T13:24:18.012 “GET /catalog-rest/echo_catalog/datasets.xml” 200 1234 1024 Sample Apache access log

    message Timestamp Request Method Request Path Status Code Response Size Response Time Tuesday, April 9, 13

  66. http://www.splunk.com Tuesday, April 9, 13

  67. Basic Splunk Search Tuesday, April 9, 13

  68. Basic Splunk Search Query Tuesday, April 9, 13

  69. Basic Splunk Search Query Time period Tuesday, April 9, 13

  70. Basic Splunk Search Query Time period Matching log entries Tuesday,

    April 9, 13

  71. Basic Splunk Search Query Time period Matching log entries Distribution

    graph Tuesday, April 9, 13

  72. Tuesday, April 9, 13

  73. Tuesday, April 9, 13

  74. Tuesday, April 9, 13

  75. Tuesday, April 9, 13

  76. Tuesday, April 9, 13

  77. Tuesday, April 9, 13

  78. Tuesday, April 9, 13

  79. Tuesday, April 9, 13

  80. Tuesday, April 9, 13

  81. Summing it all up Tuesday, April 9, 13

  82. Summing it all up ✤ Visualization helps you grasp what’s

    happening in a complex system Tuesday, April 9, 13

  83. Summing it all up ✤ Visualization helps you grasp what’s

    happening in a complex system ✤ It doesn’t have to be hard Tuesday, April 9, 13

  84. Summing it all up ✤ Visualization helps you grasp what’s

    happening in a complex system ✤ It doesn’t have to be hard ✤ You’re already generating and collecting the data you need to begin visualization Tuesday, April 9, 13

  85. Questions? Tuesday, April 9, 13