Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Visual Load Testing

Avatar for Marc Huffnagle Marc Huffnagle
April 08, 2013
Programming
0
140

Visual Load Testing

A talk I gave to Data Science Maryland on using visualization in load testing.
Avatar for Marc Huffnagle

Marc Huffnagle

April 08, 2013
Tweet

Other Decks in Programming

See All in Programming
プロダクト志向ってなんなんだろうね
Avatar for RightTouch righttouch
PRO
0
160
今ならAmazon ECSのサービス間通信をどう選ぶか / Selection of ECS Interservice Communication 2025
Avatar for Tetsuya Kikuchi tkikuc
19
3.6k
A2A プロトコルを試してみる
Avatar for azukiazusa azukiazusa1
2
1.1k
Is Xcode slowly dying out in 2025?
Avatar for 上ちょ / uetyo uetyo
1
190
プロダクト志向なエンジニアがもう一歩先の価値を目指すために意識したこと
Avatar for Nealle nealle
0
110
GitHub Copilot and GitHub Codespaces Hands-on
Avatar for Kento.Yamada ymd65536
1
120
ruby.wasmで多人数リアルタイム通信ゲームを作ろう
Avatar for lni_T lnit
2
270
DroidKnights 2025 - 다양한 스크롤 뷰에서의 영상 재생
Avatar for 이가은 gaeun5744
3
320
都市をデータで見るってこういうこと　PLATEAU属性情報入門
Avatar for nokonoko1203 nokonoko1203
1
570
PHPでWebSocketサーバーを実装しよう2025
Avatar for kubotak kubotak
0
160
XP, Testing and ninja testing
Avatar for seki at druby.org m_seki
3
190
Gleamという選択肢
Avatar for Comamoca comamoca
6
760

Featured

See All Featured
Into the Great Unknown - MozCon
Avatar for Noah Learner thekraken
39
1.9k
Building a Modern Day 
E-commerce SEO Strategy
Avatar for Aleyda Solis aleyda
42
7.3k
StorybookのUI Testing Handbookを読んだ
Avatar for Shingo Yamazaki zakiyama
30
5.8k
Making the Leap to Tech Lead
Avatar for Ryan Cromwell cromwellryan
134
9.3k
Being A Developer After 40
Avatar for Adrian Kosmaczewski akosma
90
590k
Visualization
Avatar for Eitan Lees eitanlees
146
16k
Scaling GitHub
Avatar for Zach Holman holman
459
140k
The Psychology of Web Performance [Beyond Tellerrand 2023]
Avatar for Tammy Everts tammyeverts
48
2.8k
Put a Button on it: Removing Barriers to Going Fast.
Avatar for kastner kastner
60
3.9k
Typedesign – Prime Four
Avatar for Hannes Fritz hannesfritz
42
2.7k
How STYLIGHT went responsive
Avatar for nonsquared nonsquared
100
5.6k
How to train your dragon (web standard)
Avatar for Monica Dinculescu notwaldorf
93
6.1k

Transcript

  1. Copyright 2013 Visual Load Testing Marc Huffnagle [email protected] Tuesday, April

    9, 13

  2. My background Tuesday, April 9, 13

  3. My background ✤ Developer Tuesday, April 9, 13

  4. My background ✤ Developer ✤ Sysadmin Tuesday, April 9, 13

  5. My background ✤ Developer ✤ Sysadmin ✤ Tester Tuesday, April

    9, 13

  6. My background ✤ Developer ✤ Sysadmin ✤ Tester ✤ Developer

    Tuesday, April 9, 13

  7. My background ✤ Developer ✤ Sysadmin ✤ Tester ✤ Developer

    ✤ Tester Tuesday, April 9, 13

  8. My background ✤ Developer ✤ Sysadmin ✤ Tester ✤ Developer

    ✤ Tester ✤ Sysadmin Tuesday, April 9, 13

  9. My background ✤ Developer ✤ Sysadmin ✤ Tester ✤ Developer

    ✤ Tester ✤ Sysadmin ✤ Developer ... Tuesday, April 9, 13

  10. Goals Tuesday, April 9, 13

  11. Goals ✤ Show how we use visualization when load testing

    ECHO Tuesday, April 9, 13

  12. Goals ✤ Show how we use visualization when load testing

    ECHO ✤ Demonstrate how you can use some of the same techniques Tuesday, April 9, 13

  13. Goals ✤ Show how we use visualization when load testing

    ECHO ✤ Demonstrate how you can use some of the same techniques ✤ Convince you that visualization can be easy Tuesday, April 9, 13

  14. What is ECHO? Earth Observing System Clearing HOuse Tuesday, April

    9, 13

  15. NASA Earth Observing System Tuesday, April 9, 13

  16. https://reverb.echo.nasa.gov/ ECHO Reverb Tuesday, April 9, 13

  17. Our load testing goals Tuesday, April 9, 13

  18. Our load testing goals http://ircimg.net/skeleton-computer-guy.jpg Tuesday, April 9, 13

  19. Our load testing goals http://www.recareered.com/files/2011/03/Turtle-Creative-Commons.jpg Tuesday, April 9, 13

  20. Our load testing goals http://tinyurl.com/cnb5quc Tuesday, April 9, 13

  21. Our load testing goals http://bees.chrisinch.com/wp-content/uploads/2012/04/MoneyBag.jpg Tuesday, April 9, 13

  22. Load Test Environment http://storylineblog.com/wp-content/uploads/2013/03/baby-computer-full.jpg Tuesday, April 9, 13

  23. Load Test Environment Producer Thread Work Queue Worker Thread Worker

    Thread Worker Thread Ruby Process Tuesday, April 9, 13

  24. Sidekiq http://sidekiq.org Simple, efficient message processing for Ruby. Tuesday, April

    9, 13

  25. Tuesday, April 9, 13

  26. Tuesday, April 9, 13

  27. Tuesday, April 9, 13

  28. Load Test Environment Load Test Driver Redis Sidekiq Worker Sidekiq

    Worker Sidekiq Worker Tuesday, April 9, 13

  29. http://farm5.static.flickr.com/4023/4548711373_d70fd58836_o.jpg Tuesday, April 9, 13

  30. We’ll be using visualization for two things: Tuesday, April 9,

    13

  31. We’ll be using visualization for two things: Monitoring Tuesday, April

    9, 13

  32. We’ll be using visualization for two things: Monitoring Metrics Tuesday,

    April 9, 13

  33. Nagios http://www.nagios.org/ Tuesday, April 9, 13

  34. Tuesday, April 9, 13

  35. Graphs of completed jobs Tuesday, April 9, 13

  36. Number of jobs processed Tuesday, April 9, 13

  37. Number of failed jobs Tuesday, April 9, 13

  38. Number of jobs currently running Tuesday, April 9, 13

  39. Number of jobs in the backlog Tuesday, April 9, 13

  40. http://4.bp.blogspot.com/_K4gm2yzgfeo/TJRYOHMNR2I/AAAAAAAAAKM/is6CjOkIIvk/s1600/flight-recorder.jpg Tuesday, April 9, 13

  41. Types of metrics we collect Tuesday, April 9, 13

  42. Types of metrics we collect ✤ Numeric time-series data Tuesday,

    April 9, 13

  43. Types of metrics we collect ✤ Numeric time-series data ✤

    Event-based data Tuesday, April 9, 13

  44. Operational System Load Test System Data Collection Tuesday, April 9,

    13

  45. Very important point: Keep your metrics collection as loosely coupled

    from your system as possible. Tuesday, April 9, 13

  46. It was this guy. Very important point: Keep your metrics

    collection as loosely coupled from your system as possible. Tuesday, April 9, 13

  47. Graphite http://graphite.wikidot.com Tuesday, April 9, 13

  48. What should I store in Graphite? Tuesday, April 9, 13

  49. What should I store in Graphite? Tuesday, April 9, 13

  50. How do I get data into Graphite? ✤ collectd -

    http://collectd.org ✤ logstash - http://www.logstash.net ✤ Anything that can open a socket ✤ echo “my-stat-name 1234 $(date +%s)” | nc graphite-host 2003 Tuesday, April 9, 13

  51. Tuesday, April 9, 13

  52. Tuesday, April 9, 13

  53. Tuesday, April 9, 13

  54. What about those event-based metrics? Tuesday, April 9, 13

  55. http://farm3.static.flickr.com/2799/4481372869_e5ccb9af5d_o.jpg Tuesday, April 9, 13

  56. http://upload.wikimedia.org/wikipedia/commons/c/c7/Logs.jpg Tuesday, April 9, 13

  57. http://upload.wikimedia.org/wikipedia/commons/f/fb/A_few_logs_-_geograph.org.uk_-_57580.jpg Tuesday, April 9, 13

  58. 2013-03-26T13:24:18.012 “GET /catalog-rest/echo_catalog/datasets.xml” 200 1234 1024 Sample Apache access log

    message Tuesday, April 9, 13

  59. 2013-03-26T13:24:18.012 “GET /catalog-rest/echo_catalog/datasets.xml” 200 1234 1024 Sample Apache access log

    message Timestamp Tuesday, April 9, 13

  60. 2013-03-26T13:24:18.012 “GET /catalog-rest/echo_catalog/datasets.xml” 200 1234 1024 Sample Apache access log

    message Timestamp Request Method Tuesday, April 9, 13

  61. 2013-03-26T13:24:18.012 “GET /catalog-rest/echo_catalog/datasets.xml” 200 1234 1024 Sample Apache access log

    message Timestamp Request Method Request Path Tuesday, April 9, 13

  62. 2013-03-26T13:24:18.012 “GET /catalog-rest/echo_catalog/datasets.xml” 200 1234 1024 Sample Apache access log

    message Timestamp Request Method Request Path Status Code Tuesday, April 9, 13

  63. 2013-03-26T13:24:18.012 “GET /catalog-rest/echo_catalog/datasets.xml” 200 1234 1024 Sample Apache access log

    message Timestamp Request Method Request Path Status Code Response Size Tuesday, April 9, 13

  64. 2013-03-26T13:24:18.012 “GET /catalog-rest/echo_catalog/datasets.xml” 200 1234 1024 Sample Apache access log

    message Timestamp Request Method Request Path Status Code Response Size Response Time Tuesday, April 9, 13

  65. 2013-03-26T13:24:18.012 “GET /catalog-rest/echo_catalog/datasets.xml” 200 1234 1024 Sample Apache access log

    message Timestamp Request Method Request Path Status Code Response Size Response Time Tuesday, April 9, 13

  66. http://www.splunk.com Tuesday, April 9, 13

  67. Basic Splunk Search Tuesday, April 9, 13

  68. Basic Splunk Search Query Tuesday, April 9, 13

  69. Basic Splunk Search Query Time period Tuesday, April 9, 13

  70. Basic Splunk Search Query Time period Matching log entries Tuesday,

    April 9, 13

  71. Basic Splunk Search Query Time period Matching log entries Distribution

    graph Tuesday, April 9, 13

  72. Tuesday, April 9, 13

  73. Tuesday, April 9, 13

  74. Tuesday, April 9, 13

  75. Tuesday, April 9, 13

  76. Tuesday, April 9, 13

  77. Tuesday, April 9, 13

  78. Tuesday, April 9, 13

  79. Tuesday, April 9, 13

  80. Tuesday, April 9, 13

  81. Summing it all up Tuesday, April 9, 13

  82. Summing it all up ✤ Visualization helps you grasp what’s

    happening in a complex system Tuesday, April 9, 13

  83. Summing it all up ✤ Visualization helps you grasp what’s

    happening in a complex system ✤ It doesn’t have to be hard Tuesday, April 9, 13

  84. Summing it all up ✤ Visualization helps you grasp what’s

    happening in a complex system ✤ It doesn’t have to be hard ✤ You’re already generating and collecting the data you need to begin visualization Tuesday, April 9, 13

  85. Questions? Tuesday, April 9, 13