Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

Visual Load Testing

Avatar for Marc Huffnagle Marc Huffnagle
April 08, 2013
Programming
150
0

Visual Load Testing

A talk I gave to Data Science Maryland on using visualization in load testing.

Avatar for Marc Huffnagle

Marc Huffnagle

April 08, 2013

Other Decks in Programming

See All in Programming
AI時代のコードレビューは人に向けるな、仕組みに向けろ
Avatar for meijin texmeijin
5
3.7k
[Rails World 2026] Durable orchestration on Rails: from continuation to workflow
Avatar for Vladimir Dementyev palkan
1
750
自サークルのIdPからログアウトできるようになるまで
Avatar for taiseiue taiseiue
1
140
dotNET_vulnclicker_intro.pdf
Avatar for Tomohiko Morita deka_morita
0
140
C#の現在地 進化の歴史と、AI時代の.NET Everywhere
Avatar for Yoshifumi Kawai neuecc
5
5.2k
気持ちぃ〜角丸 Squircle
Avatar for ryu ryu1013
0
310
動作中のプログラムの中身をリアルタイムに覗く / Realtime Debugger for CSharp with Roslyn
Avatar for Prota prota
1
1.9k
全ての永続トークンを、生まれる前に消し去りたい！
Avatar for sylph01 sylph01
2
880
半永久的に提供し続けられるプライベートクラウドを目指して ― 利用者の認知負荷を抑えるAPI抽象化とハードウェア世代交代の基盤設計
Avatar for Tomofumi Kondo tomokon
0
500
[2026-09-26]空論ジェネリックプロセス～テスト資産とAIで紡ぐ、再現可能なパフォーマンスチューニングの話～
Avatar for tosite tosite
0
270
SalesForceを内製化！？ ~ HR事業を支える顧客管理基盤のインフラを大公開 ~
Avatar for Kobujee_53 oku053
0
180
When benchmarks go bad - what I learned from measuring performance wrong
Avatar for Holly Cummins hollycummins
0
220

Featured

See All Featured
Speed Design
Avatar for Sergey Chernyshev sergeychernyshev
33
2.2k
The World Runs on Bad Software
Avatar for Brandon Keepers bkeepers
PRO
72
12k
[RailsConf 2023] Rails as a piece of cake
Avatar for Vladimir Dementyev palkan
59
7.1k
Game over? The fight for quality and originality in the time of robots
Avatar for Wayne Barker wayneb77
1
300
The untapped power of vector embeddings
Avatar for Frank van Dijk frankvandijk
2
1.9k
Building AI with AI
Avatar for Ines Montani inesmontani
PRO
1
1.3k
Unsuck your backbone
Avatar for Amy Palamountain ammeep
672
58k
Breaking role norms: Why Content Design is so much more than writing copy - Taylor Woolridge
Avatar for UX Y'all uxyall
1
450
How To Stay Up To Date on Web Technology
Avatar for Chris Coyier chriscoyier
790
250k
Mind Mapping
Avatar for Hélio Medeiros helmedeiros
1
400
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
Avatar for Sam Stephenson sstephenson
162
16k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
Avatar for Joe Casabona jcasabona
35
2.9k

Transcript

  1. Copyright 2013 Visual Load Testing Marc Huffnagle [email protected] Tuesday, April

    9, 13

  2. My background Tuesday, April 9, 13

  3. My background ✤ Developer Tuesday, April 9, 13

  4. My background ✤ Developer ✤ Sysadmin Tuesday, April 9, 13

  5. My background ✤ Developer ✤ Sysadmin ✤ Tester Tuesday, April

    9, 13

  6. My background ✤ Developer ✤ Sysadmin ✤ Tester ✤ Developer

    Tuesday, April 9, 13

  7. My background ✤ Developer ✤ Sysadmin ✤ Tester ✤ Developer

    ✤ Tester Tuesday, April 9, 13

  8. My background ✤ Developer ✤ Sysadmin ✤ Tester ✤ Developer

    ✤ Tester ✤ Sysadmin Tuesday, April 9, 13

  9. My background ✤ Developer ✤ Sysadmin ✤ Tester ✤ Developer

    ✤ Tester ✤ Sysadmin ✤ Developer ... Tuesday, April 9, 13

  10. Goals Tuesday, April 9, 13

  11. Goals ✤ Show how we use visualization when load testing

    ECHO Tuesday, April 9, 13

  12. Goals ✤ Show how we use visualization when load testing

    ECHO ✤ Demonstrate how you can use some of the same techniques Tuesday, April 9, 13

  13. Goals ✤ Show how we use visualization when load testing

    ECHO ✤ Demonstrate how you can use some of the same techniques ✤ Convince you that visualization can be easy Tuesday, April 9, 13

  14. What is ECHO? Earth Observing System Clearing HOuse Tuesday, April

    9, 13

  15. NASA Earth Observing System Tuesday, April 9, 13

  16. https://reverb.echo.nasa.gov/ ECHO Reverb Tuesday, April 9, 13

  17. Our load testing goals Tuesday, April 9, 13

  18. Our load testing goals http://ircimg.net/skeleton-computer-guy.jpg Tuesday, April 9, 13

  19. Our load testing goals http://www.recareered.com/files/2011/03/Turtle-Creative-Commons.jpg Tuesday, April 9, 13

  20. Our load testing goals http://tinyurl.com/cnb5quc Tuesday, April 9, 13

  21. Our load testing goals http://bees.chrisinch.com/wp-content/uploads/2012/04/MoneyBag.jpg Tuesday, April 9, 13

  22. Load Test Environment http://storylineblog.com/wp-content/uploads/2013/03/baby-computer-full.jpg Tuesday, April 9, 13

  23. Load Test Environment Producer Thread Work Queue Worker Thread Worker

    Thread Worker Thread Ruby Process Tuesday, April 9, 13

  24. Sidekiq http://sidekiq.org Simple, efficient message processing for Ruby. Tuesday, April

    9, 13

  25. Tuesday, April 9, 13

  26. Tuesday, April 9, 13

  27. Tuesday, April 9, 13

  28. Load Test Environment Load Test Driver Redis Sidekiq Worker Sidekiq

    Worker Sidekiq Worker Tuesday, April 9, 13

  29. http://farm5.static.flickr.com/4023/4548711373_d70fd58836_o.jpg Tuesday, April 9, 13

  30. We’ll be using visualization for two things: Tuesday, April 9,

    13

  31. We’ll be using visualization for two things: Monitoring Tuesday, April

    9, 13

  32. We’ll be using visualization for two things: Monitoring Metrics Tuesday,

    April 9, 13

  33. Nagios http://www.nagios.org/ Tuesday, April 9, 13

  34. Tuesday, April 9, 13

  35. Graphs of completed jobs Tuesday, April 9, 13

  36. Number of jobs processed Tuesday, April 9, 13

  37. Number of failed jobs Tuesday, April 9, 13

  38. Number of jobs currently running Tuesday, April 9, 13

  39. Number of jobs in the backlog Tuesday, April 9, 13

  40. http://4.bp.blogspot.com/_K4gm2yzgfeo/TJRYOHMNR2I/AAAAAAAAAKM/is6CjOkIIvk/s1600/flight-recorder.jpg Tuesday, April 9, 13

  41. Types of metrics we collect Tuesday, April 9, 13

  42. Types of metrics we collect ✤ Numeric time-series data Tuesday,

    April 9, 13

  43. Types of metrics we collect ✤ Numeric time-series data ✤

    Event-based data Tuesday, April 9, 13

  44. Operational System Load Test System Data Collection Tuesday, April 9,

    13

  45. Very important point: Keep your metrics collection as loosely coupled

    from your system as possible. Tuesday, April 9, 13

  46. It was this guy. Very important point: Keep your metrics

    collection as loosely coupled from your system as possible. Tuesday, April 9, 13

  47. Graphite http://graphite.wikidot.com Tuesday, April 9, 13

  48. What should I store in Graphite? Tuesday, April 9, 13

  49. What should I store in Graphite? Tuesday, April 9, 13

  50. How do I get data into Graphite? ✤ collectd -

    http://collectd.org ✤ logstash - http://www.logstash.net ✤ Anything that can open a socket ✤ echo “my-stat-name 1234 $(date +%s)” | nc graphite-host 2003 Tuesday, April 9, 13

  51. Tuesday, April 9, 13

  52. Tuesday, April 9, 13

  53. Tuesday, April 9, 13

  54. What about those event-based metrics? Tuesday, April 9, 13

  55. http://farm3.static.flickr.com/2799/4481372869_e5ccb9af5d_o.jpg Tuesday, April 9, 13

  56. http://upload.wikimedia.org/wikipedia/commons/c/c7/Logs.jpg Tuesday, April 9, 13

  57. http://upload.wikimedia.org/wikipedia/commons/f/fb/A_few_logs_-_geograph.org.uk_-_57580.jpg Tuesday, April 9, 13

  58. 2013-03-26T13:24:18.012 “GET /catalog-rest/echo_catalog/datasets.xml” 200 1234 1024 Sample Apache access log

    message Tuesday, April 9, 13

  59. 2013-03-26T13:24:18.012 “GET /catalog-rest/echo_catalog/datasets.xml” 200 1234 1024 Sample Apache access log

    message Timestamp Tuesday, April 9, 13

  60. 2013-03-26T13:24:18.012 “GET /catalog-rest/echo_catalog/datasets.xml” 200 1234 1024 Sample Apache access log

    message Timestamp Request Method Tuesday, April 9, 13

  61. 2013-03-26T13:24:18.012 “GET /catalog-rest/echo_catalog/datasets.xml” 200 1234 1024 Sample Apache access log

    message Timestamp Request Method Request Path Tuesday, April 9, 13

  62. 2013-03-26T13:24:18.012 “GET /catalog-rest/echo_catalog/datasets.xml” 200 1234 1024 Sample Apache access log

    message Timestamp Request Method Request Path Status Code Tuesday, April 9, 13

  63. 2013-03-26T13:24:18.012 “GET /catalog-rest/echo_catalog/datasets.xml” 200 1234 1024 Sample Apache access log

    message Timestamp Request Method Request Path Status Code Response Size Tuesday, April 9, 13

  64. 2013-03-26T13:24:18.012 “GET /catalog-rest/echo_catalog/datasets.xml” 200 1234 1024 Sample Apache access log

    message Timestamp Request Method Request Path Status Code Response Size Response Time Tuesday, April 9, 13

  65. 2013-03-26T13:24:18.012 “GET /catalog-rest/echo_catalog/datasets.xml” 200 1234 1024 Sample Apache access log

    message Timestamp Request Method Request Path Status Code Response Size Response Time Tuesday, April 9, 13

  66. http://www.splunk.com Tuesday, April 9, 13

  67. Basic Splunk Search Tuesday, April 9, 13

  68. Basic Splunk Search Query Tuesday, April 9, 13

  69. Basic Splunk Search Query Time period Tuesday, April 9, 13

  70. Basic Splunk Search Query Time period Matching log entries Tuesday,

    April 9, 13

  71. Basic Splunk Search Query Time period Matching log entries Distribution

    graph Tuesday, April 9, 13

  72. Tuesday, April 9, 13

  73. Tuesday, April 9, 13

  74. Tuesday, April 9, 13

  75. Tuesday, April 9, 13

  76. Tuesday, April 9, 13

  77. Tuesday, April 9, 13

  78. Tuesday, April 9, 13

  79. Tuesday, April 9, 13

  80. Tuesday, April 9, 13

  81. Summing it all up Tuesday, April 9, 13

  82. Summing it all up ✤ Visualization helps you grasp what’s

    happening in a complex system Tuesday, April 9, 13

  83. Summing it all up ✤ Visualization helps you grasp what’s

    happening in a complex system ✤ It doesn’t have to be hard Tuesday, April 9, 13

  84. Summing it all up ✤ Visualization helps you grasp what’s

    happening in a complex system ✤ It doesn’t have to be hard ✤ You’re already generating and collecting the data you need to begin visualization Tuesday, April 9, 13

  85. Questions? Tuesday, April 9, 13