Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Visual Load Testing

Sponsored · SiteGround - Reliable hosting with speed, security, and support you can count on. →
Avatar for Marc Huffnagle Marc Huffnagle
April 08, 2013
Programming
0
150

Visual Load Testing

A talk I gave to Data Science Maryland on using visualization in load testing.

Avatar for Marc Huffnagle

Marc Huffnagle

April 08, 2013
Tweet

Other Decks in Programming

See All in Programming
20260127_試行錯誤の結晶を1冊に。著者が解説 先輩データサイエンティストからの指南書 / author's_commentary_ds_instructions_guide
Avatar for nash_efp nash_efp
1
940
開発者から情シスまで - 多様なユーザー層に届けるAPI提供戦略 / Postman API Night Okinawa 2026 Winter
Avatar for tasshi tasshi
0
200
なるべく楽してバックエンドに型をつけたい！(楽とは言ってない)
Avatar for HIBIKI CUBE hibiki_cube
0
140
AI Schema Enrichment for your Oracle AI Database
Avatar for thatjeffsmith thatjeffsmith
0
250
なぜSQLはAIぽく見えるのか/why does SQL look AI like
Avatar for florets1 florets1
0
450
[KNOTS 2026登壇資料]AIで拡張‧交差する プロダクト開発のプロセス および携わるメンバーの役割
Avatar for hisatake hisatake
0
260
Smart Handoff/Pickup ガイド - Claude Code セッション管理
Avatar for rasshii yukiigarashi
0
130
Grafana：建立系統全知視角的捷徑
Avatar for Blueswen blueswen
0
330
今こそ知るべき耐量子計算機暗号(PQC)入門 / PQC: What You Need to Know Now
Avatar for mackey0225 mackey0225
3
370
MDN Web Docs に日本語翻訳でコントリビュート
Avatar for uutan1108 ohmori_yusuke
0
640
Rust 製のコードエディタ “Zed” を使ってみた
Avatar for NearMeの技術発表資料です nearme_tech
PRO
0
160
Honoを使ったリモートMCPサーバでAIツールとの連携を加速させる！
Avatar for とすり tosuri13
1
170

Featured

See All Featured
Joys of Absence: A Defence of Solitary Play
Avatar for Sebastian Deterding codingconduct
1
290
The Organizational Zoo: Understanding Human Behavior Agility Through Metaphoric Constructive Conversations (based on the works of Arthur Shelley, Ph.D)
Avatar for Dr. Kim W Petersen kimpetersen
PRO
0
240
[RailsConf 2023 Opening Keynote] The Magic of Rails
Avatar for Eileen M. Uchitelle eileencodes
31
9.9k
Unlocking the hidden potential of vector embeddings in international SEO
Avatar for Frank van Dijk frankvandijk
0
170
Max Prin - Stacking Signals: How International SEO Comes Together (And Falls Apart)
Avatar for Tech SEO Connect techseoconnect
PRO
0
84
End of SEO as We Know It (SMX Advanced Version)
Avatar for Michael King ipullrank
3
3.9k
Navigating the Design Leadership Dip - Product Design Week Design Leaders+ Conference 2024
Avatar for Andy Polaine apolaine
0
170
Crafting Experiences
Avatar for Bethany Jepchumba bethany
1
48
My Coaching Mixtape
Avatar for mlcsv mlcsv
0
47
Agile that works and the tools we love
Avatar for Rasmus Luckow-Nielsen rasmusluckow
331
21k
Visualization
Avatar for Eitan Lees eitanlees
150
17k
Improving Core Web Vitals using Speculation Rules API
Avatar for Sergey Chernyshev sergeychernyshev
21
1.4k

Transcript

  1. Copyright 2013 Visual Load Testing Marc Huffnagle [email protected] Tuesday, April

    9, 13

  2. My background Tuesday, April 9, 13

  3. My background ✤ Developer Tuesday, April 9, 13

  4. My background ✤ Developer ✤ Sysadmin Tuesday, April 9, 13

  5. My background ✤ Developer ✤ Sysadmin ✤ Tester Tuesday, April

    9, 13

  6. My background ✤ Developer ✤ Sysadmin ✤ Tester ✤ Developer

    Tuesday, April 9, 13

  7. My background ✤ Developer ✤ Sysadmin ✤ Tester ✤ Developer

    ✤ Tester Tuesday, April 9, 13

  8. My background ✤ Developer ✤ Sysadmin ✤ Tester ✤ Developer

    ✤ Tester ✤ Sysadmin Tuesday, April 9, 13

  9. My background ✤ Developer ✤ Sysadmin ✤ Tester ✤ Developer

    ✤ Tester ✤ Sysadmin ✤ Developer ... Tuesday, April 9, 13

  10. Goals Tuesday, April 9, 13

  11. Goals ✤ Show how we use visualization when load testing

    ECHO Tuesday, April 9, 13

  12. Goals ✤ Show how we use visualization when load testing

    ECHO ✤ Demonstrate how you can use some of the same techniques Tuesday, April 9, 13

  13. Goals ✤ Show how we use visualization when load testing

    ECHO ✤ Demonstrate how you can use some of the same techniques ✤ Convince you that visualization can be easy Tuesday, April 9, 13

  14. What is ECHO? Earth Observing System Clearing HOuse Tuesday, April

    9, 13

  15. NASA Earth Observing System Tuesday, April 9, 13

  16. https://reverb.echo.nasa.gov/ ECHO Reverb Tuesday, April 9, 13

  17. Our load testing goals Tuesday, April 9, 13

  18. Our load testing goals http://ircimg.net/skeleton-computer-guy.jpg Tuesday, April 9, 13

  19. Our load testing goals http://www.recareered.com/files/2011/03/Turtle-Creative-Commons.jpg Tuesday, April 9, 13

  20. Our load testing goals http://tinyurl.com/cnb5quc Tuesday, April 9, 13

  21. Our load testing goals http://bees.chrisinch.com/wp-content/uploads/2012/04/MoneyBag.jpg Tuesday, April 9, 13

  22. Load Test Environment http://storylineblog.com/wp-content/uploads/2013/03/baby-computer-full.jpg Tuesday, April 9, 13

  23. Load Test Environment Producer Thread Work Queue Worker Thread Worker

    Thread Worker Thread Ruby Process Tuesday, April 9, 13

  24. Sidekiq http://sidekiq.org Simple, efficient message processing for Ruby. Tuesday, April

    9, 13

  25. Tuesday, April 9, 13

  26. Tuesday, April 9, 13

  27. Tuesday, April 9, 13

  28. Load Test Environment Load Test Driver Redis Sidekiq Worker Sidekiq

    Worker Sidekiq Worker Tuesday, April 9, 13

  29. http://farm5.static.flickr.com/4023/4548711373_d70fd58836_o.jpg Tuesday, April 9, 13

  30. We’ll be using visualization for two things: Tuesday, April 9,

    13

  31. We’ll be using visualization for two things: Monitoring Tuesday, April

    9, 13

  32. We’ll be using visualization for two things: Monitoring Metrics Tuesday,

    April 9, 13

  33. Nagios http://www.nagios.org/ Tuesday, April 9, 13

  34. Tuesday, April 9, 13

  35. Graphs of completed jobs Tuesday, April 9, 13

  36. Number of jobs processed Tuesday, April 9, 13

  37. Number of failed jobs Tuesday, April 9, 13

  38. Number of jobs currently running Tuesday, April 9, 13

  39. Number of jobs in the backlog Tuesday, April 9, 13

  40. http://4.bp.blogspot.com/_K4gm2yzgfeo/TJRYOHMNR2I/AAAAAAAAAKM/is6CjOkIIvk/s1600/flight-recorder.jpg Tuesday, April 9, 13

  41. Types of metrics we collect Tuesday, April 9, 13

  42. Types of metrics we collect ✤ Numeric time-series data Tuesday,

    April 9, 13

  43. Types of metrics we collect ✤ Numeric time-series data ✤

    Event-based data Tuesday, April 9, 13

  44. Operational System Load Test System Data Collection Tuesday, April 9,

    13

  45. Very important point: Keep your metrics collection as loosely coupled

    from your system as possible. Tuesday, April 9, 13

  46. It was this guy. Very important point: Keep your metrics

    collection as loosely coupled from your system as possible. Tuesday, April 9, 13

  47. Graphite http://graphite.wikidot.com Tuesday, April 9, 13

  48. What should I store in Graphite? Tuesday, April 9, 13

  49. What should I store in Graphite? Tuesday, April 9, 13

  50. How do I get data into Graphite? ✤ collectd -

    http://collectd.org ✤ logstash - http://www.logstash.net ✤ Anything that can open a socket ✤ echo “my-stat-name 1234 $(date +%s)” | nc graphite-host 2003 Tuesday, April 9, 13

  51. Tuesday, April 9, 13

  52. Tuesday, April 9, 13

  53. Tuesday, April 9, 13

  54. What about those event-based metrics? Tuesday, April 9, 13

  55. http://farm3.static.flickr.com/2799/4481372869_e5ccb9af5d_o.jpg Tuesday, April 9, 13

  56. http://upload.wikimedia.org/wikipedia/commons/c/c7/Logs.jpg Tuesday, April 9, 13

  57. http://upload.wikimedia.org/wikipedia/commons/f/fb/A_few_logs_-_geograph.org.uk_-_57580.jpg Tuesday, April 9, 13

  58. 2013-03-26T13:24:18.012 “GET /catalog-rest/echo_catalog/datasets.xml” 200 1234 1024 Sample Apache access log

    message Tuesday, April 9, 13

  59. 2013-03-26T13:24:18.012 “GET /catalog-rest/echo_catalog/datasets.xml” 200 1234 1024 Sample Apache access log

    message Timestamp Tuesday, April 9, 13

  60. 2013-03-26T13:24:18.012 “GET /catalog-rest/echo_catalog/datasets.xml” 200 1234 1024 Sample Apache access log

    message Timestamp Request Method Tuesday, April 9, 13

  61. 2013-03-26T13:24:18.012 “GET /catalog-rest/echo_catalog/datasets.xml” 200 1234 1024 Sample Apache access log

    message Timestamp Request Method Request Path Tuesday, April 9, 13

  62. 2013-03-26T13:24:18.012 “GET /catalog-rest/echo_catalog/datasets.xml” 200 1234 1024 Sample Apache access log

    message Timestamp Request Method Request Path Status Code Tuesday, April 9, 13

  63. 2013-03-26T13:24:18.012 “GET /catalog-rest/echo_catalog/datasets.xml” 200 1234 1024 Sample Apache access log

    message Timestamp Request Method Request Path Status Code Response Size Tuesday, April 9, 13

  64. 2013-03-26T13:24:18.012 “GET /catalog-rest/echo_catalog/datasets.xml” 200 1234 1024 Sample Apache access log

    message Timestamp Request Method Request Path Status Code Response Size Response Time Tuesday, April 9, 13

  65. 2013-03-26T13:24:18.012 “GET /catalog-rest/echo_catalog/datasets.xml” 200 1234 1024 Sample Apache access log

    message Timestamp Request Method Request Path Status Code Response Size Response Time Tuesday, April 9, 13

  66. http://www.splunk.com Tuesday, April 9, 13

  67. Basic Splunk Search Tuesday, April 9, 13

  68. Basic Splunk Search Query Tuesday, April 9, 13

  69. Basic Splunk Search Query Time period Tuesday, April 9, 13

  70. Basic Splunk Search Query Time period Matching log entries Tuesday,

    April 9, 13

  71. Basic Splunk Search Query Time period Matching log entries Distribution

    graph Tuesday, April 9, 13

  72. Tuesday, April 9, 13

  73. Tuesday, April 9, 13

  74. Tuesday, April 9, 13

  75. Tuesday, April 9, 13

  76. Tuesday, April 9, 13

  77. Tuesday, April 9, 13

  78. Tuesday, April 9, 13

  79. Tuesday, April 9, 13

  80. Tuesday, April 9, 13

  81. Summing it all up Tuesday, April 9, 13

  82. Summing it all up ✤ Visualization helps you grasp what’s

    happening in a complex system Tuesday, April 9, 13

  83. Summing it all up ✤ Visualization helps you grasp what’s

    happening in a complex system ✤ It doesn’t have to be hard Tuesday, April 9, 13

  84. Summing it all up ✤ Visualization helps you grasp what’s

    happening in a complex system ✤ It doesn’t have to be hard ✤ You’re already generating and collecting the data you need to begin visualization Tuesday, April 9, 13

  85. Questions? Tuesday, April 9, 13