Upgrade to Pro — share decks privately, control downloads, hide ads and more …

A/B Testing with Metriks

Sponsored · Ship Features Fearlessly Turn features on and off without deploys. Used by thousands of Ruby developers. →
Avatar for Larry Marburger Larry Marburger
October 01, 2012
Programming
1
110

A/B Testing with Metriks

Quick lightning talk about using metriks to run a dead simple performance A/B test.

Avatar for Larry Marburger

Larry Marburger

October 01, 2012
Tweet

More Decks by Larry Marburger

See All by Larry Marburger
I Am Hypermedia (And So Can You)
Avatar for Larry Marburger lmarburger
3
200

Other Decks in Programming

See All in Programming
登壇資料を作る時に意識していること #登壇資料_findy
Avatar for konifar konifar
4
960
【卒業研究】会話ログ分析によるユーザーごとの関心に応じた話題提案手法
Avatar for MomokoShirakawa momok47
0
190
15年続くIoTサービスの SREエンジニアが挑む 分散トレーシング導入
Avatar for Melonps melonps
2
170
「ブロックテーマでは再現できない」は本当か？
Avatar for Takashi Kitajima inc2734
0
330
LLM Observabilityによる 対話型音声AIアプリケーションの安定運用
Avatar for Hiroyuki Moriya gekko0114
2
420
ThorVG Viewer In VS Code
Avatar for Nor-s nors
0
760
AIと一緒にレガシーに向き合ってみた
Avatar for nyafunta9858 nyafunta9858
0
170
IFSによる形状設計／デモシーンの魅力 @ 慶應大学SFC
Avatar for がむ gam0022
1
300
コマンドとリード間の連携に対する脅威分析フレームワーク
Avatar for Aja9tochin pandayumi
1
450
余白を設計しフロントエンド開発を 加速させる
Avatar for karacoro / からころ tsukuha
7
2.1k
2026年 エンジニアリング自己学習法
Avatar for yumechi(Motoki Hirao) yumechi
0
130
20260127_試行錯誤の結晶を1冊に。著者が解説 先輩データサイエンティストからの指南書 / author's_commentary_ds_instructions_guide
Avatar for nash_efp nash_efp
0
900

Featured

See All Featured
Getting science done with accelerated Python computing platforms
Avatar for Jacob Tomlinson jacobtomlinson
2
110
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
Avatar for Joe Casabona jcasabona
34
2.6k
Leveraging Curiosity to Care for An Aging Population
Avatar for Cassini Nazir cassininazir
1
160
How to optimise 3,500 product descriptions for ecommerce in one day using ChatGPT
Avatar for Katarina Dahlin katarinadahlin
PRO
0
3.4k
Navigating Team Friction
Avatar for Lara Hogan lara
192
16k
No one is an island. Learnings from fostering a developers community.
Avatar for Antonio thoeni
21
3.6k
VelocityConf: Rendering Performance Case Studies
Avatar for Addy Osmani addyosmani
333
24k
Lightning Talk: Beautiful Slides for Beginners
Avatar for Ines Montani inesmontani
PRO
1
430
Done Done
Avatar for chrislema chrislema
186
16k
The Success of Rails: Ensuring Growth for the Next 100 Years
Avatar for Eileen M. Uchitelle eileencodes
47
7.9k
Optimizing for Happiness
Avatar for Tom Preston-Werner mojombo
379
71k
Fireside Chat
Avatar for paigeccino paigeccino
41
3.8k

Transcript

  1. Story Time Monday, October 1, 12

  2. Story Time Monday, October 1, 12

  3. Lazy Metrics <script>var start = new Date();</script> <img src="<%= content_url

    %>"> <script> $('img').load(function() { recordMetric("image-load", new Date() - start); }); </script> Monday, October 1, 12

  4. Lazy Metrics <script>var start = new Date();</script> <img src="<%= content_url

    %>"> <script> $('img').load(function() { recordMetric("image-load", new Date() - start); }); </script> Monday, October 1, 12

  5. Lazy Metrics <script>var start = new Date();</script> <img src="<%= content_url

    %>"> <script> $('img').load(function() { recordMetric("image-load", new Date() - start); }); </script> Monday, October 1, 12

  6. Server # /metrics?name=image-load&value=123.45 get '/metrics' do name = params['name'] value

    = params['value'] Metriks.timer(name).update(value) content_type 'text/javascript' status 200 end Monday, October 1, 12

  7. Server # /metrics?name=image-load&value=123.45 get '/metrics' do name = params['name'] value

    = params['value'] Metriks.timer(name).update(value) content_type 'text/javascript' status 200 end Monday, October 1, 12

  8. Server # /metrics?name=image-load&value=123.45 get '/metrics' do name = params['name'] value

    = params['value'] Metriks.timer(name).update(value) content_type 'text/javascript' status 200 end Monday, October 1, 12

  9. Client Side Monday, October 1, 12

  10. Story Time Monday, October 1, 12

  11. Story Time Monday, October 1, 12

  12. Lazy A/B Test <% if fast = [true, false].sample %>

    <img src="<%= fast_content_url %>"> <% else %> <img src="<%= content_url %>"> <% end %> Monday, October 1, 12

  13. Lazy A/B Test <script> $('img').load(function() { name = "image-load<%= fast

    ? '-test' : '' %>" recordMetric(name, new Date() - start); }); </script> Monday, October 1, 12

  14. Lazy A/B Test <script> $('img').load(function() { name = "image-load<%= fast

    ? '-test' : '' %>" recordMetric(name, new Date() - start); }); </script> Monday, October 1, 12

  15. Lazy A/B Test 10.5s 6.6s Monday, October 1, 12

  16. New Relic 37ms Monday, October 1, 12

  17. metriks 14ms 110ms Monday, October 1, 12

  18. gem install metriks Thank me later. Monday, October 1, 12