Slide 1

Slide 1 text

Evan Solomon | Automattic @evansolomon You don’t know people

Slide 2

Slide 2 text

Try Measure Profit!

Slide 3

Slide 3 text

Pick one At least until we have lots of data

Slide 4

Slide 4 text

Rat pelts & cobras

Slide 5

Slide 5 text

No content

Slide 6

Slide 6 text

No content

Slide 7

Slide 7 text

No content

Slide 8

Slide 8 text

Previews up 10%

Slide 9

Slide 9 text

http://theme.wordpress.com/themes/

Slide 10

Slide 10 text

Optimizely Fast & Flexible

Slide 11

Slide 11 text

No content

Slide 12

Slide 12 text

No content

Slide 13

Slide 13 text

The (abridged) plugin wp_enqueue_script('optimizely ', $this->url); wp_localize_script( 'optimizely', 'wpcom_optimizely', array( $experiment->slug => true ) );

Slide 14

Slide 14 text

gist.github /1275892

Slide 15

Slide 15 text

jQuery (".post-812") .find("h2 > a") .html("Nacin fights Koop"); The change

Slide 16

Slide 16 text

jQuery(".post-812") .find("h2 > a") .live("mousedown", function() { window.optimizely.push( ["trackEvent", "a_click"] ); }); The goal

Slide 17

Slide 17 text

optimizely_experiment( "nancin_coding_title', array( "action" => "init", "logged_out_users" => true ) ); The test

Slide 18

Slide 18 text

var wpcom_optimizely = {"nacin_coding_title":true}; The browser

Slide 19

Slide 19 text

The target

Slide 20

Slide 20 text

isvalid.org Confidence interval Significance test

Slide 21

Slide 21 text

No content

Slide 22

Slide 22 text

github /evansolomon/isvalid.org

Slide 23

Slide 23 text

Question everything & Design for 0% failure

Slide 24

Slide 24 text

@evansolomon http://slideshare.net/evansolomon/you-dont-know-people/