Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Experimentation Mindset

Experimentation Mindset

Among the traits that distinguish a good team from a great team is their ability to innovate. Despite the rhetoric in favor of innovation, most organizations are stuck in an implementation mindset, stifling creativity, excellence, and the resultant innovation. The experimentation mindset frees us from self-imposed constraints, allowing us to continually learn and improve. In this session, we'll talk about how we learn as individuals and how we learn as organizations. We'll take a look at some examples of the experimentation mindset happening in the agile community today and we'll talk about how you can foster such a mindset in your own organization.

Michael (Doc) Norton

October 23, 2015
Tweet

More Decks by Michael (Doc) Norton

Other Decks in Business

Transcript

  1. #adchi / #ExperimentationMindset / @DocOnDev
    The Experimentation Mindset

    View Slide

  2. #adchi / #ExperimentationMindset / @DocOnDev
    Doc Norton, CEO
    [email protected]
    @DocOnDev
    @adchi / #ExperimentationMindset / @DocOnDev

    View Slide

  3. #adchi / #ExperimentationMindset / @DocOnDev
    Mindset

    View Slide

  4. #adchi / #ExperimentationMindset / @DocOnDev
    A simple experiment

    View Slide

  5. #adchi / #ExperimentationMindset / @DocOnDev
    Two Groups

    View Slide

  6. #adchi / #ExperimentationMindset / @DocOnDev
    Small Difference; Big Result

    View Slide

  7. #adchi / #ExperimentationMindset / @DocOnDev
    Mindset
    the ideas and attitudes with which a person approaches a situation

    View Slide

  8. #adchi / #ExperimentationMindset / @DocOnDev
    fixed growth

    View Slide

  9. #adchi / #ExperimentationMindset / @DocOnDev
    Dreyfus Model of skills acquisition

    View Slide

  10. #adchi / #ExperimentationMindset / @DocOnDev
    Novice

    View Slide

  11. #adchi / #ExperimentationMindset / @DocOnDev
    Advanced Beginner

    View Slide

  12. #adchi / #ExperimentationMindset / @DocOnDev
    Competent

    View Slide

  13. #adchi / #ExperimentationMindset / @DocOnDev
    Proficient

    View Slide

  14. #adchi / #ExperimentationMindset / @DocOnDev
    Expert

    View Slide

  15. #adchi / #ExperimentationMindset / @DocOnDev
    Where are you?

    View Slide

  16. #adchi / #ExperimentationMindset / @DocOnDev
    Most think they’re Expert

    View Slide

  17. #adchi / #ExperimentationMindset / @DocOnDev
    most stay at Proficient

    View Slide

  18. #adchi / #ExperimentationMindset / @DocOnDev
    From Implementation

    View Slide

  19. #adchi / #ExperimentationMindset / @DocOnDev
    Implementation Mindset get it right
    A+

    View Slide

  20. #adchi / #ExperimentationMindset / @DocOnDev
    to experimentation

    View Slide

  21. #adchi / #ExperimentationMindset / @DocOnDev
    experimentation Mindset explore different ways

    View Slide

  22. #adchi / #ExperimentationMindset / @DocOnDev
    experimentation Mindset explore different ways

    View Slide

  23. #adchi / #ExperimentationMindset / @DocOnDev
    but in a typical company…

    View Slide

  24. #adchi / #ExperimentationMindset / @DocOnDev
    telephone sales

    View Slide

  25. #adchi / #ExperimentationMindset / @DocOnDev
    Follow the script
    This will
    be
    great!

    View Slide

  26. #adchi / #ExperimentationMindset / @DocOnDev
    It wasn’t Great
    Ptolemy
    Janet
    Raphael
    Susan
    Kathy
    Tommy
    Doc
    Chris P.
    Weekly Sales Rankings

    View Slide

  27. #adchi / #ExperimentationMindset / @DocOnDev
    Watch The Master
    my name is ____________________ …
    Hello (sir/madam),

    View Slide

  28. #adchi / #ExperimentationMindset / @DocOnDev
    Watch The Master
    my name is ____________________ …
    Pat Michaels
    Good Day!

    View Slide

  29. #adchi / #ExperimentationMindset / @DocOnDev
    Experiment

    View Slide

  30. #adchi / #ExperimentationMindset / @DocOnDev
    experiment

    View Slide

  31. #adchi / #ExperimentationMindset / @DocOnDev
    experiment

    View Slide

  32. #adchi / #ExperimentationMindset / @DocOnDev
    experiment

    View Slide

  33. #adchi / #ExperimentationMindset / @DocOnDev
    top in sales!
    Doc
    Ptolemy
    Janet
    Kathy
    Tommy
    Raphael
    Susan
    Andy
    Weekly Sales Rankings

    View Slide

  34. #adchi / #ExperimentationMindset / @DocOnDev
    8 week review

    View Slide

  35. #adchi / #ExperimentationMindset / @DocOnDev
    not the feedback I expected

    View Slide

  36. #adchi / #ExperimentationMindset / @DocOnDev
    My last day

    View Slide

  37. #adchi / #ExperimentationMindset / @DocOnDev
    Best Practices

    View Slide

  38. #adchi / #ExperimentationMindset / @DocOnDev
    Implementation Mindset get it right
    A+

    View Slide

  39. #adchi / #ExperimentationMindset / @DocOnDev
    Single Loop
    Assumptions Actions Outcomes
    Get it Right

    View Slide

  40. #adchi / #ExperimentationMindset / @DocOnDev
    The Dark Side

    View Slide

  41. #adchi / #ExperimentationMindset / @DocOnDev
    double Loop
    Assumptions Actions Outcomes
    Get it Right
    Explore Different Ways

    View Slide

  42. #adchi / #ExperimentationMindset / @DocOnDev
    best practices

    View Slide

  43. #adchi / #ExperimentationMindset / @DocOnDev
    leading practices

    View Slide

  44. #adchi / #ExperimentationMindset / @DocOnDev
    from implementation to experimentation

    View Slide

  45. #adchi / #ExperimentationMindset / @DocOnDev
    experimentation

    View Slide

  46. #adchi / #ExperimentationMindset / @DocOnDev
    experimentation

    View Slide

  47. #adchi / #ExperimentationMindset / @DocOnDev
    split (a/B) + Multivariate

    View Slide

  48. #adchi / #ExperimentationMindset / @DocOnDev
    Cumulative Flow

    View Slide

  49. #adchi / #ExperimentationMindset / @DocOnDev
    velocity trends

    View Slide

  50. #adchi / #ExperimentationMindset / @DocOnDev
    code quality

    View Slide

  51. #adchi / #ExperimentationMindset / @DocOnDev
    employee engagement

    View Slide

  52. #adchi / #ExperimentationMindset / @DocOnDev
    team joy

    View Slide

  53. #adchi / #ExperimentationMindset / @DocOnDev
    Retrospectives

    View Slide

  54. #adchi / #ExperimentationMindset / @DocOnDev
    refine their process

    View Slide

  55. #adchi / #ExperimentationMindset / @DocOnDev
    Orientation + On-Boarding

    View Slide

  56. #adchi / #ExperimentationMindset / @DocOnDev
    Interest Leagues

    View Slide

  57. #adchi / #ExperimentationMindset / @DocOnDev
    hackathons

    View Slide

  58. #adchi / #ExperimentationMindset / @DocOnDev
    mentorships

    View Slide

  59. #adchi / #ExperimentationMindset / @DocOnDev
    360 / peer reviews

    View Slide

  60. #adchi / #ExperimentationMindset / @DocOnDev
    managers institutionalize procedure
    - Gabe Newell

    View Slide

  61. #adchi / #ExperimentationMindset / @DocOnDev
    being open about [pay] breeds trust
    - Leo Widrich

    View Slide

  62. #adchi / #ExperimentationMindset / @DocOnDev
    managers [are] mentors
    - Kevin Goldsmith

    View Slide

  63. #adchi / #ExperimentationMindset / @DocOnDev
    four things

    View Slide

  64. #adchi / #ExperimentationMindset / @DocOnDev
    know your purpose; challenge assumptions

    View Slide

  65. #adchi / #ExperimentationMindset / @DocOnDev
    make failure
    acceptable
    – Henry Ford
    “Failure is simply the opportunity to
    begin again, this time more intelligently.”

    View Slide

  66. think big… start small… .

    View Slide

  67. #adchi / #ExperimentationMindset / @DocOnDev
    be intolerant of mediocrity

    View Slide

  68. #adchi / #ExperimentationMindset / @DocOnDev
    keep experimenting
    Assumptions Actions Outcomes
    Get it Right
    Explore Different Ways

    View Slide

  69. Thank
    You!

    View Slide

  70. #adchi / #ExperimentationMindset / @DocOnDev
    The Experimentation Mindset

    View Slide

  71. #adchi / #ExperimentationMindset / @DocOnDev
    • Mad Scientist - https://www.flickr.com/photos/dzingeek/4587871752/
    sizes/o/
    • Stages of Growth - http://superkoopatroopa.deviantart.com/art/Terri-
    Growth-chart-125875917
    • Elephant and Mother - http://upload.wikimedia.org/wikipedia/
    commons/7/75/
    Baby_asian_elephant_(with_his_mother)_born_in_the_Lao_Elephant_
    Conservation_Center_in_Sayaboury.jpg Phone Script - http://
    www.docstoc.com/docs/6629075/Sample-Sales-Script
    • Phones -
    • http://www.enumclawsda.org/uploads/
    1/3/3/9/13391741/1971539_orig.gif?119
    • http://4.bp.blogspot.com/-qASUt2T7C7o/ULvJ8HVU3LI/
    AAAAAAAAACw/LufW5HYhCyM/s1600/Tel%C3%A8fon+fixe
    +antic.png
    • https://c2.staticflickr.com/8/7443/8758001086_2692f91620_h.jpg
    • http://cdn2.hubspot.net/hub/147894/file-270530761-jpg/images/
    phone-large.jpg
    • Mob Programming - https://techblog.betclicgroup.com/wp-content/
    uploads/2014/09/mob-programming-1-1024.jpg
    • Spotify Matrix - http://blog.kevingoldsmith.com/wp-content/uploads/
    2014/03/Screen-Shot-2013-11-09-at-7.30.08-AM-1024x644.png
    • a/b | multivariate testing - https://www.dynamicyield.com/wp-content/
    uploads/2014/05/testing.jpg
    • Hackathon - https://m2.behance.net/rendition/pm/22070355/disp/
    f4d62818fcb09d43722a945486ca5300.png
    • Things - http://41.media.tumblr.com/
    d721f204c69de1b5a6a4899429430c9e/
    tumblr_n52o0matip1snioclo1_1280.jpg, http://cdn.instructables.com/
    FIT/POMF/HKJTCKRQ/FITPOMFHKJTCKRQ.LARGE.jpg, http://
    shadowgrail.deviantart.com/art/Rock-of-Ages-83993992, http://
    vo5.deviantart.com/art/Fantastic-Four-163610854
    Images

    View Slide

  72. #adchi / #ExperimentationMindset / @DocOnDev
    • Students Test - https://img.washingtonpost.com/rf/image_1484w/
    2010-2019/WashingtonPost/2014/09/17/Others/Images/
    2014-09-17/DSC_54171410973389.jpg?
    uuid=h6VsJD6MEeSkMLgqPme3Yg
    • Woody Zuill - https://pbs.twimg.com/media/
    A8NKQ9lCQAAdA7h.jpg
    • Code Quality (WTF) - http://www.sonarqube.org/wp-content/
    uploads/2009/09/wtfm.jpg
    • 360 Feedback - http://screencrush.com/442/files/2012/07/360-
    review.jpg
    • Test Tube - http://fc09.deviantart.net/fs70/i/2010/018/2/1/
    Vector_Test_Tube_by_Algerianoo.jpg
    • No Estimates - https://twitter.com/NoEstimates
    • Tesla - https://c2.staticflickr.com/
    4/3006/2932363100_5bf7ff5820_b.jpg
    • Smiley - https://blogs.dal.ca/csc/files/2012/07/MP900443129.jpg
    • Dilbert - http://www.stephenshapiro.com/images/dilbert-bp.gif
    • Manager’s Office - https://www.flickr.com/photos/islespunkfan/
    8281372547/sizes/l
    • Bad review - http://media.benefitspro.com/benefitspro/article/
    2014/02/06/negative%20reviews.jpg
    • Captain my Captain - http://startupeers.co/wp-content/uploads/
    2014/08/o-captain-e1407919367905.jpg
    • Vader in Suit - http://fc06.deviantart.net/fs71/f/2011/179/a/a/
    darth_vader_by_iamthedarthvader-d3k9n2h.jpg
    • League - https://oliverwillis.com/wp-content/uploads/2015/08/
    league-of-legends.jpg
    • Mentorship - http://humancapitalist.com/wordpress/wp-content/
    uploads/2013/11/canstockphoto15167410.jpg
    more images

    View Slide

  73. #adchi / #ExperimentationMindset / @DocOnDev
    • Dreyfus Model of Skills Acquisition - http://en.wikipedia.org/
    wiki/Dreyfus_model_of_skill_acquisition, http://
    files.eric.ed.gov/fulltext/ED384695.pdf#page=130, https://
    www.dropbox.com/s/px1d5orrtjm5d5i/ADA084551.pdf?dl=0
    • Learning through experimentation - http://lifehacker.com/
    5985565/how-and-why-to-intentionally-set-yourself-up-for-
    failure
    • HBR: Collective Genius - http://hbr.org/2014/06/collective-
    genius/ar/1
    • How Organizations Learn - http://www.areteadventures.com/
    articles/the_challenge_of_entering_the_green_room.pdf
    • Argyris: Teaching Smart People how to Learn - http://hbr.org/
    1991/05/teaching-smart-people-how-to-learn/ar/1, http://
    pds8.egloos.com/pds/200805/20/87/
    chris_argyris_learning.pdf
    • Argyris: Double Loop Learning in Organizations - http://
    hbr.org/1977/09/double-loop-learning-in-organizations/ar/3
    • A/B Testing and the Experimentation Culture - https://
    hbr.org/2014/02/ab-testing-and-the-benefits-of-an-
    experimentation-culture/
    • Enlightened Experimentation - https://hbr.org/2001/02/
    enlightened-experimentation-the-new-imperative-for-
    innovation/ar/4
    • Argyris: Single-Loop and Double-Loop Learning in Research
    on Decision Making - https://
    093#1c5e28761e25b79cfc10de03f5a188778a0.googledrive
    .com/host/0B_RO2ClD0V7AZHpWRS1mNUc2d1k/argyris.pdf
    • Ed Batista Blog - http://www.edbatista.com/2008/05/double-
    loop.html
    Reference Material

    View Slide

  74. #adchi / #ExperimentationMindset / @DocOnDev
    • Lean Change - http://www.lean.org/LeanPost/
    Posting.cfm?LeanPostId=225
    • Scaling Up Excellence - http://www.amazon.com/
    Scaling-up-Excellence-Hayagreeva-Rao-ebook/
    dp/B00EGMQIDG
    • Start With Why - http://www.amazon.com/Start-
    Why-Leaders-Inspire-Everyone-ebook/dp/
    B002Q6XUE4/
    • Leading Change - http://www.amazon.com/gp/
    product/0875847471/
    • Woody Zuill - https://twitter.com/woodyzuill, http://
    zuill.us/WoodyZuill/
    • Mob Programming and No Estimates - http://
    www.infoq.com/interviews/zuill-mob-programming
    • Democratizing Experimentation - https://hbr.org/
    2011/04/8-ways-to-democratize-experime/
    • Failing by Design - https://hbr.org/2011/04/failing-
    by-design/ar/1
    • Smart Business Experiments - https://hbr.org/
    2011/03/a-step-by-step-guide-to-smart-business-
    experiments/ar/1
    • Evidence Based Management - https://hbr.org/
    2006/01/evidence-based-management/ar/5
    more reference material

    View Slide

  75. #adchi / #ExperimentationMindset / @DocOnDev
    • Buffer Transparency - http://
    www.fastcompany.com/3024306/bottom-
    line/why-this-startup-made-their-salaries-
    radically-transparent
    • Buffer Transparency Fail - http://
    www.fastcompany.com/3050682/lessons-
    learned/why-our-transparent-feedback-
    experiment-failed
    • Valve - https://blog.inf.ed.ac.uk/sapm/
    2014/03/14/management-at-valve-an-
    analysis-of-management-practices-at-valve-
    software/
    • Valve Handbook - https://
    www.valvesoftware.com/company/
    Valve_Handbook_LowRes.pdf
    • Spotify White Paper - https://
    dl.dropboxusercontent.com/u/1018963/
    Articles/SpotifyScaling.pdf
    • Kevin Goldsmith on Spotify - http://
    blog.kevingoldsmith.com/2014/03/14/
    thoughts-on-emulating-spotifys-matrix-
    organization-in-other-companies/
    yet more reference material

    View Slide