Experimentation Mindset

Among the traits that distinguish a good team from a great team is their ability to innovate. Despite the rhetoric in favor of innovation, most organizations are stuck in an implementation mindset, stifling creativity, excellence, and the resultant innovation. The experimentation mindset frees us from self-imposed constraints, allowing us to continually learn and improve. In this session, we'll talk about how we learn as individuals and how we learn as organizations. We'll take a look at some examples of the experimentation mindset happening in the agile community today and we'll talk about how you can foster such a mindset in your own organization.

Transcript

1. #adchi / #ExperimentationMindset / @DocOnDev
   The Experimentation Mindset
   

   View Slide

2. #adchi / #ExperimentationMindset / @DocOnDev
   Doc Norton, CEO
   doc@wearecto2.com
   @DocOnDev
   @adchi / #ExperimentationMindset / @DocOnDev
   

   View Slide

3. #adchi / #ExperimentationMindset / @DocOnDev
   Mindset
   

   View Slide

4. #adchi / #ExperimentationMindset / @DocOnDev
   A simple experiment
   

   View Slide

5. #adchi / #ExperimentationMindset / @DocOnDev
   Two Groups
   

   View Slide

6. #adchi / #ExperimentationMindset / @DocOnDev
   Small Difference; Big Result
   

   View Slide

7. #adchi / #ExperimentationMindset / @DocOnDev
   Mindset
   the ideas and attitudes with which a person approaches a situation
   

   View Slide

8. #adchi / #ExperimentationMindset / @DocOnDev
   fixed growth
   

   View Slide

9. #adchi / #ExperimentationMindset / @DocOnDev
   Dreyfus Model of skills acquisition
   

   View Slide

10. #adchi / #ExperimentationMindset / @DocOnDev
    Novice
    

    View Slide

11. #adchi / #ExperimentationMindset / @DocOnDev
    Advanced Beginner
    

    View Slide

12. #adchi / #ExperimentationMindset / @DocOnDev
    Competent
    

    View Slide

13. #adchi / #ExperimentationMindset / @DocOnDev
    Proficient
    

    View Slide

14. #adchi / #ExperimentationMindset / @DocOnDev
    Expert
    

    View Slide

15. #adchi / #ExperimentationMindset / @DocOnDev
    Where are you?
    

    View Slide

16. #adchi / #ExperimentationMindset / @DocOnDev
    Most think they’re Expert
    

    View Slide

17. #adchi / #ExperimentationMindset / @DocOnDev
    most stay at Proficient
    

    View Slide

18. #adchi / #ExperimentationMindset / @DocOnDev
    From Implementation
    

    View Slide

19. #adchi / #ExperimentationMindset / @DocOnDev
    Implementation Mindset get it right
    A+
    

    View Slide

20. #adchi / #ExperimentationMindset / @DocOnDev
    to experimentation
    

    View Slide

21. #adchi / #ExperimentationMindset / @DocOnDev
    experimentation Mindset explore different ways
    

    View Slide

22. #adchi / #ExperimentationMindset / @DocOnDev
    experimentation Mindset explore different ways
    

    View Slide

23. #adchi / #ExperimentationMindset / @DocOnDev
    but in a typical company…
    

    View Slide

24. #adchi / #ExperimentationMindset / @DocOnDev
    telephone sales
    

    View Slide

25. #adchi / #ExperimentationMindset / @DocOnDev
    Follow the script
    This will
    be
    great!
    

    View Slide

26. #adchi / #ExperimentationMindset / @DocOnDev
    It wasn’t Great
    Ptolemy
    Janet
    Raphael
    Susan
    Kathy
    Tommy
    Doc
    Chris P.
    Weekly Sales Rankings
    

    View Slide

27. #adchi / #ExperimentationMindset / @DocOnDev
    Watch The Master
    my name is ____________________ …
    Hello (sir/madam),
    

    View Slide

28. #adchi / #ExperimentationMindset / @DocOnDev
    Watch The Master
    my name is ____________________ …
    Pat Michaels
    Good Day!
    

    View Slide

29. #adchi / #ExperimentationMindset / @DocOnDev
    Experiment
    

    View Slide

30. #adchi / #ExperimentationMindset / @DocOnDev
    experiment
    

    View Slide

31. #adchi / #ExperimentationMindset / @DocOnDev
    experiment
    

    View Slide

32. #adchi / #ExperimentationMindset / @DocOnDev
    experiment
    

    View Slide

33. #adchi / #ExperimentationMindset / @DocOnDev
    top in sales!
    Doc
    Ptolemy
    Janet
    Kathy
    Tommy
    Raphael
    Susan
    Andy
    Weekly Sales Rankings
    

    View Slide

34. #adchi / #ExperimentationMindset / @DocOnDev
    8 week review
    

    View Slide

35. #adchi / #ExperimentationMindset / @DocOnDev
    not the feedback I expected
    

    View Slide

36. #adchi / #ExperimentationMindset / @DocOnDev
    My last day
    

    View Slide

37. #adchi / #ExperimentationMindset / @DocOnDev
    Best Practices
    

    View Slide

38. #adchi / #ExperimentationMindset / @DocOnDev
    Implementation Mindset get it right
    A+
    

    View Slide

39. #adchi / #ExperimentationMindset / @DocOnDev
    Single Loop
    Assumptions Actions Outcomes
    Get it Right
    

    View Slide

40. #adchi / #ExperimentationMindset / @DocOnDev
    The Dark Side
    

    View Slide

41. #adchi / #ExperimentationMindset / @DocOnDev
    double Loop
    Assumptions Actions Outcomes
    Get it Right
    Explore Different Ways
    

    View Slide

42. #adchi / #ExperimentationMindset / @DocOnDev
    best practices
    

    View Slide

43. #adchi / #ExperimentationMindset / @DocOnDev
    leading practices
    

    View Slide

44. #adchi / #ExperimentationMindset / @DocOnDev
    from implementation to experimentation
    

    View Slide

45. #adchi / #ExperimentationMindset / @DocOnDev
    experimentation
    

    View Slide

46. #adchi / #ExperimentationMindset / @DocOnDev
    experimentation
    

    View Slide

47. #adchi / #ExperimentationMindset / @DocOnDev
    split (a/B) + Multivariate
    

    View Slide

48. #adchi / #ExperimentationMindset / @DocOnDev
    Cumulative Flow
    

    View Slide

49. #adchi / #ExperimentationMindset / @DocOnDev
    velocity trends
    

    View Slide

50. #adchi / #ExperimentationMindset / @DocOnDev
    code quality
    

    View Slide

51. #adchi / #ExperimentationMindset / @DocOnDev
    employee engagement
    

    View Slide

52. #adchi / #ExperimentationMindset / @DocOnDev
    team joy
    

    View Slide

53. #adchi / #ExperimentationMindset / @DocOnDev
    Retrospectives
    

    View Slide

54. #adchi / #ExperimentationMindset / @DocOnDev
    refine their process
    

    View Slide

55. #adchi / #ExperimentationMindset / @DocOnDev
    Orientation + On-Boarding
    

    View Slide

56. #adchi / #ExperimentationMindset / @DocOnDev
    Interest Leagues
    

    View Slide

57. #adchi / #ExperimentationMindset / @DocOnDev
    hackathons
    

    View Slide

58. #adchi / #ExperimentationMindset / @DocOnDev
    mentorships
    

    View Slide

59. #adchi / #ExperimentationMindset / @DocOnDev
    360 / peer reviews
    

    View Slide

60. #adchi / #ExperimentationMindset / @DocOnDev
    managers institutionalize procedure
    - Gabe Newell
    

    View Slide

61. #adchi / #ExperimentationMindset / @DocOnDev
    being open about [pay] breeds trust
    - Leo Widrich
    

    View Slide

62. #adchi / #ExperimentationMindset / @DocOnDev
    managers [are] mentors
    - Kevin Goldsmith
    

    View Slide

63. #adchi / #ExperimentationMindset / @DocOnDev
    four things
    

    View Slide

64. #adchi / #ExperimentationMindset / @DocOnDev
    know your purpose; challenge assumptions
    

    View Slide

65. #adchi / #ExperimentationMindset / @DocOnDev
    make failure
    acceptable
    – Henry Ford
    “Failure is simply the opportunity to
    begin again, this time more intelligently.”
    

    View Slide

66. think big… start small… .
    

    View Slide

67. #adchi / #ExperimentationMindset / @DocOnDev
    be intolerant of mediocrity
    

    View Slide

68. #adchi / #ExperimentationMindset / @DocOnDev
    keep experimenting
    Assumptions Actions Outcomes
    Get it Right
    Explore Different Ways
    

    View Slide

69. Thank
    You!
    

    View Slide

70. #adchi / #ExperimentationMindset / @DocOnDev
    The Experimentation Mindset
    

    View Slide

71. #adchi / #ExperimentationMindset / @DocOnDev
    • Mad Scientist - https://www.flickr.com/photos/dzingeek/4587871752/
    sizes/o/
    • Stages of Growth - http://superkoopatroopa.deviantart.com/art/Terri-
    Growth-chart-125875917
    • Elephant and Mother - http://upload.wikimedia.org/wikipedia/
    commons/7/75/
    Baby_asian_elephant_(with_his_mother)_born_in_the_Lao_Elephant_
    Conservation_Center_in_Sayaboury.jpg Phone Script - http://
    www.docstoc.com/docs/6629075/Sample-Sales-Script
    • Phones -
    • http://www.enumclawsda.org/uploads/
    1/3/3/9/13391741/1971539_orig.gif?119
    • http://4.bp.blogspot.com/-qASUt2T7C7o/ULvJ8HVU3LI/
    AAAAAAAAACw/LufW5HYhCyM/s1600/Tel%C3%A8fon+fixe
    +antic.png
    • https://c2.staticflickr.com/8/7443/8758001086_2692f91620_h.jpg
    • http://cdn2.hubspot.net/hub/147894/file-270530761-jpg/images/
    phone-large.jpg
    • Mob Programming - https://techblog.betclicgroup.com/wp-content/
    uploads/2014/09/mob-programming-1-1024.jpg
    • Spotify Matrix - http://blog.kevingoldsmith.com/wp-content/uploads/
    2014/03/Screen-Shot-2013-11-09-at-7.30.08-AM-1024x644.png
    • a/b | multivariate testing - https://www.dynamicyield.com/wp-content/
    uploads/2014/05/testing.jpg
    • Hackathon - https://m2.behance.net/rendition/pm/22070355/disp/
    f4d62818fcb09d43722a945486ca5300.png
    • Things - http://41.media.tumblr.com/
    d721f204c69de1b5a6a4899429430c9e/
    tumblr_n52o0matip1snioclo1_1280.jpg, http://cdn.instructables.com/
    FIT/POMF/HKJTCKRQ/FITPOMFHKJTCKRQ.LARGE.jpg, http://
    shadowgrail.deviantart.com/art/Rock-of-Ages-83993992, http://
    vo5.deviantart.com/art/Fantastic-Four-163610854
    Images
    

    View Slide

72. #adchi / #ExperimentationMindset / @DocOnDev
    • Students Test - https://img.washingtonpost.com/rf/image_1484w/
    2010-2019/WashingtonPost/2014/09/17/Others/Images/
    2014-09-17/DSC_54171410973389.jpg?
    uuid=h6VsJD6MEeSkMLgqPme3Yg
    • Woody Zuill - https://pbs.twimg.com/media/
    A8NKQ9lCQAAdA7h.jpg
    • Code Quality (WTF) - http://www.sonarqube.org/wp-content/
    uploads/2009/09/wtfm.jpg
    • 360 Feedback - http://screencrush.com/442/files/2012/07/360-
    review.jpg
    • Test Tube - http://fc09.deviantart.net/fs70/i/2010/018/2/1/
    Vector_Test_Tube_by_Algerianoo.jpg
    • No Estimates - https://twitter.com/NoEstimates
    • Tesla - https://c2.staticflickr.com/
    4/3006/2932363100_5bf7ff5820_b.jpg
    • Smiley - https://blogs.dal.ca/csc/files/2012/07/MP900443129.jpg
    • Dilbert - http://www.stephenshapiro.com/images/dilbert-bp.gif
    • Manager’s Office - https://www.flickr.com/photos/islespunkfan/
    8281372547/sizes/l
    • Bad review - http://media.benefitspro.com/benefitspro/article/
    2014/02/06/negative%20reviews.jpg
    • Captain my Captain - http://startupeers.co/wp-content/uploads/
    2014/08/o-captain-e1407919367905.jpg
    • Vader in Suit - http://fc06.deviantart.net/fs71/f/2011/179/a/a/
    darth_vader_by_iamthedarthvader-d3k9n2h.jpg
    • League - https://oliverwillis.com/wp-content/uploads/2015/08/
    league-of-legends.jpg
    • Mentorship - http://humancapitalist.com/wordpress/wp-content/
    uploads/2013/11/canstockphoto15167410.jpg
    more images
    

    View Slide

73. #adchi / #ExperimentationMindset / @DocOnDev
    • Dreyfus Model of Skills Acquisition - http://en.wikipedia.org/
    wiki/Dreyfus_model_of_skill_acquisition, http://
    files.eric.ed.gov/fulltext/ED384695.pdf#page=130, https://
    www.dropbox.com/s/px1d5orrtjm5d5i/ADA084551.pdf?dl=0
    • Learning through experimentation - http://lifehacker.com/
    5985565/how-and-why-to-intentionally-set-yourself-up-for-
    failure
    • HBR: Collective Genius - http://hbr.org/2014/06/collective-
    genius/ar/1
    • How Organizations Learn - http://www.areteadventures.com/
    articles/the_challenge_of_entering_the_green_room.pdf
    • Argyris: Teaching Smart People how to Learn - http://hbr.org/
    1991/05/teaching-smart-people-how-to-learn/ar/1, http://
    pds8.egloos.com/pds/200805/20/87/
    chris_argyris_learning.pdf
    • Argyris: Double Loop Learning in Organizations - http://
    hbr.org/1977/09/double-loop-learning-in-organizations/ar/3
    • A/B Testing and the Experimentation Culture - https://
    hbr.org/2014/02/ab-testing-and-the-benefits-of-an-
    experimentation-culture/
    • Enlightened Experimentation - https://hbr.org/2001/02/
    enlightened-experimentation-the-new-imperative-for-
    innovation/ar/4
    • Argyris: Single-Loop and Double-Loop Learning in Research
    on Decision Making - https://
    093#1c5e28761e25b79cfc10de03f5a188778a0.googledrive
    .com/host/0B_RO2ClD0V7AZHpWRS1mNUc2d1k/argyris.pdf
    • Ed Batista Blog - http://www.edbatista.com/2008/05/double-
    loop.html
    Reference Material
    

    View Slide

74. #adchi / #ExperimentationMindset / @DocOnDev
    • Lean Change - http://www.lean.org/LeanPost/
    Posting.cfm?LeanPostId=225
    • Scaling Up Excellence - http://www.amazon.com/
    Scaling-up-Excellence-Hayagreeva-Rao-ebook/
    dp/B00EGMQIDG
    • Start With Why - http://www.amazon.com/Start-
    Why-Leaders-Inspire-Everyone-ebook/dp/
    B002Q6XUE4/
    • Leading Change - http://www.amazon.com/gp/
    product/0875847471/
    • Woody Zuill - https://twitter.com/woodyzuill, http://
    zuill.us/WoodyZuill/
    • Mob Programming and No Estimates - http://
    www.infoq.com/interviews/zuill-mob-programming
    • Democratizing Experimentation - https://hbr.org/
    2011/04/8-ways-to-democratize-experime/
    • Failing by Design - https://hbr.org/2011/04/failing-
    by-design/ar/1
    • Smart Business Experiments - https://hbr.org/
    2011/03/a-step-by-step-guide-to-smart-business-
    experiments/ar/1
    • Evidence Based Management - https://hbr.org/
    2006/01/evidence-based-management/ar/5
    more reference material
    

    View Slide

75. #adchi / #ExperimentationMindset / @DocOnDev
    • Buffer Transparency - http://
    www.fastcompany.com/3024306/bottom-
    line/why-this-startup-made-their-salaries-
    radically-transparent
    • Buffer Transparency Fail - http://
    www.fastcompany.com/3050682/lessons-
    learned/why-our-transparent-feedback-
    experiment-failed
    • Valve - https://blog.inf.ed.ac.uk/sapm/
    2014/03/14/management-at-valve-an-
    analysis-of-management-practices-at-valve-
    software/
    • Valve Handbook - https://
    www.valvesoftware.com/company/
    Valve_Handbook_LowRes.pdf
    • Spotify White Paper - https://
    dl.dropboxusercontent.com/u/1018963/
    Articles/SpotifyScaling.pdf
    • Kevin Goldsmith on Spotify - http://
    blog.kevingoldsmith.com/2014/03/14/
    thoughts-on-emulating-spotifys-matrix-
    organization-in-other-companies/
    yet more reference material
    

    View Slide