Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Designing and Evaluating Behaviour Change Technologies for and in the Real World

Designing and Evaluating Behaviour Change Technologies for and in the Real World

Talk given at the World Usability Day 2016 event in Tallinn, Estonia

Evangelos Karapanos

November 10, 2016
Tweet

More Decks by Evangelos Karapanos

Other Decks in Research

Transcript

  1. Designing and Evaluating Behaviour Change
    Technologies for and in the Real World
    1200
    steps
    Evangelos Karapanos

    View Slide

  2. 1200
    steps
    Designing for Experience
    How can technology provide a pleasurable
    experience?
    1940s

    View Slide

  3. 1979 Apple II

    Designing for Usability
    1979 VisiCalc - “killer
    app” for Apple II
    1981 IBM XT/AT

    1980s

    View Slide

  4. Designing for Experience
    How can technology provide a pleasurable
    experience?
    2000s

    View Slide

  5. Designing for Wellbeing
    How can technology have a positive impact on
    people’s lives?

    View Slide

  6. 1200
    steps
    Personal informatics
    tools that helps us track our behaviours,
    emotions, thoughts

    View Slide

  7. Physical activity

    View Slide

  8. Finances

    View Slide

  9. Time

    View Slide

  10. 1200
    steps
    Behaviour Change Technologies

    View Slide

  11. 1200
    steps
    Health
    Human behaviour a key predictor over the
    long-term

    View Slide

  12. 1200
    steps
    Diabetic patients skip their insulin
    medication 25% of the time
    25,000 people a year go blind 

    Hundreds of thousands lose limbs, every year,
    for something that's solvable.

    View Slide

  13. 1200
    steps
    Physical Activity
    Over 80% of the world's adolescent
    population is insufficiently physically active.
    Insufficient PA is a key risk factor for
    noncommunicable diseases (NCDs) such as
    cardiovascular diseases, cancer and diabetes.

    View Slide

  14. 1200
    steps
    NC (chronic) diseases account for 40% of
    mortality cases and 75% of health care costs
    worldwide. Estimated increase of 42% by 2023.

    View Slide

  15. 1200
    steps
    From cure to prevention
    Gordon Brown: ”NHS [National Health Service] of
    the future [being] one of patient power, with
    patients engaged and taking control over their
    own health and healthcare".

    View Slide

  16. 1200
    steps

    View Slide

  17. How to design for Behaviour Change

    View Slide

  18. Theoretically and Empirically grounded
    design

    View Slide

  19. Theoretically grounded design

    View Slide

  20. Evidence-based Behaviour Change Techniques
    Michie et al. (2013)

    View Slide

  21. The simple acts of measuring one's target
    behavior and comparing it to an external
    standard or goal can result in lasting
    improvements to that behavior.
    Self-monitoring

    View Slide

  22. –Johnny Appleseed
    self-monitoring

    View Slide

  23. Self-setting specific, proximal, and
    difficult goals results in increased
    performance
    Goal Setting Theory

    View Slide

  24. 1200
    steps

    View Slide

  25. Empirically grounded design

    View Slide

  26. Do our assumptions hold?

    View Slide

  27. Evaluating technologies in the wild
    Interaction logs Wearable cameras
    Experience
    Sampling
    Interaction logs

    View Slide

  28. Evaluating technologies in the wild
    Interaction logs Wearable cameras
    Experience
    Sampling
    Wearable cameras

    View Slide

  29. Evaluating technologies in the wild
    Interaction logs Wearable cameras
    Experience
    Sampling
    Experience sampling

    View Slide

  30. Evaluating technologies in the wild
    Interaction logs Wearable cameras
    Experience
    Sampling
    Interaction logs

    View Slide

  31. Habito
    !! !

    View Slide

  32. goal setting

    View Slide

  33. historical data

    View Slide

  34. informational and
    persuasive messages

    View Slide

  35. 256 users downloaded Habito over
    the course of 10 months
    none of these users were recruited or rewarded towards usage

    View Slide

  36. How can we design glanceable feedback?

    View Slide

  37. Do our assumptions hold?

    View Slide

  38. 1. Designed for all?

    View Slide

  39. stages of behavior change
    questionnaire
    understanding how different stages of ‘readiness’ impacted adoption
    precontemplation currently have no intention of being active
    contemplation not active but intend to be soon
    preparation trying, but not regularly active
    action regularly active, but for less than 6 months
    maintenance regularly active for 6 months or more

    View Slide

  40. precontemplation
    5 of 36, 14%
    contemplation
    preparation
    action
    maintenance
    14 of 26, 54%
    19 of 33, 58%
    7 of 24, 29%
    4 of 19, 21%
    Readiness for use:
    motivation and adoption

    View Slide

  41. 2. Goal setting… or, accepting?

    View Slide

  42. Self-setting specific, proximal, and difficult
    goals results in increased performance
    Goal Setting Theory

    View Slide

  43. Self-setters walked more

    View Slide

  44. Self-setters were only 31% of users
    The rest just accepted the preset goal

    View Slide

  45. 3. Behaviour change through
    Knowledge or self-regulation?

    View Slide

  46. Usage sessions
    historical information was only accessed
    in 30% of all usage sessions
    even more, 87% of these concerned an ongoing day

    View Slide

  47. Glances
    sessions in which users open and
    close Habito with no additional
    actions or inputs
    57%, 5 sec
    Review Engage
    22%,12 sec 21%,45 sec
    sessions with at least one
    additional actions and last
    up to 22 seconds
    sessions with at least one
    additional actions and last
    more than 22 seconds
    Usage sessions

    View Slide

  48. Glances
    73%
    Review Engage
    18% 9%
    Usage sessions

    View Slide

  49. View Slide

  50. participants were more
    likely to initiate a new walk
    when seeing a low number
    of steps in the last hour

    View Slide

  51. participants were more
    likely to initiate a new walk
    when seeing a low number
    of steps in the last hour
    Participants who saw they walked
    10 min or less over the past hour
    had a 77% chance of starting a
    new walk in the next 5 min

    View Slide

  52. Dual process theory
    System 1 - automatic mind (intuition)
    System 2 - rational mind (analytical reasoning)

    View Slide

  53. 94% (165 of 176) systems designed
    for the rational mind
    Adams et al., 2015

    View Slide

  54. Behaviour change through
    Knowledge or self-regulation?

    View Slide

  55. 4. Unexpected things are to be expected

    View Slide

  56. participants were more likely to initiate a new
    walk when closely ahead or behind of
    others

    View Slide

  57. Hidden costs of self-monitoring
    While self-monitoring led to short-term increase
    in steps, it also lead to a decrease in
    enjoyment of walking
    Etkin (2015)

    View Slide

  58. Overjustification effect
    When extrinsic motivations overshadow
    intrinsic ones

    View Slide

  59. No matter how theoretically grounded your design is
    test it in real life!

    View Slide

  60. No matter how theoretically grounded your design is
    test it in real life!

    View Slide

  61. Question what your assumptions are, about
    how people will use your product

    View Slide

  62. Question what your assumptions are, about
    how people will use your product
    Thank you
    Evangelos Karapanos

    View Slide

  63. http://persuasive.cut.ac.cy/

    View Slide