Upgrade to Pro — share decks privately, control downloads, hide ads and more …

ADDC 2019 - Matthew Eng - Everyone Does Research: A Case Study on Inclusive Qualitative Research Methods for Product Teams at IBM.

ADDC 2019 - Matthew Eng - Everyone Does Research: A Case Study on Inclusive Qualitative Research Methods for Product Teams at IBM.

IBM Design’s mission was to shift how it approached product strategy, but it led to friction between multidisciplinary teams grasping for a unified vision. Learn lessons from assembling a research team that broke bad data analysis habits and started inclusive generative and evaluative techniques. When I started doing UX research as a designer, we often felt our work and results were ignored by developers, architects, and product managers. After a series of stressful releases full of heated arguments between our multidisciplinary teams, I invested the post-release downtime to better understand the questions sought by the whole team. This lead to reorganizing the research, so that we conducted to include design, product management, and development. The research team gathered and surfaced data that each of the disciplines where focusing on separately to help construct a clearer direction for the product.

Recordings & more: https://addconf.com/

More Decks by ADDC - App Design & Development Conference

Other Decks in Technology

Transcript

  1. Research is the Glue
    Inclusive techniques to share data
    @engmatthew

    View full-size slide

  2. IBM Design
    @engmatthew
    2
    @engmatthew

    View full-size slide

  3. !3
    @engmatthew

    View full-size slide

  4. I do UX design and research
    @engmatthew

    View full-size slide

  5. We like to think
    that invention
    comes as a
    flash of insight
    -Vaclav Smil

    @engmatthew

    View full-size slide

  6. Allowing one person to
    believe that he or she is a
    vessel for creativity and
    (innovation) is too much
    responsibility.

    @engmatthew
    -Elizabeth Gilbert

    View full-size slide

  7. It can also be
    beneficial to
    create a mashup
    of skills and
    duties
    -Lauren Marchese

    @engmatthew

    View full-size slide

  8. Everyone can contribute to research
    Research can work in Agile environments
    Research must facilitate data inclusion
    @engmatthew

    View full-size slide

  9. @engmatthew
    Not every can lead a research project
    Not all research can fit into agile sprints

    View full-size slide

  10. How we work
    @engmatthew

    View full-size slide

  11. Squads
    Embedded Research
    !22
    Research
    PM
    Dev
    @engmatthew
    Design

    View full-size slide

  12. Accounts
    Embedded Research
    !23
    Research
    PM
    Dev
    @engmatthew
    Design
    Access

    View full-size slide

  13. Qualitative
    !24
    @engmatthew

    View full-size slide

  14. !25
    @engmatthew

    View full-size slide

  15. !26
    @engmatthew

    View full-size slide

  16. Navigation Case Study
    @engmatthew

    View full-size slide

  17. Tokyo Station Yoyogi Park
    @engmatthew

    View full-size slide

  18. !33
    @engmatthew

    View full-size slide

  19. Accounts
    Help
    Docs
    Network
    Containers
    DevOps
    Security
    Compute
    AI
    @engmatthew

    View full-size slide

  20. Accounts
    Help
    Docs
    Network
    Containers
    DevOps
    Security
    AI
    Help and Assistance
    Network
    Compute
    VM
    Bare Metal
    Storage
    Compute
    Security
    Learn
    @engmatthew

    View full-size slide

  21. Customer 1 Customer 2 Customer 3 Customer 4
    !36
    @engmatthew

    View full-size slide

  22. Green Olive Tree Avnet
    Indeed Ogilvy
    Arrow
    Kollacode
    Customer 1 Customer 2 Customer 3
    Customer 4 Customer 5 Customer 6
    37

    View full-size slide

  23. Seems like it is laid out by lines of business
    in IBM. Not necessarily the way I would
    architect an app

    !38
    -Customer
    @engmatthew

    View full-size slide

  24. IBM is currently dealing with a major rebranding exercise which is
    hurting its positioning. It is in the process of phasing out the SoftLayer
    and Bluemix brands
    !39

    -Forbes
    @engmatthew

    View full-size slide

  25. Reflections
    @engmatthew

    View full-size slide

  26. 41
    Design
    PM
    Dev
    Discovery Validation Implementation
    Process
    How we worked together
    @engmatthew

    View full-size slide

  27. 42
    Design
    PM
    Dev
    Discovery Validation Implementation
    Process
    How we worked together
    Research
    @engmatthew
    Customer and
    user interviews

    View full-size slide

  28. 43
    Design
    PM
    Dev
    Discovery Validation Implementation
    Process
    How we worked together
    Research
    Analytic Trends
    Competition Adoption
    and Tickets
    @engmatthew

    View full-size slide

  29. 44
    Design
    PM
    Dev
    Discovery Validation Implementation
    Process
    How we worked together
    Research
    Analyst
    NPS Feedback
    New Shining Thing
    @engmatthew
    Leadership

    View full-size slide

  30. Changes
    @engmatthew

    View full-size slide

  31. 46
    Design
    PM
    Dev
    Discovery Validation Implementation
    Process
    How we worked together
    @engmatthew
    Research Customer and
    user interviews

    View full-size slide

  32. 47
    Design
    PM
    Dev
    Discovery Validation Implementation
    Process
    How we want to work together
    Research
    @engmatthew
    Who are our
    users?
    Will this make
    sense for them?
    How is this
    performing in
    the wild?

    View full-size slide

  33. 50%
    marketing content
    (benefits + overview)
    50%
    technical content
    (features + use cases)
    marketing content
    (benefits with
    marketing tone)
    100%
    Technical content
    (benefits with technical
    tone + features + use
    cases)
    60%
    Pricing Info
    30%
    Marketing content
    5%
    Documentation
    5%
    Marketing
    Technical
    Pricing
    Docs
    Competitive Analysis
    How is your competition
    addressing the problem space?

    View full-size slide

  34. Heuristic Evals
    Guide your teams through end-
    to-end heuristic evals to get
    away from individual screens
    and more focused on goals,
    tasks, and subtasks.

    User one language for heuristic
    principles.

    View full-size slide

  35. Test Prep
    Write the steps and tasks
    together. Show where design,
    PM, and dev have questions,
    and possible variations.

    Align on what we are asking
    users to do and what metrics
    we are going to capture.

    View full-size slide

  36. Open up the testing sessions
    @engmatthew

    View full-size slide

  37. Open up the synthesis
    @engmatthew

    View full-size slide

  38. 56
    @engmatthew

    View full-size slide

  39. Takeaways
    @engmatthew

    View full-size slide

  40. Find what your team needs

    View full-size slide

  41. Invest time in an open process

    View full-size slide

  42. Q/A
    !61
    @engmatthew

    View full-size slide

  43. Thank you
    !62
    @engmatthew

    View full-size slide