Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Designing with words: Creating conversational experiences

uxaustralia
August 11, 2017

Designing with words: Creating conversational experiences

OK Google, make my UX Australia presentation… (“Showing results for mix-up Australia”)
Alexa, make my UX Australia presentation… (“Do you want to visit Australia?”)
Siri, tell Google or Alexa to make my UX Australia presentation… (“That may be beyond my abilities at the moment”)
Fine – I’ll do it the old-fashioned way.

For thirteen years, Boomworks has been focused on designing and delivering amazing digital experiences. As a user-centred design practice, if people move to a new device or platform we have to understand how they are using it to achieve their everyday goals.

For the last eight months Boomworks has been developing their intelligent conversational platform and have figured out how to re-tool our own design thinking process to approach experiences that exist entirely in text and by extension, voice.

A conversational interface enables a person to interact with a computer using natural language, either via text or voice. Thanks to the advancements in artificial intelligence, machine learning and natural language processing we are now able to design ways to interact with systems and services in a more human way.

From the context of what we have learned through this development process along with designing conversational interfaces for a number of clients, I will explore how we define a conversational experience, delving into issues relating to who is in control of the conversation you are designing - the system or your user and how to recognise when you are losing control of the conversation. And just as importantly, what to do when that happens.

With design processes now more entrenched in product and service delivery businesses my objective with this presentation is to help arm designers with some essential knowledge and practices to ensure we make the most of this opportunity and strive to raise the level of conversation.

Presented by Grant Klein at UX Australia 2017

uxaustralia

August 11, 2017
Tweet

More Decks by uxaustralia

Other Decks in Design

Transcript

  1. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Designing with Words Creating conversational experiences Grant Klein @drsymul
  2. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    hi I don’t think they heard you. Hi!
  3. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    hi I don’t think they heard you. Hi! Grant Klein
  4. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    If it’s good enough for Captain Kirk.
  5. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Did people even know what a wireframe was back then? 2004
  6. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Did people even know what a wireframe was back then? Not really
  7. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Experience Intelligence He’s talking about me! I’m BBX!
  8. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Experience Intelligence You’re making me blush…
  9. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    The written and spoken word. How do we design for what’s left?
  10. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    The written and spoken word. How do we design for what’s left? QWERTY ftw, yo!
  11. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    SAY BOT ONE MORE TIME…. SAY BOT ONE MORE TIME…. Thx: Dharmesh Shah, HubSpotLabs I DARE YOU! I DOUBLE DARE YOU! I DARE YOU! I DOUBLE DARE YOU!
  12. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Conversational Interfaces You appear to be writing a letter
  13. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Conversational Interfaces You appear to be writing a letter 2010 - Hey Siri 2012 - OK Google 2015 - Alexa!
  14. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Conversational Interfaces 2016 - Cortana In space With guns You appear to be writing a letter
  15. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Conversational Interfaces 2016 - Facebook Messenger bots 2017 - Apple Homepod 2017 - Google Home
  16. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Conversational Interfaces 2016 - Facebook Messenger bots 2017 - Apple Homepod 2017 - Google Home All the things be chatting
  17. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Artificial Intelligence I can be made to think like you
  18. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Artificial Intelligence I can be made to think like you Machine Learning
  19. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Artificial Intelligence I can be made to think like you Machine Learning I think I know what you’re thinking
  20. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Artificial Intelligence I can be made to think like you Machine Learning I think I know what you’re thinking NLP / NLU
  21. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Artificial Intelligence I can be made to think like you Machine Learning I think I know what you’re thinking NLP / NLU I can hear you talking about me
  22. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Sounds like I need a scientist, not a designer
  23. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Sounds like I need a scientist, not a designer Why do we need conversational design?
  24. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Sounds like I need a scientist, not a designer Why do we need conversational design?
  25. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Sounds like I need a scientist, not a designer Why do we need conversational design? I’m pretty sure that’s not what that means.
  26. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Sounds like I need a scientist, not a designer Why do we need conversational design? Friction and Ambiguity
  27. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Sounds like I need a scientist, not a designer Why do we need conversational design? Friction and Ambiguity I love audience participation.
  28. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Sounds like I need a scientist, not a designer Why do we need conversational design? Friction and Ambiguity I love audience participation. I’ll go first…
  29. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Why do we need conversational design?
  30. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Expectations shape the conversational experience. Why do we need conversational design?
  31. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Expectations shape the conversational experience. Why do we need conversational design? The 4 critical parts of the design process.
  32. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    The 4 critical parts of the design process. Conversational Design is like…
  33. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    The 4 critical parts of the design process. Conversational Design is like… …the first time you meet the parents of your partner.
  34. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    The 4 critical parts of the design process. 1. Only meet them if you have to.
  35. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    The 4 critical parts of the design process. 1. Only meet them if you have to. 2. What are you meeting them for?
  36. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    The 4 critical parts of the design process. 1. Only meet them if you have to. 2. What are you meeting them for? 3. Use words they understand.
  37. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    3. Use words they understand. The 4 critical parts of the design process. 1. Only meet them if you have to. 2. What are you meeting them for? 4. Know how to get out of there.
  38. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    1. Only meet them if you have to. If you did, we can chat after this talk.
  39. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Recipient Design "By recipient design we refer to a multitude of respects in which the talk by a party in a conversation is constructed or designed in ways which display an orientation and sensitivity to the particular other(s) who are the co-participants." Sacks, H. & Schegloff, E. A simplest systematics for the organization of turn-taking for conversation
  40. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Recipient Design UX translation, please?
  41. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Recipient Design UX translation, please? Human Centred Design - put human needs first.
  42. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Recipient Design UX translation, please? Human Centred Design - put human needs first. Do we need a bot for this?
  43. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Recipient Design UX translation, please? Human Centred Design - put human needs first. Do we need a bot for this? What job does the bot need to get done?
  44. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Occam’s Razor Minimisation Simple is better.
  45. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Minimisation Occam’s Razor Simple is better. Minimise cognitive load
  46. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    1. Only meet them if you have to. 2. What are you there for?
  47. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    1. Only meet them if you have to. 2. What are you there for? This is the role of on-boarding.
  48. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    1. Only meet them if you have to. 2. What are you there for? This is the role of on-boarding. Audience participation time again!
  49. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    You wouldn't ask a hotdog vendor for veterinary advice
  50. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    2. What are you there for? This is the role of on-boarding. That’s what I’m here for.
  51. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    3. Use Words They Understand They’re like olden-day Uber drivers.
  52. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    They’re like olden-day Uber drivers. 3. Use Words They Understand The best input method is situational
  53. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    They’re like olden-day Uber drivers. 3. Use Words They Understand The best input method is situational Don’t look at me.
  54. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    They’re like olden-day Uber drivers. 3. Use Words They Understand The best input method is situational Don’t look at me. Context really matters
  55. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Can I make an appointment for tomorrow afternoon?
  56. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Can I make an appointment for tomorrow afternoon? The doctor can see you on Saturday at 2pm. Is that OK?
  57. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Can I make an appointment for tomorrow afternoon? The doctor can see you on Saturday at 2pm. Is that OK? That’s great
  58. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Can I make an appointment for tomorrow afternoon? The doctor can see you on Saturday at 2pm. Is that OK? That’s great I’ll book that in for you.
  59. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Can I make an appointment for tomorrow afternoon? That’s great Thanks The doctor can see you on Saturday at 2pm. Is that OK? I’ll book that in for you.
  60. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Is this appointment related to your rash from last week?
  61. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Is this appointment related to your rash from last week? The best input method is situational
  62. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Multilingual Vision processing Episodic memory Advanced awesomeness:
  63. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    4. Know How to Get Out of There Win by failing, gracefully.
  64. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    4. Know How to Get Out of There Win by failing, gracefully. Fish – 9 def Humans - 8
  65. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Rephrase the question Failing gracefully.
  66. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Rephrase the question Failing gracefully. Intelligent handover
  67. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Rephrase the question Failing gracefully. Intelligent handover Small talk
  68. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Rephrase the question Failing gracefully. Intelligent handover Small talk 4. Know How to Get Out of There
  69. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    The 4 critical parts of the design process. 1. Only meet them if you have to. 2. What are you meeting them for? 3. Use words they understand. 4. Know how to get out of there.
  70. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Where to from here? Internet of 1997 is like conversational experiences in 2017.
  71. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Where to from here? Internet of 1997 is like conversational experiences in 2017. It’s responsive design, for a conversation.
  72. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Dave, this conversation can serve no purpose anymore.
  73. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Dave, this conversation can serve no purpose anymore. Goodbye…
  74. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Your turn to answer some questions, Grant
  75. Designing with Words 100% 9:41 AM UX Australia 2017 @drsymul

    Designing with Words Creating conversational experiences Grant Klein @drsymul