Slide 1

Slide 1 text

AI and user experience Developing AI products in 2024

Slide 2

Slide 2 text

[email protected] +358 40 7188776 @jerryjappinen Product design consultant Jerry Jäppinen

Slide 3

Slide 3 text

AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI AI

Slide 4

Slide 4 text

Intro to AI UX patterns Wrap-up Q&A

Slide 5

Slide 5 text

No content

Slide 6

Slide 6 text

No content

Slide 7

Slide 7 text

No content

Slide 8

Slide 8 text

No content

Slide 9

Slide 9 text

No content

Slide 10

Slide 10 text

No content

Slide 11

Slide 11 text

No content

Slide 12

Slide 12 text

No content

Slide 13

Slide 13 text

No content

Slide 14

Slide 14 text

No content

Slide 15

Slide 15 text

No content

Slide 16

Slide 16 text

No content

Slide 17

Slide 17 text

Would you sell this? Would you buy this? Can we productise AI technologies today?

Slide 18

Slide 18 text

What are AI technologies? Language models Image models Audio models Video models … Various types of input ⬇ Weights, embeddings ⬇ Various types of output

Slide 19

Slide 19 text

What can AI technologies do? Generate text Generate images Generate video Generate audio Manipulate text, images, video, audio Recognise patterns Scrape content Transform content Translate content Analyse natural language …

Slide 20

Slide 20 text

How do we productise? What do we need?

Slide 21

Slide 21 text

Where is the industry now? Gold rush Models are available, on-premises and cloud Some models are open-source Everyone and anyone can use them Not much technical expertise necessary You can build something in a couple of days

Slide 22

Slide 22 text

No content

Slide 23

Slide 23 text

nhost.io

Slide 24

Slide 24 text

R&D Expertise Infrastructure Cost UX Not a blocker Not a blocker Not a blocker Not a blocker ???

Slide 25

Slide 25 text

R&D Expertise Infrastructure Cost UX Not a blocker Not a blocker Not a blocker Not a blocker expectations, behaviours, beliefs, motivations, attitudes, preferences, patterns, conventions,…

Slide 26

Slide 26 text

AI and user experience

Slide 27

Slide 27 text

How do users use AI technologies?

Slide 28

Slide 28 text

No content

Slide 29

Slide 29 text

Let ’ s ask the experts

Slide 30

Slide 30 text

No content

Slide 31

Slide 31 text

We don ’ t have distinct “AI patterns” Yet I think there will be

Slide 32

Slide 32 text

No content

Slide 33

Slide 33 text

Would you talk to AI in daily life? If your entire o ff i ce suite is point-and- click?

Slide 34

Slide 34 text

Real products need to sit into existing tool landscape We interact with AI computers just like other computers

Slide 35

Slide 35 text

UX patterns Miscellaneous collection, observed by me Nothing academic or official

Slide 36

Slide 36 text

Text prompt • Very common • Microsoft Copilot, Midjourney, Notion • Similar to Spotlight, Google search

Slide 37

Slide 37 text

No content

Slide 38

Slide 38 text

Chatbot • Long sessions with back-and-forth • Expectation of memory and iteration • Amazon, ChatGPT, Gemini, Observable AI assist

Slide 39

Slide 39 text

Access to custom data ☝

Slide 40

Slide 40 text

🐣

Slide 41

Slide 41 text

“Google Maps launches a new AI” or “new chatbot”

Slide 42

Slide 42 text

Image input • Where do I get the image? • Live camera UX is different from file upload • We already have patterns for image input

Slide 43

Slide 43 text

Image to text to image https://reads.alibaba.com/ai- image-tools-ecommerce/

Slide 44

Slide 44 text

Voice

Slide 45

Slide 45 text

No content

Slide 46

Slide 46 text

No content

Slide 47

Slide 47 text

Voice • Siri, Cortana, Alexa • ChatGPT plugins, Samsung Live Translate

Slide 48

Slide 48 text

Voice • Quick responses • Clean environment • Need to concentrate • Can ’ t glance information • How to follow up? • Privacy and security?

Slide 49

Slide 49 text

VR, video, gestures

Slide 50

Slide 50 text

No content

Slide 51

Slide 51 text

No content

Slide 52

Slide 52 text

VR, video, gestures • VR has been around for a while – still difficult • We have knowledge about the UX patterns: how to avoid nausea, enable precision, interpret input • Needs specialised equipment • Libraries and APIs exist • Keeps failing on the market

Slide 53

Slide 53 text

Emerging UX patterns My emerging vocabulary specific to generative models

Slide 54

Slide 54 text

“Prompt-output”

Slide 55

Slide 55 text

“I sketch, you fi nalize” sketchlogo.ai Midjourney

Slide 56

Slide 56 text

“You sketch, I fi nalize” ➡ ??? https://reads.alibaba.com/ai-image-tools-ecommerce/

Slide 57

Slide 57 text

“Press for magic”

Slide 58

Slide 58 text

“Press for magic” 🪄 Remove background

Slide 59

Slide 59 text

“Just do it”

Slide 60

Slide 60 text

“Inform without input”

Slide 61

Slide 61 text

“No nothing”

Slide 62

Slide 62 text

What do all of these have in common?

Slide 63

Slide 63 text

Text prompt Chatbot Image input Image to text to image Voice VR Video Gestures “Prompt-output” “I sketch, you fi nalize” “You sketch, I fi nalize” “Press for magic” “Just do it” “Inform without input” “No nothing”

Slide 64

Slide 64 text

https://www.samsung.com/latin_en/support/mobile-devices/how-to-use-live-translate-for-phone- calls-on-the-galaxy-s24/#:~:text=Once%20you%20have%20set%20up,Tap%20on%20Live%20translate. https://www.youtube.com/watch?v=6LOY4KHzFOQ Check consumer expectations Many “AI products” are live for consumers already

Slide 65

Slide 65 text

User expectations are high Error tolerance is low

Slide 66

Slide 66 text

Imperfections and slow responses can be UX deal breakers AI does not excel at these

Slide 67

Slide 67 text

“Trust but verify”

Slide 68

Slide 68 text

No content

Slide 69

Slide 69 text

Productisation

Slide 70

Slide 70 text

R&D Training Infrastructure Cost UX Not a blocker Not a blocker Not a blocker Not a blocker ???

Slide 71

Slide 71 text

R&D Training Infrastructure Cost UX Not a blocker Not a blocker Not a blocker Not a blocker Not a blocker

Slide 72

Slide 72 text

You can productise AI models right now

Slide 73

Slide 73 text

R&D Training Infrastructure Cost UX Use cases Jobs to be done Value

Slide 74

Slide 74 text

Can we create something totally novel?

Slide 75

Slide 75 text

Of course. But it ’ s very di ff i cult And you will probably fail many times, like most innovators

Slide 76

Slide 76 text

Full “AI work fl ows” will still take a while Start with clearly de fi ned speci fi c tasks

Slide 77

Slide 77 text

You can manipulate bitmap images right now using image models Can we manipulate 3D fi les with these models? Maybe not with these exact models, but there ’ s a reference. Something to build on

Slide 78

Slide 78 text

What can AI technologies do? Generate text Generate images Generate video Generate audio Manipulate text, images, video, audio Recognise patterns Scrape content Transform content Translate content Analyse natural language …

Slide 79

Slide 79 text

Deliver every day End-to-end

Slide 80

Slide 80 text

AI revolution?

Slide 81

Slide 81 text

That ’ s it!

Slide 82

Slide 82 text

No content

Slide 83

Slide 83 text

[email protected] +358 40 7188776 @jerryjappinen Product design consultant Jerry Jäppinen