Slide 1

Slide 1 text

“I’m Feeling Lucky”
 Building Great Search Experiences for Today’s Users Dan Newman Director of Product Design, NPR @creativenewman Allison Shelley/NPR

Slide 2

Slide 2 text

@creativenewman #IAC19

Slide 3

Slide 3 text

@creativenewman #IAC19 From the archives: Talk of the Nation July 16, 1999 Allison Shelley/NPR

Slide 4

Slide 4 text

@creativenewman #IAC19 Think about the last time you
 searched for something online...

Slide 5

Slide 5 text

@creativenewman #IAC19

Slide 6

Slide 6 text

@creativenewman #IAC19 The specifics may change,
 but core user needs are
 remarkably consistent.

Slide 7

Slide 7 text

@creativenewman #IAC19 “Search lets users control their own destiny and assert independence from websites' attempt to direct how they use the web. Search is also users' escape hatch when they are stuck in navigation.” 
 -Jakob Nielsen, May 2001 bit.ly/nngsearch Nielsen Norman Group

Slide 8

Slide 8 text

@creativenewman #IAC19 ● Search helps when you have too much information to browse ● Search helps fragmented sites ● Search is a learning tool ● Search should be there because
 users expect it to be there ● Search can tame dynamism

Slide 9

Slide 9 text

@creativenewman #IAC19 “As the choice of first resort for many users and tasks, search is a defining element of the user experience… Unfortunately, it’s also the source of endless frustration. Search is the worst usability problem on the Web.”

Slide 10

Slide 10 text

@creativenewman #IAC19

Slide 11

Slide 11 text

@creativenewman #IAC19 PART ONE: Eight Considerations for
 Modern Search Experiences

Slide 12

Slide 12 text

@creativenewman #IAC19 1 Modern search attempts to
 provide answers, not choices.

Slide 13

Slide 13 text

@creativenewman #IAC19

Slide 14

Slide 14 text

@creativenewman #IAC19 GOOGLE NEWS YOUTUBE KNOWLEDGE GRAPH

Slide 15

Slide 15 text

@creativenewman #IAC19

Slide 16

Slide 16 text

@creativenewman #IAC19

Slide 17

Slide 17 text

@creativenewman #IAC19 2 Modern search is
 implicit in the experience.

Slide 18

Slide 18 text

@creativenewman #IAC19

Slide 19

Slide 19 text

@creativenewman #IAC19

Slide 20

Slide 20 text

@creativenewman #IAC19 3 Modern search is
 contextually-aware.

Slide 21

Slide 21 text

@creativenewman #IAC19

Slide 22

Slide 22 text

@creativenewman #IAC19

Slide 23

Slide 23 text

@creativenewman #IAC19

Slide 24

Slide 24 text

@creativenewman #IAC19

Slide 25

Slide 25 text

@creativenewman #IAC19 4 Modern search handles
 divergent use cases.

Slide 26

Slide 26 text

@creativenewman #IAC19

Slide 27

Slide 27 text

@creativenewman #IAC19

Slide 28

Slide 28 text

@creativenewman #IAC19

Slide 29

Slide 29 text

@creativenewman #IAC19

Slide 30

Slide 30 text

@creativenewman #IAC19 5 Modern search is built on
 high-quality metadata.

Slide 31

Slide 31 text

@creativenewman #IAC19

Slide 32

Slide 32 text

@creativenewman #IAC19

Slide 33

Slide 33 text

@creativenewman #IAC19 (…metadata that is
 meaningful to your users.)

Slide 34

Slide 34 text

@creativenewman #IAC19

Slide 35

Slide 35 text

@creativenewman #IAC19 “A Taxonomist, a Software Engineer, and a UX Researcher Walk
 Into a Bar: Bridging AI and User Experience Methods at Etsy“ Gio Kincade, Jenny Benevento, & Jill Fruchter, IA Summit 2017 bit.ly/etsyias17

Slide 36

Slide 36 text

@creativenewman #IAC19 “A Taxonomist, a Software Engineer, and a UX Researcher Walk
 Into a Bar: Bridging AI and User Experience Methods at Etsy“ Gio Kincade, Jenny Benevento, & Jill Fruchter, IA Summit 2017 bit.ly/etsyias17

Slide 37

Slide 37 text

@creativenewman #IAC19 6 Modern search
 guides users to success.

Slide 38

Slide 38 text

@creativenewman #IAC19

Slide 39

Slide 39 text

@creativenewman #IAC19

Slide 40

Slide 40 text

@creativenewman #IAC19

Slide 41

Slide 41 text

@creativenewman #IAC19 (“What can I ask?”)

Slide 42

Slide 42 text

@creativenewman #IAC19

Slide 43

Slide 43 text

@creativenewman #IAC19

Slide 44

Slide 44 text

@creativenewman #IAC19

Slide 45

Slide 45 text

@creativenewman #IAC19

Slide 46

Slide 46 text

@creativenewman #IAC19

Slide 47

Slide 47 text

@creativenewman #IAC19

Slide 48

Slide 48 text

@creativenewman #IAC19 7 Modern search adapts
 to all form factors.

Slide 49

Slide 49 text

@creativenewman #IAC19 “Think with Google: In-App Search“ bit.ly/google-in-app

Slide 50

Slide 50 text

@creativenewman #IAC19

Slide 51

Slide 51 text

@creativenewman #IAC19

Slide 52

Slide 52 text

@creativenewman #IAC19 Andres Urena/Unsplash

Slide 53

Slide 53 text

@creativenewman #IAC19 8 Modern search involves
 human curation.

Slide 54

Slide 54 text

@creativenewman #IAC19

Slide 55

Slide 55 text

@creativenewman #IAC19 Current Behavior

Slide 56

Slide 56 text

@creativenewman #IAC19 Serial Host Sarah Koenig Says She Set Out To Report, Not… fresh air Dec 23, 2014 45 min 21 sec Wait Show/Podcast Title Food General Topic/Series Obama Keywords (organic search) Ari People Podcast ‘Podcast’ Egypt’s Citizens Still Wait ‘To Breathe Deep The Air Of… weekend edition saturday Saturday 2 min 47 sec Waiting For A Break: Obama On ‘Strategic Patience’ In… morning edition From Wait Wait… Don’t Tell Me! Best of 2014 Part Two Saturday 49 min 30 sec Best of 2014 Part One Dec 27, 2014 49 min 30 sec Jenny Slate Dec 20, 2014 49 min 44 sec More about this show Beyond Free Lunch: Schools Open Food Pantries For Hungry all things considered Stories About Food More from this topic Wait Wait… Don’t Tell Me! Best of 2014 Part Two Saturday 49 min 30 sec Best of 2014 Part One Dec 27, 2014 49 min 30 sec Jenny Slate Dec 20, 2014 49 min 44 sec Wait Wait... Don't Tell Me! is NPR's weekly hour-long quiz program. Each week on the radio you can test your knowledge against some of the best and brightest in the news and entertainment world while figuring out what's real news and what's made up. recent episodes: Sir Patrick Stewart Dec 13, 2014 49 min 46 sec Dan Barber: Can Organic Farming Make Perfect Fish? ted radio hour Today, 8:51 AM 9 min 44 sec On His 80th Birthday, Shake It Like Elvis With A Milkshake the salt Yesterday 2 min 41 sec How Anglers Are Learning To Save Fish That Get ‘The Bends’ the salt Tuesday 4 min 28 sec Stories about Food Dan Barber: Can Organic Farming Make Perfect Fish? ted radio hour Today, 8:51 AM 9 min 44 sec On His 80th Birthday, Shake It Like Elvis With A Milkshake the salt Yesterday 2 min 41 sec How Anglers Are Learning To Save Fish That Get ‘The Bends’ the salt Tuesday 4 min 28 sec A Cure For The Common Hangover, Found On The Stove found recipes Dec 21, 2014 2 min 31 sec For normal organic results (like those above): • Use ‘best match’ results from GSA, but move ALL results from the past 24 hours to the top (as GSA doesn’t alway appropriately position new stories due to lack of page rank). • Exclude any duplicate results that appear in a featured pod (like show title pod or topic pods at left). • Use infinite scroll to continue loading more as the user scrolls. Obama In Tennessee To Promote Free Community College morning edition Today, 3:25 AM 3 min 20 sec A ‘Sizable Decrease’ In Those Passing the GED morning edition Today, 3:26 AM 3 min 48 sec Obama, GOP To Face Off Over Keystone XL Pipeline morning edition Yesterday 5 min 1 sec Compressional Republicans Take Another Swing At Obamacare morning edition Yesterday 3 min 46 sec A London Tube Dream Ride, In The Driver’s Cab weekend edition sunday Stories By Ari Shapiro More by Ari The Theater Company Is 1927; The Technology Is Cutting Edge parallels Jan 5, 2015 3 min 31 sec High-Tech Tools Help Irish Dairy Farmers Produce More Milk business Jan 2, 2015 3 min 46 sec London’s Morning Gloryville Starts Sunrise Rave Trend europe Jan 1, 2014 3 min 49 sec News Magazine Searches Morning Edition Ari Shapiro Ari Shapiro is an NPR international correspondent based in London. An award-winning journalist, his reporting covers a wide range of topics and can be heard on all of NPR's national news programs, including Morning Edition and All Things Considered. More… recent stories: The Theater Company Is 1927; The Technology Is Cutting Edge parallels Jan 5, 2015 3 min 31 sec High-Tech Tools Help Irish Dairy Farmers Produce More Milk business Jan 2, 2015 3 min 46 sec London’s Morning Gloryville Starts Sunrise Rave Trend europe Jan 1, 2014 3 min 49 sec Morning Edition Boko Haram Uses Girls As Suicide Bombers, Reports Say Today, 4:59 AM 2 min 52 sec Every weekday for over three decades, Morning Edition has taken listeners around the country and the world with multi-faceted stories and commentaries that inform, challenge and occasionally amuse. Morning Edition is the most listened-to news radio program in the country. today’s stories: Terror Attacks Stun France, Millions Turn Out For Sunday Today, 4:59 AM 3 min 8 sec In Haiti, Politics And An Earthquake Anniversary Collide Today, 4:59 AM 4 min 5 sec From Morning Edition More about this show Boko Haram Uses Girls As Suicide Bombers, Reports Say Today, 4:59 AM 2 min 52 sec Terror Attacks Stun France, Millions Turn Out For Sunday Today, 4:59 AM 3 min 8 sec In Haiti, Politics And An Earthquake Anniversary Collide Today, 4:59 AM 4 min 5 sec So you know… We always include stories from Morning Edition as part of your NPR One flow. Just hit play to get the day’s news, tailored for you. Current Behavior So you know… We always include podcasts that we think you’ll like as part of your NPR One flow. You can also search for podcasts by title, or browse recommended episodes in ‘Suggestions’ Blurbs (for people, podcasts, and shows) will need to be truncated for display in the app, with the ability to reveal all (just like the updated bio pages on NPR.org). To discuss: what actions should be available at a show level? How to reveal actions at a story level in list views? Bored … And Brilliant? A Challenge To Disconnect all tech considered Yesterday 5 min 47 sec Podcasts Rise In Popularity, Funded By Advertisers digital life Nov 30, 2014 4 min 10 sec Consider disabling button user has already hear the most recent newscast, and replace text wit ‘You’ve already heard the most recent newscast Organic results should always follow custom pods, even in cases where we suspect that most users aren’t looking for the organic results. Therefore, we don’t break the experience for those who truly want news about a given topic. Message should be tappable directly to Suggestions view

Slide 57

Slide 57 text

@creativenewman #IAC19 1 2 3 4 5 6 7 8 Modern search… … is implicit in the experience. … attempts to provide answers, not choices. … is contextually-aware. … handles divergent
 use cases. … guides users to
 success. … is built on high-
 quality metadata. … adapts to all
 form factors. … involves
 human curation.

Slide 58

Slide 58 text

@creativenewman #IAC19 Fundamentally, modern search requires you to actually care
 about your users.

Slide 59

Slide 59 text

@creativenewman #IAC19 (don’t be like Ron)

Slide 60

Slide 60 text

@creativenewman #IAC19 PART TWO: Building a Modern Search Experience at NPR

Slide 61

Slide 61 text

@creativenewman #IAC19

Slide 62

Slide 62 text

@creativenewman #IAC19

Slide 63

Slide 63 text

@creativenewman #IAC19

Slide 64

Slide 64 text

@creativenewman #IAC19

Slide 65

Slide 65 text

@creativenewman #IAC19

Slide 66

Slide 66 text

@creativenewman #IAC19

Slide 67

Slide 67 text

@creativenewman #IAC19 User expectations have changed. We need to change with them.

Slide 68

Slide 68 text

@creativenewman #IAC19

Slide 69

Slide 69 text

@creativenewman #IAC19

Slide 70

Slide 70 text

@creativenewman #IAC19

Slide 71

Slide 71 text

@creativenewman #IAC19

Slide 72

Slide 72 text

@creativenewman #IAC19

Slide 73

Slide 73 text

@creativenewman #IAC19

Slide 74

Slide 74 text

@creativenewman #IAC19 And this is just the beginning.

Slide 75

Slide 75 text

@creativenewman #IAC19 How do you know
 if it’s working?

Slide 76

Slide 76 text

@creativenewman #IAC19 Does it pass the sniff test?

Slide 77

Slide 77 text

@creativenewman #IAC19

Slide 78

Slide 78 text

@creativenewman #IAC19

Slide 79

Slide 79 text

@creativenewman #IAC19

Slide 80

Slide 80 text

@creativenewman #IAC19 How’s it going now?

Slide 81

Slide 81 text

@creativenewman #IAC19

Slide 82

Slide 82 text

@creativenewman #IAC19 PART THREE: What Comes Next?

Slide 83

Slide 83 text

@creativenewman #IAC19

Slide 84

Slide 84 text

@creativenewman #IAC19 Machine Learning:
 It’s not coming to save us Allison Shelley/NPR

Slide 85

Slide 85 text

@creativenewman #IAC19 Voice UI: Answers instead of choices Eric Lee/NPR

Slide 86

Slide 86 text

@creativenewman #IAC19 No facets, no filters,
 limited refinements.

Slide 87

Slide 87 text

@creativenewman #IAC19 What choices do we really
 need our user to make?

Slide 88

Slide 88 text

@creativenewman #IAC19 A high premium on precision,
 and low tolerance for weak results.

Slide 89

Slide 89 text

@creativenewman #IAC19 AR/VR: Inputless querying Photo: NPR

Slide 90

Slide 90 text

@creativenewman #IAC19 Traditional search is “user inputs text”. 
 Voice search is “user says something that turns into text (hopefully correctly)”. 
 AR/VR search might be “user looks at something; we implicitly turn that action into an intent that we turn into text”.

Slide 91

Slide 91 text

@creativenewman #IAC19 IN CONCLUSION: A Few Parting Thoughts

Slide 92

Slide 92 text

@creativenewman #IAC19 Work to understand user intent. (That probably means
 talking to your users)

Slide 93

Slide 93 text

@creativenewman #IAC19 You know your content
 better than Google does.

Slide 94

Slide 94 text

@creativenewman #IAC19 Refine your results.
 Test in context.

Slide 95

Slide 95 text

@creativenewman #IAC19 Search is a verb, not a noun.

Slide 96

Slide 96 text

@creativenewman #IAC19 Don’t forget that this still matters.

Slide 97

Slide 97 text

@creativenewman #IAC19 Nina Totenberg
 NPR “Founding Mother” and
 Legal Affairs Correspondent

Slide 98

Slide 98 text

@creativenewman #IAC19 Thank you. Dan Newman Director of Product Design @creativenewman dnewman@npr.org