It_Takes_a_Village_to_Raise_a_Bot.pdf

Artificial intelligence is still a mysterious topic in the industry, with the cult of the machine learning engineer at its core. But in practice, to build a conversational experience, for example, it takes several to tango.

Transcript

1. It takes a village Desiree García @thedezzie to raise a bot
3. "Information is only useful when it can be understood." - Muriel Cooper
4. Conversational systems as an embodiment of emerging AI
5. "Just add water"
6. "For example, a percentile of 0.64980796071382 for the personality characteristic big5_extraversion indicates that the author's score for that characteristic is in the 65th percentile. The author's writing exhibits the tendency to an extent that is greater than 64 percent and less than 34 percent of the sample population."
8. Your choices are driven by a desire for well-being. You consider both tradition and independence to guide a large part of what you do. You highly respect the groups you belong to and follow their guidance. And you like to set your own goals to decide how to best achieve them.
9. "One size fits all"
12. Engineers couldn't do it alone.
13. Why do people want conversational systems?
14. “Don’t play what’s there, play what’s not there.” - Miles Davis
15. Machines still have a hard time with language http://bit.ly/ai-language-problems
16. Simple conversational systems that are great
18. Complex conversational systems that are great
22. Time + Money
23. Is it convincing?
24. Is it convincing effective?
25. Content first
26. Content last
27. Scale
28. Time + Money
29. http://www.r2d3.us/ .
30. . Introduction Entities Intents Dialog builder Condition Watson responses 20 No conditions set We got ya down for a $topping pizza. Order pizza flow and some … Anything else Conversation starts Condition Watson responses 20 No conditions set We got ya down for a $topping pizza. Order pizza flow and some … Condition Watson responses (0) #greeting No responses added #greeting Edit
31. . @restaurant @location @cuisine
32. Content matters, because training matters
33. . . @restaurant @location @cuisine #recommend
34. "In just minutes a day"
35. . Getting people to train a conversational system is as easy as getting people to start exercising
36. 1. Deploy your conversational system app 2. Assess its performance using human judgment 3. Optimize its operating thresholds 4. Retrain machine learning model with golden examples from humans 5. Lather, rinse, repeat
37. 1. Deploy your conversational system app 2. Assess its performance using human judgment 3. Optimize its operating thresholds 4. Retrain machine learning model with golden examples from humans 5. Lather, rinse, repeat
38. . . . @restaurant @location @cuisine #recommend
39. "Shut it down, shut it down!"
41. In AI, *everyone* is learning as they go along
42. So we did some research.
43. They worked together.
44. domain expert data scientist sme ux designer content strategist developer business
45. domain expert developer
46. . Introduction Entities Intents Dialog builder Condition Watson responses 20 No conditions set We got ya down for a $topping pizza. Order pizza flow and some … Anything else Conversation starts Condition Watson responses 20 No conditions set We got ya down for a $topping pizza. Order pizza flow and some … Condition Watson responses (0) #greeting No responses added #greeting Edit
47. . . . . @restaurant @location @cuisine #recommend
48. Empowering the creators
49. domain expert developer data scientist business
50. It takes a village to raise a chatbot
51. domain expert
52. "Would you like us to bring you some ice?" "There's water in my room!"
53. They're closest to the content
54. data scientist moar content engineer business domain expert
56. "The notes I handle no better than many pianists. But the pauses between the notes–
 ah, that is where the art resides." - Artur Schnabel
57. What's your relationship to content?
59. Scale
61. "It's just content"
62. When you appropriate a domain or discipline that you don't know, you are unaware of your biases
65. "You can use an eraser on the drafting table or a sledgehammer at the construction site." - Frank Lloyd Wright
66. "It's just content"
67. ...what if you don't need AI?
68. Yay!
69. We've all reinvented ourselves in this industry
70. Inspiration for this talk
72. Would you put a baby in charge of customer support?
73. How about letting a toddler recommend medical treatment?
74. Or getting financial advice from a teenager?
76. nature vs. nurture
78. For a review of conversational system platforms bit.ly/chatbot- platforms For an excellent dive into conversational design 
 Conversational Design by Erika Hall (A Book Apart) Sparkle and Spin - A Book About Words, 
 by Ann Rand and Paul Rand @thedezzie Thank you! For an excellent introduction to machine learning: r2d3.us