What understood about that we've used LUIS through the year

What understood that we've used LUIS through the year.

Transcript

1. What understood about that we’ve used LUIS through the year Shinichi Tanabe January 12, 2018 Minami Aoyama Night #5
2. Speaker Shinichi Tanabe 　 (田邊 晋一/たなべ しんいち) • NAVITIME JAPAN Co., Ltd. ◦ Joined in 2008 ◦ Cogbot project ◦ Programmer
3. Products
5. Encounter
6. September 15, 2016
9. First impression
10. Easy to use, runs fast and smart.
11. Easy to use
12. Let’s go to the portal site! https://www.luis.ai
13. Step1. Create new app
15. Step2. Add intent
17. Step3. Add utterances
19. Step4. Add entities
22. Step5. Train
24. Step6. Test
30. Step7. Publish
33. That’s all!
34. Furthermore...
35. You can get a happy bonus.
36. Versioning
41. Runs fast and smart
42. Comparison between and LUIS Dialogflow
43. Test model
44. Test model Intent Places.FindPlace Utterances おいしいカレーが食べたいな どこか近くでおすすめのレストランを教えて Entities Cuisine カレー PlaceType レストラン
45. Training speed
46. LUIS 2 - 4 sec Dialogflow 4 - 8 sec The training speed result of test model
47. Precision and recall
48. Test utterance LUIS Dialogflow Intent Entity Intent Entity おいしいカレーが食べたいな 〇 〇 〇 〇 どこか近くでおすすめのレストラ ンを教えて 〇 〇 〇 〇 Precision result of test model
49. Test utterance LUIS Dialogflow Intent Entity Intent Entity おすすめのバーを教えて 〇 〇 × × おすすめのバー教えて 〇 × × × おいしいうどんが食べたい 〇 〇 〇 × おいしいうどん食べたい 〇 × 〇 × Recall result of test model
50. Yes, he was perfect!
51. Getting started
52. But, we had some questions.
53. Questions 1. How should we defines intents and entities? 2. How do we know accuracy and precision? 3. When will he go GA(General Availability)?
54. 1. How should we defines intents and entities?
55. Anti pattern Utterance : Intent ≒ 1 : 1
56. Use or copy pre-build model positively.
59. 2. How do we know accuracy and precision?
60. Comprehensive test on model
61. Batch testing
62. Test result details in a visualized view.
63. Error matrix
64. True positive True negative Green zone indicates correct prediction
65. False negative False positive Red zone indicates incorrect prediction
66. 3. When will he go GA?
67. LUIS is now GA!!
68. How to get along with LUIS
69. Points 1. Start small model which has few intents. 2. Use or copy pre-build model positively. 3. Raise requests before do something about that yourself.
70. Thank you!