Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
What understood about that we've used LUIS thro...
Search
NAVITIME JAPAN
PRO
January 16, 2018
Technology
0
21
What understood about that we've used LUIS through the year
What understood that we've used LUIS through the year.
NAVITIME JAPAN
PRO
January 16, 2018
Tweet
Share
More Decks by NAVITIME JAPAN
See All by NAVITIME JAPAN
つよつよリーダーが 抜けたらどうする? 〜ナビタイムのAgile⽀援組織の変遷〜
navitimejapan
PRO
23
15k
実践ジオフェンス 効率的に開発するために
navitimejapan
PRO
3
790
安全で使いやすいCarPlayアプリの 魅せ方:HIGと実例から学ぶ
navitimejapan
PRO
1
240
見えないユーザの声はログに埋もれている! ~ログから具体的なユーザの体験を数値化した事例紹介~
navitimejapan
PRO
6
3k
ユーザーのためなら 『デザイン』 以外にも手を伸ばせる
navitimejapan
PRO
2
1.6k
フツーのIT女子が、 Engineering Managerになるまで
navitimejapan
PRO
3
370
不確実性に打ち勝つOKR戦略/How to manage uncertainty with OKR strategy
navitimejapan
PRO
4
3.6k
アジャイルを小さいままで 組織に広める 二周目 / Agile Transformation in NAVITIME JAPAN iteration 2
navitimejapan
PRO
4
1.3k
変更障害率0%よりも「継続的な学習と実験」を価値とする 〜障害を「起こってはならないもの」としていた組織がDirtの実施に至るまで〜 / DevOps Transformation in NAVITIME JAPAN
navitimejapan
PRO
7
5.7k
Other Decks in Technology
See All in Technology
『バイトル』CTOが語る! AIネイティブ世代と切り拓くモノづくり組織
dip_tech
PRO
1
130
20251014_Pythonを実務で徹底的に使いこなした話
ippei0923
0
220
WEBサービスを成り立たせるAWSサービス
takano0131
1
190
Azureコストと向き合った、4年半のリアル / Four and a half years of dealing with Azure costs
aeonpeople
1
230
LLMプロダクトの信頼性を上げるには?LLM Observabilityによる、対話型音声AIアプリケーションの安定運用
ivry_presentationmaterials
0
670
プレーリーカードを活用しよう❗❗デジタル名刺交換からはじまるイベント会場交流のススメ
tsukaman
0
190
AI時代におけるデータの重要性 ~データマネジメントの第一歩~
ryoichi_ota
0
700
物体検出モデルでシイタケの収穫時期を自動判定してみた。 #devio2025
lamaglama39
0
240
[Codex Meetup Japan #1] Codex-Powered Mobile Apps Development
korodroid
2
1k
FinOps について (ちょっと) 本気出して考えてみた
skmkzyk
0
180
Digitization部 紹介資料
sansan33
PRO
1
5.6k
衛星画像超解像化によって実現する2D, 3D空間情報の即時生成と“AI as a Service”/ Real-time generation spatial data enabled_by satellite image super-resolution
lehupa
0
190
Featured
See All Featured
The MySQL Ecosystem @ GitHub 2015
samlambert
251
13k
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
panda_program
115
20k
Done Done
chrislema
185
16k
The Illustrated Children's Guide to Kubernetes
chrisshort
49
51k
Building a Modern Day E-commerce SEO Strategy
aleyda
44
7.8k
Designing Dashboards & Data Visualisations in Web Apps
destraynor
231
53k
How to Think Like a Performance Engineer
csswizardry
27
2.1k
[RailsConf 2023] Rails as a piece of cake
palkan
57
5.9k
A designer walks into a library…
pauljervisheath
209
24k
Making the Leap to Tech Lead
cromwellryan
135
9.6k
Six Lessons from altMBA
skipperchong
29
4k
Into the Great Unknown - MozCon
thekraken
40
2.1k
Transcript
What understood about that we’ve used LUIS through the year
Shinichi Tanabe January 12, 2018 Minami Aoyama Night #5
Speaker Shinichi Tanabe (田邊 晋一/たなべ しんいち) • NAVITIME JAPAN
Co., Ltd. ◦ Joined in 2008 ◦ Cogbot project ◦ Programmer
Products
None
Encounter
September 15, 2016
None
None
First impression
Easy to use, runs fast and smart.
Easy to use
Let’s go to the portal site! https://www.luis.ai
Step1. Create new app
None
Step2. Add intent
None
Step3. Add utterances
None
Step4. Add entities
None
None
Step5. Train
None
Step6. Test
None
None
None
None
None
Step7. Publish
None
None
That’s all!
Furthermore...
You can get a happy bonus.
Versioning
None
None
None
None
Runs fast and smart
Comparison between and LUIS Dialogflow
Test model
Test model Intent Places.FindPlace Utterances おいしいカレーが食べたいな どこか近くでおすすめのレストランを教えて Entities Cuisine カレー
PlaceType レストラン
Training speed
LUIS 2 - 4 sec Dialogflow 4 - 8 sec
The training speed result of test model
Precision and recall
Test utterance LUIS Dialogflow Intent Entity Intent Entity おいしいカレーが食べたいな 〇
〇 〇 〇 どこか近くでおすすめのレストラ ンを教えて 〇 〇 〇 〇 Precision result of test model
Test utterance LUIS Dialogflow Intent Entity Intent Entity おすすめのバーを教えて 〇
〇 × × おすすめのバー教えて 〇 × × × おいしいうどんが食べたい 〇 〇 〇 × おいしいうどん食べたい 〇 × 〇 × Recall result of test model
Yes, he was perfect!
Getting started
But, we had some questions.
Questions 1. How should we defines intents and entities? 2.
How do we know accuracy and precision? 3. When will he go GA(General Availability)?
1. How should we defines intents and entities?
Anti pattern Utterance : Intent ≒ 1 : 1
Use or copy pre-build model positively.
None
None
2. How do we know accuracy and precision?
Comprehensive test on model
Batch testing
Test result details in a visualized view.
Error matrix
True positive True negative Green zone indicates correct prediction
False negative False positive Red zone indicates incorrect prediction
3. When will he go GA?
LUIS is now GA!!
How to get along with LUIS
Points 1. Start small model which has few intents. 2.
Use or copy pre-build model positively. 3. Raise requests before do something about that yourself.
Thank you!