Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
What understood about that we've used LUIS thro...
Search
NAVITIME JAPAN
PRO
January 16, 2018
Technology
0
21
What understood about that we've used LUIS through the year
What understood that we've used LUIS through the year.
NAVITIME JAPAN
PRO
January 16, 2018
Tweet
Share
More Decks by NAVITIME JAPAN
See All by NAVITIME JAPAN
つよつよリーダーが 抜けたらどうする? 〜ナビタイムのAgile⽀援組織の変遷〜
navitimejapan
PRO
23
15k
実践ジオフェンス 効率的に開発するために
navitimejapan
PRO
3
720
安全で使いやすいCarPlayアプリの 魅せ方:HIGと実例から学ぶ
navitimejapan
PRO
1
240
見えないユーザの声はログに埋もれている! ~ログから具体的なユーザの体験を数値化した事例紹介~
navitimejapan
PRO
6
3k
ユーザーのためなら 『デザイン』 以外にも手を伸ばせる
navitimejapan
PRO
2
1.6k
フツーのIT女子が、 Engineering Managerになるまで
navitimejapan
PRO
3
360
不確実性に打ち勝つOKR戦略/How to manage uncertainty with OKR strategy
navitimejapan
PRO
4
3.6k
アジャイルを小さいままで 組織に広める 二周目 / Agile Transformation in NAVITIME JAPAN iteration 2
navitimejapan
PRO
4
1.3k
変更障害率0%よりも「継続的な学習と実験」を価値とする 〜障害を「起こってはならないもの」としていた組織がDirtの実施に至るまで〜 / DevOps Transformation in NAVITIME JAPAN
navitimejapan
PRO
7
5.6k
Other Decks in Technology
See All in Technology
JTCにおける内製×スクラム開発への挑戦〜内製化率95%達成の舞台裏/JTC's challenge of in-house development with Scrum
aeonpeople
0
250
未経験者・初心者に贈る!40分でわかるAndroidアプリ開発の今と大事なポイント
operando
5
750
IoT x エッジAI - リアルタイ ムAI活用のPoCを今すぐ始め る方法 -
niizawat
0
110
開発者を支える Internal Developer Portal のイマとコレカラ / To-day and To-morrow of Internal Developer Portals: Supporting Developers
aoto
PRO
1
480
5年目から始める Vue3 サイト改善 #frontendo
tacck
PRO
3
230
株式会社ログラス - 会社説明資料【エンジニア】/ Loglass Engineer
loglass2019
4
65k
Unlocking the Power of AI Agents with LINE Bot MCP Server
linedevth
0
110
いま注目のAIエージェントを作ってみよう
supermarimobros
0
350
プラットフォーム転換期におけるGitHub Copilot活用〜Coding agentがそれを加速するか〜 / Leveraging GitHub Copilot During Platform Transition Periods
aeonpeople
1
230
Terraformで構築する セルフサービス型データプラットフォーム / terraform-self-service-data-platform
pei0804
1
190
テストを軸にした生き残り術
kworkdev
PRO
0
210
バイブスに「型」を!Kent Beckに学ぶ、AI時代のテスト駆動開発
amixedcolor
2
580
Featured
See All Featured
It's Worth the Effort
3n
187
28k
Speed Design
sergeychernyshev
32
1.1k
Save Time (by Creating Custom Rails Generators)
garrettdimon
PRO
32
1.6k
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
addyosmani
7
850
Easily Structure & Communicate Ideas using Wireframe
afnizarnur
194
16k
Statistics for Hackers
jakevdp
799
220k
Agile that works and the tools we love
rasmusluckow
330
21k
How GitHub (no longer) Works
holman
315
140k
Large-scale JavaScript Application Architecture
addyosmani
513
110k
Designing for Performance
lara
610
69k
VelocityConf: Rendering Performance Case Studies
addyosmani
332
24k
Raft: Consensus for Rubyists
vanstee
140
7.1k
Transcript
What understood about that we’ve used LUIS through the year
Shinichi Tanabe January 12, 2018 Minami Aoyama Night #5
Speaker Shinichi Tanabe (田邊 晋一/たなべ しんいち) • NAVITIME JAPAN
Co., Ltd. ◦ Joined in 2008 ◦ Cogbot project ◦ Programmer
Products
None
Encounter
September 15, 2016
None
None
First impression
Easy to use, runs fast and smart.
Easy to use
Let’s go to the portal site! https://www.luis.ai
Step1. Create new app
None
Step2. Add intent
None
Step3. Add utterances
None
Step4. Add entities
None
None
Step5. Train
None
Step6. Test
None
None
None
None
None
Step7. Publish
None
None
That’s all!
Furthermore...
You can get a happy bonus.
Versioning
None
None
None
None
Runs fast and smart
Comparison between and LUIS Dialogflow
Test model
Test model Intent Places.FindPlace Utterances おいしいカレーが食べたいな どこか近くでおすすめのレストランを教えて Entities Cuisine カレー
PlaceType レストラン
Training speed
LUIS 2 - 4 sec Dialogflow 4 - 8 sec
The training speed result of test model
Precision and recall
Test utterance LUIS Dialogflow Intent Entity Intent Entity おいしいカレーが食べたいな 〇
〇 〇 〇 どこか近くでおすすめのレストラ ンを教えて 〇 〇 〇 〇 Precision result of test model
Test utterance LUIS Dialogflow Intent Entity Intent Entity おすすめのバーを教えて 〇
〇 × × おすすめのバー教えて 〇 × × × おいしいうどんが食べたい 〇 〇 〇 × おいしいうどん食べたい 〇 × 〇 × Recall result of test model
Yes, he was perfect!
Getting started
But, we had some questions.
Questions 1. How should we defines intents and entities? 2.
How do we know accuracy and precision? 3. When will he go GA(General Availability)?
1. How should we defines intents and entities?
Anti pattern Utterance : Intent ≒ 1 : 1
Use or copy pre-build model positively.
None
None
2. How do we know accuracy and precision?
Comprehensive test on model
Batch testing
Test result details in a visualized view.
Error matrix
True positive True negative Green zone indicates correct prediction
False negative False positive Red zone indicates incorrect prediction
3. When will he go GA?
LUIS is now GA!!
How to get along with LUIS
Points 1. Start small model which has few intents. 2.
Use or copy pre-build model positively. 3. Raise requests before do something about that yourself.
Thank you!