Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
B3_Seminar_07
Search
kakubari
March 30, 2017
Technology
0
65
B3_Seminar_07
長岡技術科学大学
自然言語処理研究室
角張竜晴
kakubari
March 30, 2017
Tweet
Share
More Decks by kakubari
See All by kakubari
動詞クエリの語間の関係性に基づくクエリマイニング
kakubari
0
110
Neural Modeling of Multi-Predicate Interactions for Japanese Predicate Argument Structure Analysis
kakubari
1
160
Leveraging Crowdsourcing for Paraphrase Recognition
kakubari
0
83
Automatically Acquired Lexical Knowledge Improves Japanese Joint Morphological and Dependency Analysis
kakubari
0
100
Labeling the Semantic Roles of Commas
kakubari
0
78
Integrating Case Frame into Japanese to Chinese Hierarchical Phrase-based Translation Model
kakubari
0
120
Improving Chinese Semantic Role Labelingusing High-quality Surface and Deep Case Frames
kakubari
0
90
Exploring Verb Frames for Sentence Simplification in Hindi
kakubari
0
130
述語項構造と照応関係のアノテーション
kakubari
0
230
Other Decks in Technology
See All in Technology
20251007: What happens when multi-agent systems become larger? (CyberAgent, Inc)
ornew
1
460
速習AGENTS.md:5分で精度を上げる "3ブロック" テンプレ
ismk
6
1.8k
RDS の負荷が高い場合に AWS で取りうる具体策 N 連発/a-series-of-specific-countermeasures-available-on-aws-when-rds-is-under-high-load
emiki
7
4.2k
GoでもGUIアプリを作りたい!
kworkdev
PRO
0
150
衛星画像超解像化によって実現する2D, 3D空間情報の即時生成と“AI as a Service”/ Real-time generation spatial data enabled_by satellite image super-resolution
lehupa
0
190
Sansan Engineering Unit 紹介資料
sansan33
PRO
1
3k
Implementing and Evaluating a High-Level Language with WasmGC and the Wasm Component Model: Scala’s Case
tanishiking
0
150
組織改革から開発効率向上まで! - 成功事例から見えたAI活用のポイント - / 20251016 Tetsuharu Kokaki
shift_evolve
PRO
1
160
フレームワークを意識させないワークショップづくり
keigosuda
0
210
Performance Insights 廃止から Database Insights 利用へ/transition-from-performance-insights-to-database-insights
emiki
0
320
CoRL 2025 Survey
harukiabe
1
220
AI時代こそ求められる設計力- AWSクラウドデザインパターン3選で信頼性と拡張性を高める-
kenichirokimura
3
350
Featured
See All Featured
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
tammyeverts
55
3k
Large-scale JavaScript Application Architecture
addyosmani
514
110k
Being A Developer After 40
akosma
91
590k
StorybookのUI Testing Handbookを読んだ
zakiyama
31
6.2k
Build your cross-platform service in a week with App Engine
jlugia
232
18k
Java REST API Framework Comparison - PWX 2021
mraible
34
8.9k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
marcduiker
34
2.3k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
morganepeng
132
19k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
35
3.2k
Fantastic passwords and where to find them - at NoRuKo
philnash
52
3.4k
[RailsConf 2023] Rails as a piece of cake
palkan
57
5.9k
4 Signs Your Business is Dying
shpigford
185
22k
Transcript
Ԭٕज़Պֶେֶ ిؾిࢠใֶ՝ఔ ֶ෦ɹ֯ுཽ ࣗવݴޠݚڀࣨ ɹ#̏θϛ ʙୈճʙ ใΞΫηεධՁํ๏ᶄ 1
今日の内容 ˔جຊతͳใݕࡧධՁࢦඪ ɹɾٯॱҐ ˔ςΩετΛରͱͨ͠ใΞΫηεධՁ ɹɾ#-&6 2
Web検索の検索意図 ˔#SPEFS͕ʹࣔͨ͠ݕࡧҙਤͷ̏ͭͷλΠϓ ɾ༠ಋܕ ಛఆͷαΠτΛ๚Ε͍ͨͱ͍͏ҙਤ ɾใऩूܕ ҰͭҎ্ͷΣϒϖʔδʹॻ͔Ε͍ͯΔͱࢥΘΕΔ ใΛऔಘ͍ͨ͠ͱ͍͏ҙਤ ɾऔҾܕ ΣϒΛհͱͨ͠ΞΫγϣϯΛ࣮ߦ͍ͨ͠ͱ͍͏ ҙਤʢྫ͑ɺҿ৯ళͷ༧ʣ
3
逆数順位 ˔༠ಋܕݕࡧҙਤʹదͨ͠ධՁࢦඪ ɹɾಛఆͷαΠτΛ๚Ε͍ͨ ɹɾཉ͍͠จॻΛҰͭݟ͚͍ͭͨ ˔ٯॱҐͷఆٛ ɹݕࡧ݁Ռதɺ࠷্Ґͷద߹จॻͷϥϯΫΛS ͱ͠ɺ ద߹จॻΛؚ·ͳ͍߹ʹɺಛʹS
ʹ㱣ͱ͢Δɻ ͜ͷ࣌ͷٯॱҐ SFDJQSPDBMSBOL ɺ ಛʹɺݕࡧ݁Ռ͕ద߹จॻΛؚ·ͳ͍߹33 RR= 1 r 1 4
テキストを対象とした情報アクセス評価指標 ˔ػց༁ͷࣗಈධՁࢦඪɹ#-&6 ɹػց༁ͷࣗಈධՁͰɺਓखʹΑΔෳͷਖ਼ղ σʔλʢଈͪࢀর༁ʣΛ༩͑Δඞཁ͕͋Δɻ ɹ༁ͷํҰ௨ΓͰͳ͍ͨΊ
5
BLEU ࢀর༁T ɿ5IFDBUJTPOUIFNBU ʢୈҰͷࢀর༁ʣ ɹɹɹT ɿ5IFSFJTBDBUPOUIFNBUʢୈೋͷࢀর༁ʣ ධՁͷରͱͳΔػց༁ͷ݁ՌɿT
5IFNBUJTPOUIFDBU ͜ͷจTʹؚ·ΕΔશϢχάϥϜ HSBN T \lUIFz lNBUz lJTz lPOz lDBUz^ ྫ͑ɺzUIFzͷසͰ͋Γɺ ͜ΕΛ$ lUIFz ͷΑ͏ʹද͢ɻ 6
BLEU ಉ༷ʹɺTʹରԠ͢ΔୈҰͷࢀর༁T Ͱ $ lUIFz T
ୈೋͷࢀর༁T ʹ͍ͭͯ $ lUIFz T ػց༁ͷ݁Ռͷ֤จTΛධՁ͢Δʹɺ ࢀর༁தͰ͜ΕʹରԠ͢Δਖ਼ղ༁ͱͷۙ͞Λߟ͑Δɻ 7
BLEU Ұͭͷख͕͔Γͱͯ͠ɺ ਖ਼ղ༁ͱػց༁݁Ռͷ྆ํʹؚ·ΕΔzUIFzͷΑ͏ ͳϢχάϥϜͷසʹ͍ͭͯൺֱ͢Δɻ ྫ͑ʜ ػց༁݁ՌʹzUIFz͕ճग़ݱ͍ͯͯ͠ɺ ୈҰͷࢀর༁ʹ̎ճɺୈೋͷࢀর༁ʹ̍ճ͔͠ग़ ݱ͠ͳ͍ɻ ػց༁݁ՌʹճͷใुΛ༩͑ͳ͍ɻ
8
BLEU ैͬͯɺHSBN T HSBN T ͕ͱʹؚΉ֤Ϣχά ϥϜFʹ͍ͭͯɺසΛמΓࠐΉ
$MJQ ɻ $MJQ F T NJO NBY $ F T $ F T ྫ͑ɺ$ lUIFz T Ͱ͋ͬͯɺ ɹɹɹ$ lUIFz T Ͱ͋Εɺ $MJQ lUIFz T ̎ 9
BLEU ɹಉ༷ʹόΠάϥϜʹ͍ͭͯߟ͍͑ͯ͘ɻ ػց༁Tʹ͍ͭͯ HSBN T \lUIFNBUz lNBUJTz lJTPOz lPOUIFz
lUIFDBUz^ ͱͳΔɻ ɹҎ্ΑΓɺਖ਼ղ༁ʹؚ·Εͳ͍zNBUJTz͕ଘࡏ͢Δ ͜ͱ͕Θ͔ΓɺϢχάϥϜΑΓࡉ͔͍ධՁͰ͖Δɻ /άϥϜͰɺΑΓࡉ͔͍ධՁ͕Ͱ͖Δ 10
BLEU ػց༁݁ՌશମʢจTͷू߹ʣͷධՁΛߦ͏ࡍɺ /άϥϜͷמΓࠐΈසʹجͮ͘ࢦඪΛߟ͑Δɻ 1SFD / ɺਫ਼ʹ֤/άϥϜͷසΛಋೖͨ͠ͷʹ
૬͢Δɻ Prec N = Clip(e,s) e∈gramN (s) ∑ s ∑ C(e,s) e∈gramN (s) ∑ s ∑ 11
BLEU #-&6Ͱɺ͞Βʹ/ ʹ͍ͭͯ1SFD/ ΛҎԼ ͷΑ͏ʹ݁߹͢Δɻ
͜Εਫ਼ʹࣅͨࢦඪͷͨΊɺػց༁݁Ռʹؚ·Ε ΔϊΠζʹରͯ͠ϖφϧςΟΛ༩͑Δ͜ͱ͕Ͱ͖Δɻ PREC = exp( 1 4 lnPrec N N∈{1,2,3,4} ∑ ) 12
BLEU ˔ϖφϧςΟΛ༩͑Δج४ ػց༁݁Ռ͕ୈҰͷਖ਼ղ༁ͱશͯҰகͨ͠߹ɺ ୈೋͷਖ਼ղ༁ͷzUIFSFzΛؚ·ͳ͍͔ΒϖφϧςΟΛ ༩͑Δ͜ͱෆదɻ /άϥϜͷ࠶ݱΛߟ͑ΔΘΓʹɺ ɹػց༁݁Ռͷ͞ʹண 13
BLEU ػց༁݁Ռͷ͕͞ਖ਼ղ༁ͷ͞ͱൺֱͯ͠ʜ ᶃ͗͢Δͱஅͨ͠߹ ɹϖφϧςΟΛ༩͑Δ ᶄ͗͢Δͱஅͨ͠߹ ɹ13&$ʹΑΓϖφϧςΟ͕༩͑ΒΕΔ 14
BLEU ػց༁݁Ռதͷ֤จTʹ͍ͭͯɺରԠ͢Δਖ਼ղจT ͷ͏͕ͪ͞࠷Tʹ͍ۙͷΛબɻ ͦͷਖ਼ղจͷ͞Λ ࠷దϚονɿ#.- T Ͱද͢ɻ ͦͯ͠ɺػց༁݁Ռશମʹ͍ͭͯͦͷΛٻΊΔͱ
4#.-ػց༁݁Ռͷཧతͳ͞ʹ૬͢Δ SBML = BML(s) = arg len(s* ) min len(s)− len(s* ) s ∑ s ∑ 15
BLEU Ұํɺػց༁݁Ռͷશͷ࣮ଌ ͜ΕΒΑΓɺ#-&6ͷ؆қϖφϧςΟ 4:4-4.#-ͷ࣌ɺ#1ͱͳΓ ϖφϧςΟ͕՝͞ΕΔɻ
SYSL = len(s) s ∑ BP=exp(min(0,1- SBML SYSL )) 16
BLEU Ҏ্ͷఆٛʹج͖ͮɺ#-&6 ˔#-&6ͷ·ͱΊ ɾجຊతʹසΛߟྀͨ͠/άϥϜʹجͮ͘ਫ਼ ɾػց༁݁Ռશମͱͯ͗͢͠Δͱஅͨ͠߹ɺ ɹϖφϧςΟΛ՝͢ࢦඪ
BLEU=BP PREC 17
参考文献 ˔ใΞΫηεධՁํ๏ʢ̏ɺ̐ষʣɺञҪɺ ɹίϩφࣾɺ݄ 18