Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
(Reading )Does BERT Know that the IS-A Relation...
Search
Sponsored
·
Your Podcast. Everywhere. Effortlessly.
Share. Educate. Inspire. Entertain. You do you. We'll handle the rest.
→
ando
January 23, 2023
Science
140
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
(Reading )Does BERT Know that the IS-A Relation Is Transitive?
Komachi lab
ando
January 23, 2023
Transcript
8 slides
ACL2022 Short paper
- #&35͕*4"ؔͷ5SBOTJUJWFੑ࣭ͱͲͷఔҰக͢Δ͔ΛఆྔԽɻ - #&35ͷ༧ଌ*4"ؔͷਪҠੑʹશʹैΘͳ͍͜ͱ͕໌Β͔ʹͳͬͨ 5SBOTJUJWF A is-a B & →
A is-a C︖ B is-a C - #&35*4"ؔΛͷ"DDVSBDZͰ༧ଌͰ͖Δ - #&35͕"JTB#ͱ#JTB$Λਖ਼͘͠༧ଌͨ͠߹ɺ"JTB$ ˠͦͷ··ࣝϕʔεͱͯ͠ѻ͑ͳ͍ 2 概要
- ໊ࢺΛ༻͍Δ 3 Task definition 語義のペア Is-aであれば1, でなければ0
-\TcT㱨4 BOEIZQP T 㱵 ^ 8PSE/FUͷશͯͷϦʔϑηϯεɻ 48PSE/FUͷશͯͷޠٛͷू߹ɺIZQP T ҙຯTͷԼҐޠٛͷू߹Λද͢ɻ -
*4"ΛऔΓग़͢ • -͔ΒMFBGͷޠٛ/ΛϥϯμϜʹநग़͠ɺ/ΛSPPU3ʹଓͯ͠ɺύεQ /ˠ3 Λಘ Δ Q͔Β"ɺ#ɺ$ͷͭͷޠٛΛϥϯμϜʹநग़͠ɺ"ɺ#ɺ$ͷޠٛͷྫจΛಘΔ ͜ͷ݁Ռɺλϓϧʢ"ɺ#ɺ$ʣͱͭͷਖ਼ྫʢ"ɺ#ʣɺʢ#ɺ$ʣɺʢ"ɺ$ʣ͕ಘ ΒΕΔɻ - /PU*4"ΛऔΓग़͢ • -͔Βೋͭͷ/ /ΛϥϯμϜʹநग़͠ɺೋͭͷύεQ /ˠ3 ͱQ /ˠ3 Λ ಘΔQɺQ͔ΒͦΕͧΕ"⒌ɺ#⒌ΛϥϯμϜʹαϯϓϦϯά͠ɺޠٛ"⒌ɺ#⒌ͷྫจΛಘ Δ "⒌͕#⒌ˠ3ͷύε্ʹͳ͍߹ɺ·ͨͦͷٯͷ߹ɺෛྫʢ"⒌ #⒌ʣΛಘΔ - σʔληοτͰɺݸͷλϓϧ͕͋Γɺݸͷਖ਼ྫͱݸͷෛྫ͕͋Δɻ 4 Positive, Negative example抽出
- #&35ͷ࠷ऴͷϕΫτϧΛ༻ʢTVCXPSEBWFSBHFʣ - #&35ϑΝΠϯνϡʔχϯά͠ͳ͍ɺ࠷ۙʢOOʣྨثΛ༻ ˠγϯϓϧͳͷΛ͍͍ͨ - ϢʔΫϦουڑΛڑࢦඪͱͯ͠༻͍Δɻ 5 分類 語義2
語義1
- ςετηοτͰɺ " # ͱ # $ ͷฏۉϗοϓͦΕͧΕ ͱ Ͱ͋ͬͨɻ
- ͜ͷࠩɺ8PSE/FUͷྫจΛ࣋ͭޠ͕ٛۉʹ͍ͯ͠ͳ͍͜ͱʹىҼ͍ͯ͠Δɻ ʢ্ҐޠྫจΛ͍͍࣋ͬͯ͢ʣ 6 Hop数
- ϗοϓ͕গͳ͍߹ʢʣɺϗοϓ͕ଟ͍߹ʢʣΑΓߴ͍ਫ਼Ͱ*4"ؔ Λ༧ଌͰ͖Δ - ϗοϓ͕૿Ճͯ͠༧ଌਫ਼େ͖͘ԼͤͣɺϗοϓͰਫ਼ʹେ͖ͳΒ͖ͭ ͳ͍ɻ 7 実験結果 ?
- #&35͕ʢ"ɺ#ʣɺʢ#ɺ$ʣΛਖ਼͘͠༧ଌͨ͠߹ʹɺ*4"ؔʢ"ɺ$ʣΛਖ਼͘͠༧ଌ ͢ΔසΛଌఆ - Q "# ͷ " # ͷ͏ͪɺਖ਼͘͠༧ଌ͞Εͨ
" # ͷׂ߹ - Q "$c"# #$ ɺ " # ͱ # $ ͕ਖ਼͘͠༧ଌ͞ΕΔ߹ɺ " $ ͕ਖ਼͘͠༧ଌ͞ΕΔׂ߹ - "JTB$͕ৗʹਖ਼͘͠༧ଌ͞Εͳ͍͜ͱɺ#&35͕ཧతʹҰ؏ͨ͠༧ଌΛ͢ΔೳྗΛ ͍͍ܽͯΔ͜ͱΛ͍ࣔࠦͯ͠Δɻ 8 Prediction Ability for Transitivity
More Decks by ando
See All by ando
博士論文公聴会資料
ando55
0
670
Is In-hospital Meta-information Useful for Abstractive Discharge Summary Generation?
ando55
0
300
(読み会)Evaluating Factuality in Text Simplification
ando55
1
220
(Reading) Relational Multi-Task Learning Modeling Relations between Data and Tasks
ando55
0
200
(Reading )Agreeing to Disagree: Annotating Offensive Language Datasets with Annotators’ Disagreement
ando55
0
190
(Reading) Preregistering NLP research
ando55
0
86
(Reading) Predictive Adversarial Learning from Positive and Unlabeled Data
ando55
0
180
Argument Invention from First Principles
ando55
2
370
Other Decks in Science
See All in Science
AlgorithAlgorihms for Decision Making
mickey_kubo
0
200
Cognitive Debt - What AI will do to us
martinlippert
1
150
はじめてのグラフ信号サンプリング
arthur1
0
160
勾配流から乖離した学習ダイナミクス
hanbao
1
1.2k
GKE上でオセロの強化学習やってみた
akasan
0
130
自社のレビュー履歴からAIコードレビュアーをつくる方法
estie
5
2k
AI Agents for Earth Observation
sabman
0
150
Note agro-climatique et prairies - Numéro 7
institutdelelevage
PRO
0
800
データベース10: 拡張実体関連モデル
trycycle
PRO
0
1.6k
言葉をはかる:テキストマイニング入門①講義編
satocos135
0
320
データベース12: 正規化(2/2) - データ従属性に基づく正規化
trycycle
PRO
0
1.9k
現代AI入門: 大規模言語モデルから思考するシステムへ — Test-Time Scaling, Loop, Harness, RSI
stillpedant
PRO
49
26k
Featured
See All Featured
Leveraging LLMs for student feedback in introductory data science courses - posit::conf(2025)
minecr
1
490
Money Talks: Using Revenue to Get Sh*t Done
nikkihalliwell
0
570
The Spectacular Lies of Maps
axbom
PRO
1
1.1k
Navigating Algorithm Shifts & AI Overviews - #SMXNext
aleyda
1
1.7k
Testing 201, or: Great Expectations
jmmastey
46
8.4k
Accessibility Awareness
sabderemane
1
310
We Analyzed 250 Million AI Search Results: Here's What I Found
joshbly
2
2.1k
The Illustrated Guide to Node.js - THAT Conference 2024
reverentgeek
1
620
Applied NLP in the Age of Generative AI
inesmontani
PRO
4
2.6k
Documentation Writing (for coders)
carmenintech
77
5.6k
Six Lessons from altMBA
skipperchong
29
4.6k
Fashionably flexible responsive web design (full day workshop)
malarkey
409
67k