Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
What Can Neural Networks Reason About?
Search
Scatter Lab Inc.
May 29, 2020
Research
0
2.2k
What Can Neural Networks Reason About?
Scatter Lab Inc.
May 29, 2020
Tweet
Share
More Decks by Scatter Lab Inc.
See All by Scatter Lab Inc.
zeta introduction
scatterlab
0
1.7k
SimCLR: A Simple Framework for Contrastive Learning of Visual Representations
scatterlab
0
4k
Adversarial Filters of Dataset Biases
scatterlab
0
2.2k
Sparse, Dense, and Attentional Representations for Text Retrieval
scatterlab
0
2.3k
Weight Poisoning Attacks on Pre-trained Models
scatterlab
0
2.2k
Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval
scatterlab
0
2.5k
Beyond Accuracy: Behavioral Testing of NLP Models with CheckList
scatterlab
0
2.3k
Open-Retrieval Conversational Question Answering
scatterlab
0
2.3k
Exploring the Limits of Transfer Learning with Unified Text-to-Text Transformer
scatterlab
0
2.2k
Other Decks in Research
See All in Research
Computational OT #1 - Monge and Kantorovitch
gpeyre
0
190
最適化と機械学習による問題解決
mickey_kubo
0
140
集合間Bregmanダイバージェンスと置換不変NNによるその学習
wasyro
0
110
SSII2025 [SS1] レンズレスカメラ
ssii
PRO
2
980
公立高校入試等に対する受入保留アルゴリズム(DA)導入の提言
shunyanoda
0
6k
Adaptive fusion of multi-modal remote sensing data for optimal sub-field crop yield prediction
satai
3
220
カスタマーサクセスの視点からAWS Summitの展示を考える~製品開発で活用できる勘所~
masakiokuda
2
120
ノンパラメトリック分布表現を用いた位置尤度場周辺化によるRTK-GNSSの整数アンビギュイティ推定
aoki_nosse
0
330
SatCLIP: Global, General-Purpose Location Embeddings with Satellite Imagery
satai
3
230
Transparency to sustain open science infrastructure - Printemps Couperin
mlarrieu
1
190
Submeter-level land cover mapping of Japan
satai
3
130
20250605_新交通システム推進議連_熊本都市圏「車1割削減、渋滞半減、公共交通2倍」から考える地方都市交通政策
trafficbrain
0
550
Featured
See All Featured
Build your cross-platform service in a week with App Engine
jlugia
231
18k
The Art of Delivering Value - GDevCon NA Keynote
reverentgeek
15
1.6k
BBQ
matthewcrist
89
9.7k
How To Stay Up To Date on Web Technology
chriscoyier
790
250k
The Invisible Side of Design
smashingmag
301
51k
Building a Modern Day E-commerce SEO Strategy
aleyda
42
7.4k
The Pragmatic Product Professional
lauravandoore
35
6.7k
It's Worth the Effort
3n
185
28k
ReactJS: Keep Simple. Everything can be a component!
pedronauck
667
120k
The Cult of Friendly URLs
andyhume
79
6.5k
Music & Morning Musume
bryan
46
6.7k
Typedesign – Prime Four
hannesfritz
42
2.7k
Transcript
8IBUDBOOFVSBMOFUXPSL SFBTPOBCPVU ҳ࢚ળ .-4DJFOUJTU 1JOHQPOH
ݾର ݾର • Introduction: Reasoning • Algorithmic Alignment • Conclusion
*OUSPEVDUJPO3FBTPOJOH
8IBUJT3FBTPOJOH *OUSPEVDUJPO3FBTPOJOH • “୶ܻ”
8IBUJT3FBTPOJOH *OUSPEVDUJPO3FBTPOJOH • ୶ܻ: ঌҊ ח Ѫਵ۽ࠗఠ ঌ ޅೞח Ѫਸ
ࢎҊೣ • ীಘ ܻী যਃ -> ܻח یझ ࣻبীਃ -> ীಘ যו աۄী ਸө? • ࠁܳ ਸ ٸ, Ӓ ࠁ۽ࠗఠ ҙೞ ޅೠ Ѫী ೠ ࢜۽ ࠁܳ ب೧ղח স
8IBUJT3FBTPOJOH *OUSPEVDUJPO3FBTPOJOH • ࠁܳ ਸ ٸ, Ӓ ࠁ۽ࠗఠ ҙೞ ޅೠ
Ѫী ೠ ࢜۽ ࠁܳ ب೧ղח স • न҃ݎ ୶ܻ ޙઁ: ࠁ/ࣁ࢚ਸ ҳઑചೞҊ Ӓ ҳઑ۽ࠗఠ Ѿҗܳ ஏೞب۾ णदఇ • GNN, Neural Symbolic Programs (Semantic Parsing), Deep Sets
%FGJOJUJPOPG3FBTPOJOH *OUSPEVDUJPO3FBTPOJOH • ޛ s ∈ Sо যࢲ п
sܳ Xۄח ߭ఠ۽ അೡ ࣻ Ҋ о • ࢚ട {S1, S2, S3, …} ী ೧ࢲ ۄ߰ {y1, y2, y3, …} о ਸ ٸ • ࠁ ޅೠ ࢚ട Sী ೠ ۄ߰ yܳ بೞח ೣࣻ y=g(S)ܳ ח Ѫ ݾ
4USVDUVSFTGPS3FBTPOJOH *OUSPEVDUJPO3FBTPOJOH • Deep Sets • S = {ࡈр ҕ,
ۆ ҕ, ֢ۆ ҕ} ۄҊ о೧ࠁݶ, • ࢎۈ ੑীࢲח ࣽࢲо ࢚ҙ হ {ࡈр ҕ, ۆ ҕ, ֢ۆ ҕ} = {ۆ ҕ, ֢ۆ ҕ, ࡈр ҕ} • Permutation Invariant ೞѱ ೣࣻ gܳ ࢸ҅ೠ Ѫ Deep set • য۰ਕ ࠁ݅ Ӓր MLP MLPۄҊ ࢤп • যڃ ࣽࢲ۽ ৬ب ࢚ҙ হ
4USVDUVSFTGPS3FBTPOJOH *OUSPEVDUJPO3FBTPOJOH • GNN (Graph Neural Network) • Aggregate৬ Concatܳ
ഝਊೞৈ Graph ҳઑܳ Networkܳ അ
,JOEPG3FBTPOJOH *OUSPEVDUJPO3FBTPOJOH • ٜ ୶ܻ ޙઁܳ դب৬ ౠী ٮۄࢲ ֎
о۽ ࠙ܨೣ • ా҅ ਃড (Summary Statistics): য ੑ۱ਸ ‘ࣁח’ ޙઁ • द) ز ࢎী ݻ ѐ ա? Ҋনی ѐী যڃ Ѫ ݆ա? • ҙ҅ ࢲৌ (Relational Argmax): য ੑ۱ীࢲ ࢚ ҙ҅ܳ ٮח ޙઁ • द) о ݣܻ ڄযઉ ח ޛ ह যڃ ࢝ӭੋо? • ز ۽Ӓې߁ (Dynamic Programming): Ѿҗܳ ೞݴ ಹח ޙઁ • द) ೖࠁա, ઁੌ ૣ ӡ ӝ • NP-Hard Problem: ??? • द) য ী ೧ࢲ Ӓ 0غח ࠗ࠙ ਸ ਸ ࣻ ਸө?
,JOEPG3FBTPOJOH *OUSPEVDUJPO3FBTPOJOH • ٜ ୶ܻ ޙઁܳ դب৬ ౠী ٮۄࢲ ֎
о۽ ࠙ܨೣ • ా҅ ਃড (Summary Statistics): য ੑ۱ਸ ‘ࣁח’ ޙઁ • द) ز ࢎী ݻ ѐ ա? Ҋনی ѐী যڃ Ѫ ݆ա? • ҙ҅ ࢲৌ (Relational Argmax): য ੑ۱ীࢲ ࢚ ҙ҅ܳ ٮח ޙઁ • द) о ݣܻ ڄযઉ ח ޛ ह যڃ ࢝ӭੋо? • ز ۽Ӓې߁ (Dynamic Programming): Ѿҗܳ ೞݴ ಹח ޙઁ • द) ೖࠁա, ઁੌ ૣ ӡ ӝ • NP-Hard Problem: ??? • द) য ী ೧ࢲ Ӓ 0غח ࠗ࠙ ਸ ਸ ࣻ ਸө?
,JOEPG3FBTPOJOH *OUSPEVDUJPO3FBTPOJOH • ٜ ୶ܻ ޙઁܳ դب৬ ౠী ٮۄࢲ ֎
о۽ ࠙ܨೣ • ా҅ ਃড (Summary Statistics): য ੑ۱ਸ ‘ࣁח’ ޙઁ • द) ز ࢎী ݻ ѐ ա? Ҋনی ѐী যڃ Ѫ ݆ա? • ҙ҅ ࢲৌ (Relational Argmax): য ੑ۱ীࢲ ࢚ ҙ҅ܳ ٮח ޙઁ • द) о ݣܻ ڄযઉ ח ޛ ह যڃ ࢝ӭੋо? • ز ۽Ӓې߁ (Dynamic Programming): Ѿҗܳ ೞݴ ಹח ޙઁ • द) ೖࠁա, ઁੌ ૣ ӡ ӝ • NP-Hard Problem: ??? • द) য ী ೧ࢲ Ӓ 0غח ࠗ࠙ ਸ ਸ ࣻ ਸө?
,JOEPG3FBTPOJOH *OUSPEVDUJPO3FBTPOJOH • ٜ ୶ܻ ޙઁܳ դب৬ ౠী ٮۄࢲ ֎
о۽ ࠙ܨೣ • ా҅ ਃড (Summary Statistics): য ੑ۱ਸ ‘ࣁח’ ޙઁ • द) ز ࢎী ݻ ѐ ա? Ҋনی ѐী যڃ Ѫ ݆ա? • ҙ҅ ࢲৌ (Relational Argmax): য ੑ۱ীࢲ ࢚ ҙ҅ܳ ٮח ޙઁ • द) о ݣܻ ڄযઉ ח ޛ ह যڃ ࢝ӭੋо? • ز ۽Ӓې߁ (Dynamic Programming): Ѿҗܳ ೞݴ ಹח ޙઁ • द) ೖࠁա, ઁੌ ૣ ӡ ӝ • NP-Hard Problem: ࠺Ѿ ౚ݂ӝ҅о ೦दрী ಽ ࣻ ח ޙઁܳ ೧ ޙઁٜ۽ ೦ दрী ജਗೡ ࣻ ח • द) য ী ೧ࢲ Ӓ 0غח ࠗ࠙ ਸ ਸ ࣻ ਸө?
,JOEPG3FBTPOJOH *OUSPEVDUJPO3FBTPOJOH • ٜ п ޙઁٜী ೧ࢲ যڃ न҃ݎ ҳઑ۽
ಽ ࣻ ח ೞҊ ೞ • ా҅ ਃড (Summary Statistics): য ੑ۱ਸ ‘ࣁח’ ޙઁ • द) GNNҗ Deep Setਵ۽ח ੜ ಽ ࣻ ݅, MLP۽ח ಽӝ য۰ • ҙ҅ ࢲৌ (Relational Argmax): য ੑ۱ীࢲ ࢚ ҙ҅ܳ ٮח ޙઁ • द) GNNਵ۽ח ಽ ࣻ ݅, Deep Setਵ۽ח ಽӝ য۰ • ز ۽Ӓې߁ (Dynamic Programming): Ѿҗܳ ೞݴ ಹח ޙઁ • द) GNNਵ۽ ಽ ࣻ • NP-Hard Problem: ࠺Ѿ ౚ݂ӝ҅о ೦दрী ಽ ࣻ ח ޙઁܳ ೧ ޙઁٜ۽ ೦ दрী ജਗೡ ࣻ ח • द) Exhaustive Searchо ਃೣ
"MHPSJUIN"MJHONFOU
4USVDUVSF$PNQMFYJUZPG1SPCMFN "MHPSJUINJD"MJHONFOU • ޙઁ৬ Ӓ ޙઁܳ ಹח न҃ݎ ҳઑܳ о೧ࠁӝ
• ݅ডী ޙઁ ҳઑܳ न҃ݎ ҳઑী दఆ ࣻ ݶ?
4USVDUVSF$PNQMFYJUZPG1SPCMFN "MHPSJUINJD"MJHONFOU • ޙઁ ಽ ҙীࢲ ֤ޙ ਸ ઁೣ
4USVDUVSF$PNQMFYJUZPG1SPCMFN "MHPSJUINJD"MJHONFOU • ޙઁ ಽ ҙীࢲ ֤ޙ ਸ ઁೣ
4USVDUVSF$PNQMFYJUZPG1SPCMFN "MHPSJUINJD"MJHONFOU • ޙઁ ಽ ҙীࢲ ֤ޙਸ ਸ ઁೣ •
೧ࢳ: • ઑѤਸ ݅ೞח ޙઁח GNNਵ۽ दఆ ࣻ • Ӓ ޙઁী աఋաח ޛח ୭ Nѐө݅ оמೞҊ, • Ӓ ޙઁ ޛ ࣽࢲח ޙઁܳ ಹחؘ ޖҙೞ
4USVDUVSF$PNQMFYJUZPG1SPCMFN "MHPSJUINJD"MJHONFOU • ޙઁ ಽ ҙীࢲ ֤ޙਸ ਸ ઁೣ •
೧ࢳ: • ઑѤਸ ݅ೞח ޙઁח GNNਵ۽ दఆ ࣻ • ӒܻҊ GNN MLP۽ दఆ ࣻ
4USVDUVSF$PNQMFYJUZPG1SPCMFN "MHPSJUINJD"MJHONFOU • ޙઁ ಽ ҙীࢲ ֤ޙਸ ਸ ઁೣ •
೧ࢳ: • ઑѤਸ ݅ೞח ޙઁח GNNਵ۽ दఆ ࣻ • ӒܻҊ GNN MLP۽ दఆ ࣻ • ޙઁ: “ޙઁ ण” ҃ب Ӓۡө???
4USVDUVSF$PNQMFYJUZPG1SPCMFN "MHPSJUINJD"MJHONFOU • ޙઁ : ޙઁ णী ೧ࢲب Ӓۡө? •
೧ࠁݶ MLPח ੜ ޅ ߓח Ѫ э: ҳઑਵ۽ ޙઁܳ ୶࢚ചೞח מ۱ ࠗ೧ࢲ • GNN п ױ҅ܳ ߓ ࣻ ݅, MLPۄݶ ܖ Ѿҗޛਸ ೞա۽ ߓਕঠ ೣ
1"$-FBSOBCJMJUZBOE"MJHONFOU "MHPSJUINJD"MJHONFOU • Probably approximately correct learning (Ѣ ഛೠ ण)
• ੑ۱җ ۱हਸ ࢠ݂೧ࢲ णೞח ঌҊ્ܻਸ ࢤп೧ࠁݶ • Probably: ֫ ഛܫ۽ • Approximately Correct: ݽ؛ ী۞о Threshold ݅ੌѢ
1"$-FBSOBCJMJUZ "MHPSJUINJD"MJHONFOU • Probably approximately correct learning (Ѣ ഛೠ ण)
• ೧ࢳ: • ܻ ݽ؛ ࢠ݂ਸ ా೧ࢲ णदఆ ࣻ Ҋ о೧ࠁ (PAC ઑѤ) • Ӓ۞ݶ ী۞بܳ ઁೠೞӝ ਤ೧ࢲח ݆ ࡳইঠ ೠ (୭ࣗ M ݅ఀ ࠂب۽ ࡳইঠೣ)
1"$-FBSOBCJMJUZ "MHPSJUINJD"MJHONFOU • Probably approximately correct learning (Ѣ ഛೠ ण)
• ؊ ए ೧ࢳ: • ࢠ݂ਵ۽ णदఆ ٸ, ࢿמ ֫۰ݶ ݆ ࡳইঠೠ!
1"$-FBSOBCJMJUZ&YBNQMF "MHPSJUINJD"MJHONFOU • MLPח ݽٚ ࢎѾ җਸ ೞա ܖ۽ рೡ
ࣻ ߆ী হਵ۽
1"$-FBSOBCJMJUZ&YBNQMF "MHPSJUINJD"MJHONFOU • MLPח ݽٚ ࢎѾ җਸ ೞա ܖ۽ рೡ
ࣻ ߆ী হਵ۽ • ೧ࢳ: • MLP۽ ޙઁܳ ಽѱ दః۰ݶ • ୭ࣗೠ Layer ӝ ী ೧ ੑ۱ ରਗ ӝ ݅ఀ Ѣٟઁғೠ Ѫ • ӒѪਸ فߣ૩ Layer ӝী ೧ ғೠ Ѫ • ݅ఀ ࢠ݂೧ঠ णदఆ ࣻ ਸ Ѫ
1"$-FBSOBCJMJUZBOE"MJHONFOU "MHPSJUINJD"MJHONFOU • ݽ؛ PAC ള۲ оמ ઑѤਸ ݅ೠݶ
Alignment ܳ ࣻधਵ۽ ॶ ࣻ • ೧ࢳ: • ޙઁী ೧ࢲ Ӓ ޙઁܳ f1, f2, f3,..ਵ۽ ଂѓ ࣻ Ҋ оೞҊ • Ӓ ଂѐ ٜࠗ࠙ਸ пп न҃ݎਵ۽ दఆ ࣻ Ҋ оೞݶ • Alignment ػח Ѫ • пп ݽ؛ਸ ള۲दఆ ٸ, ӝઓী Mѐ ࡳ Ѫࠁ ѱ ࡳইب غח ҃
1"$-FBSOBCJMJUZBOE"MJHONFOU "MHPSJUINJD"MJHONFOU • ݽ؛ PAC ള۲ оמ ઑѤਸ ݅ೠݶ
Alignment ܳ ࣻधਵ۽ ॶ ࣻ • ؊ ए ೧ࢳ: • য۰ ޙઁܳ ए ࣁࠗ ޙઁ۽ ଂѐࢲ णदௌਸ ٸ, • Ӓ ए ࣁࠗ ޙઁ пп ؘఠ۽ب ੜ ߓ ࣻ ਵݶ જѷ!
#FUUFS"MJHONFOU#FUUFS(FOFSBMJ[BUJPO "MHPSJUINJD"MJHONFOU • Alignmentܳ ੜ ೡ ࣻ ח ݽ؛ ੜ
ߓ ࣻ • ઑѤਸ ݅ೠח о ೞীࢲ….
#FUUFS"MJHONFOU#FUUFS(FOFSBMJ[BUJPO "MHPSJUINJD"MJHONFOU • Alignmentܳ ੜ ೡ ࣻ ח ݽ؛ ੜ
ߓ ࣻ • ઑѤਸ ݅ೠח о ೞীࢲ….
#FUUFS"MJHONFOU#FUUFS(FOFSBMJ[BUJPO "MHPSJUINJD"MJHONFOU • Alignmentܳ ੜ ೡ ࣻ ח ݽ؛ ੜ
ߓ ࣻ • ппਸ ੜ ଂѐࢲ ߓח স ੜ ഛ݀ػݶ Ӓۧѱ ػח ܻࣗ • ցޖ োೠ ݈ੋ٠ • ܻ ҙীࢲ BERTо MLP ա LSTM ࠁ ੜೞח ਬח? • BERT ҳઑо ޙ ਫ਼ੋ ҳઑܳ ؊ Generalization ਸ ੜ ೮ӝ ٸޙ
#FUUFS"MJHONFOU#FUUFS(FOFSBMJ[BUJPO "MHPSJUINJD"MJHONFOU • Generalization ਸ ੜ ޅೞח ݽ؛ য۰ ޙઁܳ
णೞӝ য۰ • ࣘغѱ ݈ೞݶ ݽ؛ ࠂبী ٮۄ Ӓ ޙઁܳ ಽ “ल” ࠁੋח Ѫ • п ޙઁী ೠ ࢿמ
#FUUFS"MJHONFOU#FUUFS(FOFSBMJ[BUJPO "MHPSJUINJD"MJHONFOU • Generalization ਸ ੜ ޅೞח ݽ؛ য۰ ޙઁܳ
णೞӝ য۰ • ࣘغѱ ݈ೞݶ ݽ؛ ࠂبী ٮۄ Ӓ ޙઁܳ ಽ “ल” ࠁੋח Ѫ • Monster Trainer (Path Searching) ޙઁী ೠ п ݽ؛ ࢿמ
$PODMVTJPO
$PODMVTJPO $PODMVTJPO • যڃ न҃ݎ ݽ؛ਸ ഝਊ೧ࢲ যڃ ޙઁী ೧ࢲ
ಽ ٸ • Ӓ ݽ؛ ҳઑо ޙઁ ࢲࢎ ҳઑܳ ನҚೡ ࣻ যঠ ೣ • ݅ড Ӓۧ ঋݶ ই ݆ ࢠ ਃೣ = ݽ؛ ޙઁܳ ੌ߈ചೡ ࣻ হ • ࠂೠ ݽ؛ ԙ ੜ ಽח ঋ݅, рױೠ ݽ؛ ಽӝ য۰ • ܻীѱ ח दࢎ • औѱ ߓ ݽ؛, рױೠ ഋక۽ ҳࢿػ ݽ؛ য ޑೣਸ ੜ աఋյ ࣻ ਸө? • അ BERT ҳઑח ցޖ ࠂೠ Ѫ ইקө?