Share
Embed
On the Acquisition of Shared Grammatical Representations in Bilingual Language Models
ACL読み会2025@名大で使用したスライドです
Shin Yamaguchi
September 22, 2025
Transcript
23 slides
-
0OUIF"DRVJTJUJPOPG4IBSFE(SBNNBUJDBM 3FQSFTFOUBUJPOTJO#JMJOHVBM-BOHVBHF.PEFMT Catherine Arnett, Tyler A. Chang, James A. Michaelov,
Ben Bergen https://aclanthology.org/2025.acl-long.1010/ ʮ"$-ಡΈձ!໊େʯࢿྉ ੩Ԭେֶङݚڀࣨ #ࢁޱਅ -
ಋೖ ݴޠϞσϧ͢Ͱʹֶशͨ͠ݴޠΛ͏·͘ར༻͢Δ͜ͱͰޮ తʹֶशͰ͖Δ ݴޠؒసҠ సҠޮՌ͕ݴޠϖΞʹΑ͕ͬͯࠩ͋Δ͜ͱ͕ΒΕ͍ͯΔ ݴޠతʹ͍ۙͱసҠޮՌ͕ߴ͍ FHˠӳˠӳ ίʔύεதͷڞ༗͞Εͨޠኮදݱͷස͕ߴ͍ͱసҠޮՌ͕ߴ͍ ࠷ۙͷݴޠؒసҠͷݚڀͰసҠޮՌʹඇରশੑ͕͋ΔՄೳੑ
͕ࣔࠦ͞Ε͍ͯΔ νϕοτޠˠӳӳˠνϕοτޠ ݴޠϞσϧ͕ͲͷΑ͏ͳจ๏ೳྗΛͲͷΑ͏ʹసҠ͍ͤͯ͞Δ ͷ͔Λ໌Β͔ʹ͍ͨ͠ˠਓؒͷݴޠ֫ಘͷղ໌ 2 -
ಋೖ ݴޠϞσϧ͢Ͱʹֶशͨ͠ݴޠΛ͏·͘ར༻͢Δ͜ͱͰޮ తʹֶशͰ͖Δ ݴޠؒసҠ จ๏ೳྗʹ͍ͭͯݴޠؒసҠΛղऍ ධՁ͢Δํ๏ͱͯ͠ จ๏༰ೝੑஅλεΫˠ֤ݴޠͰ༰ೝ ෆ ՄೳจΛஅͰ͖Δ͔ݟΔ
෦ϓϩʔϏϯάˠϞσϧ෦ͰӨڹ͍ͯ͠Δ෦ΛݟΔ 3 -
ಋೖ ݴޠϞσϧ͢Ͱʹֶशͨ͠ݴޠΛ͏·͘ར༻͢Δ͜ͱͰޮ తʹֶशͰ͖Δ ݴޠؒసҠ จ๏ೳྗʹ͍ͭͯݴޠؒసҠΛղऍ ධՁ͢Δํ๏ͱͯ͠ จ๏༰ೝੑஅλεΫˠ֤ݴޠͰ༰ೝ ෆ ՄೳจΛஅͰ͖Δ͔ݟΔ
෦ϓϩʔϏϯάˠϞσϧ෦ͰӨڹ͍ͯ͠Δ෦ΛݟΔ ߏతϓϥΠϛϯάޮՌ ˠ֤ݴޠͰڞ༗͍ͯ͠Δจ๏දݱ͕൚Խ͞Ε͍ͯΔ͔ݟΔ 3 -
ߏతϓϥΠϛϯάޮՌ ਓؒ ҎԼͷΑ͏ͳ༩֨ަସߏจ ӳޠB ΦϥϯμޠC Λߟ͑Δ (a)The cook shows a
hat to the boxer. (PO:Prepositional Object) (b)De kok toont een hoed aan de bokser.(PO) (aʼ)The cook shows the boxer a hat. (DO:Double Object) (bʼ)De kok toont de bokser een hoed. (DO) 4 -
ߏతϓϥΠϛϯάޮՌ ਓؒ ҎԼͷΑ͏ͳ༩֨ަସߏจ ӳޠB ΦϥϯμޠC Λߟ͑Δ (a)The cook shows a
hat to the boxer. (PO:Prepositional Object) (b)De kok toont een hoed aan de bokser.(PO) (aʼ)The cook shows the boxer a hat. (DO:Double Object) (bʼ)De kok toont de bokser een hoed. (DO) BˠB`ͱCˠC`ͷަସݴޠʹؔΘΒͣಉ͡จ๏ݱ ·ͨB B` C C`ͯ͢ҙຯಉ͡ 4 -
ߏతϓϥΠϛϯάޮՌ ਓؒ ϓϥΠϜจΛݟͤͨ͋ͱλʔήοτจΛੜͤ͞Δ ྫ͑ C ˠ B ͱ͔ C` ˠ
B ͱ͔ͰఏࣔˠੜΛ͓͜ͳ͏ 5 -
ߏతϓϥΠϛϯάޮՌ ਓؒ ϓϥΠϜจΛݟͤͨ͋ͱλʔήοτจΛੜͤ͞Δ ྫ͑ C ˠ B ͱ͔ C` ˠ
B ͱ͔ͰఏࣔˠੜΛ͓͜ͳ͏ ͜ͷͱ͖ਓؒϓϥΠϜจͱಉ͡ߏΛ࣋ͬͨλʔήοτจΛ ΑΓੜ͍͢͠ͱ͍͏͜ͱ͕ΒΕ͍ͯΔ ઌͷྫͩͱ C` ΛݟͨޙΑΓ C Λݟͨޙͷํ͕ B Λੜ͍͢͠ ੜҎ֎ʹ؟ٿσʔλΛ༻͍ͨಡΈ࣮ݧ͋ΓαϓϥΠβϧཧ͔ Βͷઆ໌ͳ͞Ε͍ͯΔ 5 -
ߏతϓϥΠϛϯάޮՌ ਓؒ ϓϥΠϜจΛݟͤͨ͋ͱλʔήοτจΛੜͤ͞Δ ྫ͑ C ˠ B ͱ͔ C` ˠ
B ͱ͔ͰఏࣔˠੜΛ͓͜ͳ͏ ͜ͷͱ͖ਓؒϓϥΠϜจͱಉ͡ߏΛ࣋ͬͨλʔήοτจΛ ΑΓੜ͍͢͠ͱ͍͏͜ͱ͕ΒΕ͍ͯΔ ઌͷྫͩͱ C` ΛݟͨޙΑΓ C Λݟͨޙͷํ͕ B Λੜ͍͢͠ ੜҎ֎ʹ؟ٿσʔλΛ༻͍ͨಡΈ࣮ݧ͋ΓαϓϥΠβϧཧ͔ Βͷઆ໌ͳ͞Ε͍ͯΔ ਓؒʹ͓͚Δ࣮ݧͰసҠޮՌॱংʹґଘͯ͠ޮՌ ͕มΘΔͱ͍͏݁Ռ͕͋Δ ୯ʹޙʹֶशͨ͠-ͷํ͕Α͘Ͱ͖ΔͰ͠ΐ͏ͱ͍͏ओு 5 -
ߏతϓϥΠϛϯάޮՌ -. ϓϥΠϜจΛݟͤͨ͋ͱλʔήοτจͷੜ֬ΛݟΔ ྫ͑ C ˠ B ͱ͔ C` ˠ
B ͱ͔ͰఏࣔˠੜΛ͓͜ͳ͏ 6 -
ߏతϓϥΠϛϯάޮՌ -. ϓϥΠϜจΛݟͤͨ͋ͱλʔήοτจͷੜ֬ΛݟΔ ྫ͑ C ˠ B ͱ͔ C` ˠ
B ͱ͔ͰఏࣔˠੜΛ͓͜ͳ͏ ਖ਼نԽ͞Εͨੜ֬ͷࠩΛݟͯϓϥΠϛϯάޮՌΛݕূ 1ϓϥΠϜ 5λʔήοτ 1 Y ֬ ฏۉ 6 -
֓ཁ -.͕֫ಘͨ͠จ๏ೳྗͷݴޠؒసҠʹ͍ͭͯ മ࿐ॱংͱྔΛ౷੍ֶͯ͠श͞ΕͨϞσϧʹରͯ͠ ߏϓϥΠϛϯάޮՌΛ \Φϥϯμޠ εϖΠϯޠ ϙʔϥϯυޠ ΪϦγϟޠ^ͱӳޠͷ ݴޠϖΞͰݕূΛߦͬͨ ࣮ݧ݁Ռͱͯ͠શମΛ௨ͨ͠ϓϥΠϛϯάޮՌ͕֬ೝ͞Εͨ
ҰํͰసҠޮՌʹॱংͰઆ໌Ͱ͖ͳ͍ඇରশੑ͕ݱΕͨ ಛʹӳޠΛλʔήοτͱͨ͠ͱ͖ʹޮՌ͕େ͖͘ͳͬͨ 7 -
Ϟσϧͷֶश ֶशσʔλͱമ࿐ॱংΛ౷੍͢Δ ϞϊϦϯΨϧίʔύεΛܨ͚͛ͨͩͷ4FRVFOUJBM -Λʮ෮शʯ͢ΔΑ͏ͳ4JNVMUBOFPVT 9 En Du #UPL #UPL Du
En L1 L2 En Du #UPL # #UPL Du En En Du -
ධՁ ֶशͨ͠Ϟσϧʹରͯ͠-ˠ-ͷϓϥΠϛϯάޮՌͰධՁ ͭͷจ๏ݱʹ͍ͭͯѻͬͨ %010 THFOJUJWFPGHFOJUJWF ॴ༗֨ද 5IFOVO`TFHHJTZFMMPX THFOJUJWF 5IFFHHPGUIFOVOJTZFMMPX
PGHFOJUJWF "DUJWF1BTTJWF ೳಈଶडಈଶ 5IFUBYJDIBTFTUIFUSVDL 5IFUSVDLJTDIBTFECZUIFUBYJ Φϥϯμޠͭͷจ๏ݱʹ͍ͭͯ ଞݴޠೳಈड༰ͷΈ ֤ݴޠϖΞͰϖΞΛධՁʹͬͨ 11 -
ٞ ֶशͨ͠Ϟσϧʹରͯ͠#-J.1ͰධՁ #-J.1-ͰԼ͍ͯ͠Δͷʹର͠ ϓϥΠϛϯάޮՌॱংʹΑΒͣݱΕ ͍ͯΔ #-J.1ɿޡΓͷ͋ΔϛχϚϧɾϖΞʹ ͓͍ͯ ਖ਼ྫʹΑΓߴ͍֬ΛׂΓͯΒΕΔ ͔ͷλεΫ These
casseroles disgust Kayla. ↑こっちに⾼い確率を割り当てたい These casseroles disgusts Kayla. 13 -
ݸਓతͳײ 1SPT จ๏༰ೝੑஅλεΫͳͲڞ༗ͨ͠จ๏ݱʹ͍ͭͯධՁͰ ͖ͳ͍ͷͰ ͜ͷจ๏ݱͱΓ͋͑ͣڞ༗ సҠ͍ͯͦ͠͏ͱ ͍͏͜ͱ͕ݴ͑Δͷ͕خ͍͠ αϓϥΠβϧཧͰͷઆ໌͕ͳ͞Ε͍ͯΔΒ͘͠-.ͷධՁʹ ͑ͦ͏Ͱخ͍͠ $POT
ඇରশੑ͕୯७ʹӳޠҎ֎ͷσʔληοτʹӳޠؚ͕·Ε͢ ͍ͱ͍͏͚ͩͰݴޠͱͯ͠ྨࣅ͍ͯ͠Δͱ͔ݴޠݻ༗ͷͳʹ͔ Λ͍ࣔࠦͯ͠Δͱ͍͏ͷૣܭͳؾ͕͢Δ 16