On the Acquisition of Shared Grammatical Representations in Bilingual Language Models

ACL読み会2025@名大で使用したスライドです

Transcript

1. 0O
   UIF
   "DRVJTJUJPO
   PG
   4IBSFE
   (SBNNBUJDBM
   3FQSFTFOUBUJPOT
   JO
   #JMJOHVBM
   -BOHVBHF
   .PEFMT Catherine Arnett, Tyler A. Chang, James A. Michaelov, Ben Bergen https://aclanthology.org/2025.acl-long.1010/ ʮ"$-ಡΈձ!໊େʯ
   ࢿྉ ੩Ԭେֶङ໺ݚڀࣨ #ࢁޱਅ
2. ໨࣍ ಋೖ ߏ଄తϓϥΠϛϯάޮՌ ֓ཁ Ϟσϧͷֶश ධՁ ٞ࿦ ·ͱΊ ݸਓతͳײ૝ 1
3. ಋೖ  ݴޠϞσϧ͸͢Ͱʹֶशͨ͠ݴޠΛ͏·͘ར༻͢Δ͜ͱͰޮ཰ తʹֶशͰ͖Δ ݴޠؒసҠ సҠޮՌ͕ݴޠϖΞʹΑ͕ͬͯࠩ͋Δ͜ͱ͕஌ΒΕ͍ͯΔ ݴޠతʹ͍ۙͱసҠޮՌ͕ߴ͍ FH
   ෹ˠӳ
   
   ೔ˠӳ ίʔύεதͷڞ༗͞Εͨޠኮ΍දݱͷස౓͕ߴ͍ͱసҠޮՌ͕ߴ͍ ࠷ۙͷݴޠؒసҠͷݚڀͰ͸సҠޮՌʹඇରশੑ͕͋ΔՄೳੑ ͕ࣔࠦ͞Ε͍ͯΔ νϕοτޠˠӳ
   
   ӳˠνϕοτޠ 2
4. ಋೖ  ݴޠϞσϧ͸͢Ͱʹֶशͨ͠ݴޠΛ͏·͘ར༻͢Δ͜ͱͰޮ཰ తʹֶशͰ͖Δ ݴޠؒసҠ సҠޮՌ͕ݴޠϖΞʹΑ͕ͬͯࠩ͋Δ͜ͱ͕஌ΒΕ͍ͯΔ ݴޠతʹ͍ۙͱసҠޮՌ͕ߴ͍ FH
   ෹ˠӳ
   
   ೔ˠӳ ίʔύεதͷڞ༗͞Εͨޠኮ΍දݱͷස౓͕ߴ͍ͱసҠޮՌ͕ߴ͍ ࠷ۙͷݴޠؒసҠͷݚڀͰ͸సҠޮՌʹඇରশੑ͕͋ΔՄೳੑ ͕ࣔࠦ͞Ε͍ͯΔ νϕοτޠˠӳ
   
   ӳˠνϕοτޠ ݴޠϞσϧ͕ͲͷΑ͏ͳจ๏ೳྗΛͲͷΑ͏ʹసҠ͍ͤͯ͞Δ ͷ͔Λ໌Β͔ʹ͍ͨ͠ˠਓؒͷݴޠ֫ಘͷղ໌ 2
5. ಋೖ  ݴޠϞσϧ͸͢Ͱʹֶशͨ͠ݴޠΛ͏·͘ར༻͢Δ͜ͱͰޮ཰ తʹֶशͰ͖Δ ݴޠؒసҠ จ๏ೳྗʹ͍ͭͯݴޠؒసҠΛղऍ ධՁ͢Δํ๏ͱͯ͠ จ๏༰ೝੑ൑அλεΫˠ֤ݴޠͰ༰ೝ ෆ ՄೳจΛ൑அͰ͖Δ͔ݟΔ ಺෦ϓϩʔϏϯάˠϞσϧ಺෦ͰӨڹ͍ͯ͠Δ෦෼ΛݟΔ 3
6. ಋೖ  ݴޠϞσϧ͸͢Ͱʹֶशͨ͠ݴޠΛ͏·͘ར༻͢Δ͜ͱͰޮ཰ తʹֶशͰ͖Δ ݴޠؒసҠ จ๏ೳྗʹ͍ͭͯݴޠؒసҠΛղऍ ධՁ͢Δํ๏ͱͯ͠ จ๏༰ೝੑ൑அλεΫˠ֤ݴޠͰ༰ೝ ෆ ՄೳจΛ൑அͰ͖Δ͔ݟΔ ಺෦ϓϩʔϏϯάˠϞσϧ಺෦ͰӨڹ͍ͯ͠Δ෦෼ΛݟΔ ߏ଄తϓϥΠϛϯάޮՌ
   ˠ֤ݴޠͰڞ༗͍ͯ͠Δจ๏දݱ͕൚Խ͞Ε͍ͯΔ͔ݟΔ 3
7. ߏ଄తϓϥΠϛϯάޮՌ ਓؒ ҎԼͷΑ͏ͳ༩֨ަସߏจ ӳޠB ΦϥϯμޠC Λߟ͑Δ (a)The cook shows a hat to the boxer. (PO:Prepositional Object) (b)De kok toont een hoed aan de bokser.(PO) (aʼ)The cook shows the boxer a hat. (DO:Double Object) (bʼ)De kok toont de bokser een hoed. (DO) 4
8. ߏ଄తϓϥΠϛϯάޮՌ ਓؒ ҎԼͷΑ͏ͳ༩֨ަସߏจ ӳޠB ΦϥϯμޠC Λߟ͑Δ (a)The cook shows a hat to the boxer. (PO:Prepositional Object) (b)De kok toont een hoed aan de bokser.(PO) (aʼ)The cook shows the boxer a hat. (DO:Double Object) (bʼ)De kok toont de bokser een hoed. (DO) BˠB`ͱCˠC`ͷަସ͸ݴޠʹؔΘΒͣಉ͡จ๏ݱ৅ ·ͨB
   B`
   C
   C`͸͢΂ͯҙຯ͸ಉ͡ 4
9. ߏ଄తϓϥΠϛϯάޮՌ ਓؒ ϓϥΠϜจΛݟͤͨ͋ͱλʔήοτจΛੜ੒ͤ͞Δ ྫ͑͹ C ˠ B ͱ͔ C` ˠ B ͱ͔Ͱఏࣔˠੜ੒Λ͓͜ͳ͏ 5
10. ߏ଄తϓϥΠϛϯάޮՌ ਓؒ ϓϥΠϜจΛݟͤͨ͋ͱλʔήοτจΛੜ੒ͤ͞Δ ྫ͑͹ C ˠ B ͱ͔ C` ˠ B ͱ͔Ͱఏࣔˠੜ੒Λ͓͜ͳ͏ ͜ͷͱ͖ਓؒ͸ϓϥΠϜจͱಉ͡ߏ଄Λ࣋ͬͨλʔήοτจΛ ΑΓੜ੒͠΍͍͢ͱ͍͏͜ͱ͕஌ΒΕ͍ͯΔ ઌͷྫͩͱ C` ΛݟͨޙΑΓ C Λݟͨޙͷํ͕ B Λੜ੒͠΍͍͢ ੜ੒Ҏ֎ʹ΋؟ٿσʔλΛ༻͍ͨಡΈ࣮ݧ΋͋ΓαϓϥΠβϧཧ࿦͔ Βͷઆ໌΋ͳ͞Ε͍ͯΔ 5
11. ߏ଄తϓϥΠϛϯάޮՌ ਓؒ ϓϥΠϜจΛݟͤͨ͋ͱλʔήοτจΛੜ੒ͤ͞Δ ྫ͑͹ C ˠ B ͱ͔ C` ˠ B ͱ͔Ͱఏࣔˠੜ੒Λ͓͜ͳ͏ ͜ͷͱ͖ਓؒ͸ϓϥΠϜจͱಉ͡ߏ଄Λ࣋ͬͨλʔήοτจΛ ΑΓੜ੒͠΍͍͢ͱ͍͏͜ͱ͕஌ΒΕ͍ͯΔ ઌͷྫͩͱ C` ΛݟͨޙΑΓ C Λݟͨޙͷํ͕ B Λੜ੒͠΍͍͢ ੜ੒Ҏ֎ʹ΋؟ٿσʔλΛ༻͍ͨಡΈ࣮ݧ΋͋ΓαϓϥΠβϧཧ࿦͔ Βͷઆ໌΋ͳ͞Ε͍ͯΔ ਓؒʹ͓͚Δ࣮ݧͰ͸సҠޮՌ͸ॱংʹґଘͯ͠ޮՌ ͕มΘΔͱ͍͏݁Ռ͕͋Δ ୯ʹޙʹֶशͨ͠-ͷํ͕Α͘Ͱ͖ΔͰ͠ΐ͏ͱ͍͏ओு 5
12. ߏ଄తϓϥΠϛϯάޮՌ -. ϓϥΠϜจΛݟͤͨ͋ͱλʔήοτจͷੜ੒֬཰ΛݟΔ ྫ͑͹ C ˠ B ͱ͔ C` ˠ B ͱ͔Ͱఏࣔˠੜ੒Λ͓͜ͳ͏ 6
13. ߏ଄తϓϥΠϛϯάޮՌ -. ϓϥΠϜจΛݟͤͨ͋ͱλʔήοτจͷੜ੒֬཰ΛݟΔ ྫ͑͹ C ˠ B ͱ͔ C` ˠ B ͱ͔Ͱఏࣔˠੜ੒Λ͓͜ͳ͏ ਖ਼نԽ͞Εͨੜ੒֬཰ͷࠩΛݟͯϓϥΠϛϯάޮՌΛݕূ 1ϓϥΠϜ 5λʔήοτ
    1 Y ֬཰ ฏۉ
    6
14. ֓ཁ -.͕֫ಘͨ͠จ๏ೳྗͷݴޠؒసҠʹ͍ͭͯ മ࿐ॱংͱྔΛ౷੍ֶͯ͠श͞ΕͨϞσϧʹରͯ͠ ߏ଄ϓϥΠϛϯάޮՌΛ \Φϥϯμޠ εϖΠϯޠ
    ϙʔϥϯυޠ ΪϦγϟޠ^ͱӳޠͷ ݴޠϖΞͰݕূΛߦͬͨ ࣮ݧ݁Ռͱͯ͠શମΛ௨ͨ͠ϓϥΠϛϯάޮՌ͕֬ೝ͞Εͨ ҰํͰసҠޮՌʹ͸ॱংͰ͸આ໌Ͱ͖ͳ͍ඇରশੑ͕ݱΕͨ ಛʹӳޠΛλʔήοτͱͨ͠ͱ͖ʹޮՌ͕େ͖͘ͳͬͨ 7
15. Ϟσϧͷֶश ֤ݴޠϖΞͰֶशσʔλͱമ࿐ॱং - - Λ౷੍͢Δ 04$"3ͷ֤ݴޠ্͔Β.ߦͱͬͯ τʔΫφΠβΛ֤ݴޠϖΞͰͦΕͧΕֶशͯ͠ γʔέϯε࠷େ௕UPLFOʹௐ੔ͯ͠ #UPLFOΛαϯϓϦϯάͨ͠ (15TNBMMΛॳظԽ͔ͯ͠Βֶश Lεςοϓͣͭ-ˠ-ͰܭLεςοϓֶशͨ͠ 8
16. Ϟσϧͷֶश ֶशσʔλͱമ࿐ॱংΛ౷੍͢Δ ϞϊϦϯΨϧίʔύεΛܨ͚͛ͨͩͷ4FRVFOUJBM -Λʮ෮शʯ͢ΔΑ͏ͳ4JNVMUBOFPVT 9 En Du #
    UPL #
    UPL Du En L1 L2 En Du #
    UPL # #UPL Du En En Du
17. Ϟσϧͷֶश νΣοΫϙΠϯτ͝ͱͷ αϓϥΠβϧͷભҠ ӈ൒෼ 4FRVFOUJBM -ֶश௚ޙʹ-ͷείΞ ͕ٸܹʹѱԽ ഁ໓త๨٫ ΪϦγϟޠ ྨࣅ౓௿ ͸ ಛʹѱԽ 10
18. ධՁ ֶशͨ͠Ϟσϧʹରͯ͠-ˠ-ͷϓϥΠϛϯάޮՌͰධՁ ͭͷจ๏ݱ৅ʹ͍ͭͯѻͬͨ %010 THFOJUJWFPGHFOJUJWF ॴ༗֨ද৅
    5IF
    OVO`T
    FHH
    JT
    ZFMMPX THFOJUJWF 5IF
    FHH
    PG
    UIF
    OVO
    JT
    ZFMMPX PGHFOJUJWF "DUJWF1BTTJWF ೳಈଶडಈଶ
    5IF
    UBYJ
    DIBTFT
    UIF
    USVDL 5IF
    USVDL
    JT
    DIBTFE
    CZ
    UIF
    UBYJ Φϥϯμޠ͸ͭͷจ๏ݱ৅ʹ͍ͭͯ ଞݴޠ͸ೳಈड༰ͷΈ ֤ݴޠϖΞͰϖΞΛධՁʹ࢖ͬͨ 11
19. ධՁ 12 4JNVMUBOFPVT ্ ʹ͓͍ͯӳޠΛλʔήοτʹͱͬͨશͯͷ ϖΞͰϓϥΠϛϯάޮՌ͕༗ҙʹݟΒΕͨ ඇରশੑ ҰํͰΪϦγϟޠ΍ϙʔϥϯυޠͰ͸༗ҙͳޮՌ͕ಘΒΕͳ ͔ͬͨ΋ͷ΋͋ͬͨ ݴޠྨࣅ౓ʹىҼ͍ͯ͠Δͱߟ࡯
20. ٞ࿦ ֶशͨ͠Ϟσϧʹରͯ͠#-J.1ͰධՁ #-J.1͸-Ͱ௿Լ͍ͯ͠Δͷʹର͠ ϓϥΠϛϯάޮՌ͸ॱংʹΑΒͣݱΕ ͍ͯΔ #-J.1ɿޡΓͷ͋ΔϛχϚϧɾϖΞʹ ͓͍ͯ ਖ਼ྫʹΑΓߴ͍֬཰ΛׂΓ౰ͯΒΕΔ ͔ͷλεΫ These casseroles disgust Kayla. ↑こっちに⾼い確率を割り当てたい These casseroles disgusts Kayla. 13
21. ಛʹΪϦγϟޠʹ͍ͭͯ ΪϦγϟޠ͸ จࣈͷڞ༗͕ͳ͍ ޠॱͷ੍໿͕ൺֱతΏΔ͍ डಈଶΛCF
    աڈ෼ࢺͰ͸ͳ͘ಈࢺͷ׆༻Ͱද͢ ͑ʂʁ ͜ͷ͋ͨΓ͔ΒసҠޮՌ͕௿͔ͬͨͱߟ࡯͍ͯ͠Δ 14
22. ·ͱΊ -.͕֫ಘͨ͠จ๏ೳྗͷݴޠؒసҠʹ͍ͭͯ മ࿐ॱংͱྔΛ౷੍ֶͯ͠श͞ΕͨϞσϧʹରͯ͠ ߏ଄ϓϥΠϛϯάޮՌͰݕূͨ͠ ݁Ռͱͯ͠ॱংͰ͸આ໌Ͱ͖ͳ͍ඇରশੑ͕ݱΕͨ ಛʹӳޠΛλʔήοτݴޠͱͨ͠ͱ͖ʹޮՌ͕େ͖͘ͳͬͨ ݴޠతʹྨࣅ͍ͯ͠Δ΋ͷ΄ͲసҠޮՌ͕ߴ͔ͬͨ 15
23. ݸਓతͳײ૝ 1SPT จ๏༰ೝੑ൑அλεΫͳͲ͸ڞ༗ͨ͠จ๏ݱ৅ʹ͍ͭͯධՁͰ ͖ͳ͍ͷͰ ͜ͷจ๏ݱ৅͸ͱΓ͋͑ͣڞ༗ సҠ͍ͯͦ͠͏ͱ ͍͏͜ͱ͕ݴ͑Δͷ͕خ͍͠ αϓϥΠβϧཧ࿦Ͱͷઆ໌͕ͳ͞Ε͍ͯΔΒ͘͠-.ͷධՁʹ ࢖͑ͦ͏Ͱخ͍͠ $POT ඇରশੑ͕୯७ʹӳޠҎ֎ͷσʔληοτʹӳޠؚ͕·Ε΍͢ ͍ͱ͍͏͚ͩͰݴޠͱͯ͠ྨࣅ͍ͯ͠Δͱ͔ݴޠݻ༗ͷͳʹ͔ Λ͍ࣔࠦͯ͠Δͱ͍͏ͷ͸ૣܭͳؾ͕͢Δ 16