Share
Embed
論文紹介: On the Limitations of Unsupervised Bilingual Dictionary Induction
首都大 小町研 ACL 2018 読み会
画像が荒いです、元論文を参照してください
Satoru Katsumata
December 10, 2023
Transcript
22 slides
-
֓ཁ w -BNQMFFUBMʹΑͬͯVOTVQFSWJTFE.5͕ΛूΊ͍ͯΔ ˠͦ͜ͰఏҊ͞Εͨख๏VOTVQFSWJTFEBMJHONFOUPGXPSE FNCFEEJOHʹΑΔCJMJOHVBMEJDUJPOBSZJOEVDUJPO #%* $POOFBVFUBM Λجʹ͍ͯ͠Δ
w ͜ͷจ$POOFBVFUBM͕ͲͷΑ͏ͳঢ়گͰ্ख͘ߦ͘ͷ͔ Λੳ͍ͯ͠Δ w $POOFBVFUBMͷख๏ʹରͯ͠XFBLTVQFSWJTJPOTJHOBMΛೖ Εͯͪΐͬͱਫ਼Λ্͕Δ͜ͱΛࣔͨ͠ w ̎ͭͷNPOPMJOHVBMXPSEFNCFEEJOH͔Βग़དྷ্͕Δ CJMJOHVBMEJDUJPOBSZͷੑೳΛධՁ͢ΔNFUSJDΛఏҊ !2 8PSE5SBOTMBUJPO8JUIPVU1BSBMMFM%BUB$POOFBVFUBM *$-3 6OTVQFSWJTFE.BDIJOF5SBOTMBUJPO6TJOH.POPMJOHVBM$PSQPSB0OMZ-BNQMFFUBM *$-3 -
֓ཁ w -BNQMFFUBMʹΑͬͯVOTVQFSWJTFE.5͕ΛूΊ͍ͯΔ ˠͦ͜ͰఏҊ͞Εͨख๏VOTVQFSWJTFEBMJHONFOUPGXPSE FNCFEEJOHʹΑΔCJMJOHVBMEJDUJPOBSZJOEVDUJPO #%* $POOFBVFUBM Λجʹ͍ͯ͠Δ
w ͜ͷจ$POOFBVFUBM͕ͲͷΑ͏ͳঢ়گͰ্ख͘ߦ͘ͷ͔ Λੳ͍ͯ͠Δ w $POOFBVFUBMͷख๏ʹରͯ͠XFBLTVQFSWJTJPOTJHOBMΛೖ Εͯͪΐͬͱਫ਼Λ্͕Δ͜ͱΛࣔͨ͠ w ̎ͭͷNPOPMJOHVBMXPSEFNCFEEJOH͔Βग़དྷ্͕Δ CJMJOHVBMEJDUJPOBSZͷੑೳΛධՁ͢ΔNFUSJDΛఏҊ !3 8PSE5SBOTMBUJPO8JUIPVU1BSBMMFM%BUB$POOFBVFUBM *$-3 6OTVQFSWJTFE.BDIJOF5SBOTMBUJPO6TJOH.POPMJOHVBM$PSQPSB0OMZ-BNQMFFUBM *$-3 1ISBTF#BTFE/FVSBM 6OTVQFSWJTFE.BDIJOF5SBOTMBUJPO-BNQMFFUBM &./-1Ͱ ʢ4.5ଆͰʣ͜ͷख๏Λ༻͍ͯ͠Δ -
$POOFBVFUBM " ͦΕͧΕͷNPOPMJOHVBMXPSEFNCFEEJOHTΛ࡞ʢ&OHMJTIɺ੨*UBMJBOʣ # 9ͷFNCFEEJOHTΛ:ͷFNCFEEJOHTTQBDFඈ͢Α͏ʹ8Λ BEWFSTBSJBMʹֶश͢Δ ʢ89ͱ:ΛEJTDSJNJOBUFɺ8͜ΕΛGPPM͢ΔΑ͏ʹ͢Δʣ $ ߴසͳ୯ޠΛBODIPSͱͯ͠ɺߦϓϩΫϥεςεੳΛ༻͍ͯɺ8Λ
SFpOFNFOU͍ͯ͘͠ % ͋Δ୯ޠʹରͯ͠ɺ͏Ұํͷݴޠۭ͔ؒΒۙ୯ޠΛ୳͢ ͜ͷ࣌ͷڑɺDPTྨࣅϕʔεͰIVCOFTTΛܰݮͯ͠ܭଌ͢Δ !4 ˢͷਤ8PSE5SBOTMBUJPO8JUIPVU1BSBMMFM%BUB$POOFBVFUBM *$-3ΑΓҾ༻ -
$POOFBVFUBM " ͦΕͧΕͷNPOPMJOHVBMXPSEFNCFEEJOHTΛ࡞ʢ&OHMJTIɺ੨*UBMJBOʣ # 9ͷFNCFEEJOHTΛ:ͷFNCFEEJOHTTQBDFඈ͢Α͏ʹ8Λ BEWFSTBSJBMʹֶश͢Δ ʢ89ͱ:ΛEJTDSJNJOBUFɺ8͜ΕΛGPPM͢ΔΑ͏ʹ͢Δʣ $ ߴසͳ୯ޠΛBODIPSͱͯ͠ɺߦϓϩΫϥεςεੳΛ༻͍ͯɺ8Λ
SFpOFNFOU͍ͯ͘͠ % ͋Δ୯ޠʹରͯ͠ɺ͏Ұํͷݴޠۭ͔ؒΒۙ୯ޠΛ୳͢ ͜ͷ࣌ͷڑɺDPTྨࣅϕʔεͰIVCOFTTΛܰݮͯ͠ܭଌ͢Δ !5 .POPMJOHVBMXPSEFNCFEEJOHTHSBQIT ۙࣅతJTPNPSQIJDͰ͋Δͱ͍͏Ծఆʹج͍͍ͮͯΔ ʢ.JLPMPWFUBM#BSPOF;IBOHFUBM$POOFBVFUBMʣ -
$POOFBVFUBM " ͦΕͧΕͷNPOPMJOHVBMXPSEFNCFEEJOHTΛ࡞ʢ&OHMJTIɺ੨*UBMJBOʣ # 9ͷFNCFEEJOHTΛ:ͷFNCFEEJOHTTQBDFඈ͢Α͏ʹ8Λ BEWFSTBSJBMʹֶश͢Δ ʢ89ͱ:ΛEJTDSJNJOBUFɺ8͜ΕΛGPPM͢ΔΑ͏ʹ͢Δʣ $ ߴසͳ୯ޠΛBODIPSͱͯ͠ɺߦϓϩΫϥεςεੳΛ༻͍ͯɺ8Λ
SFpOFNFOU͍ͯ͘͠ % ͋Δ୯ޠʹରͯ͠ɺ͏Ұํͷݴޠۭ͔ؒΒۙ୯ޠΛ୳͢ ͜ͷ࣌ͷڑɺDPTྨࣅϕʔεͰIVCOFTTΛܰݮͯ͠ܭଌ͢Δ !6 8ߦߦྻ ˣͷࣜͰJUFSBUJWFMZʹ8Λߋ৽͍ͯ͘͠ -
ͪΐͬͱͨ͠ڭࢣ৴߸ΛೖΕΔͱʜ w $POOFBVFUBMͷख๏ʹରͯ͠XFBLTVQFSWJTJPO TJHOBMΛೖΕΔ͜ͱͰͪΐͬͱྑ͘ͳΔͷͰͳ͍͔ w ۩ମత XFBLTVQFSWJTJPOTJHOBMݴޠؒͰද͕ಉҰͳ୯ޠ ˢΛઌ΄ͲͷSFpOFNFOUεςοϓ࣌ͷTFFEࣙॻͱ͠ ͯϓϩΫϥεςεੳΛߦ͏ w
ҙMFNNBUJ[BUJPOͱ͔ߦΘͣɺ શʹͦͷ··ͷঢ়ଶͰ୯ޠͷදΛݟ͍ͯΔ !7 -
άϥϑͷྨࣅͷٻΊํ ۩ମతάϥϑ͔Β-BQMBDJBOFJHFOWBMVFTΛٻΊɺάϥϑؒͷ JTPTQFDUSBM߹͍Λάϥϑͷྨࣅͱͯ͠༻͢Δ !11 L2 : graph2 L1 : graph1
֤άϥϑͰɺݻ༗Λɺ߹ܭͯ͠શମͷҎԼͷ݅ͰɺݸऔΓग़͢ ʢ͔Βݸɺ͔ΒݸऔΕΔʣɺͱͯ͠ɺ ҎԼͷΑ͏ʹ֤ݻ༗ͷࠩΛूੵ͢Δ ˠ͜ͷूੵͨࠩ͠Λάϥϑؒͷྨࣅͱ͢Δ ʢ͕খ͍͞ํ͕ྨࣅ͕େ͖͍ʣ L1 k1 L2 k2 ki k = min(k1 , k2 ) Δ = k ∑ i=1 (λ1i − λ2i ) 2 k = min j ∑k i=1 λji ∑n i=1 λji > 0.9 ઌ΄Ͳͷྫͩͱ L -
ࠓճௐΔ༰ w $POOFBVFUBMͷख๏্͕ख͍͘͘ઃఆɺ͍͔ͳ͍ઃఆΛௐ͍ͨ w <ݴޠతಛ>EFQFOEFUNBSLJOHͰͳ͍ݴޠʹ͍ͭͯՃ࣮ݧ ˢ$POOFBVFUBMɺ΄ͱΜͲEFQFOEFOUNBSLJOHͷݴޠʹ͍࣮ͭͯݧΛ͍ͯ͠ΔͨΊ w <σʔλͷಛ>NPOPMJOHVBMDPSQPSBͷEPNBJOΛม͑ͨ ˢ$POOFBVFUBMɺ8JLJQFEJBΛ༻ɺDPNQBSBCMFͳঢ়گͷͨΊ w
<FNCFEEJOHͷಛ>4(/4ͱ$#08ɺϋΠύʔύϥϝʔλʹΑΔੑೳͷมԽ ˢ$POOFBVFUBMɺݴޠؒͰಉ͡ϋΠύʔύϥϝʔλʹ͍ͯ͠ΔͨΊ w <࣍ݩͷಛ>FNCFEEJOHTQBDFͷ࣍ݩΛখͨ͘͞͠Γͨ͠ w <UFTUͷ୯ޠͷಛ>ධՁ࣌ʹ༻͢Δ୯ޠͰɺ্ख͍͖͍͘͢୯ޠͱ͍͔ͳ͍ ୯ޠʹ͍ͭͯɺ104ͳͲʹͯ͠ੳͨ͠ !12 -
࣮ݧઃఆ w λεΫ#JMJOHVBM%JDUJPOBSZ*OEVDUJPO TSDଆͷ୯ޠΛ/݅༻ҙ͢Δ DSPTTMJOHVBMTQBDF͔ΒରԠ͢Δ UHUଆͷ୯ޠΛ୳ͯ͘͠Δ Ͱݟ͚ͭͨ୯ޠͱHPMEΛൺֱͯ͠ɺ ߹͍ͬͯΔ͔Ͳ͏͔ΛௐΔʢධՁ1SFDJTJPOBUʣ w XPSEFNCFEEJOHTGBTU5FYU
ઃఆ4(/4 XJOEPX DIBS@OHSBN EJN !13 $POOFBVFUBM 5IJTXPSL -BOHVBHFT &OHMJTIUP 'SFODI (FSNBO $IJOFTF 3VTTJBO 4QBOJTI 4QBOJTI &TUPOJBO &5 'JOOJTI '* (SFFL &- )VOHBSJBO )6 1PMJTI 1- 5VSLJTI 53 -
ݴޠతˠσʔλˠFNCFEEJOHˠ࣍ݩˠ୯ޠ σʔλͷಛʹ͍ͭͯ w &1&VSP1BSM7 8JLJ8JLJQFEJB &.&"NFEJDBMEPNBJO w &/\&4 '* )6^
w BDEPNBJOTJNJMBSJUZ EGڭࢣ৴߸͋Γ HG$POOFBVFUBM w ҙ ֤ίʔύεͷαΠζ .TFOUTͰ౷Ұ ʢXJLJઌ΄ͲΑΓখ͍͞ʣ w $POOFBVFBBMͷख๏ σʔλ͕ἧΘͳ͍ͱશવμϝ !16 -
FNCFEEJOHͷಛʹ͍ͭͯ w &/&4Ͱ࣮ݧ w &/ଆ 4(/4ɺXJOEPXɺDIBSOHSBNͰݻఆ w &4ҎԼΛม͑ͨ XJOEPX DIBSOHSBN
BMHPSJUIN<4(/4 $#08> w ͪΐͬͱͨ͠ϋΠύʔύϥϝʔλͷมԽ ˠͦ͜·ͰӨڹͳ͠ w 4(/4ˠ$#08 ˠશવμϝʜ !17 ݴޠతˠσʔλˠFNCFEEJOHˠ࣍ݩˠ୯ޠ -
࣍ݩͷಛʹ͍ͭͯ w ઌ΄Ͳ·ͰEJN ˠEJNͷFNCFEEJOHͰͬͯΈͨ w &/\&5 '* &-^Ͱͪΐͬͱ ྑ͘ͳ͍ͬͯΔ w
EJNͩͱNPOPMJOHVBM XPSEFNCFEEJOH͕ &5 '* &-ͷ͍͠ಛʹ PWFSpU͍ͯ͠Δ͔Βʁ w EJNͰͷͨΓํʢ104ͱ͔ʣ Έ͍ͨ !18 EJN EJN &/&4 &/&5 &/'* &/&- &/)6 &/1- &/53 ݴޠతˠσʔλˠFNCFEEJOHˠ࣍ݩˠ୯ޠ -
·ͱΊ w ڭࢣͳ͠#JMJOHVBM%JDUJPOBSZ*OEVDUJPOɺಛʹ $POOFBVFUBMʹΑΔख๏͕ͲͷΑ͏ͳঢ়گͰ্ख͍͘ ͘ͷ͔Λௐͨ w άϥϑͷྨࣅ߹͍ͱCJMJOHVBMEJDUJPOBSZͷੑೳʹ૬ؔ ͕͋ͬͨ ˠࣅ͍ͯΔํ͕͍͍Μͩͳ͊ w
ͪΐͬͱͨ͠ڭࢣ৴߸ΛೖΕͯಉ͘͡Β͍͔߹ʹΑͬ ͯͪΐͬͱྑ͍ͬͯ݁Ռʹͳͬͨ !21 -
ࢀߟจݙ w 1SPDSVTUFTBOBMZTJT IUUQHWIBUFCMPKQFOUSZ w "$-Ͱͷൃදಈը IUUQTWJNFPDPN w ͜ͷεϥΠυதʹ͓͚Δ$POOFBVFUBM 8PSE5SBOTMBUJPOXJUIPVU1BSBMMFM%BUB$POOFBVFUBM
*$-3 w .POPMJOHVBMXPSEFNCFEEJOHT͕JTPNPSQIJDͰ͋Δ͜ͱʹؔ࿈͢Δจ &YQMPJUJOH4JNJMBSJUJFTBNPOH-BOHVBHFTGPS.BDIJOF5SBOTMBUJPO.JLPMPWFUBM BS9JW 5PXBSET$SPTTMJOHVBM%JTUSJCVUFE3FQSFTFOUBUJPOTXJUIPVU1BSBMMFM5FYU5SBJOFEXJUI"EWFSTBSJBM "VUP&ODPEFST#BSPOF 8PSLTIPQPO3FQSFTFOUBUJPO-FBSOJOHGPS/-1 "EWFSTBSJBM5SBJOJOHGPS6OTVQFSWJTFE#JMJOHVBM-FYJDPO*OEVDUJPO;IBOHFUBM "$- !22