Upgrade to Pro — share decks privately, control downloads, hide ads and more …

論文紹介: On the Limitations of Unsupervised Biling...

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →

論文紹介: On the Limitations of Unsupervised Bilingual Dictionary Induction

首都大 小町研 ACL 2018 読み会
画像が荒いです、元論文を参照してください

Satoru Katsumata

December 10, 2023

Transcript

22 slides
  1. ֓ཁ w -BNQMFFUBMʹΑͬͯVOTVQFSWJTFE.5͕஫໨ΛूΊ͍ͯΔ
 ˠͦ͜ͰఏҊ͞Εͨख๏͸VOTVQFSWJTFEBMJHONFOUPGXPSE FNCFEEJOHʹΑΔCJMJOHVBMEJDUJPOBSZJOEVDUJPO #%* 
 $POOFBVFUBM  Λجʹ͍ͯ͠Δ

    w ͜ͷ࿦จ͸$POOFBVFUBM͕ͲͷΑ͏ͳঢ়گͰ্ख͘ߦ͘ͷ͔ Λ෼ੳ͍ͯ͠Δ w $POOFBVFUBMͷख๏ʹରͯ͠XFBLTVQFSWJTJPOTJHOBMΛೖ Εͯͪΐͬͱਫ਼౓Λ্͕Δ͜ͱΛࣔͨ͠ w ̎ͭͷNPOPMJOHVBMXPSEFNCFEEJOH͔Βग़དྷ্͕Δ CJMJOHVBMEJDUJPOBSZͷੑೳΛධՁ͢ΔNFUSJDΛఏҊ !2 8PSE5SBOTMBUJPO8JUIPVU1BSBMMFM%BUB$POOFBVFUBM *$-3
 6OTVQFSWJTFE.BDIJOF5SBOTMBUJPO6TJOH.POPMJOHVBM$PSQPSB0OMZ-BNQMFFUBM *$-3
  2. ֓ཁ w -BNQMFFUBMʹΑͬͯVOTVQFSWJTFE.5͕஫໨ΛूΊ͍ͯΔ
 ˠͦ͜ͰఏҊ͞Εͨख๏͸VOTVQFSWJTFEBMJHONFOUPGXPSE FNCFEEJOHʹΑΔCJMJOHVBMEJDUJPOBSZJOEVDUJPO #%* 
 $POOFBVFUBM  Λجʹ͍ͯ͠Δ

    w ͜ͷ࿦จ͸$POOFBVFUBM͕ͲͷΑ͏ͳঢ়گͰ্ख͘ߦ͘ͷ͔ Λ෼ੳ͍ͯ͠Δ w $POOFBVFUBMͷख๏ʹରͯ͠XFBLTVQFSWJTJPOTJHOBMΛೖ Εͯͪΐͬͱਫ਼౓Λ্͕Δ͜ͱΛࣔͨ͠ w ̎ͭͷNPOPMJOHVBMXPSEFNCFEEJOH͔Βग़དྷ্͕Δ CJMJOHVBMEJDUJPOBSZͷੑೳΛධՁ͢ΔNFUSJDΛఏҊ !3 8PSE5SBOTMBUJPO8JUIPVU1BSBMMFM%BUB$POOFBVFUBM *$-3
 6OTVQFSWJTFE.BDIJOF5SBOTMBUJPO6TJOH.POPMJOHVBM$PSQPSB0OMZ-BNQMFFUBM *$-3 1ISBTF#BTFE/FVSBM 6OTVQFSWJTFE.BDIJOF5SBOTMBUJPO-BNQMFFUBM  &./-1Ͱ΋
 ʢ4.5ଆͰʣ͜ͷख๏Λ࢖༻͍ͯ͠Δ
  3. $POOFBVFUBM  " ͦΕͧΕͷNPOPMJOHVBMXPSEFNCFEEJOHTΛ࡞੒ʢ੺&OHMJTIɺ੨*UBMJBOʣ # 9ͷFNCFEEJOHTΛ:ͷFNCFEEJOHTTQBDF΁ඈ͹͢Α͏ʹ8Λ BEWFSTBSJBMʹֶश͢Δ
 ʢ89ͱ:ΛEJTDSJNJOBUFɺ8͸͜ΕΛGPPM͢ΔΑ͏ʹ͢Δʣ $ ߴස౓ͳ୯ޠΛBODIPSͱͯ͠ɺ௚ߦϓϩΫϥεςε෼ੳΛ༻͍ͯɺ8Λ

    SFpOFNFOU͍ͯ͘͠ % ͋Δ୯ޠʹରͯ͠ɺ΋͏Ұํͷݴޠۭ͔ؒΒۙ๣୯ޠΛ୳͢
 ͜ͷ࣌ͷڑ཭͸ɺDPTྨࣅ౓ϕʔεͰIVCOFTTΛܰݮͯ͠ܭଌ͢Δ !4 ˢͷਤ͸8PSE5SBOTMBUJPO8JUIPVU1BSBMMFM%BUB$POOFBVFUBM *$-3ΑΓҾ༻
  4. $POOFBVFUBM  " ͦΕͧΕͷNPOPMJOHVBMXPSEFNCFEEJOHTΛ࡞੒ʢ੺&OHMJTIɺ੨*UBMJBOʣ # 9ͷFNCFEEJOHTΛ:ͷFNCFEEJOHTTQBDF΁ඈ͹͢Α͏ʹ8Λ BEWFSTBSJBMʹֶश͢Δ
 ʢ89ͱ:ΛEJTDSJNJOBUFɺ8͸͜ΕΛGPPM͢ΔΑ͏ʹ͢Δʣ $ ߴස౓ͳ୯ޠΛBODIPSͱͯ͠ɺ௚ߦϓϩΫϥεςε෼ੳΛ༻͍ͯɺ8Λ

    SFpOFNFOU͍ͯ͘͠ % ͋Δ୯ޠʹରͯ͠ɺ΋͏Ұํͷݴޠۭ͔ؒΒۙ๣୯ޠΛ୳͢
 ͜ͷ࣌ͷڑ཭͸ɺDPTྨࣅ౓ϕʔεͰIVCOFTTΛܰݮͯ͠ܭଌ͢Δ !5 .POPMJOHVBMXPSEFNCFEEJOHTHSBQIT͸
 ۙࣅతJTPNPSQIJDͰ͋Δͱ͍͏Ծఆʹج͍͍ͮͯΔ
 ʢ.JLPMPWFUBM#BSPOF;IBOHFUBM$POOFBVFUBMʣ
  5. άϥϑͷྨࣅ౓ͷٻΊํ ۩ମతάϥϑ͔Β-BQMBDJBOFJHFOWBMVFTΛٻΊɺάϥϑؒͷ JTPTQFDUSBM౓߹͍Λάϥϑͷྨࣅ౓ͱͯ͠࢖༻͢Δ !11 L2 : graph2 L1 : graph1

    ֤άϥϑͰɺݻ༗஋Λɺ߹ܭͯ͠શମͷҎԼͷ৚݅ͰɺݸऔΓग़͢
 ʢ͔Βݸɺ͔ΒݸऔΕΔʣɺͱͯ͠ɺ
 
 ҎԼͷΑ͏ʹ֤ݻ༗஋ͷࠩ෼Λूੵ͢Δ ˠ͜ͷूੵͨࠩ͠෼Λάϥϑؒͷྨࣅ౓ͱ͢Δ
 ʢ஋͕খ͍͞ํ͕ྨࣅ౓͕େ͖͍ʣ L1 k1 L2 k2 ki k = min(k1 , k2 ) Δ = k ∑ i=1 (λ1i − λ2i ) 2 k = min j ∑k i=1 λji ∑n i=1 λji > 0.9 ઌ΄Ͳͷྫͩͱ
 L
  6. ࠓճௐ΂Δ಺༰ w $POOFBVFUBMͷख๏্͕ख͍͘͘ઃఆɺ͍͔ͳ͍ઃఆΛௐ΂͍ͨ w <ݴޠతಛ௃>EFQFOEFUNBSLJOHͰ͸ͳ͍ݴޠʹ͍ͭͯ௥Ճ࣮ݧ
 ˢ$POOFBVFUBM͸ɺ΄ͱΜͲEFQFOEFOUNBSLJOHͷݴޠʹ͍࣮ͭͯݧΛ͍ͯ͠ΔͨΊ w <σʔλͷಛ௃>NPOPMJOHVBMDPSQPSBͷEPNBJOΛม͑ͨ
 ˢ$POOFBVFUBM͸ɺ8JLJQFEJBΛ࢖༻ɺDPNQBSBCMFͳঢ়گͷͨΊ w

    <FNCFEEJOHͷಛ௃>4(/4ͱ$#08ɺϋΠύʔύϥϝʔλʹΑΔੑೳͷมԽ
 ˢ$POOFBVFUBM͸ɺݴޠؒͰಉ͡ϋΠύʔύϥϝʔλʹ͍ͯ͠ΔͨΊ w <࣍ݩͷಛ௃>FNCFEEJOHTQBDFͷ࣍ݩΛখͨ͘͞͠Γͨ͠ w <UFTUͷ୯ޠͷಛ௃>ධՁ࣌ʹ࢖༻͢Δ୯ޠͰɺ্ख͍͖͘΍͍͢୯ޠͱ͍͔ͳ͍ ୯ޠʹ͍ͭͯɺ104ͳͲʹ஫໨ͯ͠෼ੳͨ͠ !12
  7. ࣮ݧઃఆ w λεΫ#JMJOHVBM%JDUJPOBSZ*OEVDUJPO
 TSDଆͷ୯ޠΛ/݅༻ҙ͢Δ
 DSPTTMJOHVBMTQBDF͔ΒରԠ͢Δ
 UHUଆͷ୯ޠΛ୳ͯ͘͠Δ
 Ͱݟ͚ͭͨ୯ޠͱHPMEΛൺֱͯ͠ɺ
 ߹͍ͬͯΔ͔Ͳ͏͔Λௐ΂ΔʢධՁ1SFDJTJPOBUʣ w XPSEFNCFEEJOHTGBTU5FYU


    ઃఆ4(/4 XJOEPX DIBS@OHSBN EJN !13 $POOFBVFUBM  5IJTXPSL -BOHVBHFT
 &OHMJTIUP 'SFODI (FSNBO  $IJOFTF 3VTTJBO  4QBOJTI 4QBOJTI &TUPOJBO &5 'JOOJTI '* (SFFL &-  )VOHBSJBO )6 1PMJTI 1- 5VSLJTI 53
  8. ݴޠతˠσʔλˠFNCFEEJOHˠ࣍ݩˠ୯ޠ σʔλͷಛ௃ʹ͍ͭͯ w &1&VSP1BSM7
 8JLJ8JLJQFEJB
 &.&"NFEJDBMEPNBJO w &/\&4 '* )6^

    w BDEPNBJOTJNJMBSJUZ
 EGڭࢣ৴߸͋Γ
 HG$POOFBVFUBM w ஫ҙ
 ֤ίʔύεͷαΠζ͸
 .TFOUTͰ౷Ұ
 ʢXJLJ͸ઌ΄ͲΑΓখ͍͞ʣ w $POOFBVFBBMͷख๏͸
 σʔλ͕ἧΘͳ͍ͱશવμϝ !16
  9. FNCFEEJOHͷಛ௃ʹ͍ͭͯ w &/&4Ͱ࣮ݧ w &/ଆ͸
 4(/4ɺXJOEPXɺDIBSOHSBNͰݻఆ w &4͸ҎԼΛม͑ͨ
 XJOEPX
 DIBSOHSBN


    BMHPSJUIN<4(/4 $#08> w ͪΐͬͱͨ͠ϋΠύʔύϥϝʔλͷมԽ
 ˠͦ͜·ͰӨڹͳ͠ w 4(/4ˠ$#08
 ˠશવμϝʜ !17 ݴޠతˠσʔλˠFNCFEEJOHˠ࣍ݩˠ୯ޠ
  10. ࣍ݩͷಛ௃ʹ͍ͭͯ w ઌ΄Ͳ·ͰEJN
 ˠEJNͷFNCFEEJOHͰ΋΍ͬͯΈͨ w &/\&5 '* &-^Ͱͪΐͬͱ
 ྑ͘ͳ͍ͬͯΔ w

    EJNͩͱNPOPMJOHVBM
 XPSEFNCFEEJOH͕
 &5 '* &-ͷ௝͍͠ಛ௃ʹ
 PWFSpU͍ͯ͠Δ͔Βʁ w EJNͰͷ౰ͨΓํʢ104ͱ͔ʣ
 ͸Έ͍ͨ !18 EJN EJN &/&4   &/&5   &/'*   &/&-   &/)6   &/1-   &/53   ݴޠతˠσʔλˠFNCFEEJOHˠ࣍ݩˠ୯ޠ
  11. ࢀߟจݙ w 1SPDSVTUFTBOBMZTJT
 IUUQHWIBUFCMPKQFOUSZ w "$-Ͱͷൃදಈը
 IUUQTWJNFPDPN w ͜ͷεϥΠυதʹ͓͚Δ$POOFBVFUBM
 8PSE5SBOTMBUJPOXJUIPVU1BSBMMFM%BUB$POOFBVFUBM

    
 *$-3 w .POPMJOHVBMXPSEFNCFEEJOHT͕JTPNPSQIJDͰ͋Δ͜ͱʹؔ࿈͢Δ࿦จ
 &YQMPJUJOH4JNJMBSJUJFTBNPOH-BOHVBHFTGPS.BDIJOF5SBOTMBUJPO.JLPMPWFUBM BS9JW
 5PXBSET$SPTTMJOHVBM%JTUSJCVUFE3FQSFTFOUBUJPOTXJUIPVU1BSBMMFM5FYU5SBJOFEXJUI"EWFSTBSJBM "VUP&ODPEFST#BSPOF 8PSLTIPQPO3FQSFTFOUBUJPO-FBSOJOHGPS/-1
 "EWFSTBSJBM5SBJOJOHGPS6OTVQFSWJTFE#JMJOHVBM-FYJDPO*OEVDUJPO;IBOHFUBM "$- !22

More Decks by Satoru Katsumata

Other Decks in Research