ELMoで文脈に応じた類似キーワード検索システムを作った話 / ELMo for Searching Similar Keywords

ML@Loft #11. 類似画像/テキスト検索

Transcript

1. &-.PͰจ຺ʹԠͨ͡
 ྨࣅΩʔϫʔυݕࡧγεςϜ
 Λ࡞ͬͨ࿩ ©The Asahi Shimbun Company 2020 .-!-PGU
   
   גࣜձࣾே೔৽ฉࣾ
   ాޱ༤࠸
 ೥݄೔
2. ே೔৽ฉͷݚڀ։ൃ!ϝσΟΞϥϘ 2 ࣗಈཁ໿ɺࣗಈߍਖ਼ͳͲࣗવݴޠॲཧͷجૅݚڀΛߦ͍ͬͯ ΔɻΞ΢τϓοτͷܗࣜ͸ֶձൃද͕ϝΠϯ
   ݚڀدΓ
   ઌ೔ͷ/-1Ͱ͸ݴޠࢿݯ৆Λ͍͖ͨͩ·ͨ͠
   ݚڀ੒Ռ͸ཁ໿"1*
   ͱͯ͠ެ։தͳͷͰ࢖ͬͯΈ͍ͯͩ͘͞ʂ .-!-PGU
   ͸
   ओʹ"84
   ্ͰػցֶशϫʔΫϩʔυΛ ӡ༻͍ͯ͠ΔσϕϩούʔɾσʔλαΠΤϯςΟετ ͷͨΊͷʮ͓೰Έ૬ஊձʯͰ͢ɻ݄ʹճ
   "84
   -PGU
   5PLZP
   Ͱ։࠵͠ɺຖճ׆ൃͳٞ࿦͕ߦΘΕ͍ͯ·͢ɻ
   ୈճ͸ྨࣅը૾ݕࡧΛςʔϚʹɺಛ௃ྔʹམͱ͠ࠐ ΉωοτϫʔΫͷ࿩΍ɺಛ௃ྔݕࡧͷ଎౓ɾՄ༻ੑ޲ ্ͷ࿩ɺྨࣅը૾ݕࡧͷγεςϜઃܭશମͷ࿩ͳͲʹ ͍ͭͯٞ࿦͠·͢ɻ͸͡Ίʹొஃऀͷํʑ͔Β෼ͣ ͭͷࣗݾ঺հ-5
   ܗࣜͰྨࣅը૾ݕࡧʹ͓͚Δ՝୊Λ໰ ୊ఏى͍͍ͨͩͨޙɺࢀՃऀͷօ͞Μ͔Β௖͍࣭ͨ໰ ΛݩʹύωϧσΟεΧογϣϯΛ࣮ࢪ͠·͢ɻ ϞόΠϧ޲͚χϡʔεΞϓϦ༻
   จࣈ
   Ͱੜ੒ "84Ͱʮ͓೰Έ૬ஊձʯ
   -PGU͕ʮ͓೰Έ૬ஊձʯ
   "84-PGUͰ͓೰Έ૬ஊ
   -4-PGUͰ͓೰Έ૬ஊձ
   .-!-PGU͕૬ஊձ ީิΛͭग़ྗ χϡʔεهࣄͰ͸ͳͯ͘΋͋Δఔ౓ͦΕΒ͍͠΋ͷ͕ग़ͤΔ https://cl.asahi.com/ "1*Λ࢖ͬͯΈ͍ͨਓ͸ͥͻͪ͜Β΁ ©The Asahi Shimbun Company 2020
3. ே೔৽ฉͷݚڀ։ൃ!*$53"% 3 ࣾ಺ͷ՝୊ղܾΛ͢ΔνʔϜɻϓϩτλΠϓ࡞੒΍αʔϏ εԽ͕ϝΠϯ
   ։ൃدΓ
   ߴߍ໺ٿͷࣗಈઓධ࡞੒ͷ͓ʔͱΓ͌΍ɺ"*ܦࡁهऀΈͭ ͚ʔͨɺ࢛୒࣌ࣄΫΠζαʔϏεͷ2SJDIΛ։ൃ ©The Asahi Shimbun Company 2020
4. ࠓ೔࿩͢͜ͱ 4 2SJDIʹ͓͚Δ࢛୒ΫΠζͷ࡞੒ϑϩʔ
   XPSEWFDʹΑΔྨࣅΩʔϫʔυݕࡧͱͦͷ໰୊఺
   &-.PʹΑΔྨࣅΩʔϫʔυݕࡧ
   ©The Asahi Shimbun Company 2020 https://qrich.asahi.com/
5. 5 ©The Asahi Shimbun Company 2020 2SJDIʹ͓͚Δ࢛୒ΫΠζͷ࡞੒ϑϩʔ 
   هࣄσʔλͷऔಘ
   
   هࣄຊจ͔Β݀ൈ͖͢ΔΩʔϫʔυΛબ୒
   ॏཁޠநग़
   
   બ୒ͨ͠Ωʔϫʔυʹྨࣅ͢Δ୯ޠΛݕࡧ͢Δ
   
   ͱΛ߹Θ࢛ͤͯ୒໰୊ͱ͢Δ
6. 6 ©The Asahi Shimbun Company 2020 2SJDIʹ͓͚Δ࢛୒ΫΠζͷ࡞੒ϑϩʔ 
   هࣄσʔλͷऔಘ
   
   هࣄຊจ͔Β݀ൈ͖͢ΔΩʔϫʔυΛબ୒
   ॏཁޠநग़
   
   બ୒ͨ͠Ωʔϫʔυʹྨࣅ͢Δ୯ޠΛݕࡧ͢Δ
   
   ͱΛ߹Θ࢛ͤͯ୒໰୊ͱ͢Δ ࠓ೔͸࿩͢ͷ͸͜ͷ෦෼
7. 7 ©The Asahi Shimbun Company 2020 2SJDIʹ͓͚Δ࢛୒ΫΠζͷ࡞੒ϑϩʔ 
   هࣄσʔλͷऔಘ
   
   هࣄຊจ͔Β݀ൈ͖͢ΔΩʔϫʔυΛબ୒
   ॏཁޠநग़
   
   બ୒ͨ͠Ωʔϫʔυʹྨࣅ͢Δ୯ޠΛݕࡧ͢Δ
   
   ͱΛ߹Θ࢛ͤͯ୒໰୊ͱ͢Δ ࠓ೔͸࿩͢ͷ͸͜ͷ෦෼ ˞ʮΩʔϫʔυʯͷཻ౓͸/&PMPHE

   
   
   
   
   ࣙॻͰ෼ׂ͞Ε໊ͨࢺΛࢦ͠·͢
8. 8 ©The Asahi Shimbun Company 2020 XPSEWFDʹΑΔྨࣅΩʔϫʔυݕࡧ ே೔৽ฉͷهࣄσʔλΛ༻͍ͯXPSEWFD
   TLJQHSBN
   ͷ
 ୯ޠϕΫτϧΛߏங
   ୯ޠϕΫτϧ͸HFOTJNͰಡΈࠐΊΔͷͰ؆୯ʹۙ๣ͷΩʔ ϫʔυ͕ݕࡧՄೳ
9. 9 ©The Asahi Shimbun Company 2020 هࣄͷ಺༰ʹؔΘΒͣۙ๣ͷ୯ޠ͕ৗʹಉ͡ XPSEWFDʹΑΔྨࣅΩʔϫʔυݕࡧ ே೔৽ฉͷهࣄσʔλΛ༻͍ͯXPSEWFD
   TLJQHSBN
   ͷ
 ୯ޠϕΫτϧΛߏங
   ୯ޠϕΫτϧ͸HFOTJNͰಡΈࠐΊΔͷͰ؆୯ʹۙ๣ͷΩʔ ϫʔυ͕ݕࡧՄೳ
10. 10 ©The Asahi Shimbun Company 2020 XPSEWFDͩͱࠔΔϙΠϯτ ͦ΋ͦ΋ྑ͍දݱ͕֫ಘͰ͖͍ͯͳ͍
    Ωʔϫʔυͷ୯ޠϕΫτϧͷۙ๣L୯ޠ͸ৗʹಉ͡
11. 11 ©The Asahi Shimbun Company 2020 XPSEWFDͩͱࠔΔϙΠϯτ ͦ΋ͦ΋ྑ͍දݱ͕֫ಘͰ͖͍ͯͳ͍
    Ωʔϫʔυͷ୯ޠϕΫτϧͷۙ๣L୯ޠ͸ৗʹಉ͡ ถΧϦϑΥϧχΞभͷશҬʹ̍̕೔໷ɺ࣮࣭తͳ֎ग़ېࢭ ໋ྩ͕ग़͞Εͨɻϩαϯθϧε΍αϯϑϥϯγείͳͲͷ େ౎ࢢͷ΄͔ɺγϦίϯόϨʔΛ༴͠ɺ׆ؾ͋Δ๛͔ͳ஍ Ҭͱͯ͠஌ΒΕΔಉभ͕ͩɺܦࡁ׆ಈΑΓ৽ܕίϩφ΢Π ϧεରࡦΛ༏ઌͨ͠ܗͩɻഎܠʹ͸ઌखΛଧͭ͜ͱͰײછ ֦େΛ৯͍ࢭΊΔૂ͍͕͋Δɻ هࣄຊจ ૂͬͨ෦෼ͷҨ఻ࢠΛࣗ༝ʹվมͰ͖ΔήϊϜฤूٕज़ɻ ಛʹɺ೥ʹొ৔ͨ͠ʮ$3*413$BTʢΫϦεύʔ ΩϟεφΠϯʣʯ͸ɺϊʔϕϧ৆ީิͱ΋ݴΘΕΔɻҩྍ ΍৯඼ͳͲ͞·͟·ͳ෼໺ͰԠ༻͕ظ଴͞ΕΔҰํɺͦͷ ಛڐΛ८ͬͯੈքதͰ૪͍͕܁Γ޿͛ΒΕ͍ͯΔɻڊֹͷ རӹʹͭͳ͕ΔՄೳੑ͕͋Δಛڐͷߦํ͸ʕʕɻ
12. 12 ©The Asahi Shimbun Company 2020 XPSEWFDͩͱࠔΔϙΠϯτ ͦ΋ͦ΋ྑ͍දݱ͕֫ಘͰ͖͍ͯͳ͍
    Ωʔϫʔυͷ୯ޠϕΫτϧͷۙ๣L୯ޠ͸ৗʹಉ͡ ถΧϦϑΥϧχΞभͷશҬʹ̍̕೔໷ɺ࣮࣭తͳ֎ग़ېࢭ ໋ྩ͕ग़͞Εͨɻϩαϯθϧε΍αϯϑϥϯγείͳͲͷ େ౎ࢢͷ΄͔ɺγϦίϯόϨʔΛ༴͠ɺ׆ؾ͋Δ๛͔ͳ஍ Ҭͱͯ͠஌ΒΕΔಉभ͕ͩɺܦࡁ׆ಈΑΓ৽ܕίϩφ΢Π ϧεରࡦΛ༏ઌͨ͠ܗͩɻഎܠʹ͸ઌखΛଧͭ͜ͱͰײછ ֦େΛ৯͍ࢭΊΔૂ͍͕͋Δɻ هࣄຊจ ૂͬͨ෦෼ͷҨ఻ࢠΛࣗ༝ʹվมͰ͖ΔήϊϜฤूٕज़ɻ ಛʹɺ೥ʹొ৔ͨ͠ʮ$3*413$BTʢΫϦεύʔ ΩϟεφΠϯʣʯ͸ɺϊʔϕϧ৆ީิͱ΋ݴΘΕΔɻҩྍ ΍৯඼ͳͲ͞·͟·ͳ෼໺ͰԠ༻͕ظ଴͞ΕΔҰํɺͦͷ ಛڐΛ८ͬͯੈքதͰ૪͍͕܁Γ޿͛ΒΕ͍ͯΔɻڊֹͷ རӹʹͭͳ͕ΔՄೳੑ͕͋Δಛڐͷߦํ͸ʕʕɻ ʮγϦίϯόϨʔʯͷۙ๣ΛXPSEWFDͰऔಘ͢Δͱɺ
 
    *5اۀ
 
    αϯϊθ
 
    όΠΦϕϯνϟʔ
 ͱ͍͏݁Ռʹ ʮήϊϜฤूʯͷۙ๣ΛXPSEWFDͰऔಘ͢Δͱɺ
 
    &4ࡉ๔
 
    ώτ
 
    ສೳࡉ๔
 ͱ͍͏݁Ռʹ
13. 13 ©The Asahi Shimbun Company 2020 ιϑτόϯΫ͸̑೔ɺ࣍ੈ୅ͷߴ଎Ҡಈ௨৴ํࣜʮ̜̑ʯͷαʔ ϏεΛࠓ݄̎̓೔ʹ࢝ΊΔͱൃදͨ͠ɻ͍·ͷ̜̐ͷྉۚʹɺ݄ ֹ̍ઍԁʢ੫ൈ͖ʣΛ௥Ճ͢Ε͹࢖͑ΔΑ͏ʹ͢Δɻܞଳి࿩େ ख̏ࣾͰ̜̑ͷ։࢝࣌ظͱྉۚΛൃදͨ͠ͷ͸ॳΊͯɻ ιϑτόϯΫͷ౦඿ڊ౤ख͕ࠓقͷ։ນ౤खΛ຿ΊΔ͜ ͱ͕̒೔·Ͱʹܾ·ͬͨɻϓϩ̔೥໨Ͱॳͷେ໾ͱͳ Δɻ̎̌೔ͷ։ນઓ͸ຊڌ஍ͷ෱ԬϖΠϖΠυʔϜͰ ϩοςͱରઓ͢Δɻ ถάʔάϧͷ਌ձࣾʮΞϧϑΝϕοτʯͷ࣌Ձ૯ֹ͕̍ ̒೔ɺ̍ஹυϧʢ̍̍̌ஹԁʣΛಥഁͨ͠ɻถاۀͰ ͸ɺΞοϓϧɺΞϚκϯɺϚΠΫϩιϑτʹଓ͖̐ࣾ໨ ʹͳΔɻ೔ຊͷ࣌Ձ૯ֹτοϓͷτϤλࣗಈंʢ̎̑ஹ ԁʣͳͲɺ೔ຊ੎ͱͷ͕ࠩ·͢·֦͢େ͍ͯ͠Δɻ ೥͔Β೥ʹ͔͚ͯɺੈք֤஍Ͱʮաڈ࠷ѱʯͱ΋ݺ͹Ε Δ৿ྛՐࡂ͕૬࣍͗·ͨ͠ɻ஍ٿԹஆԽ͕ҰҼͱ΋ࢦఠ͞Ε͍ͯ ·͕͢ɺݱ৔Ͱऔࡐͯ͠ΈΔͱผͷଆ໘΋ݟ͖͑ͯ·ͨ͠ɻΦʔ ετϥϦΞɺϒϥδϧͷΞϚκϯɺถΧϦϑΥϧχΞͰԿ͕ى͖ ͍ͯΔͷ͔ɺಛ೿һ͕ใࠂ͠·͢ɻ XPSEWFDͩͱࠔΔϙΠϯτ εϙʔπɺܦࡁهࣄʹ͓͚ΔʮιϑτόϯΫʯɻۙ๣୯ޠ͸ͲͪΒ΋ʮָఱʯɺʮ%F/"ʯɺʮΦϦοΫεʯ اۀͷΞϚκϯͱ೤ଳӍྛͷΞϚκϯɻۙ๣୯ޠ͸ͲͪΒ΋ʮωοτ௨ൢʯɺʮάʔάϧʯɺʮΩϯυϧʯ ͦ΋ͦ΋ྑ͍දݱ͕֫ಘͰ͖͍ͯͳ͍
    Ωʔϫʔυͷ୯ޠϕΫτϧͷۙ๣L୯ޠ͸ৗʹಉ͡
14. ΑΓྑ͍୯ޠͷϕΫτϧදݱΛ
 ٻΊͯ&-.PʹͨͲΓண͘ ©The Asahi Shimbun Company 2020 14
15. 15 ©The Asahi Shimbun Company 2020 ͦ΋ͦ΋&-.Pͱ͸ʁ ݴޠϞσϧʹΑΔϕΫτϧදݱ
    l&NCFEEJOH
    GSPN
    -BOHVBHF
    .PEFMzͷུশ
    &-.P<>ࣗମ͸CJ-45.Λ༻͍ͯݴޠϞσϧɻXPSEWFDʹ ΑΔ୯ޠϕΫτϧͱ͸ҟͳΓɺจΛCJ-45.ͰಡΈࠐΉͷͰ จ຺ʹԠͯ͡୯ޠͷϕΫτϧදݱ͕มԽ͢Δ
    
16. 16 ©The Asahi Shimbun Company 2020 จ຺ʹԠͨ͡୯ޠϕΫτϧ
    &-.PϕΫτϧ .- ! -PGU ͸ ओ ʹ "84 ʜ DIBS$//Λ࢖ͬͯ
 ୯ޠͷϕΫτϧΛදݱ CJ-45.ͷ૚໨ CJ-45.ͷ૚໨ ࠓճ͸CJ-45.ͷ૚໨ͱ૚໨ͷӅΕঢ়ଶΛ݁߹ͯ͠&-.P ϕΫτϧ
    ࣍ݩ
    ͱ͢Δ &-.PϕΫτϧ
17. 17 ©The Asahi Shimbun Company 2020 ͳͥ&-.Pͳͷ͔ʁ XPSEWFD
    TLJQHSBNDCPX
    Ҏ֎ͷ୯ޠϕΫτϧͷϞσϧ (MP7F
    GBTU5FYU
    Ͱ΋୯ޠʹͭͷϕΫτϧ͕͋Δ͚ͩͰ ҙຯͷଟ༷ੑʹରॲͰ͖ͳ͍
    #&35<>͸܇࿅ʹ͕͔͔࣌ؒΔ্ʹɺ#1&ʹΑΔ୯ޠ෼ׂ͕ લఏͳͷͰࠓճͷλεΫʹ͸߹Θͳ͍
    /&PMPHEࣙॻʹΑΔ෼ׂͰ΋#&35͸ͭ͘ΕΔ͕ίετେ
    &-.P͸DIBS$//ʹΑͬͯ୯ޠͷϕΫτϧදݱΛͭ͘ΔͷͰ ޠኮαΠζ͕େ͖͘ͳͬͯ΋ରԠ͕Ͱ͖Δ
18. 18 ©The Asahi Shimbun Company 2020 ɹ&-.PʹಡΈࠐ·ͤΔهࣄΛબͿ &-.PʹಡΈࠐ·ͤΔهࣄΛ֤Ωʔϫʔυ͝ͱʹͭબͿ
    ෳ਺ͷҙຯʹରॲ͢ΔͨΊɺࠓճ͸શͯͷΩʔϫʔυ͕ ͭͷҙຯΛ࣋ͭͱԾఆ
    ֤୯ޠͰͭͷϕΫτϧΛͭ͘Δ
    ͳΔ΂͘ҙຯ͕ҟͳΔهࣄΛͭݟ͚͍ͭͨ
    ʮιϑτόϯΫʯͷεϙʔπهࣄΛͭΛ&-.PʹಡΈࠐ ·ͤͯ΋ࣅͨϕΫτϧ͕Ͱ͖ͯ͠·͏
    5'*%'ͱ48&.<>Λ݁߹ͯ͠จॻΛϕΫτϧԽ͠ɺͭͷ هࣄΛબͿ
    த৺ʹ࠷΋͍ۙ΋ͷΛީิهࣄ
    த৺͔Β࠷΋ԕ͍΋ͷΛީิهࣄ
19. 19 ©The Asahi Shimbun Company 2020 ࣮ࡍʹͲͷΑ͏ͳهࣄ͕બ͹Ε͔ͨ த৺ʹ͋Δ΋ͷ͕ٿஂͷʮιϑτόϯΫʯɺத৺͔Β࠷΋ԕ ͍ͱ͜Ζʹ͋Δ΋ͷ͕اۀͷʮιϑτόϯΫʯ
    εϓϦϯτΛΊ͙Δ࠶ฤڠٞʹͭ ͍ͯιϑτόϯΫͷଙਖ਼ٛձ௕݉ ࣾ௕͸݄ɺถχϡʔϤʔΫͰه ऀஂʹʮண࣮ʹਐΜͰ͍Δʯͱ ޠͬͨɻ ٿஂ͸೔ɺલ޿ౡͷ܀ݪ݈ଠ ಺໺ख  ɺલϩοςͷ઒ຊྑ ฏัख  ɺલιϑτόϯΫͷ ۚແӳ౤ख  ͷબख͕೔ ͔ΒԬࢁݝ૔ෑࢢͰͷळقΩϟ ϯϓʹࢀՃ͠ɺೖஂςετΛड ͚Δͱൃදͨ͠ɻ ީิهࣄ ީิهࣄ̎
20. 20 ©The Asahi Shimbun Company 2020 ۙ๣ݕࡧ༻ͷΠϯσοΫεΛ࡞੒ ֤ΩʔϫʔυΛͭͷهࣄΛ࢖ͬͯ&-.PϕΫτϧΛऔಘ͠ɺ "OOPZΛ࢖ͬͯΠϯσοΫεΛ࡞੒
    2SJDIͷΫΠζ࡞੒࣌͸ɺهࣄຊจͱ݀ൈ͖ର৅ͷΩʔϫʔ υΛಡΈࠐ·ͤͯ&-.PϕΫτϧΛऔಘ͠ɺͦͷϕΫτϧͷ ۙ๣ʹ͋Δ୯ޠΛݕࡧ
    ৽ޠ͕ొ৔ͨ͠৔߹͸ਓखͰΩʔϫʔυͱهࣄΛબΜͰ &-.PϕΫτϧΛऔಘ͠ɺ"OOPZͷΠϯσοΫεʹ௥Ճɾߋ ৽͢Δӡ༻ʹ͍ͯ͠Δ
21. 21 ©The Asahi Shimbun Company 2020 &-.PͰۙ๣ͷ୯ޠ͸Ͳ͏มΘ͔ͬͨʁ &-.Pͷۙ๣୯ޠ
    ΦϦοΫεɺڊਓɺϨουιοΫε &-.Pͷۙ๣୯ޠ
    ϥΠϒυΞɺιχʔɺΩϟϊϯ ถάʔάϧͷ਌ձࣾʮΞϧϑΝϕοτʯͷ࣌Ձ૯ֹ͕̍ ̒೔ɺ̍ஹυϧʢ̍̍̌ஹԁʣΛಥഁͨ͠ɻถاۀͰ ͸ɺΞοϓϧɺΞϚκϯɺϚΠΫϩιϑτʹଓ͖̐ࣾ໨ ʹͳΔɻ೔ຊͷ࣌Ձ૯ֹτοϓͷτϤλࣗಈंʢ̎̑ஹ ԁʣͳͲɺ೔ຊ੎ͱͷ͕ࠩ·͢·֦͢େ͍ͯ͠Δɻ ೥͔Β೥ʹ͔͚ͯɺੈք֤஍Ͱʮաڈ࠷ѱʯͱ΋ݺ͹Ε Δ৿ྛՐࡂ͕૬࣍͗·ͨ͠ɻ஍ٿԹஆԽ͕ҰҼͱ΋ࢦఠ͞Ε͍ͯ ·͕͢ɺݱ৔Ͱऔࡐͯ͠ΈΔͱผͷଆ໘΋ݟ͖͑ͯ·ͨ͠ɻΦʔ ετϥϦΞɺϒϥδϧͷΞϚκϯɺถΧϦϑΥϧχΞͰԿ͕ى͖ ͍ͯΔͷ͔ɺಛ೿һ͕ใࠂ͠·͢ɻ XPSEWFDͰ͸ۙ๣୯ޠ͸ͲͪΒ΋ʮωοτ௨ൢʯɺʮάʔάϧʯɺʮΩϯυϧʯ &-.Pͷۙ๣୯ޠ
    ϨϊϘɺμΠϜϥʔɺωοτϑϦοΫε &-.Pͷۙ๣୯ޠ
    ϝϯϑΟεɺϘεχΞɺΨϘϯ ιϑτόϯΫ͸̑೔ɺ࣍ੈ୅ͷߴ଎Ҡಈ௨৴ํࣜʮ̜̑ʯͷαʔ ϏεΛࠓ݄̎̓೔ʹ࢝ΊΔͱൃදͨ͠ɻ͍·ͷ̜̐ͷྉۚʹɺ݄ ֹ̍ઍԁʢ੫ൈ͖ʣΛ௥Ճ͢Ε͹࢖͑ΔΑ͏ʹ͢Δɻܞଳి࿩େ ख̏ࣾͰ̜̑ͷ։࢝࣌ظͱྉۚΛൃදͨ͠ͷ͸ॳΊͯɻ ιϑτόϯΫͷ౦඿ڊ౤ख͕ࠓقͷ։ນ౤खΛ຿ΊΔ͜ ͱ͕̒೔·Ͱʹܾ·ͬͨɻϓϩ̔೥໨Ͱॳͷେ໾ͱͳ Δɻ̎̌೔ͷ։ນઓ͸ຊڌ஍ͷ෱ԬϖΠϖΠυʔϜͰ ϩοςͱରઓ͢Δɻ XPSEWFDͰ͸ۙ๣୯ޠ͸ͲͪΒ΋ʮָఱʯɺʮ%F/"ʯɺʮΦϦοΫεʯ
22. ·ͱΊ 22 2SJDIʹ͓͚ΔΫΠζ࡞੒ϑϩʔͷ঺հ
    XPSEWFDͷ໰୊఺
    ۙ๣ͷΩʔϫʔυ͕ৗʹಉ͡
    &-.PͰจ຺ʹԠͨ͡ྨࣅΩʔϫʔυγεςϜΛͭͬͨ͘
    ޠኮαΠζ͕େ͖ͯ͘΋܇࿅͕ՄೳͳͷͰ&-.PΛ࠾༻
    &-.PʹಡΈࠐ·ͤΔهࣄબ୒͕ॏཁ
    จ຺ʹԠͯۙ͡๣ͷ୯ޠ΋มԽ͠ɺXPSEWFDͱൺֱ͠ ͯ΋ྨࣅΩʔϫʔυΛ͋Δఔ౓͏·͘औΕ͍ͯΔ ©The Asahi Shimbun Company 2020
23. 
    ࢀߟจݙ 23 [1] Peters+18, Deep contextualized word representations, NAACL2018 [2] Devlin+19, BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding, NAACL2019 [3] Shen+18, Baseline Needs More Love: On Simple Word- Embedding-Based Models and Associated Pooling Mechanisms, ACL2018 ©The Asahi Shimbun Company 2020
24. ͝ਗ਼ௌ͋Γ͕ͱ͏͍͟͝·ͨ͠ʂ ©The Asahi Shimbun Company 2020