ML@Loft #11. 類似画像/テキスト検索
&-.PͰจ຺ʹԠͨ͡ ྨࣅΩʔϫʔυݕࡧγεςϜ Λ࡞ͬͨ©The Asahi Shimbun Company 2020.-!-PGUגࣜձࣾே৽ฉࣾాޱ༤࠸ ݄
View Slide
ே৽ฉͷݚڀ։ൃ!ϝσΟΞϥϘ2ࣗಈཁɺࣗಈߍਖ਼ͳͲࣗવݴޠॲཧͷجૅݚڀΛߦ͍ͬͯΔɻΞτϓοτͷܗֶࣜձൃද͕ϝΠϯ ݚڀدΓઌͷ/-1ͰݴޠࢿݯΛ͍͖ͨͩ·ͨ͠ݚڀՌཁ"1*ͱͯ͠ެ։தͳͷͰͬͯΈ͍ͯͩ͘͞ʂ.-!-PGUओʹ"84্ͰػցֶशϫʔΫϩʔυΛӡ༻͍ͯ͠ΔσϕϩούʔɾσʔλαΠΤϯςΟετͷͨΊͷʮ͓Έ૬ஊձʯͰ͢ɻ݄ʹճ"84-PGU5PLZPͰ։࠵͠ɺຖճ׆ൃͳ͕ٞߦΘΕ͍ͯ·͢ɻୈճྨࣅը૾ݕࡧΛςʔϚʹɺಛྔʹམͱ͠ࠐΉωοτϫʔΫͷɺಛྔݕࡧͷɾՄ༻ੑ্ͷɺྨࣅը૾ݕࡧͷγεςϜઃܭશମͷͳͲʹ͍ͭͯٞ͠·͢ɻ͡Ίʹొஃऀͷํʑ͔Βͣͭͷࣗݾհ-5ܗࣜͰྨࣅը૾ݕࡧʹ͓͚Δ՝Λఏى͍͍ͨͩͨޙɺࢀՃऀͷօ͞Μ͔Β͍࣭ͨΛݩʹύωϧσΟεΧογϣϯΛ࣮ࢪ͠·͢ɻϞόΠϧ͚χϡʔεΞϓϦ༻ จࣈͰੜ"84Ͱʮ͓Έ૬ஊձʯ-PGU͕ʮ͓Έ૬ஊձʯ"84-PGUͰ͓Έ૬ஊ-4-PGUͰ͓Έ૬ஊձ.-!-PGU͕૬ஊձީิΛͭग़ྗχϡʔεهࣄͰͳͯ͋͘ΔఔͦΕΒ͍͠ͷ͕ग़ͤΔhttps://cl.asahi.com/"1*ΛͬͯΈ͍ͨਓͥͻͪ͜Β©The Asahi Shimbun Company 2020
ே৽ฉͷݚڀ։ൃ!*$53"%3ࣾͷ՝ղܾΛ͢ΔνʔϜɻϓϩτλΠϓ࡞αʔϏεԽ͕ϝΠϯ ։ൃدΓߴߍٿͷࣗಈઓධ࡞ͷ͓ʔͱΓ͌ɺ"*ܦࡁهऀΈ͚ͭʔͨɺ࢛࣌ࣄΫΠζαʔϏεͷ2SJDIΛ։ൃ©The Asahi Shimbun Company 2020
ࠓ͢͜ͱ42SJDIʹ͓͚Δ࢛ΫΠζͷ࡞ϑϩʔXPSEWFDʹΑΔྨࣅΩʔϫʔυݕࡧͱͦͷ&-.PʹΑΔྨࣅΩʔϫʔυݕࡧ©The Asahi Shimbun Company 2020https://qrich.asahi.com/
5©The Asahi Shimbun Company 20202SJDIʹ͓͚Δ࢛ΫΠζͷ࡞ϑϩʔهࣄσʔλͷऔಘهࣄຊจ͔Β݀ൈ͖͢ΔΩʔϫʔυΛબ ॏཁޠநग़બͨ͠Ωʔϫʔυʹྨࣅ͢Δ୯ޠΛݕࡧ͢ΔͱΛ߹Θ࢛ͤͯͱ͢Δ
6©The Asahi Shimbun Company 20202SJDIʹ͓͚Δ࢛ΫΠζͷ࡞ϑϩʔهࣄσʔλͷऔಘهࣄຊจ͔Β݀ൈ͖͢ΔΩʔϫʔυΛબ ॏཁޠநग़બͨ͠Ωʔϫʔυʹྨࣅ͢Δ୯ޠΛݕࡧ͢ΔͱΛ߹Θ࢛ͤͯͱ͢Δࠓ͢ͷ͜ͷ෦
7©The Asahi Shimbun Company 20202SJDIʹ͓͚Δ࢛ΫΠζͷ࡞ϑϩʔهࣄσʔλͷऔಘهࣄຊจ͔Β݀ൈ͖͢ΔΩʔϫʔυΛબ ॏཁޠநग़બͨ͠Ωʔϫʔυʹྨࣅ͢Δ୯ޠΛݕࡧ͢ΔͱΛ߹Θ࢛ͤͯͱ͢Δࠓ͢ͷ͜ͷ෦˞ʮΩʔϫʔυʯͷཻ/&PMPHE ࣙॻͰׂ͞Ε໊ͨࢺΛࢦ͠·͢
8©The Asahi Shimbun Company 2020XPSEWFDʹΑΔྨࣅΩʔϫʔυݕࡧே৽ฉͷهࣄσʔλΛ༻͍ͯXPSEWFD TLJQHSBNͷ ୯ޠϕΫτϧΛߏங୯ޠϕΫτϧHFOTJNͰಡΈࠐΊΔͷͰ؆୯ʹۙͷΩʔϫʔυ͕ݕࡧՄೳ
9©The Asahi Shimbun Company 2020هࣄͷ༰ʹؔΘΒͣۙͷ୯ޠ͕ৗʹಉ͡XPSEWFDʹΑΔྨࣅΩʔϫʔυݕࡧே৽ฉͷهࣄσʔλΛ༻͍ͯXPSEWFD TLJQHSBNͷ ୯ޠϕΫτϧΛߏங୯ޠϕΫτϧHFOTJNͰಡΈࠐΊΔͷͰ؆୯ʹۙͷΩʔϫʔυ͕ݕࡧՄೳ
10©The Asahi Shimbun Company 2020XPSEWFDͩͱࠔΔϙΠϯτͦͦྑ͍දݱ͕֫ಘͰ͖͍ͯͳ͍Ωʔϫʔυͷ୯ޠϕΫτϧͷۙL୯ޠৗʹಉ͡
11©The Asahi Shimbun Company 2020XPSEWFDͩͱࠔΔϙΠϯτͦͦྑ͍දݱ͕֫ಘͰ͖͍ͯͳ͍Ωʔϫʔυͷ୯ޠϕΫτϧͷۙL୯ޠৗʹಉ͡ถΧϦϑΥϧχΞभͷશҬʹ̍̕ɺ࣮࣭తͳ֎ग़ېࢭ໋ྩ͕ग़͞ΕͨɻϩαϯθϧεαϯϑϥϯγείͳͲͷେࢢͷ΄͔ɺγϦίϯόϨʔΛ༴͠ɺ׆ؾ͋Δ๛͔ͳҬͱͯ͠ΒΕΔಉभ͕ͩɺܦࡁ׆ಈΑΓ৽ܕίϩφΠϧεରࡦΛ༏ઌͨ͠ܗͩɻഎܠʹઌखΛଧͭ͜ͱͰײછ֦େΛ৯͍ࢭΊΔૂ͍͕͋Δɻهࣄຊจૂͬͨ෦ͷҨࢠΛࣗ༝ʹվมͰ͖ΔήϊϜฤूٕज़ɻಛʹɺʹొͨ͠ʮ$3*413$BTʢΫϦεύʔΩϟεφΠϯʣʯɺϊʔϕϧީิͱݴΘΕΔɻҩྍ৯ͳͲ͞·͟·ͳͰԠ༻͕ظ͞ΕΔҰํɺͦͷಛڐΛ८ͬͯੈքதͰ૪͍͕܁Γ͛ΒΕ͍ͯΔɻڊֹͷརӹʹͭͳ͕ΔՄೳੑ͕͋Δಛڐͷߦํʕʕɻ
12©The Asahi Shimbun Company 2020XPSEWFDͩͱࠔΔϙΠϯτͦͦྑ͍දݱ͕֫ಘͰ͖͍ͯͳ͍Ωʔϫʔυͷ୯ޠϕΫτϧͷۙL୯ޠৗʹಉ͡ถΧϦϑΥϧχΞभͷશҬʹ̍̕ɺ࣮࣭తͳ֎ग़ېࢭ໋ྩ͕ग़͞ΕͨɻϩαϯθϧεαϯϑϥϯγείͳͲͷେࢢͷ΄͔ɺγϦίϯόϨʔΛ༴͠ɺ׆ؾ͋Δ๛͔ͳҬͱͯ͠ΒΕΔಉभ͕ͩɺܦࡁ׆ಈΑΓ৽ܕίϩφΠϧεରࡦΛ༏ઌͨ͠ܗͩɻഎܠʹઌखΛଧͭ͜ͱͰײછ֦େΛ৯͍ࢭΊΔૂ͍͕͋Δɻهࣄຊจૂͬͨ෦ͷҨࢠΛࣗ༝ʹվมͰ͖ΔήϊϜฤूٕज़ɻಛʹɺʹొͨ͠ʮ$3*413$BTʢΫϦεύʔΩϟεφΠϯʣʯɺϊʔϕϧީิͱݴΘΕΔɻҩྍ৯ͳͲ͞·͟·ͳͰԠ༻͕ظ͞ΕΔҰํɺͦͷಛڐΛ८ͬͯੈքதͰ૪͍͕܁Γ͛ΒΕ͍ͯΔɻڊֹͷརӹʹͭͳ͕ΔՄೳੑ͕͋ΔಛڐͷߦํʕʕɻʮγϦίϯόϨʔʯͷۙΛXPSEWFDͰऔಘ͢Δͱɺ *5اۀ αϯϊθ όΠΦϕϯνϟʔ ͱ͍͏݁ՌʹʮήϊϜฤूʯͷۙΛXPSEWFDͰऔಘ͢Δͱɺ &4ࡉ๔ ώτ ສೳࡉ๔ ͱ͍͏݁Ռʹ
13©The Asahi Shimbun Company 2020ιϑτόϯΫ̑ɺ࣍ੈͷߴҠಈ௨৴ํࣜʮ̜̑ʯͷαʔϏεΛࠓ݄̎̓ʹ࢝ΊΔͱൃදͨ͠ɻ͍·ͷ̜̐ͷྉۚʹɺֹ݄̍ઍԁʢ੫ൈ͖ʣΛՃ͢Ε͑ΔΑ͏ʹ͢Δɻܞଳిେख̏ࣾͰ̜̑ͷ։࢝࣌ظͱྉۚΛൃදͨ͠ͷॳΊͯɻιϑτόϯΫͷ౦ڊख͕ࠓقͷ։ນखΛΊΔ͜ͱ͕̒·Ͱʹܾ·ͬͨɻϓϩ̔ͰॳͷେͱͳΔɻ̎̌ͷ։ນઓຊڌͷԬϖΠϖΠυʔϜͰϩοςͱରઓ͢ΔɻถάʔάϧͷձࣾʮΞϧϑΝϕοτʯͷ࣌Ձ૯ֹ͕̍̒ɺ̍ஹυϧʢ̍̍̌ஹԁʣΛಥഁͨ͠ɻถاۀͰɺΞοϓϧɺΞϚκϯɺϚΠΫϩιϑτʹଓ͖̐ࣾʹͳΔɻຊͷ࣌Ձ૯ֹτοϓͷτϤλࣗಈंʢ̎̑ஹԁʣͳͲɺຊͱͷ͕ࠩ·͢·֦͢େ͍ͯ͠Δɻ͔Βʹ͔͚ͯɺੈք֤Ͱʮաڈ࠷ѱʯͱݺΕΔྛՐࡂ͕૬࣍͗·ͨ͠ɻٿԹஆԽ͕ҰҼͱࢦఠ͞Ε͍ͯ·͕͢ɺݱͰऔࡐͯ͠ΈΔͱผͷଆ໘ݟ͖͑ͯ·ͨ͠ɻΦʔετϥϦΞɺϒϥδϧͷΞϚκϯɺถΧϦϑΥϧχΞͰԿ͕ى͖͍ͯΔͷ͔ɺಛһ͕ใࠂ͠·͢ɻXPSEWFDͩͱࠔΔϙΠϯτεϙʔπɺܦࡁهࣄʹ͓͚ΔʮιϑτόϯΫʯɻۙ୯ޠͲͪΒʮָఱʯɺʮ%F/"ʯɺʮΦϦοΫεʯاۀͷΞϚκϯͱଳӍྛͷΞϚκϯɻۙ୯ޠͲͪΒʮωοτ௨ൢʯɺʮάʔάϧʯɺʮΩϯυϧʯͦͦྑ͍දݱ͕֫ಘͰ͖͍ͯͳ͍Ωʔϫʔυͷ୯ޠϕΫτϧͷۙL୯ޠৗʹಉ͡
ΑΓྑ͍୯ޠͷϕΫτϧදݱΛ ٻΊͯ&-.PʹͨͲΓண͘©The Asahi Shimbun Company 202014
15©The Asahi Shimbun Company 2020ͦͦ&-.PͱʁݴޠϞσϧʹΑΔϕΫτϧදݱl&NCFEEJOHGSPN-BOHVBHF.PEFMzͷུশ&-.P<>ࣗମCJ-45.Λ༻͍ͯݴޠϞσϧɻXPSEWFDʹΑΔ୯ޠϕΫτϧͱҟͳΓɺจΛCJ-45.ͰಡΈࠐΉͷͰจ຺ʹԠͯ͡୯ޠͷϕΫτϧදݱ͕มԽ͢Δ
16©The Asahi Shimbun Company 2020จ຺ʹԠͨ͡୯ޠϕΫτϧ &-.PϕΫτϧ.- ! -PGU ओ ʹ "84 ʜDIBS$//Λͬͯ ୯ޠͷϕΫτϧΛදݱCJ-45.ͷCJ-45.ͷࠓճCJ-45.ͷͱͷӅΕঢ়ଶΛ݁߹ͯ͠&-.PϕΫτϧ ࣍ݩͱ͢Δ&-.PϕΫτϧ
17©The Asahi Shimbun Company 2020ͳͥ&-.Pͳͷ͔ʁXPSEWFD TLJQHSBNDCPXҎ֎ͷ୯ޠϕΫτϧͷϞσϧ(MP7F GBTU5FYUͰ୯ޠʹͭͷϕΫτϧ͕͋Δ͚ͩͰҙຯͷଟ༷ੑʹରॲͰ͖ͳ͍#&35<>܇࿅ʹ͕͔͔࣌ؒΔ্ʹɺ#1&ʹΑΔ୯ޠׂ͕લఏͳͷͰࠓճͷλεΫʹ߹Θͳ͍/&PMPHEࣙॻʹΑΔׂͰ#&35ͭ͘ΕΔ͕ίετେ&-.PDIBS$//ʹΑͬͯ୯ޠͷϕΫτϧදݱΛͭ͘ΔͷͰޠኮαΠζ͕େ͖͘ͳͬͯରԠ͕Ͱ͖Δ
18©The Asahi Shimbun Company 2020ɹ&-.PʹಡΈࠐ·ͤΔهࣄΛબͿ&-.PʹಡΈࠐ·ͤΔهࣄΛ֤Ωʔϫʔυ͝ͱʹͭબͿෳͷҙຯʹରॲ͢ΔͨΊɺࠓճશͯͷΩʔϫʔυ͕ͭͷҙຯΛ࣋ͭͱԾఆ ֤୯ޠͰͭͷϕΫτϧΛͭ͘ΔͳΔ͘ҙຯ͕ҟͳΔهࣄΛͭݟ͚͍ͭͨʮιϑτόϯΫʯͷεϙʔπهࣄΛͭΛ&-.PʹಡΈࠐ·ͤͯࣅͨϕΫτϧ͕Ͱ͖ͯ͠·͏5'*%'ͱ48&.<>Λ݁߹ͯ͠จॻΛϕΫτϧԽ͠ɺͭͷهࣄΛબͿத৺ʹ࠷͍ۙͷΛީิهࣄத৺͔Β࠷ԕ͍ͷΛީิهࣄ
19©The Asahi Shimbun Company 2020࣮ࡍʹͲͷΑ͏ͳهࣄ͕બΕ͔ͨத৺ʹ͋Δͷ͕ٿஂͷʮιϑτόϯΫʯɺத৺͔Β࠷ԕ͍ͱ͜Ζʹ͋Δͷ͕اۀͷʮιϑτόϯΫʯεϓϦϯτΛΊ͙Δ࠶ฤڠٞʹ͍ͭͯιϑτόϯΫͷଙਖ਼ٛձ݄݉ࣾɺถχϡʔϤʔΫͰهऀஂʹʮண࣮ʹਐΜͰ͍Δʯͱޠͬͨɻٿஂɺલౡͷ܀ݪ݈ଠख ɺલϩοςͷຊྑฏัख ɺલιϑτόϯΫͷۚແӳख ͷબख͕͔ΒԬࢁݝෑࢢͰͷळقΩϟϯϓʹࢀՃ͠ɺೖஂςετΛड͚Δͱൃදͨ͠ɻީิهࣄީิهࣄ̎
20©The Asahi Shimbun Company 2020ۙݕࡧ༻ͷΠϯσοΫεΛ࡞֤ΩʔϫʔυΛͭͷهࣄΛͬͯ&-.PϕΫτϧΛऔಘ͠ɺ"OOPZΛͬͯΠϯσοΫεΛ࡞2SJDIͷΫΠζ࡞࣌ɺهࣄຊจͱ݀ൈ͖ରͷΩʔϫʔυΛಡΈࠐ·ͤͯ&-.PϕΫτϧΛऔಘ͠ɺͦͷϕΫτϧͷۙʹ͋Δ୯ޠΛݕࡧ৽ޠ͕ొͨ͠߹ਓखͰΩʔϫʔυͱهࣄΛબΜͰ&-.PϕΫτϧΛऔಘ͠ɺ"OOPZͷΠϯσοΫεʹՃɾߋ৽͢Δӡ༻ʹ͍ͯ͠Δ
21©The Asahi Shimbun Company 2020&-.PͰۙͷ୯ޠͲ͏มΘ͔ͬͨʁ&-.Pͷۙ୯ޠΦϦοΫεɺڊਓɺϨουιοΫε &-.Pͷۙ୯ޠϥΠϒυΞɺιχʔɺΩϟϊϯถάʔάϧͷձࣾʮΞϧϑΝϕοτʯͷ࣌Ձ૯ֹ͕̍̒ɺ̍ஹυϧʢ̍̍̌ஹԁʣΛಥഁͨ͠ɻถاۀͰɺΞοϓϧɺΞϚκϯɺϚΠΫϩιϑτʹଓ͖̐ࣾʹͳΔɻຊͷ࣌Ձ૯ֹτοϓͷτϤλࣗಈंʢ̎̑ஹԁʣͳͲɺຊͱͷ͕ࠩ·͢·֦͢େ͍ͯ͠Δɻ͔Βʹ͔͚ͯɺੈք֤Ͱʮաڈ࠷ѱʯͱݺΕΔྛՐࡂ͕૬࣍͗·ͨ͠ɻٿԹஆԽ͕ҰҼͱࢦఠ͞Ε͍ͯ·͕͢ɺݱͰऔࡐͯ͠ΈΔͱผͷଆ໘ݟ͖͑ͯ·ͨ͠ɻΦʔετϥϦΞɺϒϥδϧͷΞϚκϯɺถΧϦϑΥϧχΞͰԿ͕ى͖͍ͯΔͷ͔ɺಛһ͕ใࠂ͠·͢ɻXPSEWFDͰۙ୯ޠͲͪΒʮωοτ௨ൢʯɺʮάʔάϧʯɺʮΩϯυϧʯ&-.Pͷۙ୯ޠϨϊϘɺμΠϜϥʔɺωοτϑϦοΫε &-.Pͷۙ୯ޠϝϯϑΟεɺϘεχΞɺΨϘϯιϑτόϯΫ̑ɺ࣍ੈͷߴҠಈ௨৴ํࣜʮ̜̑ʯͷαʔϏεΛࠓ݄̎̓ʹ࢝ΊΔͱൃදͨ͠ɻ͍·ͷ̜̐ͷྉۚʹɺֹ݄̍ઍԁʢ੫ൈ͖ʣΛՃ͢Ε͑ΔΑ͏ʹ͢Δɻܞଳిେख̏ࣾͰ̜̑ͷ։࢝࣌ظͱྉۚΛൃදͨ͠ͷॳΊͯɻιϑτόϯΫͷ౦ڊख͕ࠓقͷ։ນखΛΊΔ͜ͱ͕̒·Ͱʹܾ·ͬͨɻϓϩ̔ͰॳͷେͱͳΔɻ̎̌ͷ։ນઓຊڌͷԬϖΠϖΠυʔϜͰϩοςͱରઓ͢ΔɻXPSEWFDͰۙ୯ޠͲͪΒʮָఱʯɺʮ%F/"ʯɺʮΦϦοΫεʯ
·ͱΊ222SJDIʹ͓͚ΔΫΠζ࡞ϑϩʔͷհXPSEWFDͷۙͷΩʔϫʔυ͕ৗʹಉ͡&-.PͰจ຺ʹԠͨ͡ྨࣅΩʔϫʔυγεςϜΛͭͬͨ͘ޠኮαΠζ͕େ͖ͯ͘܇࿅͕ՄೳͳͷͰ&-.PΛ࠾༻&-.PʹಡΈࠐ·ͤΔهࣄબ͕ॏཁจ຺ʹԠͯۙ͡ͷ୯ޠมԽ͠ɺXPSEWFDͱൺֱͯ͠ྨࣅΩʔϫʔυΛ͋Δఔ͏·͘औΕ͍ͯΔ©The Asahi Shimbun Company 2020
ࢀߟจݙ23[1] Peters+18, Deep contextualized word representations,NAACL2018[2] Devlin+19, BERT: Pre-training of Deep BidirectionalTransformers for Language Understanding, NAACL2019[3] Shen+18, Baseline Needs More Love: On Simple Word-Embedding-Based Models and Associated Pooling Mechanisms,ACL2018©The Asahi Shimbun Company 2020
͝ਗ਼ௌ͋Γ͕ͱ͏͍͟͝·ͨ͠ʂ©The Asahi Shimbun Company 2020
takuyay0ne
joere
hacomono
kurochan
yukihiromori
masakamayama
adavis
bengo4com
n1ru4l
yokawasa
nagix
opeonikute
tanoku
skipperchong
eileencodes
tmm1
aarron
addyosmani
productmarketing
lauravandoore
ddemaree
chriscoyier
jasonvnalue
samanthasiow