Share
Embed
The Web Conference 2020 Report -多目的最適化における確率的ラベル集約-
Yuko Ishizaki
April 30, 2020
Transcript
22 slides
-
©2020 Wantedly, Inc. ଟత࠷దԽʹ͓͚Δ֬తϥϕϧू The Web Conference Taipei 2020 Report
Apr 30, 2020 - Yuko Ishizaki -
©2020 Wantedly, Inc. 5IF8FC$POGFSFODFจɾجௐߨԋ .BUDIJOH$SPTT/FUXPSLGPS-FBSOJOHUP3BOLJO1FSTPOBM4FBSDI ɹGoogle Drive ͷݕࡧʹ͓͍ͯγϯϓϧͰޮՌతͳϞσϧΛಋೖͨ͠
.VMUJ0CKFDUJWF3BOLJOH0QUJNJ[BUJPOGPS1SPEVDU4FBSDI6TJOH4UPDIBTUJD -BCFM"HHSFHBUJPO ɹAmazon Echo ͷݕࡧʹ͓͍ͯଟత࠷దԽΛऔΓѻͬͨจ #JBTPOUIF8FCBOE#FZPOE ɹWeb4ALLͰͷجௐߨԋ ࣮ͰͷΞΠσΟΞʹͳΓͦ͏ͳͷɺ࣮ͦ͢͠͏ͳͷɺݕূσʔλྔ͕ेͳͷΛϐοΫΞοϓ -
©2020 Wantedly, Inc. Matching Cross Network for Learning to Rank
in Personal Search Zhen Qin, Zhongliang Li, Michael Bendersky, Donald Metzler Google LLC, Mountain View, CA, USA -
©2020 Wantedly, Inc. հจ̍ Matching Cross Network for Learning to
Rank in Personal Search Motivation γϯϓϧͰޮతͳυΩϡϝϯτݕࡧ ࠷ۙͷυΩϡϝϯτݕࡧɺݕࡧΫΤϦʔͱυΩϡϝϯ τͷςΩετ༰ͱͷҙຯత߹கʹॏΛஔ͍͍ͯΔɻ ͔͠͠ɺͦΕҎ֎ͷαΠυใॏཁͰɺྫۭ͑ߓͰ ʮྖऩॻʯͱυϥΠϒΛݕࡧͨ͠߹ɺ୳͍ͯ͠Δͷ ߤۭ݊ͷྖऩॻͰ͋ΔՄೳੑ͕ߴ͍ɻ·ͨɺେ͖ͳϞ σϧ(BERTͳͲ)Λ༻ͨ͠߹ɺϨΠςϯγʔ͕ʹ ͳΔɻ γϯϓϧͰޮՌతͳϞσϧΛ࡞͠ɺGoogle Driveͷݕ ࡧʹ༻͍ͨ͠ɻ -
©2020 Wantedly, Inc. ݕࡧΫΤϦʔʹର͠ɺυϥΠϒͷυΩϡϝϯτΛϥϯΫ͚͢ΔϞσϧ .BUDI'JSTU 2VFSZͱ%PDVNFOUͷ&NCFEEJOHͷཁૉੵ • ηϚϯςΟοΫϚονϯά • &NCFEEJOHʹಉࣙ͡ॻͱ-PPLVQ5BCMFΛ༻
4JEF*OGPSNBUJPO ࡞͞Ε͔ͯΒͷܦա࣌ؒ ࣌ࠁ ϢʔβΫϦοΫใ -BUFOU$SPTT • "UUFOUJPOͷҰछ • w͕&NCFEEJOHཁૉੵͷग़ྗ • ಛྔؒͷ૬ޓ࡞༻Λޮతʹֶश հจ̍ Matching Cross Network for Learning to Rank in Personal Search -
©2020 Wantedly, Inc. σʔληοτ ɹ(NBJMͱ(PPHMF%SJWFͷԯTBNQMFΛ༻ ධՁࢦඪ ɹwDMJDLQPTJUJPO QPTJUJPOόΠΞεิਖ਼ ൺֱϞσϧ w
#BTFMJOFಛྔΛͯ͢DPODBUFOBUF w -BUFOU$SPTT2VFSZ2VFSZ͚ͩ-BUFOU$SPTT w .VMUJQMJDBUJPO'JSTU-BUFOU$SPTTΛDPODBUFOBUFʹ w ,FSOFM.$/.$/ΛҰ෦มߋɹ Offline Experimental Results հจ̍ Matching Cross Network for Learning to Rank in Personal Search &NCFEEJOHཁૉੵͱ-BUFOU$SPTTΛ Έ߹ΘͤΔ͜ͱ͕ޮՌతͰ͋Δ͜ͱ͕Θ͔Δ 1୯Ґߦྻ -
©2020 Wantedly, Inc. σʔλ ɹ(PPHMF%SJWFͷ݄ͷສճͷݕࡧͰ ɹطଘͷϞσϧͱ"#ςετΛ࣮ࢪ ධՁࢦඪ w $53ΫϦοΫ w
"$1 ɹɹɹɹɹɹɹɹɹɹɹɹɹɹɹ .ΫϦοΫ͞Εͨηογϣϯ w "CBOEPO3BUF w -POH$MJDLQFS4FTTJPOυΩϡϝϯτΛඵҎ্Ӿཡ w 5JNFUP$MJDLΫϦοΫʹ͔͔Δ࣌ؒɹ հจ̍ Matching Cross Network for Learning to Rank in Personal Search Online Experimental Results ͯ͢ͷࢦඪ͕༗ҙʹվળ͞ΕͨͨΊ (PPHMF%SJWFͷݕࡧͷϞσϧΛϦϓϨʔε ˣ͕͍ํ͕ྑ͍ࢦඪ -
©2020 Wantedly, Inc. ·ͱΊ w ݕࡧΫΤϦʔͱυΩϡϝϯτͱαΠυใΛޮՌతʹֶशͰ͖ΔγϯϓϧͳϥϯΫ͚ϞσϧΛ࣮ݱ w "#ςετͰ༗ҙʹվળ͕ݟΒΕɺੈք࠷େͷύʔιφϧݕࡧΤϯδϯͱͯ͠(PPHMF%SJWFʹಋೖ ײ w
(PPHMF%SJWFͷݕࡧʹ͍ͭͯΕͯ໘ന͔ͬͨ ୯ʹpMUFSJOHͩͱࢥͬͯͨ w ηϚϯςΟοΫϚονϯάͷ෦Λͬͱෳࡶͳͷʹ͢ΔͳͲɺԠ༻͕Ͱ͖ͦ͏ հจ̍ Matching Cross Network for Learning to Rank in Personal Search -
©2020 Wantedly, Inc. Multi-Objective Ranking Optimization for Product Search Using
Stochastic Label Aggregation David Carmel, Elad Haramaty, Arnon Lazerson, Liane Lewin-Eytan -
©2020 Wantedly, Inc. Իϕʔεͷݕࡧʹ͓͚Δଟత࠷దԽ ݕࡧɺݕࡧΫΤϦʔͱͱͷؔ࿈ੑɺߪೖͷ Մೳੑͱ͍ͬͨɺෳͷతΛ࠷దԽͯ͠ϥϯΫ͚͢ Δඞཁ͕͋ΔɻeίϚʔεͰͷݕࡧଟ͘ͷઌߦݚڀ ͕͋Δ͕ɺԻʹΑΔݕࡧͷଟత࠷దԽʹؔ ͢Δͷ·ͩͳ͍ɻ ԻʹΑΔݕࡧͷଟత࠷దԽʹରͯ͠ɺ֬
తϥϕϧूͱ͍͏ΞϓϩʔνΛࢼΈͨɻ Amazon, Echo, Alexa and all related logos are trademarks of Amazon.com, Inc. or its affiliates. Motivation հจ̎ Multi-Objective Ranking Optimization for Product Search Using Stochastic Label Aggregation -
©2020 Wantedly, Inc. ݕࡧΫΤϦʔʹର͠ɺߪೖՄೳੑ1ͱؔ࿈ੑ3ͱͷ྆ํΛ࠷దԽͯ͠ɺΛϥϯΫ͚͢ΔϞσϧ ֬తϥϕϧू Ћͷ֬ͰϥϕϧΛ1ʹЋͷ֬Ͱ3ʹ͢Δ 5XP1IBTF.PEFM ϥϕϧ1Ͱֶशͤͨ͞Ϟσϧͱ ϥϕϧ3Ͱֶशͤͨ͞ϞσϧΛ࡞Δ
ͦͷग़ྗΛ֬తϥϕϧूͷϞσϧͷಛྔʹֶश հจ̎ Multi-Objective Ranking Optimization for Product Search Using Stochastic Label Aggregation 1IBTF.PEFM4UPDIBTUJD-BCFM"HHSFHBUJPO 1IBTF.PEFM4UPDIBTUJD-BCFM"HHSFHBUJPO -
©2020 Wantedly, Inc. հจ̎ Multi-Objective Ranking Optimization for Product Search
Using Stochastic Label Aggregation Experiments σʔληοτ "MFYBͷϩάສΫΤϦʔ w ूԻݕࡧσʔλ w ະՃԻݕࡧσʔλ w 8FCݕࡧσʔλ Ϟσϧ 9(#PPTU MBNCEBNBSU ධՁࢦඪ /%$(! ಛྔ w +BDDBSE w ϨʔϕϯγϡλΠϯڑ w 'BTU5FYUίαΠϯྨࣅ 1IBTF ֬తϥϕϧू 1IBTF ֬తϥϕϧू 1IBTF ઢܗϥϕϧू 1IBTF ઢܗϥϕϧू 'VTJPOείΞͷ λΠτϧɺΧςΰϦʔɺϒϥϯυ 1IBTF 4UPDL͕࠷ྑ͍ -
©2020 Wantedly, Inc. ֬తϥϕϧूͷίετؔɺҎԼͷΑ͏ʹ 1ͷίετؔͱ3ͷίετؔͷઢܗʹ͍͠ ূ໌ ֬తϥϕϧू྆ํͷϥϕϧ͕ͳֶͯ͘श͕Մೳ ΞϊςʔγϣϯҰൠతʹίετ͕ߴ͍ հจ̎ Multi-Objective
Ranking Optimization for Product Search Using Stochastic Label Aggregation Theoretical Analysis Pareto frontiers ֬తϥϕϧूͰֶशͨ͠ϞσϧύϨʔτ࠷దղͷ ू߹Λग़ྗ͢Δɻ ࠨͷࣜʹ͓͚ΔЋ͕ͷ࣌ͱͷ࣌ɻЋͷʹΑͬͯύϨʔτ࠷దղͷू߹Λग़ྗͰ͖Δͱ͍͏ ײతͳΠϝʔδɻ -
©2020 Wantedly, Inc. հจ̎ Multi-Objective Ranking Optimization for Product Search
Using Stochastic Label Aggregation ·ͱΊ w ԻʹΑΔݕࡧͰଟతϥϯΩϯά࠷దԽΛߦͬͨݚڀ w ֬తϥϕϧूͱ1IBTFNPEFMޮՌతͰ͋ͬͨ ײ w 8BOUFEMZ7JTJUͷਪનଟత࠷దԽͱ͍͏ଆ໘͋ΔͷͰɺ࣮ʹΞΠσΟΞΛར༻Ͱ͖ͦ͏ w ཧతੳͱղઆ͕ৄ͘͠ॻ͔Ε͍ͯͯྑ͍ͱࢥͬͨ -
©2020 Wantedly, Inc. Web্ͷόΠΞεʹ͍ͭͯ ΄ͱΜͲͷWebγεςϜϢʔβͷϑΟʔυόοΫʹ Αͬͯ࠷దԽΛߦ͍ͬͯΔɻ͔͠͠ɺϢʔβͷϑΟʔυ όοΫ༷ʑͳόΠΞε͕͔͔͍ͬͯΔ߹͕͋Δɻಛ ʹɺݕࡧɾਪનγεςϜͳͲ௨ৗɺػցֶशΛ༻͠ ͍ͯΔͨΊɺόΠΞεΛڧԽͤͯ͞͠·͏͜ͱ͕͋Δɻ Web্ͷόΠΞεΛཧղ͠ɺͦͷೝࣝϨϕϧΛ্͛Α
͏ɻ 8FC"MMجௐߨԋ Bias on the Web and Beyond Bias on the web. Ricardo Baeza-Yates https://doi.org/10.1145/3209581 Motivation όΠΞεʹؾ͚ͮͣʹγεςϜ։ൃΛ͢Δͱ ϢʔβɾαʔϏεʹѱӨڹΛٴ΅͢Մೳੑ -
©2020 Wantedly, Inc. Data Bias https://www.languageconnect.net/blog/market-research/the- language-of-web-content-infographic/ ݴޠόΠΞε WebαΠτͷ52%͕ӳޠͰهࡌ͞Ε͍ͯΔ͕ɺӳޠ͕ωΠςΟϒɾୈ2ݴޠͰ͋Δਓੈքͷ16%. (ԁάϥϑͪΐͬͱݹ͍)
ݱࡏɺੈքͰΘΕ͍ͯΔݴޠ7100छྨ͋ΔͷʹɺWikipediaͰΘΕ͍ͯΔͷ299ݴޠ͚ͩɻ 8FC"MMجௐߨԋ Bias on the Web and Beyond ڭҭɾܦࡁɾٕज़తόΠΞεʹΑͬͯ ΠϯλʔωοτʹΞΫηε͍ͯ͠Δਓภ͍ͬͯΔ https://upload.wikimedia.org/wikipedia/commons/1/1d/ Www.wikipedia.org_screenshot_2018.png -
©2020 Wantedly, Inc. Wikipediaͷঁੑͷฤूऀ11ˋ͔͍͠ͳ͍ɻ ҎԼͷਤWikipediaͷঁੑͷهͷྦྷੵׂ߹ɻ εϖΠϯͷ༌ग़ֹͱWeb্ϦϯΫͷάϥϑɻઌਐࠃͰ ͋Δ΄Ͳ૬͕ؔେ͖͍ɻ Data Bias ܦࡁόΠΞε
8FC"MMجௐߨԋ Bias on the Web and Beyond ͜ΕҎ֎ʹਓछ ྸ फڭ ࣏ ཧʜ ༷ʑͳཁҼͰσʔλʹόΠΞε͕͔͔Δ ੑผόΠΞε Bias on the web. Ricardo Baeza-Yates https://doi.org/10.1145/3209581 -
©2020 Wantedly, Inc. Web্ͷ΄ͱΜͲͷίϯςϯπগͷΞΫςΟϒϢʔ βʹΑͬͯ࡞ΒΕ͍ͯΔɻ֤αʔϏεͷ50%ͷίϯςϯ πΛ࡞͢ΔΞΫςΟϒϢʔβͷׂ߹ΛάϥϑԽͨ͠ ͷɻ Activity Bias গͷΞΫςΟϒϢʔβ
8FC"MMجௐߨԋ Bias on the Web and Beyond ωοτ্ͰΈΜͳͷҙݟͩͱࢥΘΕ͍ͯΔ͜ͱ ͦ͏Ͱͳ͍ͱ͍͏͜ͱ͋Δ Amazon༗ྉͷِϨϏϡʔࢭΩϟϯϖʔϯͰ1000ਓ ͷϑΣΠΫϨϏϡΞʔΛఠൃͨ͜͠ͱ͋Δ ϑΣΠΫϨϏϡʔ https://www.theguardian.com/international -
©2020 Wantedly, Inc. Bias in the Interaction Ϣʔβૢ࡞ͷόΠΞε w ϓϨθϯςʔγϣϯόΠΞεϢʔβݟͨͷ͔͠ΫϦοΫ͠ͳ͍
w ϙδγϣϯόΠΞεࠨ্ΫϦοΫ͞Ε͍͢ w ϥϯΩϯάόΠΞεϥϯΩϯά্͕Ґͷͷ΄ͲΫϦοΫ͞Ε͍͢ Bias on the web. Ricardo Baeza-Yates ɹhttps://dl.acm.org/doi/pdf/10.1145/3209581 8FC"MMجௐߨԋ Bias on the Web and Beyond ͜ΕΒ૬ޓʹ࡞༻͢ΔͨΊ όΠΞεͷඇৗʹࠔ The Evolution of Google's Search Results Pages & Effects on User Behaviour -
©2020 Wantedly, Inc. Vicious Cycle of Bias 2࣍όΠΞε όΠΞεόΠΞεΛੜΉɻ ৽͍͠WebίϯςϯπΛ࡞͢Δͱ͖ɺผͷWebίϯς
ϯπΛࢀߟʹͯ͠ϦϯΫΛΔέʔε͋Δɻෳ͞Ε ͨใͱϦϯΫʹΑͬͯɺݕࡧΤϯδϯ͕͞ΒʹόΠΞ εΛ͔͚ͯ͠·͏߹͕͋Δɻ ·ͨɺաͳύʔιφϥΠζΞϧΰϦζϜดͨ͡ੈք Λ࡞Γग़ͯ͠͠·͏ɻ Degenerate Feedback Loops in Recommender Systems Ray Jiang, Silvia Chiappa, Tor Lattimore, Andras Agyorgy, and Pushmeet Kohli. 8FC"MMجௐߨԋ Bias on the Web and Beyond ଟ༷ੑɾηϨϯσΟϐςΟͷେ͞ -
©2020 Wantedly, Inc. 8FC"MMجௐߨԋ Bias on the Web and Beyond
·ͱΊ w όΠΞεͷରॲʹɺ·ͣόΠΞεΛೝ͢Δ͜ͱ͔Β࢝·Δ w όΠΞεΛߟྀ͠ɺ༏ΕͨγεςϜઃܭΛ͢Δඞཁ͕͋Δ ײ w ͜ͷεϥΠυʹهࡌग़དྷͳ͔͕ͬͨɺଞʹࢁͷࣄྫ͕͋ͬͯͱͯڵຯਂ͔ͬͨ w ଟ͘ฉ͍ͨ͜ͱ͕͋Δ͜ͱɾ૾͕༰қͳ͜ͱ͕ͩͬͨɺؾΛ͚͍ͭͯͳ͍ͱݟಀͯ͠͠·͏͜ͱͰ ͋Δͱࢥ͍ɺͱͯؾ͕࣋ͪҾ͖క·ͬͨ