Save 37% off PRO during our Black Friday Sale! »

論文紹介 Towards a Fair Marketplace: Counterfactual Evaluation of the trade-off between Relevance, Fairness & Satisfaction in Recommendation Systems

論文紹介 Towards a Fair Marketplace: Counterfactual Evaluation of the trade-off between Relevance, Fairness & Satisfaction in Recommendation Systems

社内論文読み会の資料です

Mehrotra, Rishabh, et al. "Towards a fair marketplace: Counterfactual evaluation of the trade-off between relevance, fairness & satisfaction in recommendation systems." Proceedings of the 27th acm international conference on information and knowledge management. 2018.

D77e6b2d469947a4792ab062d466350b?s=128

Takashi Nishibayashi

October 15, 2021
Tweet

Transcript

  1. ࿦จ঺հ Towards a Fair Marketplace: Counterfactual Evaluation of the trade-off

    between Relevance, Fairness & Satisfaction in Recommendation Systems Mehrotra, Rishabh, et al. "Towards a fair marketplace: Counterfactual evaluation of the trade-off between relevance, fairness & satisfaction in recommendation systems." Proceedings of the 27th acm international conference on information and knowledge management. 2018. ࣾ಺%4࿦จಡΈձ! ੢ྛ޹ 5BLBTIJ/JTIJCBZBTIJIBHJOP 1
  2. ֓ཁ w $*,.࠾୒ w ྆໘ࢢ৔ʹ͓͚ΔڙڅαΠυ΁ͷެฏੑͱফඅऀ΁ͷਪનͷଥ౰ੑͷτϨʔυ ΦϑΛݕ౼ͨ͠ɻ w ফඅऀͷຬ଍౓΁ͷӨڹΛଌఆͨ͠ w ൓࣮Ծ૝ਪఆͷख๏Λ༻͍ͯਪનϙϦγʔͷධՁΛߦͳ͏GSBNFXPSLΛఏҊ

    w ؔ࿈ੑͱެฏੑΛಉ࣌ʹ࠷దԽ͢Δ w Ϣʔβͷຬ଍౓Λݦஶʹଛͳ͏͜ͱͳ͘ެฏੑΛେ෯ʹվળͰ͖ͨ w ࣮ݧ w ࣮ࡍͷΦϯϥΠϯετϦʔϛϯάαʔϏεͷϩάΛ࢖ͬͯ
  3. બΜͩཧ༝ w $PVOUFSGBDUVBMMFBSOJOHʹڵຯ͕͋Δ w աڈͷϙϦγʔͱҟͳΔϙϦγʔΛֶश͢Δ w ઃఆ͕ۀ຿ʹ͍ۙ w "E/FUXPSLˠ྆໘ࢢ৔ w

    ޿ࠂ഑৴ˠਪનɺ0⒎1PMJDZ&WBMVBUJPO w ʰࢪࡦσβΠϯͷͨΊͷػցֶशೖ໳ʱͰ঺հ͞Ε͍ͯͨ
  4. *OUSPEVDUJPO

  5. ྆໘ࢢ৔ʹ͓͚Δ໰୊ w ྆໘ࢢ৔ͱ͸ w ফඅऀ ങ͍ख ͱڙڅऀ ചΓख ͷ૒ํ͕ސ٬ͱͳΔQMBUGPSN w

    ྫΦϯϥΠϯγϣοϐϯά &CBZ ɺԻָ 4QPUJGZ ɺϥΠυγΣ Ξ 6CFS -ZGU ɺ॓ധࢪઃݕࡧ "JSCOC #PPLJOHDPN  w ਎ۙͳྫ;VDLT"E/FUXPSL w ফඅऀͱڙڅऀΛͭͳ͙஥հऀΛ௨ͯ͠αʔϏεΛར༻͢Δ w ਪનγεςϜ΍ݕࡧΤϯδϯ
  6. ྆໘ࢢ৔ʹ͓͚Δ໰୊ DPOU w ਪનγεςϜ͕ফඅऀʹ༩͑ΔӨڹ͕ڧ͍ w Ϣʔβʔͷຬ଍౓Λ࠷େԽ͢ΔͨΊʹਪન γεςϜ͸ؔ࿈ੑΛ࠷దԽ͢Δ w ؔ࿈ੑSFMFWBODF w

    ͦͷ݁Ռɺڙڅऀʹ༩͑ΒΕΔ஫໨౓͸ඇ ৗʹෆฏ౳ʹͳΔ w ϩϯάςʔϧͷେଟ਺ͷڙڅऀ͸஫໨͞Ε ͳ͍ɻڙڅऀ ΞʔςΟετ౳ ͸Ϣʔβʔʹ ެฏͳػձΛఏڙ͢Δ͜ͱΛ๬ΜͰ͍Δɻ
  7. .PUJWBUJPO w ଟ͘ͷڙڅऀ͸ࢢ৔ʹຬ଍͍ͯ͠ͳ͍ɻϓϥοτϑΥʔϚʔ͸ΑΓଟ ͘ͷڙڅऀΛҾ͖෇͚ΔͨΊʹެฏੑΛߟྀ͠ͳ͚Ε͹ͳΒͳ͍ɻ w ϢʔβʔʹެฏͳػձΛఏڙ͢Δʹͯ͠΋ɺؔ࿈ੑͱެฏੑͱຬ଍౓ ʹ͸τϨʔυΦϑͷؔ܎͕͋ΔͷͰ͸ɻ͜Εͷ૬ޓ࡞༻Λ໌Β͔ʹ͠ ͍ͨɻ w ਪનϙϦγʔʹ͍ͭͯ0OMJOF"#5FTUΛ͠ͳ͍Ͱ0⒐JOFͰධՁͨ͠

    ͍
  8. ຊ࿦จͷߩݙ w ڙڅऀͷެฏੑΛ໌ࣔతʹߟྀ͢Δ͜ͱͷॏཁੑΛ໌Β͔ʹͨ͠ w ྆໘ࢢ৔ઃఆʹ͓͚Δެฏੑͱؔ࿈ੑͷ૬ޓ࡞༻Λௐࠪͨ͠ w ਪનํࡦͷΦϑϥΠϯධՁ͕ՄೳͱͳΔ$PVOUFSGBDUVBMϑϨʔϜ ϫʔΫΛఏҊ w ڙڅऀͷެฏੑͱؔ࿈ੑΛಉ࣌ʹ࠷దԽ͢ΔਪનϙϦγʔͷఏҊ

  9. ิ଍ w (SFFEZ͞Λ؇࿨ͯ͠ଟ༷ੑ %JWFSTJUZ ΍໨৽͠͞ /PWFMUZ Λߟྀͯ͠ Ϗδωεతʹ্ख͘ߦͬͨͱ͍͏ใࠂ͕૿͖͑ͯͨ w $PVOUFSGBDUVBMMFBSOJOH

    w खݩͷσʔλͰաڈͷϙϦγʔͱ͸ҟͳΔϙϦγʔͷධՁΛߦͳ͏ w 3FD4ZT w ϙϦςΟΧϧʹਖ਼͍͔͠Ͳ͏͔ͷ࿩ͱ͸·ͨผ w 'BJSOFTTBXBSFNBDIJOFMFBSOJOH
  10. 1SPCMFN'PSNVMBUJPO

  11. $POUFYU w ԻָετϦʔϛϯάαʔϏεΛߟ͑Δ w ྆໘ࢢ৔ w Ϣʔβʔ͸ԻָΛฉ͘ফඅऀ w ΞʔςΟετ͸ڙڅऀ w

    ਪનγεςϜ͸ۂͷू߹ ϓϨΠϦετ Λਪન͢Δɺ͜ΕΒͷۂ͸ҟ ͳΔΞʔςΟετͷ΋ͷʹͳΔ͔΋͠Εͳ͍
  12. ఆٛ w ؔ࿈ੑ3FMFWBODF w Ϣʔβʔͷؔ৺QSPpMF΁ͷۙ͞ w աڈͷϢʔβʔͷϓϨΠϦετ΁ͷ൓ԠΛݩʹɺۂͱϢʔβʔͷۭ ؒͷຒΊࠐΈදݱΛֶश͍ͯ͠ΔɻTLJQHSBNNPEFMΛར༻ɻ w ϓϨΠϦετͷϕΫτϧͱͯ͠ߏ੒ۂͷϕΫτϧͷฏۉΛར༻

    w ίαΠϯྨࣅ౓Λؔ࿈ੑείΞͱ͢Δ w Ϣʔβʔຬ଍౓6TFS4BUJTGBDUJPO w ௚઀ܭଌͰ͖ͳ͍͔Βਪન͞ΕͨϓϨΠϦετͷௌ͍ͨۂ਺ͱ͢Δ
  13. ఆٛ DPOU w 'BJSOFTT w ਪનʹ͸lTQFSTUBSFDPOPNJDTzͱݺ͹ΕΔݻ༗ͷ໰୊͕͋Δ w ਓؾͷ͋ΔΞΠςϜ͸ΑΓਓؾͷঢ়ଶ͕ଓ͘ w ΞΫηείετΛ࠷খʹ͍ͨ͠Ϣʔβʔ͸ਓؾΞΠςϜʹϩοΫΠϯ͞

    ΕΔɻςʔϧΤϯυͷڙڅऀ͸ΑΓҰ૚ۤ࿑͢Δ͠ɺࢢ৔ʹຬ଍͠ͳ͍ w HSPVQGBJSOFTTͷ֓೦Λಋೖ w ΞʔςΟετͷਓؾ౓Λ࢖ͬͯެฏੑΛධՁ͢Δ w ΞʔςΟετͷਓؾεϖΫτϧͷҐஔʹج͍ͮͯάϧʔϓ෼͚ w ਪનۂू߹ʹҟͳΔάϧʔϓͷΞʔςΟετ͕͍Ε͹ެฏͱ͢Δ
  14. HSPVQGBJSOFTTС T w ۂू߹s w ਓؾ౓CJOͷ਺K w ਓؾ౓CJOJʹଐ͢ΔΞʔςΟετPi w ϓϨΠϦετs

    ʹؚ·ΕΔΞʔςΟετA(s) w K൪໨ͷۂaj ༷ʑͳਓؾ౓ͷΞʔςΟετͷ ۂؚ͕·ΕΔUSBDLTFU΄ͲείΞ͕ ߴ͘ͳΔɻ ۂͩͱͯ͠ɺಉ͡ਓؾ౓ͷΞʔςΟ ετͷΈͩͱ㲋ɻάϧʔϓҟͳ ΔΞʔςΟετ͔Βۂͮͭͩͱ 㲋 㲋 㲋
  15. $POUFYUVBM#BOEJU'PSNVMBUJPO w ใुSߴ͍Ϣʔβʔຬ଍౓ w $POUFYU4QBDF9 w Ϣʔβʔͷؔ৺ɾ࣌ࠁɾ৔ॴͳͲ w "DUJPO4QBDF" w

    ༗ݶɻϢʔβʔʹਪન͢ΔϓϨΠϦετΛબͿ͜ͱ w ϢʔβʔV㱨6 w ϓϨΠϦετT㱨4 w ਪનγεςϜͷΰʔϧ͸ใुΛ࠷େԽ͢Δ͜ͱ
  16. 0QUJNJ[JOHGPS6TFS3FMFWBODF w ϓϨΠϦετ ਪનީิ ͷϥϯμϜͳαϯϓϧͷެฏੑείΞͱؔ࿈ ੑείΞΛ֬ೝ w ެฏੑ͕ߴ͍ϓϨΠϦετ͸ؔ࿈ੑ͕௿͍܏޲ w ؔ࿈ੑ͕ߴ͍ϓϨΠϦετ͸ެฏੑ͕௿͍܏޲

    w ී௨ʹਪનͯͨ͠Βެฏ͞ʹѱӨڹ͕͋Δ w ؔ࿈ੑͷߴ͍ϓϨΠϦετͱɺશମͷϓϨΠϦετͰެฏੑείΞ ͷ෼෍Λൺֱ w ؔ࿈ੑͷߴ͍ϓϨΠϦετͷํ͕௿͍ํʹͣΕΔ
  17. Y͕࣠ެฏੑείΞ HSPVQGBJSOFTT  ϓϨΠϦετΛۂͱ͍ͯ͠ΔͷͰ্͕ݶ

  18. 5SBEFP⒎CFUXFFO 3FMFWBODFBOE'BJSOFTT

  19. $PNCJOBUJPOPG'BJSOFTTBOE3FMFWBODF w ফඅऀͱڙڅऀͷ྆ऀΛຬ଍ͤ͞ΔͨΊʹ྆໘ࢢ৔ʹ͓͚Δਪનγε ςϜ͸࣍ͷͭΛόϥϯεͤ͞Δඞཁ͕͋Δ w ফඅऀͱίϯςϯπͷؔ࿈ੑ w ڙڅऀ͕࿐ग़͢Δػձͷެฏੑ w جຊϙϦγʔ

    w ؔ࿈ੑ࠷େԽϙϦγʔ w ެฏੑ࠷େԽϙϦγʔ w
  20. ϙϦγʔͷ૊Έ͋Θͤ w *NQPSUBODFQBSBNFUFSЌͰ༏ઌ౓Λࢦఆ *OUFSQPMBUJPO1PMJDZ  w  w ֬཰ЌͰެฏ͞NBYɺͦΕҎ֎͸ؔ࿈౓NBY 1SPCBCJMJTUJD1PMJDZ

     w  w ؔ࿈ੑΛอূ (VBSBOUFFE3FMFWBODF  w ؔ࿈ੑ͕ᮢ஋Ҏ্ͷϓϨΠϦετͷதͰެฏੑΛ࠷େԽ w
  21. "EBQUJWF1PMJDZ

  22. 6TFS'BJSOFTT"⒏OJUZ w ϢʔβʔʹΑͬͯಛఆͷڙڅऀʹ͔͠ڵຯ͕ͳ͔ͬͨΓɺਪન͞Ε ͨίϯςϯπʹରͯ͠ΑΓॊೈͩͬͨΓ͍Ζ͍Ζ͋Δɻ w ϢʔβʔϨϕϧͷެฏੑ͞ʹର͢Δؾ࣭ͷҧ͍͕͋Δͱ͍͏ࣄ͸ɺ Ϣʔβʔຖͷެฏੑʹର͢Δ਌࿨ੑΛར༻ͨ͠ਪનϙϦγʔΛ։ൃ ͨ͘͠ͳΔɻ w ެฏੑ਌࿨ੑͷܭࢉ

    Ϣʔβʔͷຬ଍౓ ؔ࿈ੑ͕ᮢ஋Ҏ্ͷϓϨΠϦετʹର͢Δຬ଍౓ͷฏۉͱެฏੑ͕ᮢ஋Ҏ ্ͷϓϨΠϦετʹର͢Δຬ଍౓ͷฏۉͷࠩ
  23. 6TFS'BJSOFTT"⒏OJUZИVͷղऍ w ИV͕ͷ஋͕௿͍΄ͲɺϢʔβʔ͸ެฏͳίϯςϯπʹରͯ͠׮༰Ͱ ͸ͳ͍ w ެฏੑͷߴ͍ۂϦετΛਪનͯ͠΋ௌ͍ͯ͘Εͳ͍ w ИV͕ͷ஋͕ߴ͍΄Ͳ׮༰

  24. "⒏OJUZBXBSF3FDPNNFOEFS w Ϣʔβʔͷެฏͳίϯςϯπʹର͢Δ਌࿨ੑΛߟྀͨ͠ਪનΛߟ͑ Δɻͭ·Γ਌࿨ੑείΞ͕௿͍Ϣʔβʔʹ͸ؔ࿈ੑͷߴ͍ϓϨΠϦ ετͷΈΛਪનɻߴ͍Ϣʔβʔʹ͸ެฏͳϓϨΠϦετΛਪન͢Δ w "EBQUJWF* w "EBQUJWF** ඪ४Խͨ͠਌࿨ੑ

  25. 6OCJBTFE&TUJNBUJPOPG 6TFS4BUJTGBDUJPO

  26. Ϣʔβʔຬ଍౓ͷਪఆ w ެฏੑΛߟྀͨ͠ਪનΛߦͳ͏ͱϢʔβʔͷຬ଍౓͸Ͳ͏มΘΔͩΖ͏͔  w ਪఆ͢Δํ๏ w େ఍͸"#5FTUΛ࣮ࢪ͢Δ w ͔͕͔͔࣌ؒ͠͠Δ͠ߴίετ

    w ՄೳͳΒP⒐JOFධՁ͍ͨ͠ w աڈͷϙϦγʔʹΑͬͯੜ੒͞ΕͨϩάΛ࢖ͬͯ৽͍͠ϙϦγʔΛద༻ ͨ͠ͱ͖ͷϢʔβʔຬ଍౓Λਪఆ͢Δ w ͨͩ͠$POUFYUVBM#BOEJUઃఆʹ͓͍ͯ͸աڈͷϙϦγʔ͕બ୒ͨ͠ߦ ಈͷϩά͔͠࢒͍ͬͯͳ͍ɻϩά͸ ͷܗ (x, a, ra )
  27. 6OCJBTFE&TUJNBUPS w աڈͱҟͳΔBDUJPOΛબ୒ͨ࣌͠ʹͲ͏ͳΔ͔ϩά͔Β͸Θ͔Βͳ͍ ͔Β୯७ʹධՁͰ͖ͳ͍ w 0⒎1PMJDZ&WBMVBUJPO w ͜ͷͨΊʹҰ༷ϥϯμϜʹߦಈΛબΜͰϩάΛऩूͨ͠ ॏཁ 

    w ͜ͷσʔλΛ࢖ͬͰ*14FTUJNBUPSͰධՁ͢Δ
  28. ܏޲είΞΛར༻͢ΔͨΊͷσʔλͷݕূ w ߦಈΛબ୒͢Δ֬཰ʹ͍ͭͯ ʹ͍ͨ͠ w Ϣʔβʔຖʹબ΂ΔQMBZMJTUͷू߹͔ΒҰ༷ʹબΜͩ w ݕূ w ϩά͔Βܭࢉͨ͠܏޲είΞΛݩʹܭࢉͨ͠BDUJPOͷظ଴ग़ݱ਺

    ͕Ұக͍ͯ͠Δ͔ w )BSNPOJD.FBO5FTU pa > 0 ∀a
  29. &NQJSJDBM&WBMVBUJPO

  30. %BUBTFU w ԻָετϦʔϛϯάαʔϏε w TQPUJGZͱॻ͍ͯͳ͍͚ͲTQPUJGZͩͱࢥΘΕΔ w ୳ࡧσʔλऩूͷͨΊͷ"#5FTUΛߦͳͬͨ w z5IFFYQMPSBUJPOEBUBHBUIFSJOH"#UFTUXBTSVOGPSXFFLTQFSJPE JO/PWFNCFSzͱ͋Δ͕ڪΒ͘ϥϯμϜʹBDUJPOΛબΜͰϩάΛ࢒͠

    ͨͷͩͱࢥΘΕΔ અ  w ສਓҎ্ͷϢʔβʔͷSBOEPNDPMMFDUJPO w Ҏ্ͷQMBZMJTUͱͷ΍ΓͱΓ
  31. $PNQBSJOH%J⒎FSFOU5SBEFP⒎1PMJDJFT w ެฏੑϙϦγʔWTؔ࿈ੑϙϦγʔ w ؔ࿈ੑΛॏࢹͨ͠ਪન͔ΒެฏੑΛॏࢹͨ͠ਪનʹҠߦ͢Δͱɺ ຬ଍౓͕௿Լ͢Δ

  32. $PNQBSJOH%J⒎FSFOU5SBEFP⒎1PMJDJFT  w JOUFSQPMBUFE'BJSOFTTBOE3FMFWBODFQPMJDZ w *NQPSUBODFQBSBNFUFSЌͷ஋Λ͔Β·Ͱม͑ͳ͕ΒධՁ w ࠷΋ެฏͳͱ͖ʹͱ࠷௿ɺЌΛ্͍͛ͯ͘ͱຬ଍౓͸্͕ Δ͕ЌΛӽ͑Δͱେ෯ͳ޲্͸ΈΒΕͳ͍ w

    ެฏੑʹͷJNQPSUBODFΛஔ͍ͯ΋Ϣʔβʔຬ଍౓΁ͷਂࠁͳ Өڹ͸ͳ͍ࣄΛ͍ࣔࠦͯ͠Δ w 1SPCBCJMJTUJD1PMJDZ w ಉ༷ͷ܏޲ɺϦχΞʹ૿Ճ͍ͯ͠Δ͕͜Ε͸֬཰తʹެฏ͞NBY ͷQMBZMJTU͕ग़Δ͔Βͩͱߟ͑ΒΕΔ
  33. None
  34. (VBSBOUFFJOH3FMFWBODF w ؔ࿈ੑ੍໿ͷ্Ͱެฏ͞ΛNBYJNJ[F͢ΔϙϦγʔ w ଞͷϙϦγʔΑΓ΋Ϣʔβʔຬ଍౓͕ߴ͍

  35. "EBQUJWF1PMJDZ Ϣʔβʔຖͷެฏੑʹର͢Δ਌࿨ੑΛར༻ͨ͠ϙϦγʔ w *OUFSQPMBUFE͓ΑͼQSPCBCJMJTUJDQPMJDZͷͲͪΒΑΓ΋ྑ͍ w άϩʔόϧʹެฏ͞Λద༻͢ΔΑΓ΋ϢʔβʔϨϕϧͰద༻ͨ͠ ํ͕ྑ͍ͱΘ͔Δ w ਖ਼نԽ͞Εͨ਌࿨ੑείΞʹجͮ͘ϙϦγʔ͸ۃ୺ʹׂΓ͋ͯΛߦ ͳ͏ϙϦγʔΑΓ΋ྑ͍

  36. *NQBDUPG'BJSOFTT w 'BJSOFTT*NQPSUBODFQBSBNFUFSЌʹ͍ͭͯ w ಉ͡ЌͳΒҟͳΔϙϦγʔͰ΋ಉ͡ެฏੑΠϯύΫτͱͳΔͷ͔  w ҧ͏͜ͱΛ֬ೝͨ͠

  37. $PTUWT#FOFpU"OBMZTJT "EBQUJWF**͕࠷΋ྑ͍தؒ஍఺ΛͱΕ͍ͯΔ

  38. ݁࿦ w ਪનʹ͓͚ΔʮਪનΞΠςϜͷফඅऀ΁ͷؔ࿈ੑʯͱʮڙڅऀؒͷ ެฏੑʯͷ૬ޓ࡞༻Λཧղ͢ΔͨΊͷϑϨʔϜϫʔΫΛఏҊͨ͠ w ެฏੑͱؔ࿈ੑͷόϥϯεΛऔΔϙϦγʔΛఏҊ͠ɺͦͷͱ͖ͷফ අऀຬ଍౓΁ͷӨڹΛ0⒎1PMJDZධՁͨ͠ w "#5FTUΛߦͳͬͯզʑͷൃݟΛݕূ͍ͨ͠

  39. ײ૝޿ࠂ഑৴΁ͷԠ༻Λߟ͑Δ w 0⒎1PMJDZ&WBMVBUJPO0⒎1PMJDZ-FBSOJOH w ΍Γ͍ͨ w ͔͠͠%41ͰϥϯμϜʹ޿ࠂΛબͿͱ͸  ೖࡳֹۚͲ͏͢Δ 

    w $1.WT%JWFSTJUZ w ͢΂ͯͷϝσΟΞ͕ऩӹ࠷େԽΛ࠷༏ઌͰ๬ΜͰ͍Δͷ͔  "E/FUXPSL  w ਌࿨ੑ w ᩦཉͳ഑৴WT୳ࡧ഑৴ ৽͍͠ະධՁͷ޿ࠂΛ഑৴͢Δ  w ୳ࡧͯ͠΋$1.͕Լ͕Βͳ͍࿮͕͋ΔͳΒੵۃతʹ୳ࡧ͕Ͱ͖Δ͸ͣ