$30 off During Our Annual Pro Sale. View Details »

論文紹介 Towards a Fair Marketplace: Counterfactual Evaluation of the trade-off between Relevance, Fairness & Satisfaction in Recommendation Systems

論文紹介 Towards a Fair Marketplace: Counterfactual Evaluation of the trade-off between Relevance, Fairness & Satisfaction in Recommendation Systems

社内論文読み会の資料です

Mehrotra, Rishabh, et al. "Towards a fair marketplace: Counterfactual evaluation of the trade-off between relevance, fairness & satisfaction in recommendation systems." Proceedings of the 27th acm international conference on information and knowledge management. 2018.

Takashi Nishibayashi

October 15, 2021
Tweet

More Decks by Takashi Nishibayashi

Other Decks in Research

Transcript

  1. ࿦จ঺հ Towards a Fair Marketplace: Counterfactual Evaluation of the trade-off

    between Relevance, Fairness & Satisfaction in Recommendation Systems Mehrotra, Rishabh, et al. "Towards a fair marketplace: Counterfactual evaluation of the trade-off between relevance, fairness & satisfaction in recommendation systems." Proceedings of the 27th acm international conference on information and knowledge management. 2018. ࣾ಺%4࿦จಡΈձ! ੢ྛ޹ 5BLBTIJ/JTIJCBZBTIJIBHJOP 1
  2. ֓ཁ w $*,.࠾୒ w ྆໘ࢢ৔ʹ͓͚ΔڙڅαΠυ΁ͷެฏੑͱফඅऀ΁ͷਪનͷଥ౰ੑͷτϨʔυ ΦϑΛݕ౼ͨ͠ɻ w ফඅऀͷຬ଍౓΁ͷӨڹΛଌఆͨ͠ w ൓࣮Ծ૝ਪఆͷख๏Λ༻͍ͯਪનϙϦγʔͷධՁΛߦͳ͏GSBNFXPSLΛఏҊ

    w ؔ࿈ੑͱެฏੑΛಉ࣌ʹ࠷దԽ͢Δ w Ϣʔβͷຬ଍౓Λݦஶʹଛͳ͏͜ͱͳ͘ެฏੑΛେ෯ʹվળͰ͖ͨ w ࣮ݧ w ࣮ࡍͷΦϯϥΠϯετϦʔϛϯάαʔϏεͷϩάΛ࢖ͬͯ
  3. બΜͩཧ༝ w $PVOUFSGBDUVBMMFBSOJOHʹڵຯ͕͋Δ w աڈͷϙϦγʔͱҟͳΔϙϦγʔΛֶश͢Δ w ઃఆ͕ۀ຿ʹ͍ۙ w "E/FUXPSLˠ྆໘ࢢ৔ w

    ޿ࠂ഑৴ˠਪનɺ0⒎1PMJDZ&WBMVBUJPO w ʰࢪࡦσβΠϯͷͨΊͷػցֶशೖ໳ʱͰ঺հ͞Ε͍ͯͨ
  4. *OUSPEVDUJPO

  5. ྆໘ࢢ৔ʹ͓͚Δ໰୊ w ྆໘ࢢ৔ͱ͸ w ফඅऀ ങ͍ख ͱڙڅऀ ചΓख ͷ૒ํ͕ސ٬ͱͳΔQMBUGPSN w

    ྫΦϯϥΠϯγϣοϐϯά &CBZ ɺԻָ 4QPUJGZ ɺϥΠυγΣ Ξ 6CFS -ZGU ɺ॓ധࢪઃݕࡧ "JSCOC #PPLJOHDPN  w ਎ۙͳྫ;VDLT"E/FUXPSL w ফඅऀͱڙڅऀΛͭͳ͙஥հऀΛ௨ͯ͠αʔϏεΛར༻͢Δ w ਪનγεςϜ΍ݕࡧΤϯδϯ
  6. ྆໘ࢢ৔ʹ͓͚Δ໰୊ DPOU w ਪનγεςϜ͕ফඅऀʹ༩͑ΔӨڹ͕ڧ͍ w Ϣʔβʔͷຬ଍౓Λ࠷େԽ͢ΔͨΊʹਪન γεςϜ͸ؔ࿈ੑΛ࠷దԽ͢Δ w ؔ࿈ੑSFMFWBODF w

    ͦͷ݁Ռɺڙڅऀʹ༩͑ΒΕΔ஫໨౓͸ඇ ৗʹෆฏ౳ʹͳΔ w ϩϯάςʔϧͷେଟ਺ͷڙڅऀ͸஫໨͞Ε ͳ͍ɻڙڅऀ ΞʔςΟετ౳ ͸Ϣʔβʔʹ ެฏͳػձΛఏڙ͢Δ͜ͱΛ๬ΜͰ͍Δɻ
  7. .PUJWBUJPO w ଟ͘ͷڙڅऀ͸ࢢ৔ʹຬ଍͍ͯ͠ͳ͍ɻϓϥοτϑΥʔϚʔ͸ΑΓଟ ͘ͷڙڅऀΛҾ͖෇͚ΔͨΊʹެฏੑΛߟྀ͠ͳ͚Ε͹ͳΒͳ͍ɻ w ϢʔβʔʹެฏͳػձΛఏڙ͢Δʹͯ͠΋ɺؔ࿈ੑͱެฏੑͱຬ଍౓ ʹ͸τϨʔυΦϑͷؔ܎͕͋ΔͷͰ͸ɻ͜Εͷ૬ޓ࡞༻Λ໌Β͔ʹ͠ ͍ͨɻ w ਪનϙϦγʔʹ͍ͭͯ0OMJOF"#5FTUΛ͠ͳ͍Ͱ0⒐JOFͰධՁͨ͠

    ͍
  8. ຊ࿦จͷߩݙ w ڙڅऀͷެฏੑΛ໌ࣔతʹߟྀ͢Δ͜ͱͷॏཁੑΛ໌Β͔ʹͨ͠ w ྆໘ࢢ৔ઃఆʹ͓͚Δެฏੑͱؔ࿈ੑͷ૬ޓ࡞༻Λௐࠪͨ͠ w ਪનํࡦͷΦϑϥΠϯධՁ͕ՄೳͱͳΔ$PVOUFSGBDUVBMϑϨʔϜ ϫʔΫΛఏҊ w ڙڅऀͷެฏੑͱؔ࿈ੑΛಉ࣌ʹ࠷దԽ͢ΔਪનϙϦγʔͷఏҊ

  9. ิ଍ w (SFFEZ͞Λ؇࿨ͯ͠ଟ༷ੑ %JWFSTJUZ ΍໨৽͠͞ /PWFMUZ Λߟྀͯ͠ Ϗδωεతʹ্ख͘ߦͬͨͱ͍͏ใࠂ͕૿͖͑ͯͨ w $PVOUFSGBDUVBMMFBSOJOH

    w खݩͷσʔλͰաڈͷϙϦγʔͱ͸ҟͳΔϙϦγʔͷධՁΛߦͳ͏ w 3FD4ZT w ϙϦςΟΧϧʹਖ਼͍͔͠Ͳ͏͔ͷ࿩ͱ͸·ͨผ w 'BJSOFTTBXBSFNBDIJOFMFBSOJOH
  10. 1SPCMFN'PSNVMBUJPO

  11. $POUFYU w ԻָετϦʔϛϯάαʔϏεΛߟ͑Δ w ྆໘ࢢ৔ w Ϣʔβʔ͸ԻָΛฉ͘ফඅऀ w ΞʔςΟετ͸ڙڅऀ w

    ਪનγεςϜ͸ۂͷू߹ ϓϨΠϦετ Λਪન͢Δɺ͜ΕΒͷۂ͸ҟ ͳΔΞʔςΟετͷ΋ͷʹͳΔ͔΋͠Εͳ͍
  12. ఆٛ w ؔ࿈ੑ3FMFWBODF w Ϣʔβʔͷؔ৺QSPpMF΁ͷۙ͞ w աڈͷϢʔβʔͷϓϨΠϦετ΁ͷ൓ԠΛݩʹɺۂͱϢʔβʔͷۭ ؒͷຒΊࠐΈදݱΛֶश͍ͯ͠ΔɻTLJQHSBNNPEFMΛར༻ɻ w ϓϨΠϦετͷϕΫτϧͱͯ͠ߏ੒ۂͷϕΫτϧͷฏۉΛར༻

    w ίαΠϯྨࣅ౓Λؔ࿈ੑείΞͱ͢Δ w Ϣʔβʔຬ଍౓6TFS4BUJTGBDUJPO w ௚઀ܭଌͰ͖ͳ͍͔Βਪન͞ΕͨϓϨΠϦετͷௌ͍ͨۂ਺ͱ͢Δ
  13. ఆٛ DPOU w 'BJSOFTT w ਪનʹ͸lTQFSTUBSFDPOPNJDTzͱݺ͹ΕΔݻ༗ͷ໰୊͕͋Δ w ਓؾͷ͋ΔΞΠςϜ͸ΑΓਓؾͷঢ়ଶ͕ଓ͘ w ΞΫηείετΛ࠷খʹ͍ͨ͠Ϣʔβʔ͸ਓؾΞΠςϜʹϩοΫΠϯ͞

    ΕΔɻςʔϧΤϯυͷڙڅऀ͸ΑΓҰ૚ۤ࿑͢Δ͠ɺࢢ৔ʹຬ଍͠ͳ͍ w HSPVQGBJSOFTTͷ֓೦Λಋೖ w ΞʔςΟετͷਓؾ౓Λ࢖ͬͯެฏੑΛධՁ͢Δ w ΞʔςΟετͷਓؾεϖΫτϧͷҐஔʹج͍ͮͯάϧʔϓ෼͚ w ਪનۂू߹ʹҟͳΔάϧʔϓͷΞʔςΟετ͕͍Ε͹ެฏͱ͢Δ
  14. HSPVQGBJSOFTTС T w ۂू߹s w ਓؾ౓CJOͷ਺K w ਓؾ౓CJOJʹଐ͢ΔΞʔςΟετPi w ϓϨΠϦετs

    ʹؚ·ΕΔΞʔςΟετA(s) w K൪໨ͷۂaj ༷ʑͳਓؾ౓ͷΞʔςΟετͷ ۂؚ͕·ΕΔUSBDLTFU΄ͲείΞ͕ ߴ͘ͳΔɻ ۂͩͱͯ͠ɺಉ͡ਓؾ౓ͷΞʔςΟ ετͷΈͩͱ㲋ɻάϧʔϓҟͳ ΔΞʔςΟετ͔Βۂͮͭͩͱ 㲋 㲋 㲋
  15. $POUFYUVBM#BOEJU'PSNVMBUJPO w ใुSߴ͍Ϣʔβʔຬ଍౓ w $POUFYU4QBDF9 w Ϣʔβʔͷؔ৺ɾ࣌ࠁɾ৔ॴͳͲ w "DUJPO4QBDF" w

    ༗ݶɻϢʔβʔʹਪન͢ΔϓϨΠϦετΛબͿ͜ͱ w ϢʔβʔV㱨6 w ϓϨΠϦετT㱨4 w ਪનγεςϜͷΰʔϧ͸ใुΛ࠷େԽ͢Δ͜ͱ
  16. 0QUJNJ[JOHGPS6TFS3FMFWBODF w ϓϨΠϦετ ਪનީิ ͷϥϯμϜͳαϯϓϧͷެฏੑείΞͱؔ࿈ ੑείΞΛ֬ೝ w ެฏੑ͕ߴ͍ϓϨΠϦετ͸ؔ࿈ੑ͕௿͍܏޲ w ؔ࿈ੑ͕ߴ͍ϓϨΠϦετ͸ެฏੑ͕௿͍܏޲

    w ී௨ʹਪનͯͨ͠Βެฏ͞ʹѱӨڹ͕͋Δ w ؔ࿈ੑͷߴ͍ϓϨΠϦετͱɺશମͷϓϨΠϦετͰެฏੑείΞ ͷ෼෍Λൺֱ w ؔ࿈ੑͷߴ͍ϓϨΠϦετͷํ͕௿͍ํʹͣΕΔ
  17. Y͕࣠ެฏੑείΞ HSPVQGBJSOFTT  ϓϨΠϦετΛۂͱ͍ͯ͠ΔͷͰ্͕ݶ

  18. 5SBEFP⒎CFUXFFO 3FMFWBODFBOE'BJSOFTT

  19. $PNCJOBUJPOPG'BJSOFTTBOE3FMFWBODF w ফඅऀͱڙڅऀͷ྆ऀΛຬ଍ͤ͞ΔͨΊʹ྆໘ࢢ৔ʹ͓͚Δਪનγε ςϜ͸࣍ͷͭΛόϥϯεͤ͞Δඞཁ͕͋Δ w ফඅऀͱίϯςϯπͷؔ࿈ੑ w ڙڅऀ͕࿐ग़͢Δػձͷެฏੑ w جຊϙϦγʔ

    w ؔ࿈ੑ࠷େԽϙϦγʔ w ެฏੑ࠷େԽϙϦγʔ w
  20. ϙϦγʔͷ૊Έ͋Θͤ w *NQPSUBODFQBSBNFUFSЌͰ༏ઌ౓Λࢦఆ *OUFSQPMBUJPO1PMJDZ  w  w ֬཰ЌͰެฏ͞NBYɺͦΕҎ֎͸ؔ࿈౓NBY 1SPCBCJMJTUJD1PMJDZ

     w  w ؔ࿈ੑΛอূ (VBSBOUFFE3FMFWBODF  w ؔ࿈ੑ͕ᮢ஋Ҏ্ͷϓϨΠϦετͷதͰެฏੑΛ࠷େԽ w
  21. "EBQUJWF1PMJDZ

  22. 6TFS'BJSOFTT"⒏OJUZ w ϢʔβʔʹΑͬͯಛఆͷڙڅऀʹ͔͠ڵຯ͕ͳ͔ͬͨΓɺਪન͞Ε ͨίϯςϯπʹରͯ͠ΑΓॊೈͩͬͨΓ͍Ζ͍Ζ͋Δɻ w ϢʔβʔϨϕϧͷެฏੑ͞ʹର͢Δؾ࣭ͷҧ͍͕͋Δͱ͍͏ࣄ͸ɺ Ϣʔβʔຖͷެฏੑʹର͢Δ਌࿨ੑΛར༻ͨ͠ਪનϙϦγʔΛ։ൃ ͨ͘͠ͳΔɻ w ެฏੑ਌࿨ੑͷܭࢉ

    Ϣʔβʔͷຬ଍౓ ؔ࿈ੑ͕ᮢ஋Ҏ্ͷϓϨΠϦετʹର͢Δຬ଍౓ͷฏۉͱެฏੑ͕ᮢ஋Ҏ ্ͷϓϨΠϦετʹର͢Δຬ଍౓ͷฏۉͷࠩ
  23. 6TFS'BJSOFTT"⒏OJUZИVͷղऍ w ИV͕ͷ஋͕௿͍΄ͲɺϢʔβʔ͸ެฏͳίϯςϯπʹରͯ͠׮༰Ͱ ͸ͳ͍ w ެฏੑͷߴ͍ۂϦετΛਪનͯ͠΋ௌ͍ͯ͘Εͳ͍ w ИV͕ͷ஋͕ߴ͍΄Ͳ׮༰

  24. "⒏OJUZBXBSF3FDPNNFOEFS w Ϣʔβʔͷެฏͳίϯςϯπʹର͢Δ਌࿨ੑΛߟྀͨ͠ਪનΛߟ͑ Δɻͭ·Γ਌࿨ੑείΞ͕௿͍Ϣʔβʔʹ͸ؔ࿈ੑͷߴ͍ϓϨΠϦ ετͷΈΛਪનɻߴ͍Ϣʔβʔʹ͸ެฏͳϓϨΠϦετΛਪન͢Δ w "EBQUJWF* w "EBQUJWF** ඪ४Խͨ͠਌࿨ੑ

  25. 6OCJBTFE&TUJNBUJPOPG 6TFS4BUJTGBDUJPO

  26. Ϣʔβʔຬ଍౓ͷਪఆ w ެฏੑΛߟྀͨ͠ਪનΛߦͳ͏ͱϢʔβʔͷຬ଍౓͸Ͳ͏มΘΔͩΖ͏͔  w ਪఆ͢Δํ๏ w େ఍͸"#5FTUΛ࣮ࢪ͢Δ w ͔͕͔͔࣌ؒ͠͠Δ͠ߴίετ

    w ՄೳͳΒP⒐JOFධՁ͍ͨ͠ w աڈͷϙϦγʔʹΑͬͯੜ੒͞ΕͨϩάΛ࢖ͬͯ৽͍͠ϙϦγʔΛద༻ ͨ͠ͱ͖ͷϢʔβʔຬ଍౓Λਪఆ͢Δ w ͨͩ͠$POUFYUVBM#BOEJUઃఆʹ͓͍ͯ͸աڈͷϙϦγʔ͕બ୒ͨ͠ߦ ಈͷϩά͔͠࢒͍ͬͯͳ͍ɻϩά͸ ͷܗ (x, a, ra )
  27. 6OCJBTFE&TUJNBUPS w աڈͱҟͳΔBDUJPOΛબ୒ͨ࣌͠ʹͲ͏ͳΔ͔ϩά͔Β͸Θ͔Βͳ͍ ͔Β୯७ʹධՁͰ͖ͳ͍ w 0⒎1PMJDZ&WBMVBUJPO w ͜ͷͨΊʹҰ༷ϥϯμϜʹߦಈΛબΜͰϩάΛऩूͨ͠ ॏཁ 

    w ͜ͷσʔλΛ࢖ͬͰ*14FTUJNBUPSͰධՁ͢Δ
  28. ܏޲είΞΛར༻͢ΔͨΊͷσʔλͷݕূ w ߦಈΛબ୒͢Δ֬཰ʹ͍ͭͯ ʹ͍ͨ͠ w Ϣʔβʔຖʹબ΂ΔQMBZMJTUͷू߹͔ΒҰ༷ʹબΜͩ w ݕূ w ϩά͔Βܭࢉͨ͠܏޲είΞΛݩʹܭࢉͨ͠BDUJPOͷظ଴ग़ݱ਺

    ͕Ұக͍ͯ͠Δ͔ w )BSNPOJD.FBO5FTU pa > 0 ∀a
  29. &NQJSJDBM&WBMVBUJPO

  30. %BUBTFU w ԻָετϦʔϛϯάαʔϏε w TQPUJGZͱॻ͍ͯͳ͍͚ͲTQPUJGZͩͱࢥΘΕΔ w ୳ࡧσʔλऩूͷͨΊͷ"#5FTUΛߦͳͬͨ w z5IFFYQMPSBUJPOEBUBHBUIFSJOH"#UFTUXBTSVOGPSXFFLTQFSJPE JO/PWFNCFSzͱ͋Δ͕ڪΒ͘ϥϯμϜʹBDUJPOΛબΜͰϩάΛ࢒͠

    ͨͷͩͱࢥΘΕΔ અ  w ສਓҎ্ͷϢʔβʔͷSBOEPNDPMMFDUJPO w Ҏ্ͷQMBZMJTUͱͷ΍ΓͱΓ
  31. $PNQBSJOH%J⒎FSFOU5SBEFP⒎1PMJDJFT w ެฏੑϙϦγʔWTؔ࿈ੑϙϦγʔ w ؔ࿈ੑΛॏࢹͨ͠ਪન͔ΒެฏੑΛॏࢹͨ͠ਪનʹҠߦ͢Δͱɺ ຬ଍౓͕௿Լ͢Δ

  32. $PNQBSJOH%J⒎FSFOU5SBEFP⒎1PMJDJFT  w JOUFSQPMBUFE'BJSOFTTBOE3FMFWBODFQPMJDZ w *NQPSUBODFQBSBNFUFSЌͷ஋Λ͔Β·Ͱม͑ͳ͕ΒධՁ w ࠷΋ެฏͳͱ͖ʹͱ࠷௿ɺЌΛ্͍͛ͯ͘ͱຬ଍౓͸্͕ Δ͕ЌΛӽ͑Δͱେ෯ͳ޲্͸ΈΒΕͳ͍ w

    ެฏੑʹͷJNQPSUBODFΛஔ͍ͯ΋Ϣʔβʔຬ଍౓΁ͷਂࠁͳ Өڹ͸ͳ͍ࣄΛ͍ࣔࠦͯ͠Δ w 1SPCBCJMJTUJD1PMJDZ w ಉ༷ͷ܏޲ɺϦχΞʹ૿Ճ͍ͯ͠Δ͕͜Ε͸֬཰తʹެฏ͞NBY ͷQMBZMJTU͕ग़Δ͔Βͩͱߟ͑ΒΕΔ
  33. None
  34. (VBSBOUFFJOH3FMFWBODF w ؔ࿈ੑ੍໿ͷ্Ͱެฏ͞ΛNBYJNJ[F͢ΔϙϦγʔ w ଞͷϙϦγʔΑΓ΋Ϣʔβʔຬ଍౓͕ߴ͍

  35. "EBQUJWF1PMJDZ Ϣʔβʔຖͷެฏੑʹର͢Δ਌࿨ੑΛར༻ͨ͠ϙϦγʔ w *OUFSQPMBUFE͓ΑͼQSPCBCJMJTUJDQPMJDZͷͲͪΒΑΓ΋ྑ͍ w άϩʔόϧʹެฏ͞Λద༻͢ΔΑΓ΋ϢʔβʔϨϕϧͰద༻ͨ͠ ํ͕ྑ͍ͱΘ͔Δ w ਖ਼نԽ͞Εͨ਌࿨ੑείΞʹجͮ͘ϙϦγʔ͸ۃ୺ʹׂΓ͋ͯΛߦ ͳ͏ϙϦγʔΑΓ΋ྑ͍

  36. *NQBDUPG'BJSOFTT w 'BJSOFTT*NQPSUBODFQBSBNFUFSЌʹ͍ͭͯ w ಉ͡ЌͳΒҟͳΔϙϦγʔͰ΋ಉ͡ެฏੑΠϯύΫτͱͳΔͷ͔  w ҧ͏͜ͱΛ֬ೝͨ͠

  37. $PTUWT#FOFpU"OBMZTJT "EBQUJWF**͕࠷΋ྑ͍தؒ஍఺ΛͱΕ͍ͯΔ

  38. ݁࿦ w ਪનʹ͓͚ΔʮਪનΞΠςϜͷফඅऀ΁ͷؔ࿈ੑʯͱʮڙڅऀؒͷ ެฏੑʯͷ૬ޓ࡞༻Λཧղ͢ΔͨΊͷϑϨʔϜϫʔΫΛఏҊͨ͠ w ެฏੑͱؔ࿈ੑͷόϥϯεΛऔΔϙϦγʔΛఏҊ͠ɺͦͷͱ͖ͷফ අऀຬ଍౓΁ͷӨڹΛ0⒎1PMJDZධՁͨ͠ w "#5FTUΛߦͳͬͯզʑͷൃݟΛݕূ͍ͨ͠

  39. ײ૝޿ࠂ഑৴΁ͷԠ༻Λߟ͑Δ w 0⒎1PMJDZ&WBMVBUJPO0⒎1PMJDZ-FBSOJOH w ΍Γ͍ͨ w ͔͠͠%41ͰϥϯμϜʹ޿ࠂΛબͿͱ͸  ೖࡳֹۚͲ͏͢Δ 

    w $1.WT%JWFSTJUZ w ͢΂ͯͷϝσΟΞ͕ऩӹ࠷େԽΛ࠷༏ઌͰ๬ΜͰ͍Δͷ͔  "E/FUXPSL  w ਌࿨ੑ w ᩦཉͳ഑৴WT୳ࡧ഑৴ ৽͍͠ະධՁͷ޿ࠂΛ഑৴͢Δ  w ୳ࡧͯ͠΋$1.͕Լ͕Βͳ͍࿮͕͋ΔͳΒੵۃతʹ୳ࡧ͕Ͱ͖Δ͸ͣ