Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Win ratioとは何か?

Shuntaro Sato
February 12, 2023

Win ratioとは何か?

従来の複合エンドポイントの問題点,それをWin ratioはどう対処しているのか?どのように計算するのか解説しています.

Shuntaro Sato

February 12, 2023
Tweet

More Decks by Shuntaro Sato

Other Decks in Research

Transcript

  1. ྲྀΕ 2 ෳ߹ΤϯυϙΠϯτ w ԿͰඞཁʁˠݕग़ྗෆ଍ w Կ͕໰୊ʁ ରࡦ w 8JOSBUJP

    w ૣ͘ىͬͨ͜ࣄ৅ͷ৘ใ͔͠࢖Θͳ͍ w ֤ΤϯυϙΠϯτͷྟচతͳॏΈ͸ແࢹ w ΞϧΰϦζϜ w ࢦඪͷҙຯ w ϦεΫൺɺΦοζൺɺϋβʔυൺͷҙຯΛ࠶ߟ w ྑ͍఺ͱ՝୊ ᶃ 8JOSBUJP
  2. ෳ߹ΤϯυϙΠϯτͷ໰୊఺ 5 'FSSFJSB(PO[ÂMF[* #VTTF+8 )FFMT"OTEFMM% .POUPSJ7. "LM&" #SZBOU%. FUBM 


    1SPCMFNTXJUIVTFPGDPNQPTJUFFOEQPJOUTJODBSEJPWBTDVMBSUSJBMTTZTUFNBUJDSFWJFXPGSBOEPNJTFEDPOUSPMMFEUSJBMT#.+"QS  ͷ'JHVSF ᶃ %FBUI ᶄ $SJUJDBM 4USPLF  ᶅ .BKPS /POGBUBM.*  ᶆ .PEFSBUF )PTQJUBMJ[BUJPO  ᶇ .JOPS $IBOHFJOCMPPEQSFTTVSF w ॏ঱౓͕ߴ͍ΤϯυϙΠϯτ͸ɺ 
 ޮՌ͕খ͍͞ w ॏ঱౓͕௿͍ΤϯυϙΠϯτ͸ɺ 
 ޮՌ͕େ͖͍ w ॏ঱౓͕௿͍ΤϯυϙΠϯτ͸ߴ͍ΤϯυϙΠϯτΑΓɺΠϕϯτΛൃੜ͠΍͍͢ w ෳ߹ΤϯυϙΠϯτ͸ɺUJNFUP fi STUFWFOUͷ৘ใΛ༻͍Δ ॏ঱౓͕ߴ͍ΤϯυϙΠϯτͷ৽نͷ࣏ྍޮՌΛద੾ʹධՁͰ͖͍ͯͳ͍͔΋͠Εͳ͍ ৽ن࣏ྍ͸ෳ߹ΤϯυϙΠϯτͷൃੜස౓Λม͑ͨ ϛεϦʔσΟϯά
  3. 8JOSBUJP 7 ΞϧΰϦζϜ ᶃ ৽ن࣏ྍ܈ʢҎԼɺ࣏ྍ܈ʣͱରর܈ͷରϖΞΛ࡞Δ ᶄ ࣄલʹΤϯυϙΠϯτͷ༏ઌॱҐΛܾΊΔ ᶅ ༏ઌॱҐͷߴ͍ΤϯυϙΠϯτ͔Βɺ 


    Πϕϯτ͕ൃੜ͢Δ·Ͱͷ࣌ؒΛ࢖ͬͯɺ࣏ྍ܈ͷʮ8JOʢউͪʣʯʮ-PTFʢෛ͚ʣʯΛܾΊΔ ᶆ ʮ5JFʢҾ͖෼͚ʣʯͷ৔߹ɺԼҐͷΤϯυϙΠϯτͰಉ͡Α͏ʹධՁ͢Δ ᶇ 8JOOFSTͷ૯਺ͱ-PTFSTͷ૯਺ͷൺΛ8JOSBUJPͱ͢Δ 1PDPDL4+ "SJUJ$" $PMMJFS5+ 8BOH%5IFXJOSBUJPBOFXBQQSPBDIUPUIFBOBMZTJTPGDPNQPTJUFFOEQPJOUTJODMJOJDBMUSJBMTCBTFEPODMJOJDBM QSJPSJUJFT&VS)FBSU++BO  r w ෳ߹ΤϯυϙΠϯτΛߏ੒͢ΔΤϯυϙΠϯτͷ༏ઌॱҐΛߟྀͨ͠ࢦඪ w ޮՌࢦඪͱ৴པ۠ؒ΋ಘΒΕΔ w ݩͷΞΠσΞ͸ɺ'JOLFMTUFJO4DIPFOGFMEݕఆʢϊϯύϥϝτϦοΫݕఆʣ
  4. ΞϧΰϦζϜɹᶃϖΞΛ࡞Δ 8 5IFNBUDIFEQBJSTBQQSPBDI 5IFVONBUDIFEQBJSTBQQSPBDI 3JTLTDPSF    ಉ͡ϦεΫΛ࣋ͭਓಉ࢜ΛϖΞʹ͢Δ ࣏ྍ܈

    ରর܈ w ϞσϧʹΑΓɺҰਓҰਓͷ3JTLTDPSFΛܭࢉ͢Δඞཁ w ݪஶ࿦จͰ͸નΊΒΕ͍͕ͯͨ w ࣮༻తͰͳ͍ͱɺஶऀΒࣗ਎΋೥ޙͷ࿦จͰݴٴ 3FEGPST# (SFHTPO+ $SPXMFZ" .D"OESFX5 #FO:FIVEB0 4UPOF(8 FUBM5IF XJOSBUJPBQQSPBDIGPSDPNQPTJUFFOEQPJOUTQSBDUJDBMHVJEBODFCBTFEPOQSFWJPVT FYQFSJFODF&VS)FBSU+%FD  r ͢΂ͯͷ૊Έ߹ΘͤΛϖΞʹ͢Δ ࣏ྍ܈ /5 ରর܈ /$ w 3JTLTDPSF͸ෆཁ w ݩͷϦεΫ͕ۃ୺ʹ཭Ε͍ͯΔਓಉ࢜ΛϖΞʹ ͍ͯ͠Δ w ࣮༻త ϖΞͷ਺ /5º/$
  5. ΞϧΰϦζϜɹᶅᶆ࣏ྍ܈ͷ8JO -PTF 5JFͷ൑ఆ 10 ྫɿ$7EFBUI)PTQJUBMJ[BUJPOͰߏ੒͞Εͨෳ߹Ξ΢τΧϜ  $7EFBUIͰ࣏ྍ܈ͷ8JO͕ܾ·Δύλʔϯ ଧͪ੾Γ ࣏ྍ ରর

    ࣏ྍ ରর ࣏ྍ ରর ࣏ྍ͸ରরΑΓ΋ૣ͘ )PTQJUBMJ[BUJPOΛى͍ͯ͜͠Δ͕ɺ ༏ઌॱҐ͕ߴ͍$7EFBUIΛධՁͯ͠ ͍ΔͨΊແࢹ w ͲͪΒ΋$7EFBUIΛى͍ͯ͜͠ͳ͍৔߹ɺ 
 ੜଘظ͕ؒશ͘ಉ͡৔߹ɺ  )PTQJUBMJ[BUJPOͷධՁ΁ w ؍࡯ظؒΛ୹͍ํʹͦΖ͑ͨͱ͖ʹɺͦͷ࣌఺ʹ$7EFBUIΛ ى͍ͯ͜͠ͳ͚Ε͹ɺ  )PTQJUBMJ[BUJPOͷධՁ΁ ࣏ྍ ରর ଧͪ੾Γ  )PTQJUBMJ[BUJPOͰ࣏ྍ܈ͷ8JO͕ܾ·Δύλʔϯ ଧͪ੾Γ ࣏ྍ ରর ࣏ྍ ରর ࣏ྍ ରর ࣏ྍ܈͸$7EFBUIΛى͍ͯ͜͠Δ͕ɺ 
 ؍࡯ظؒΛͦΖ͑ͨ৔߹ɺ 
 Ҿ͖෼͚ʹͳΓɺ  Ͱ൑ఆ͢Δύλʔϯ w ͲͪΒ΋)PTQJUBMJ[BJPOΛى͍ͯ͜͠ͳ͍৔߹ɺ 
 ൃੜظ͕ؒશ͘ಉ͡৔߹ɺ5JFʢҾ͖෼͚ʣ൑ఆ w ؍࡯ظؒΛ୹͍ํʹͦΖ͑ͨͱ͖ʹɺͦͷ࣌఺ʹ )PTQJUBMJ[BUJPOΛى͍ͯ͜͠ͳ͚Ε͹ɺ5JFʢҾ͖෼͚ʣ൑ఆ ࣏ྍ ରর 1PDPDL4+ "SJUJ$" $PMMJFS5+ 8BOH%5IFXJOSBUJPBOFXBQQSPBDIUPUIFBOBMZTJTPGDPNQPTJUFFOEQPJOUTJODMJOJDBMUSJBMTCBTFEPODMJOJDBMQSJPSJUJFT&VS)FBSU+ +BO  rͷ'JHVSFΛࢀߟ
  6. ΞϧΰϦζϜɹᶇ8JOSBUJPͷܭࢉ 11 ࣏ྍ܈ /5 ରর܈ /$ ਓ ਓ 300 ×

    312 = 94224 ϖΞ 5JFT / 8JOT /8 -PTTFT /- 5JFT / 8JOT /8 -PTTFT /-  $7EFBUI  )PTQJUBMJ[BUJPO 5PUBMXJOT 5PUBMMPTTFT 27060 + 15270 = 42330 18532 + 7745 = 26277 8JOSBUJP 5PUBMXJOT 5PUBMMPTTFT       $*UP 1 3FEGPST# (SFHTPO+ $SPXMFZ" .D"OESFX5 #FO:FIVEB0 4UPOF(8 FUBM5IFXJOSBUJPBQQSPBDIGPSDPNQPTJUFFOEQPJOUTQSBDUJDBMHVJEBODFCBTFEPOQSFWJPVTFYQFSJFODF &VS)FBSU+%FD  rͷ'JHVSFΛࢀߟ
  7. 8JOSBUJPͷղऍ 12 8JOSBUJP 5PUBMXJOT 5PUBMMPTTFT  = NW NL =

    NW NT × NC NL NT × NC ࣏ྍ܈͕উͭ֬཰ ࣏ྍ܈͕ෛ͚Δ֬཰  3JTLSBUJP ࣏ྍ܈ʹ͓͍ͯΠϕϯτΛى֬͜͢཰ ରর܈ʹ͓͍ͯΠϕϯτΛى֬͜͢཰  0EETSBUJP ࣏ྍ܈ͷΦοζ ରর܈ͷΦοζ   ࣏ྍ܈ʹ͓͍ͯΠϕϯτΛى֬͜͢཰ ࣏ྍ܈ʹ͓͍ͯΠϕϯτΛى͜͞ͳ͍֬཰ ରর܈ʹ͓͍ͯΠϕϯτΛى֬͜͢཰ ରর܈ʹ͓͍ͯΠϕϯτΛى͜͞ͳ͍֬཰ )B[BSESBUJP  ࣏ྍ܈ͷϋβʔυ ରর܈ͷϋβʔυ ࣏ྍ܈ͷॠؒΠϕϯτൃੜ֬཰ ରর܈ͷॠؒΠϕϯτൃੜ֬཰  ˡղऍ͠΍͍͢ ˡղऍͮ͠Β͍ ɹղऍʹ஫ҙඞཁ w Ͳͷࢦඪ΋ղऍʹ͸஫ҙ͕ඞཁ w Ͱ͖Δ͚ͩɺϦεΫͷߟ͑ํʹ͍͖͍࣋ͬͯͨʢཁݚڀ͔ʁʣ ԋऀ࡞੒
  8. 8JOSBUJPͷྑ͍఺ͱ՝୊ 14 3FEGPST# (SFHTPO+ $SPXMFZ" .D"OESFX5 #FO:FIVEB0 4UPOF(8 FUBM5IFXJOSBUJPBQQSPBDIGPSDPNQPTJUFFOEQPJOUTQSBDUJDBM HVJEBODFCBTFEPOQSFWJPVTFYQFSJFODF&VS)FBSU+%FD

     rͷ5BLFIPNF fi HVSFΛࢀߟ ྑ͍఺ ՝୊ ෳ߹ΤϯυϙΠϯτΛߏ੒͢Δ 
 ͢΂ͯͷΤϯυϙΠϯτͷ৘ใΛ࢖͑Δ ೝ஌͞Εͯͳ͍ ΤϯυϙΠϯτʹରͯ͠ɺ 
 ྟচతͳ؍఺͔Β༏ઌॱҐΛ͚ͭΒΕΔ ౷ܭղੳ͕೉͍͠ ܁Γฦ͠ΠϕϯτΛൃੜ͢ΔΤϯυϙΠϯτ΋ 
 ૊ΈࠐΊΔ αϯϓϧαΠζͷઃܭ͕೉͍͠ ΠϕϯτൃੜͰଌΕͳ͍ɺ 
 มԽྔͷΑ͏ͳΤϯυϙΠϯτ΋૊ΈࠐΊΔ 5JNFUPFWFOUͷ৔߹ɺੜଘظؒΛແࢹͯ͠ɺ 
 ૣ͘ى͔ͬͨ͜Ͳ͏͔ͷ৘ใͷΈ࢖͍ͬͯΔ ֓೦͕Θ͔Γ΍͍͢ ඇৗʹັྗత ˠ࣌ؒ࣍ୈʁ ੜ෺౷ܭՈͱҰॹʹ ݚڀ͢Ε͹ղܾʂ
  9. ͓͞Β͍ 15 ෳ߹ΤϯυϙΠϯτ w ԿͰඞཁʁˠݕग़ྗෆ଍ w Կ͕໰୊ʁ ରࡦ w 8JOSBUJP

    w ૣ͘ىͬͨ͜ࣄ৅ͷ৘ใ͔͠࢖Θͳ͍ w ֤ΤϯυϙΠϯτͷྟচతͳॏΈ͸ແࢹ w ΞϧΰϦζϜ w ࢦඪͷҙຯ w ϦεΫൺɺΦοζൺɺϋβʔυൺͷҙຯΛ࠶ߟ w ྑ͍఺ͱ՝୊ ᶃ 8JOSBUJP