NDCG is NOT All I Need - Speaker Deck

NDCG is NOT All I Need

by statditto

Slide 1

Slide 1 text

1VCMJD -:$PSQPSBUJPO "OBMZUJDT6OJU 0"%JWJTJPO ࠤ໺࿨޾ /%$( JT/05"MM*/FFE

Slide 2

Slide 2 text

1VCMJD -:$PSQPSBUJPO 0"3FDPNNFOE

Slide 3

Slide 3 text

1VCMJD -:$PSQPSBUJPO • -*/&಺ͷ༷ʑͳ৔ॴͰެࣜΞΧ΢ϯτʢ0"ʣ͕ਪન͞Ε͍ͯΔ 0"3FDPNNFOEͱ͸ ϗʔϜ ͓͢͢ΊެࣜΞΧ΢ϯτ 5BML)FBE7JFX ϓϩϑΟʔϧ

Slide 4

Slide 4 text

1VCMJD -:$PSQPSBUJPO • 0"3FDPNNFOEͰ͸ɺاըɺ։ൃɺ.-ɺ%4ͷऀ͕࿈ܞΛͱΓͳ͕Β վળΛਐΊ͍ͯΔ ϓϩδΣΫτͷମ੍ ϓϥϯφʔ ΤϯδχΞ .-ΤϯδχΞ %4ʢ෼ੳऀʣ

Slide 5

Slide 5 text

1VCMJD -:$PSQPSBUJPO ࣄ݅

Slide 6

Slide 6 text

1VCMJD -:$PSQPSBUJPO ͋Δ೔ͷ͜ͱʜ .-ΤϯδχΞ ๻ʢ഑ଐ͔Β൒೥ʣ ΦϑϥΠϯݕূ͕͍͍ײ͡ ͳͷͰ"#ςετʹҠΓ͍ͨ Ͱ͢ʂ෼ੳΛ͓ئ͍ͯ͠΋͍ ͍Ͱ͔͢ʁ ͸͍ʂʂʂ

Slide 7

Slide 7 text

1VCMJD -:$PSQPSBUJPO • Ϣʔβʔʹ݅ͣͭ0"Λਪન͢Δ࿮ • ʮ͓͢͢ΊΛߋ৽ʯΛԡ͢ͱ࣍ͷ͕݅ දࣔ͞ΕΔ • ͲͷϢʔβʔʹɺͲͷ0"͕දࣔ͞ΕΔ͔͸ɺ .-ͰύʔιφϥΠζ͞Ε͍ͯΔ • ݅ͷ0"͸EBJMZͰόονߋ৽͞ΕΔ • 0"ͷ༑ͩͪ௥Ճ਺Λ૿΍͢͜ͱ͕໨త "#ςετͷର৅࿮ ͓͢͢ΊެࣜΞΧ΢ϯτ

Slide 8

Slide 8 text

1VCMJD -:$PSQPSBUJPO • ࢪࡦɿطଘͷ.-ϩδοΫΛ৽͍͠ϩδοΫʹߋ৽͢Δ • ৽ϩδοΫ͸0"3FDPNNFOEͷҟͳΔ໘Ͱ͢ͰʹಋೖࡁΈ • ҟͳΔ໘Ͱ"#ςετΛͨ͠ࡍʹɺେ͖ͳ੒ՌΛڍ࣮͛ͨ੷͕͋Δ • ΦϑϥΠϯݕূͰͷੑೳධՁ΋ྑ޷ ࢪࡦͷ֓ཁ ๻ উͬͨͳʂX

Slide 9

Slide 9 text

1VCMJD -:$PSQPSBUJPO ༗ҙࠩͳ͠ʂ

Slide 10

Slide 10 text

1VCMJD -:$PSQPSBUJPO • ओཁධՁࢦඪͷ༑ͩͪ௥Ճ཰ʢ͍ΘΏΔίϯόʔδϣϯϨʔτʣ͸ ༗ҙࠩͳ͠ • ͦΕҎ֎ͷࢦඪ΍ΨʔυϨʔϧϝτϦΫε΋ಛʹมԽͳ͠ • ී௨ʹࠔͬͯ͠·ͬͨ "#ςετͷ݁Ռ ๻ Ͳ͏ͯ͠ʜ

Slide 11

Slide 11 text

1VCMJD -:$PSQPSBUJPO ࢥ͍ඳ͍͍ͯͨֆ ਖ਼࣮͘͠૷ʂ ਖ਼͘͠෼ੳʂ ѹ౗తউརʂ ΦϑϥΠϯධՁ ޷ௐʂ

Slide 12

Slide 12 text

1VCMJD -:$PSQPSBUJPO • ౰ॳ૝ఆͨ͠γφϦΦ௨Γʹ͸ͳΒͳ͔ͬͨ • Ͳ͜ʹ໰୊͕͋Δʁ • ຊ൪؀ڥ΁ͷ࣮૷ϛε • ҙਤ͠ͳ͍ϢʔβʔӨڹ • ෼ੳͷϛε΍ϥϯμϜԽͷࣦഊ • FUD • ৭ʑௐ΂͕ͨݪҼ͸൑໌͠ͳ͔ͬͨ ໰୊఺ͷ୳ࡧ ਖ਼࣮͘͠૷ʂ ਖ਼͘͠෼ੳʂ ഊ๺ ΦϑϥΠϯධՁ ޷ௐʂ

Slide 13

Slide 13 text

1VCMJD -:$PSQPSBUJPO ࣮͸ΦϑϥΠϯධՁʹ ໰୊͕જΜͰ͍·͢

Slide 14

Slide 14 text

1VCMJD -:$PSQPSBUJPO Ұॹʹߟ͑ͯΈΑ͏ ˞͔͜͜Βઌͷ਺஋͸શͯαϯϓϧσʔλͰ͢

Slide 15

Slide 15 text

1VCMJD -:$PSQPSBUJPO ग़୊ฤ ˞͔͜͜Βઌͷ਺஋͸શͯαϯϓϧσʔλͰ͢ʂ

Slide 16

Slide 16 text

1VCMJD -:$PSQPSBUJPO • ΦϑϥΠϯධՁͰ͸/%$(Λ࠷ॏࢹɺ࣍఺Ͱ3FDBMM΋֬ೝ • ࣮ࡍ͸΋͏গ͠৭ʑݟ͍ͯΔ͕ɺࠓճ͸ׂѪ • /%$(ˏ, • ্Ґ,݅ʹ͍ͭͯɺؔ࿈ੑͷߴ͍ॱʹͲΕ΄Ͳਖ਼͘͠ฒΜͰ͍Δ͔ • 3FDBMMˏ, • ্Ґ,݅ʹ͍ͭͯɺਖ਼ྫΛͲΕؚ͚ͩΜͰ͍Δ͔ • ͲͪΒ΋ݕࡧɺਪનͷ෼໺Ͱ͸ඪ४తͳࢦඪ ධՁࢦඪʢΦϑϥΠϯʣ

Slide 17

Slide 17 text

1VCMJD -:$PSQPSBUJPO • ,ͷࢦඪ͕ඇৗʹ৳ͼ͍ͯΔ • Ϣʔβʔͷׂ͕࠷ॳͷ͔݅͠ݟ͍ͯͳ͍͜ͱ͕஌ΒΕ͍ͯΔ • ૯߹తʹΈͯੑೳ͕޲্͍ͯ͠ΔͩΖ͏ͱ൑அ͞Εͨ ΦϑϥΠϯධՁͷ݁Ռ /%$(ˏ /%$(ˏ 3FDBMMˏ 3FDBMMˏ طଘϩδοΫ ৽نϩδοΫ Ϧϑτ

Slide 18

Slide 18 text

1VCMJD -:$PSQPSBUJPO ඵߟ͑ͯΈΑ͏

Slide 19

Slide 19 text

1VCMJD -:$PSQPSBUJPO • ,ͷࢦඪ͕ඇৗʹ৳ͼ͍ͯΔ • Ϣʔβʔͷׂ͕࠷ॳͷ͔݅͠ݟ͍ͯͳ͍͜ ͱ͕஌ΒΕ͍ͯΔ • ૯߹తʹΈͯੑೳ͕޲্͍ͯ͠ΔͩΖ͏ͱ ൑அ͞Εͨ "#ςετͷର৅࿮ /%$(ˏ /%$(ˏ 3FDBMMˏ 3FDBMMˏ طଘϩδοΫ ৽نϩδοΫ Ϧϑτ

Slide 20

Slide 20 text

1VCMJD -:$PSQPSBUJPO ղ౴ฤ

Slide 21

Slide 21 text

1VCMJD -:$PSQPSBUJPO 6*ͷಛ௃ͱॱং

Slide 22

Slide 22 text

1VCMJD -:$PSQPSBUJPO • ಺෦తʹ͸දࣔॱং͕ఆٛ͞Ε͍ͯΔ • Ϣʔβʔࢹ఺Ͱ͸Ұ੪ʹදࣔ͞ΕΔͨΊɺ ϦετදࣔͳͲͷܗࣜʹൺ΂ɺݟ͑ํʹ ͋·Γ͕ࠩͳ͍ • Ծઆɿࠨهͷ༷ͳ6*Ͱ͸ɺॱং͕༩͑Δ ݁Ռ΁ͷӨڹ͸খ͍͞ • /%$(ΑΓ΋3FDBMMΛॏࢹ͢΂͖ͱ͍͏ ࣔࠦΛಘͨ 6*Λ࠶֬ೝ ͓͢͢ΊެࣜΞΧ΢ϯτ ⁞   ⁠ ⁡

Slide 23

Slide 23 text

1VCMJD -:$PSQPSBUJPO • /%$(͸, ͷ྆ํͰ޲্͍ͯ͠Δ͕ɺҰ౓ͦͷ݁Ռ͸๨ΕΔ • 3FDBMM͸,Ͱ޲্͍ͯ͠Δ͕ɺ,Ͱ͸ݮগ͍ͯ͠Δ • ,ͷݮগ͕Կ͔ѱ͞Λ͍ͯ͠ΔͷͰ͸ʁ ݁ՌΛ΋͏Ұ౓֬ೝ /%$(ˏ /%$(ˏ 3FDBMMˏ 3FDBMMˏ طଘϩδοΫ ৽نϩδοΫ Ϧϑτ

Slide 24

Slide 24 text

1VCMJD -:$PSQPSBUJPO ύϨʔτͷ๏ଇ ˞͔͜͜Βઌͷ਺஋΋શͯαϯϓϧσʔλͰ͢ʂ

Slide 25

Slide 25 text

1VCMJD -:$PSQPSBUJPO • ʮશମͷ਺஋ͷେ෦෼͸ɺશମͷҰ෦ͷཁૉ͕ੜΈग़͍ͯ͠Δʯ ͱ͍͏๏ଇ • վΊͯϢʔβʔͷߦಈϩάΛूܭͨ͠ͱ͜ΖɺϢʔβʔͷׂ͕ ࠷ॳͷ͔݅͠Έ͍ͯͳ͍ͱ͍͏લఏ͸ਖ਼͔ͬͨ͠ • ͔͠͠ɺ࢒ΓׂͷϢʔβʔ͕ɺ༑ͩͪ௥Ճ਺ͷׂΛ઎Ί͍ͯͨ • ͜ΕΒͷϢʔβʔͷ΄΅શһ͕݅શͯΛӾཡ͓ͯ͠Γɺ ϩΠϠϦςΟ͕ߴ͍Ϣʔβʔ͕ू·͍ͬͯͨ ύϨʔτͷ๏ଇ

Slide 26

Slide 26 text

1VCMJD -:$PSQPSBUJPO • େଟ਺ͷϢʔβʔʢશମͷʣ͸࠷ॳͷ͔݅͠ݟͳ͍ • ˠ3FDBMMˏͰධՁͰ͖Δ • গ਺ͷϢʔβʔʢશମͷʣ͸݅શͯΛΈΔ • ˠ3FDBMMˏͰධՁͰ͖Δ • 3FDBMMͷॏΈ෇͚ฏۉΛ༑ͩͪ௥Ճ਺ͷൺʢʣͰܭࢉ • طଘϩδοΫɿ0.20×0.2 + 0.40×0.8 = 0.360 • ৽نϩδοΫɿ0.30×0.2 + 0.38×0.8 = 0.364 • ΦϑϥΠϯධՁͷ݁ՌΛਖ਼͘͠ղऍͰ͖͍ͯͳ͔ͬͨ • ຊ౰͸ϩδοΫؒʹੑೳ͕ࠩͳ͔ͬͨ ΦϑϥΠϯධՁΛ࠶ղऍ ྆ऀ͕֓ͶҰகʂ

Slide 27

Slide 27 text

1VCMJD -:$PSQPSBUJPO • ʮධՁࢦඪೖ໳ʯߴ༄৻Ұɼ௕ాྯ࢜ ஶ גࣜձࣾϗΫιΤϜ ؂म • ষʹධՁࢦඪͱ,1*ͷ࿩͕هࡌ͞Ε͍ͯΔ • ΦϑϥΠϯධՁͱ,1*ͷζϨʹؔ͢Δ࿩͕ ݴٴ͞Ε͍ͯͯخ͍͠ • ධՁࢦඪʹର͢Δ޲͖߹͍ํΛ੔ཧ͢Δ ্ͰಡΜͰ͓͖͍ͨҰ࡭ ΋ͬͱֶͼ͍ͨਓ΁

Slide 28

Slide 28 text

1VCMJD -:$PSQPSBUJPO ·ͱΊ

Slide 29

Slide 29 text

1VCMJD -:$PSQPSBUJPO • ສೳͳධՁࢦඪ͸ଘࡏ͠ͳ͍ • ঢ়گʹΑͬͯద੾ͳධՁࢦඪ͸ҟͳΔ • ෼໺Ͱඪ४తʹར༻͞Ε͍ͯΔධՁࢦඪͰ΋ɺ·ͣ͸͔͔ٙͬͯΔ΂͖ • Ϣʔβʔߦಈͷཧղ͸ॏཁʂʂʂ • ࣮຿Ͱ޲͖߹͏σʔλ͸࿪Έ΍όΠΞε·ΈΕͰ͋Δ͜ͱ͕ଟ͍ • ࠓճͷΑ͏ʹɺᐆດͳཧղͷ··෼ੳ͢Δͷ͸ඇৗʹةݥ • σʔλʹਅ᎜ʹ޲͖߹ͬͨஸೡͳجૅ෼ੳ͔͠উͨΜʂ ·ͱΊ

Slide 30

Slide 30 text

1VCMJD -:$PSQPSBUJPO &OKPZ