Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
NDCG is NOT All I Need
Search
statditto
October 30, 2025
Science
3k
2
Share
NDCG is NOT All I Need
LINEヤフー ABEMA Meetup ~データサイエンス~ で発表した資料です。
https://lycorptech-jp.connpass.com/event/370887/
statditto
October 30, 2025
More Decks by statditto
See All by statditto
t検定は中心局限定理の夢を見るか?
statditto
2
750
RでHex ~ R + Shinylive + Quarto = 最強 ~
statditto
0
630
相関データとサンプルサイズ設計 ~デルタ法のサンプルサイズ設計には気をつけて~
statditto
1
860
Other Decks in Science
See All in Science
コミュニティサイエンスの実践@日本認知科学会2025
hayataka88
0
150
2025-06-11-ai_belgium
sofievl
1
250
検索と推論タスクに関する論文の紹介
ynakano
1
180
People who frequently use ChatGPT for writing tasks are accurate and robust detectors of AI-generated text
rudorudo11
0
210
HDC tutorial
michielstock
1
600
KISHIMOTO Atsuo
genomethica
0
120
アクシズを探せ! 各勢力の位置関係についての考察
miu_crescent
PRO
1
200
[Paper Introduction] From Bytes to Ideas:Language Modeling with Autoregressive U-Nets
haruumiomoto
0
220
DMMにおけるABテスト検証設計の工夫
xc6da
1
1.7k
SpatialRDDパッケージによる空間回帰不連続デザイン
saltcooky12
0
190
20251212_LT忘年会_データサイエンス枠_新川.pdf
shinpsan
0
270
Vibecoding for Product Managers
ibknadedeji
0
150
Featured
See All Featured
Amusing Abliteration
ianozsvald
1
150
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
sstephenson
162
16k
職位にかかわらず全員がリーダーシップを発揮するチーム作り / Building a team where everyone can demonstrate leadership regardless of position
madoxten
62
53k
<Decoding/> the Language of Devs - We Love SEO 2024
nikkihalliwell
1
180
Being A Developer After 40
akosma
91
590k
Why Our Code Smells
bkeepers
PRO
340
58k
Conquering PDFs: document understanding beyond plain text
inesmontani
PRO
4
2.6k
GitHub's CSS Performance
jonrohan
1032
470k
We Analyzed 250 Million AI Search Results: Here's What I Found
joshbly
1
1.1k
世界の人気アプリ100個を分析して見えたペイウォール設計の心得
akihiro_kokubo
PRO
68
38k
Reality Check: Gamification 10 Years Later
codingconduct
0
2.1k
Information Architects: The Missing Link in Design Systems
soysaucechin
0
870
Transcript
1VCMJD -:$PSQPSBUJPO "OBMZUJDT6OJU 0"%JWJTJPO ࠤ /%$( JT/05"MM*/FFE
1VCMJD -:$PSQPSBUJPO 0"3FDPNNFOE
1VCMJD -:$PSQPSBUJPO • -*/&ͷ༷ʑͳॴͰެࣜΞΧϯτʢ0"ʣ͕ਪન͞Ε͍ͯΔ 0"3FDPNNFOEͱ ϗʔϜ ͓͢͢ΊެࣜΞΧϯτ 5BML)FBE7JFX ϓϩϑΟʔϧ
1VCMJD -:$PSQPSBUJPO • 0"3FDPNNFOEͰɺاըɺ։ൃɺ.-ɺ%4ͷऀ͕࿈ܞΛͱΓͳ͕Β վળΛਐΊ͍ͯΔ ϓϩδΣΫτͷମ੍ ϓϥϯφʔ ΤϯδχΞ .-ΤϯδχΞ
%4ʢੳऀʣ
1VCMJD -:$PSQPSBUJPO ࣄ݅
1VCMJD -:$PSQPSBUJPO ͋Δͷ͜ͱʜ .-ΤϯδχΞ ʢଐ͔Βʣ ΦϑϥΠϯݕূ͕͍͍ײ͡ ͳͷͰ"#ςετʹҠΓ͍ͨ Ͱ͢ʂੳΛ͓ئ͍͍ͯ͠ ͍Ͱ͔͢ʁ
͍ʂʂʂ
1VCMJD -:$PSQPSBUJPO • Ϣʔβʔʹ݅ͣͭ0"Λਪન͢Δ • ʮ͓͢͢ΊΛߋ৽ʯΛԡ͢ͱ࣍ͷ͕݅ දࣔ͞ΕΔ • ͲͷϢʔβʔʹɺͲͷ0"͕දࣔ͞ΕΔ͔ɺ .-ͰύʔιφϥΠζ͞Ε͍ͯΔ
• ݅ͷ0"EBJMZͰόονߋ৽͞ΕΔ • 0"ͷ༑ͩͪՃΛ૿͢͜ͱ͕త "#ςετͷର ͓͢͢ΊެࣜΞΧϯτ
1VCMJD -:$PSQPSBUJPO • ࢪࡦɿطଘͷ.-ϩδοΫΛ৽͍͠ϩδοΫʹߋ৽͢Δ • ৽ϩδοΫ0"3FDPNNFOEͷҟͳΔ໘Ͱ͢ͰʹಋೖࡁΈ • ҟͳΔ໘Ͱ"#ςετΛͨ͠ࡍʹɺେ͖ͳՌΛڍ࣮͕͛ͨ͋Δ • ΦϑϥΠϯݕূͰͷੑೳධՁྑ
ࢪࡦͷ֓ཁ উͬͨͳʂX
1VCMJD -:$PSQPSBUJPO ༗ҙࠩͳ͠ʂ
1VCMJD -:$PSQPSBUJPO • ओཁධՁࢦඪͷ༑ͩͪՃʢ͍ΘΏΔίϯόʔδϣϯϨʔτʣ ༗ҙࠩͳ͠ • ͦΕҎ֎ͷࢦඪΨʔυϨʔϧϝτϦΫεಛʹมԽͳ͠ • ී௨ʹࠔͬͯ͠·ͬͨ
"#ςετͷ݁Ռ Ͳ͏ͯ͠ʜ
1VCMJD -:$PSQPSBUJPO ࢥ͍ඳ͍͍ͯͨֆ ਖ਼࣮͘͠ʂ ਖ਼͘͠ੳʂ ѹతউརʂ ΦϑϥΠϯධՁ ௐʂ
1VCMJD -:$PSQPSBUJPO • ॳఆͨ͠γφϦΦ௨ΓʹͳΒͳ͔ͬͨ • Ͳ͜ʹ͕͋Δʁ • ຊ൪ڥͷ࣮ϛε • ҙਤ͠ͳ͍ϢʔβʔӨڹ
• ੳͷϛεϥϯμϜԽͷࣦഊ • FUD • ৭ʑௐ͕ͨݪҼ໌͠ͳ͔ͬͨ ͷ୳ࡧ ਖ਼࣮͘͠ʂ ਖ਼͘͠ੳʂ ഊ ΦϑϥΠϯධՁ ௐʂ
1VCMJD -:$PSQPSBUJPO ࣮ΦϑϥΠϯධՁʹ ͕જΜͰ͍·͢
1VCMJD -:$PSQPSBUJPO Ұॹʹߟ͑ͯΈΑ͏ ˞͔͜͜ΒઌͷશͯαϯϓϧσʔλͰ͢
1VCMJD -:$PSQPSBUJPO ग़ฤ ˞͔͜͜ΒઌͷશͯαϯϓϧσʔλͰ͢ʂ
1VCMJD -:$PSQPSBUJPO • ΦϑϥΠϯධՁͰ/%$(Λ࠷ॏࢹɺ࣍Ͱ3FDBMM֬ೝ • ࣮ࡍ͏গ͠৭ʑݟ͍ͯΔ͕ɺࠓճׂѪ • /%$(ˏ, • ্Ґ,݅ʹ͍ͭͯɺؔ࿈ੑͷߴ͍ॱʹͲΕ΄Ͳਖ਼͘͠ฒΜͰ͍Δ͔
• 3FDBMMˏ, • ্Ґ,݅ʹ͍ͭͯɺਖ਼ྫΛͲΕؚ͚ͩΜͰ͍Δ͔ • ͲͪΒݕࡧɺਪનͷͰඪ४తͳࢦඪ ධՁࢦඪʢΦϑϥΠϯʣ
1VCMJD -:$PSQPSBUJPO • ,ͷࢦඪ͕ඇৗʹ৳ͼ͍ͯΔ • Ϣʔβʔͷׂ͕࠷ॳͷ͔݅͠ݟ͍ͯͳ͍͜ͱ͕ΒΕ͍ͯΔ • ૯߹తʹΈͯੑೳ্͕͍ͯ͠ΔͩΖ͏ͱஅ͞Εͨ ΦϑϥΠϯධՁͷ݁Ռ
/%$(ˏ /%$(ˏ 3FDBMMˏ 3FDBMMˏ طଘϩδοΫ ৽نϩδοΫ Ϧϑτ
1VCMJD -:$PSQPSBUJPO ඵߟ͑ͯΈΑ͏
1VCMJD -:$PSQPSBUJPO • ,ͷࢦඪ͕ඇৗʹ৳ͼ͍ͯΔ • Ϣʔβʔͷׂ͕࠷ॳͷ͔݅͠ݟ͍ͯͳ͍͜ ͱ͕ΒΕ͍ͯΔ • ૯߹తʹΈͯੑೳ্͕͍ͯ͠ΔͩΖ͏ͱ அ͞Εͨ
"#ςετͷର /%$(ˏ /%$(ˏ 3FDBMMˏ 3FDBMMˏ طଘϩδοΫ ৽نϩδοΫ Ϧϑτ
1VCMJD -:$PSQPSBUJPO ղฤ
1VCMJD -:$PSQPSBUJPO 6*ͷಛͱॱং
1VCMJD -:$PSQPSBUJPO • ෦తʹදࣔॱং͕ఆٛ͞Ε͍ͯΔ • ϢʔβʔࢹͰҰ੪ʹදࣔ͞ΕΔͨΊɺ ϦετදࣔͳͲͷܗࣜʹൺɺݟ͑ํʹ ͋·Γ͕ࠩͳ͍ • Ծઆɿࠨهͷ༷ͳ6*Ͱɺॱং͕༩͑Δ
݁ՌͷӨڹখ͍͞ • /%$(ΑΓ3FDBMMΛॏࢹ͖͢ͱ͍͏ ࣔࠦΛಘͨ 6*Λ࠶֬ೝ ͓͢͢ΊެࣜΞΧϯτ ⁞
1VCMJD -:$PSQPSBUJPO • /%$(, ͷ྆ํͰ্͍ͯ͠Δ͕ɺҰͦͷ݁ՌΕΔ • 3FDBMM,Ͱ্͍ͯ͠Δ͕ɺ,Ͱݮগ͍ͯ͠Δ • ,ͷݮগ͕Կ͔ѱ͞Λ͍ͯ͠ΔͷͰʁ
݁ՌΛ͏Ұ֬ೝ /%$(ˏ /%$(ˏ 3FDBMMˏ 3FDBMMˏ طଘϩδοΫ ৽نϩδοΫ Ϧϑτ
1VCMJD -:$PSQPSBUJPO ύϨʔτͷ๏ଇ ˞͔͜͜ΒઌͷશͯαϯϓϧσʔλͰ͢ʂ
1VCMJD -:$PSQPSBUJPO • ʮશମͷͷେ෦ɺશମͷҰ෦ͷཁૉ͕ੜΈग़͍ͯ͠Δʯ ͱ͍͏๏ଇ • վΊͯϢʔβʔͷߦಈϩάΛूܭͨ͠ͱ͜ΖɺϢʔβʔͷׂ͕ ࠷ॳͷ͔݅͠Έ͍ͯͳ͍ͱ͍͏લఏਖ਼͔ͬͨ͠ • ͔͠͠ɺΓׂͷϢʔβʔ͕ɺ༑ͩͪՃͷׂΛΊ͍ͯͨ
• ͜ΕΒͷϢʔβʔͷ΄΅શһ͕݅શͯΛӾཡ͓ͯ͠Γɺ ϩΠϠϦςΟ͕ߴ͍Ϣʔβʔ͕ू·͍ͬͯͨ ύϨʔτͷ๏ଇ
1VCMJD -:$PSQPSBUJPO • େଟͷϢʔβʔʢશମͷʣ࠷ॳͷ͔݅͠ݟͳ͍ • ˠ3FDBMMˏͰධՁͰ͖Δ • গͷϢʔβʔʢશମͷʣ݅શͯΛΈΔ • ˠ3FDBMMˏͰධՁͰ͖Δ
• 3FDBMMͷॏΈ͚ฏۉΛ༑ͩͪՃͷൺʢʣͰܭࢉ • طଘϩδοΫɿ0.20×0.2 + 0.40×0.8 = 0.360 • ৽نϩδοΫɿ0.30×0.2 + 0.38×0.8 = 0.364 • ΦϑϥΠϯධՁͷ݁ՌΛਖ਼͘͠ղऍͰ͖͍ͯͳ͔ͬͨ • ຊϩδοΫؒʹੑೳ͕ࠩͳ͔ͬͨ ΦϑϥΠϯධՁΛ࠶ղऍ ྆ऀ͕֓ͶҰகʂ
1VCMJD -:$PSQPSBUJPO • ʮධՁࢦඪೖʯߴ༄৻Ұɼాྯ࢜ ஶ גࣜձࣾϗΫιΤϜ म • ষʹධՁࢦඪͱ,1*ͷ͕هࡌ͞Ε͍ͯΔ •
ΦϑϥΠϯධՁͱ,1*ͷζϨʹؔ͢Δ͕ ݴٴ͞Ε͍ͯͯخ͍͠ • ධՁࢦඪʹର͢Δ͖߹͍ํΛཧ͢Δ ্ͰಡΜͰ͓͖͍ͨҰ ͬͱֶͼ͍ͨਓ
1VCMJD -:$PSQPSBUJPO ·ͱΊ
1VCMJD -:$PSQPSBUJPO • ສೳͳධՁࢦඪଘࡏ͠ͳ͍ • ঢ়گʹΑͬͯదͳධՁࢦඪҟͳΔ • Ͱඪ४తʹར༻͞Ε͍ͯΔධՁࢦඪͰɺ·͔͔ͣٙͬͯΔ͖ • Ϣʔβʔߦಈͷཧղॏཁʂʂʂ
• ࣮Ͱ͖߹͏σʔλΈόΠΞε·ΈΕͰ͋Δ͜ͱ͕ଟ͍ • ࠓճͷΑ͏ʹɺᐆດͳཧղͷ··ੳ͢Δͷඇৗʹةݥ • σʔλʹਅʹ͖߹ͬͨஸೡͳجૅੳ͔͠উͨΜʂ ·ͱΊ
1VCMJD -:$PSQPSBUJPO &OKPZ