Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
NDCG is NOT All I Need
Search
statditto
October 30, 2025
Science
2
2.7k
NDCG is NOT All I Need
LINEヤフー ABEMA Meetup ~データサイエンス~ で発表した資料です。
https://lycorptech-jp.connpass.com/event/370887/
statditto
October 30, 2025
Tweet
Share
More Decks by statditto
See All by statditto
t検定は中心局限定理の夢を見るか?
statditto
2
700
RでHex ~ R + Shinylive + Quarto = 最強 ~
statditto
0
560
相関データとサンプルサイズ設計 ~デルタ法のサンプルサイズ設計には気をつけて~
statditto
1
790
Other Decks in Science
See All in Science
データベース06: SQL (3/3) 副問い合わせ
trycycle
PRO
1
710
baseballrによるMLBデータの抽出と階層ベイズモデルによる打率の推定 / TokyoR118
dropout009
2
650
凸最適化からDC最適化まで
santana_hammer
1
350
KH Coderチュートリアル(スライド版)
koichih
1
56k
People who frequently use ChatGPT for writing tasks are accurate and robust detectors of AI-generated text
rudorudo11
0
170
俺たちは本当に分かり合えるのか? ~ PdMとスクラムチームの “ずれ” を科学する
bonotake
2
1.2k
Lean4による汎化誤差評価の形式化
milano0017
1
410
データベース12: 正規化(2/2) - データ従属性に基づく正規化
trycycle
PRO
0
1.1k
My Little Monster
juzishuu
0
460
Performance Evaluation and Ranking of Drivers in Multiple Motorsports Using Massey’s Method
konakalab
0
130
コミュニティサイエンスの実践@日本認知科学会2025
hayataka88
0
110
【RSJ2025】PAMIQ Core: リアルタイム継続学習のための⾮同期推論・学習フレームワーク
gesonanko
0
580
Featured
See All Featured
We Analyzed 250 Million AI Search Results: Here's What I Found
joshbly
0
440
JAMstack: Web Apps at Ludicrous Speed - All Things Open 2022
reverentgeek
1
300
AI Search: Implications for SEO and How to Move Forward - #ShenzhenSEOConference
aleyda
1
1.1k
Being A Developer After 40
akosma
91
590k
Navigating the moral maze — ethical principles for Al-driven product design
skipperchong
1
230
Rails Girls Zürich Keynote
gr2m
95
14k
Why You Should Never Use an ORM
jnunemaker
PRO
61
9.7k
Marketing Yourself as an Engineer | Alaka | Gurzu
gurzu
0
110
AI Search: Where Are We & What Can We Do About It?
aleyda
0
6.8k
Dealing with People You Can't Stand - Big Design 2015
cassininazir
367
27k
Thoughts on Productivity
jonyablonski
74
5k
A Modern Web Designer's Workflow
chriscoyier
698
190k
Transcript
1VCMJD -:$PSQPSBUJPO "OBMZUJDT6OJU 0"%JWJTJPO ࠤ /%$( JT/05"MM*/FFE
1VCMJD -:$PSQPSBUJPO 0"3FDPNNFOE
1VCMJD -:$PSQPSBUJPO • -*/&ͷ༷ʑͳॴͰެࣜΞΧϯτʢ0"ʣ͕ਪન͞Ε͍ͯΔ 0"3FDPNNFOEͱ ϗʔϜ ͓͢͢ΊެࣜΞΧϯτ 5BML)FBE7JFX ϓϩϑΟʔϧ
1VCMJD -:$PSQPSBUJPO • 0"3FDPNNFOEͰɺاըɺ։ൃɺ.-ɺ%4ͷऀ͕࿈ܞΛͱΓͳ͕Β վળΛਐΊ͍ͯΔ ϓϩδΣΫτͷମ੍ ϓϥϯφʔ ΤϯδχΞ .-ΤϯδχΞ
%4ʢੳऀʣ
1VCMJD -:$PSQPSBUJPO ࣄ݅
1VCMJD -:$PSQPSBUJPO ͋Δͷ͜ͱʜ .-ΤϯδχΞ ʢଐ͔Βʣ ΦϑϥΠϯݕূ͕͍͍ײ͡ ͳͷͰ"#ςετʹҠΓ͍ͨ Ͱ͢ʂੳΛ͓ئ͍͍ͯ͠ ͍Ͱ͔͢ʁ
͍ʂʂʂ
1VCMJD -:$PSQPSBUJPO • Ϣʔβʔʹ݅ͣͭ0"Λਪન͢Δ • ʮ͓͢͢ΊΛߋ৽ʯΛԡ͢ͱ࣍ͷ͕݅ දࣔ͞ΕΔ • ͲͷϢʔβʔʹɺͲͷ0"͕දࣔ͞ΕΔ͔ɺ .-ͰύʔιφϥΠζ͞Ε͍ͯΔ
• ݅ͷ0"EBJMZͰόονߋ৽͞ΕΔ • 0"ͷ༑ͩͪՃΛ૿͢͜ͱ͕త "#ςετͷର ͓͢͢ΊެࣜΞΧϯτ
1VCMJD -:$PSQPSBUJPO • ࢪࡦɿطଘͷ.-ϩδοΫΛ৽͍͠ϩδοΫʹߋ৽͢Δ • ৽ϩδοΫ0"3FDPNNFOEͷҟͳΔ໘Ͱ͢ͰʹಋೖࡁΈ • ҟͳΔ໘Ͱ"#ςετΛͨ͠ࡍʹɺେ͖ͳՌΛڍ࣮͕͛ͨ͋Δ • ΦϑϥΠϯݕূͰͷੑೳධՁྑ
ࢪࡦͷ֓ཁ উͬͨͳʂX
1VCMJD -:$PSQPSBUJPO ༗ҙࠩͳ͠ʂ
1VCMJD -:$PSQPSBUJPO • ओཁධՁࢦඪͷ༑ͩͪՃʢ͍ΘΏΔίϯόʔδϣϯϨʔτʣ ༗ҙࠩͳ͠ • ͦΕҎ֎ͷࢦඪΨʔυϨʔϧϝτϦΫεಛʹมԽͳ͠ • ී௨ʹࠔͬͯ͠·ͬͨ
"#ςετͷ݁Ռ Ͳ͏ͯ͠ʜ
1VCMJD -:$PSQPSBUJPO ࢥ͍ඳ͍͍ͯͨֆ ਖ਼࣮͘͠ʂ ਖ਼͘͠ੳʂ ѹతউརʂ ΦϑϥΠϯධՁ ௐʂ
1VCMJD -:$PSQPSBUJPO • ॳఆͨ͠γφϦΦ௨ΓʹͳΒͳ͔ͬͨ • Ͳ͜ʹ͕͋Δʁ • ຊ൪ڥͷ࣮ϛε • ҙਤ͠ͳ͍ϢʔβʔӨڹ
• ੳͷϛεϥϯμϜԽͷࣦഊ • FUD • ৭ʑௐ͕ͨݪҼ໌͠ͳ͔ͬͨ ͷ୳ࡧ ਖ਼࣮͘͠ʂ ਖ਼͘͠ੳʂ ഊ ΦϑϥΠϯධՁ ௐʂ
1VCMJD -:$PSQPSBUJPO ࣮ΦϑϥΠϯධՁʹ ͕જΜͰ͍·͢
1VCMJD -:$PSQPSBUJPO Ұॹʹߟ͑ͯΈΑ͏ ˞͔͜͜ΒઌͷશͯαϯϓϧσʔλͰ͢
1VCMJD -:$PSQPSBUJPO ग़ฤ ˞͔͜͜ΒઌͷશͯαϯϓϧσʔλͰ͢ʂ
1VCMJD -:$PSQPSBUJPO • ΦϑϥΠϯධՁͰ/%$(Λ࠷ॏࢹɺ࣍Ͱ3FDBMM֬ೝ • ࣮ࡍ͏গ͠৭ʑݟ͍ͯΔ͕ɺࠓճׂѪ • /%$(ˏ, • ্Ґ,݅ʹ͍ͭͯɺؔ࿈ੑͷߴ͍ॱʹͲΕ΄Ͳਖ਼͘͠ฒΜͰ͍Δ͔
• 3FDBMMˏ, • ্Ґ,݅ʹ͍ͭͯɺਖ਼ྫΛͲΕؚ͚ͩΜͰ͍Δ͔ • ͲͪΒݕࡧɺਪનͷͰඪ४తͳࢦඪ ධՁࢦඪʢΦϑϥΠϯʣ
1VCMJD -:$PSQPSBUJPO • ,ͷࢦඪ͕ඇৗʹ৳ͼ͍ͯΔ • Ϣʔβʔͷׂ͕࠷ॳͷ͔݅͠ݟ͍ͯͳ͍͜ͱ͕ΒΕ͍ͯΔ • ૯߹తʹΈͯੑೳ্͕͍ͯ͠ΔͩΖ͏ͱஅ͞Εͨ ΦϑϥΠϯධՁͷ݁Ռ
/%$(ˏ /%$(ˏ 3FDBMMˏ 3FDBMMˏ طଘϩδοΫ ৽نϩδοΫ Ϧϑτ
1VCMJD -:$PSQPSBUJPO ඵߟ͑ͯΈΑ͏
1VCMJD -:$PSQPSBUJPO • ,ͷࢦඪ͕ඇৗʹ৳ͼ͍ͯΔ • Ϣʔβʔͷׂ͕࠷ॳͷ͔݅͠ݟ͍ͯͳ͍͜ ͱ͕ΒΕ͍ͯΔ • ૯߹తʹΈͯੑೳ্͕͍ͯ͠ΔͩΖ͏ͱ அ͞Εͨ
"#ςετͷର /%$(ˏ /%$(ˏ 3FDBMMˏ 3FDBMMˏ طଘϩδοΫ ৽نϩδοΫ Ϧϑτ
1VCMJD -:$PSQPSBUJPO ղฤ
1VCMJD -:$PSQPSBUJPO 6*ͷಛͱॱং
1VCMJD -:$PSQPSBUJPO • ෦తʹදࣔॱং͕ఆٛ͞Ε͍ͯΔ • ϢʔβʔࢹͰҰ੪ʹදࣔ͞ΕΔͨΊɺ ϦετදࣔͳͲͷܗࣜʹൺɺݟ͑ํʹ ͋·Γ͕ࠩͳ͍ • Ծઆɿࠨهͷ༷ͳ6*Ͱɺॱং͕༩͑Δ
݁ՌͷӨڹখ͍͞ • /%$(ΑΓ3FDBMMΛॏࢹ͖͢ͱ͍͏ ࣔࠦΛಘͨ 6*Λ࠶֬ೝ ͓͢͢ΊެࣜΞΧϯτ ⁞
1VCMJD -:$PSQPSBUJPO • /%$(, ͷ྆ํͰ্͍ͯ͠Δ͕ɺҰͦͷ݁ՌΕΔ • 3FDBMM,Ͱ্͍ͯ͠Δ͕ɺ,Ͱݮগ͍ͯ͠Δ • ,ͷݮগ͕Կ͔ѱ͞Λ͍ͯ͠ΔͷͰʁ
݁ՌΛ͏Ұ֬ೝ /%$(ˏ /%$(ˏ 3FDBMMˏ 3FDBMMˏ طଘϩδοΫ ৽نϩδοΫ Ϧϑτ
1VCMJD -:$PSQPSBUJPO ύϨʔτͷ๏ଇ ˞͔͜͜ΒઌͷશͯαϯϓϧσʔλͰ͢ʂ
1VCMJD -:$PSQPSBUJPO • ʮશମͷͷେ෦ɺશମͷҰ෦ͷཁૉ͕ੜΈग़͍ͯ͠Δʯ ͱ͍͏๏ଇ • վΊͯϢʔβʔͷߦಈϩάΛूܭͨ͠ͱ͜ΖɺϢʔβʔͷׂ͕ ࠷ॳͷ͔݅͠Έ͍ͯͳ͍ͱ͍͏લఏਖ਼͔ͬͨ͠ • ͔͠͠ɺΓׂͷϢʔβʔ͕ɺ༑ͩͪՃͷׂΛΊ͍ͯͨ
• ͜ΕΒͷϢʔβʔͷ΄΅શһ͕݅શͯΛӾཡ͓ͯ͠Γɺ ϩΠϠϦςΟ͕ߴ͍Ϣʔβʔ͕ू·͍ͬͯͨ ύϨʔτͷ๏ଇ
1VCMJD -:$PSQPSBUJPO • େଟͷϢʔβʔʢશମͷʣ࠷ॳͷ͔݅͠ݟͳ͍ • ˠ3FDBMMˏͰධՁͰ͖Δ • গͷϢʔβʔʢશମͷʣ݅શͯΛΈΔ • ˠ3FDBMMˏͰධՁͰ͖Δ
• 3FDBMMͷॏΈ͚ฏۉΛ༑ͩͪՃͷൺʢʣͰܭࢉ • طଘϩδοΫɿ0.20×0.2 + 0.40×0.8 = 0.360 • ৽نϩδοΫɿ0.30×0.2 + 0.38×0.8 = 0.364 • ΦϑϥΠϯධՁͷ݁ՌΛਖ਼͘͠ղऍͰ͖͍ͯͳ͔ͬͨ • ຊϩδοΫؒʹੑೳ͕ࠩͳ͔ͬͨ ΦϑϥΠϯධՁΛ࠶ղऍ ྆ऀ͕֓ͶҰகʂ
1VCMJD -:$PSQPSBUJPO • ʮධՁࢦඪೖʯߴ༄৻Ұɼాྯ࢜ ஶ גࣜձࣾϗΫιΤϜ म • ষʹධՁࢦඪͱ,1*ͷ͕هࡌ͞Ε͍ͯΔ •
ΦϑϥΠϯධՁͱ,1*ͷζϨʹؔ͢Δ͕ ݴٴ͞Ε͍ͯͯخ͍͠ • ධՁࢦඪʹର͢Δ͖߹͍ํΛཧ͢Δ ্ͰಡΜͰ͓͖͍ͨҰ ͬͱֶͼ͍ͨਓ
1VCMJD -:$PSQPSBUJPO ·ͱΊ
1VCMJD -:$PSQPSBUJPO • ສೳͳධՁࢦඪଘࡏ͠ͳ͍ • ঢ়گʹΑͬͯదͳධՁࢦඪҟͳΔ • Ͱඪ४తʹར༻͞Ε͍ͯΔධՁࢦඪͰɺ·͔͔ͣٙͬͯΔ͖ • Ϣʔβʔߦಈͷཧղॏཁʂʂʂ
• ࣮Ͱ͖߹͏σʔλΈόΠΞε·ΈΕͰ͋Δ͜ͱ͕ଟ͍ • ࠓճͷΑ͏ʹɺᐆດͳཧղͷ··ੳ͢Δͷඇৗʹةݥ • σʔλʹਅʹ͖߹ͬͨஸೡͳجૅੳ͔͠উͨΜʂ ·ͱΊ
1VCMJD -:$PSQPSBUJPO &OKPZ