Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Speaker Deck
PRO
Sign in
Sign up for free
An_Attention-Based_User_Behavior_Modeling_Framework_for_Recommendation.pdf
kishimoto
June 21, 2019
Research
1
1.6k
An_Attention-Based_User_Behavior_Modeling_Framework_for_Recommendation.pdf
kishimoto
June 21, 2019
Tweet
Share
More Decks by kishimoto
See All by kishimoto
マイクロアドにおけるCTR予測への取り組み
kishimotobanana
4
8.5k
Other Decks in Research
See All in Research
論文紹介 / Panoptic Narrative Grounding
forest1988
0
200
第1回『帰ってきたウルトラマン』勉強会〜ウルトラマンが帰ってきた〜
hirokundayon
0
550
GovTechとマーケットデザイン発表資料(CA森脇)
daimoriwaki
0
150
科学技術情報分析の面白さ
hayataka88
5
4.8k
第9回チャンピオンズミーティング・カプリコーン杯ラウンド1集計 / Umamusume Capricorn 2022 Round1
kitachan_black
0
2.8k
幼少期の自然体験が理科学習への態度に及ぼす影響
arumakan
0
820
素人発想玄人実行2.0
hf149
0
1.2k
車両管理効率化・事故率抑制に向けた連携に関する3者連携協定
koshiba_noriaki
0
110
深層学習を用いた三次元点群処理入門
nnchiba
4
2.5k
機械学習ベースの動画像処理における近似計算手法の検討 (CPSY 2022/03)
hashi0203
0
170
計算情報学研究室 (数理情報学第7研究室)紹介スライド
ssakaue
0
120
論文読み会資料When Shift Operation Meets Vision Transformer:An Extremely Simple Alternative to Attention Mechanism
sensetime_japan
1
750
Featured
See All Featured
Fireside Chat
paigeccino
11
1.3k
We Have a Design System, Now What?
morganepeng
35
2.9k
Product Roadmaps are Hard
iamctodd
34
6.1k
How to train your dragon (web standard)
notwaldorf
57
3.8k
The Pragmatic Product Professional
lauravandoore
19
2.9k
Optimizing for Happiness
mojombo
365
63k
ピンチをチャンスに:未来をつくるプロダクトロードマップ #pmconf2020
aki_i
21
14k
Building Your Own Lightsaber
phodgson
94
4.6k
Infographics Made Easy
chrislema
233
17k
The Straight Up "How To Draw Better" Workshop
denniskardys
225
120k
Mobile First: as difficult as doing things right
swwweet
212
7.5k
GraphQLとの向き合い方2022年版
quramy
16
8.1k
Transcript
"53BOL"O"UUFOUJPO#BTFE 6TFS#FIBWJPS.PEFMJOH'SBNFXPSL GPS3FDPNNFOEBUJPO 12 / 3/ 6 2 0 /6
6/ 2 0 2 1 # ( # )9 9
จͷ֓ཁ • "UUFOUJPOʹجͮ͘ϢʔβߦಈϞσϦϯάͱͦͷϨίϝϯυ λεΫͷԠ༻ΛఏҊ • 3//$//ϕʔεͷํ๏ΑΓֶशͷऩଋ͕ૣ͘ߴੑೳ • ͬ͘͟Γݴ͑5SBOTGPSNFSͷϨίϝϯυͷద༻ """* ஶऀΒژେֶͱ"MJCBCBͷάϧʔϓ
ಋೖ
*OUSPEVDUJPO • ϢʔβʔࣗͷߦಈʹΑΓදݱՄೳ • ୯ޠ͕ͦͷपғͷίϯςΩετͰදݱͰ͖Δ͜ͱͱಉ༷ • ߦಈܥྻΛΤϯίʔυ͢ΔͨΊʹ3//$//͕සग़ • 3//ฒྻԽࠔ͔ͭظͷґଘؔͷҡ࣋ࠔ •
$//ฒྻԽՄೳ͕ͩہॴతͳґଘ͔ؔ͠ҡ࣋ෆՄ • 3//$//ͱʹ͍ܥྻͱ͍ܥྻͷ྆ํ্ख͘ѻ͑ͳ͍ • ܥྻͷ͞ʹؔͳ͘ґଘؔΛҡ࣋Ͱ͖Δ"UUFOUJPO͕ొ • ୯ͳΔ"UUFOUJPOͩͱϕΫτϧͷ֤࣍ݩʹ͍ͭͯಉ͡ॏΈͰࢉ • ֤࣍ݩͷҟͳΔlҙຯzΛ্ख͘ѻ͑ͳ͍ .VMUJ)FBE"UUFOUJPOͷ༧ײ
ํ๏
4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL
4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL άϧʔϓ ʢ*% ళ*% ʣ ݕࡧ άϧʔϓ ʢݕࡧ τʔΫϯʣ
Ϋʔϙϯडཧ άϧʔϓ ʢΫʔϙϯ*% ళ*% ʣ Ϩίϝϯυ ର *% ళ*% !" #$
4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL άϧʔϓ ʢ*% ళ*% ʣ ݕࡧ άϧʔϓ ʢݕࡧ τʔΫϯʣ
Ϋʔϙϯडཧ άϧʔϓ ʢΫʔϙϯ*% ళ*% ʣ Ϩίϝϯυ ର *% ళ*% !" #$
4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL άϧʔϓ ʢ*% ళ*% ʣ ݕࡧ άϧʔϓ ʢݕࡧ τʔΫϯʣ
Ϋʔϙϯडཧ άϧʔϓ ʢΫʔϙϯ*% ళ*% ʣ Ϩίϝϯυ ର *% ళ*%
4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL !"# άϧʔϓ
ʢ*% ళ*% ʣ ݕࡧ άϧʔϓ ʢݕࡧ τʔΫϯʣ Ϋʔϙϯडཧ άϧʔϓ ʢΫʔϙϯ*% ళ*% ʣ Ϩίϝϯυ ର *% ళ*%
4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL - άϧʔϓ ʢ*% ళ*% ʣ ݕࡧ άϧʔϓ ʢݕࡧ
τʔΫϯʣ Ϋʔϙϯडཧ άϧʔϓ ʢΫʔϙϯ*% ళ*% ʣ Ϩίϝϯυ ର *% ళ*%
4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL άϧʔϓ ʢ*% ళ*% ʣ ݕࡧ άϧʔϓ ʢݕࡧ τʔΫϯʣ
Ϋʔϙϯडཧ άϧʔϓ ʢΫʔϙϯ*% ళ*% ʣ Ϩίϝϯυ ର *% ళ*% -
4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL άϧʔϓ ʢ*% ళ*% ʣ ݕࡧ άϧʔϓ ʢݕࡧ τʔΫϯʣ
Ϋʔϙϯडཧ άϧʔϓ ʢΫʔϙϯ*% ళ*% ʣ Ϩίϝϯυ ର *% ళ*% - DPODBU
4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL άϧʔϓ ʢ*% ళ*% ʣ ݕࡧ άϧʔϓ ʢݕࡧ τʔΫϯʣ
Ϋʔϙϯडཧ άϧʔϓ ʢΫʔϙϯ*% ళ*% ʣ Ϩίϝϯυ ର *% ళ*% - - - - - - -
4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL άϧʔϓ ʢ*% ళ*% ʣ ݕࡧ άϧʔϓ ʢݕࡧ τʔΫϯʣ
Ϋʔϙϯडཧ άϧʔϓ ʢΫʔϙϯ*% ళ*% ʣ Ϩίϝϯυ ର *% ళ*%
3BX'FBUVSF4QBDFT • ϢʔβʔͷߦಈΛ{", $, %}ͱͯ͠ఆࣜԽ • Ϣʔβʔ' = { ")
, $) , %) |+ = 1,2, … , /} • 'Λߦಈͷੑ࣭ʹΑΓҟͳΔάϧʔϓʹׂ " $ % ߦಈλΠϓ FH Ӿཡɺߪങɺ ߦಈΦϒδΣΫτ FH \*% ళ*%^ɺ\ݕࡧτʔΫϯ^ɺ ߦಈൃੜ࣌ͷλΠϜελϯϓ 0 = {123 , 124 , … , 125 } 123 ∩ 124 = 7 ' =∪9:9 5 129 άϧʔϓ ݕࡧ άϧʔϓ Ϋʔϙϯडཧ άϧʔϓ
#FIBWJPS&NCFEEJOH4QBDFT • άϧʔϓ!"#ʹ͓͍ͯ $% , '% , (% Λ&NCFEEJOH )#%
= +# ($% , '% , (% ) $% '% (% ී௨ʹ&NCFEEJOH ී௨ʹ&NCFEEJOHͯ݁͠߹ʢ \*% ళ*%^ͳͲෳଘࡏ͢ΔͷͰʣ ΧςΰϦԽͯ͠&NCFEEJOH ߦಈൃੜ࣌ͷλΠϜελϯϓ͔ΒϨίϝϯυ࣌·ͰͷܦաͷϨϯδ͝ͱʹΧςΰϦʹม 0, 1 , 1,2 , 2,4 , … , [24, 2456) 0 1 2 7 + 1
#FIBWJPS&NCFEEJOH4QBDFT !"# = %&'" (# + *((+!," - '!.+%/01%" /#
+ *((+!," 2(4# ) จͰՃࢉ͕ͩ ࣮Ͱ݁߹ ͜ͷϨΠϠʔͷ࠷ऴతͳग़ྗ 6 = {!89: , !89< , … , !89> } !89@ = .(A.4/# (!"# ) ֤άϧʔϓͰ!"#ͷϕΫτϧͷTIBQFҟͳΔ ಉ͡ಛྔͷ&NCFEEJOHڞ༗ ͨͩ࣌ؒ͠ͷ&NCFEEJOHڞ༗͠ͳ͍
-BUFOU4FNBOUJD4QBDFT • ֤ߦಈΛ,ݸͷજࡏతҙຯۭؒʹӨ • ͭ·Γ.VMUJ)FBE"UUFOUJPOΛߦ͏ • Ϣʔβʔͷߦಈ!Λάϧʔϓ͝ͱʹҟͳΔӨؔ"#$ Λ༻͍ͯ ݻఆͷϕΫτϧʹม •
4ΛͦΕͧΕͷજࡏతҙຯۭؒʹӨ % = '()'*+ , ("#. /01. , "#3 /013 , … , "#5 (/015 )) %7 = "87 (%) 5SBOTGPSNFSͷ .VMUJ)FBE"UUFOUJPOͷ9:ʹ૬
-BUFOU4FNBOUJD4QBDFT • !"# !$% จͰ୯ҰͷEFOTFMBZFSͰ׆ੑԽ͕ؔ3F-6 • ֤TIBQFΛཧ &'(( &) *'((
શߦಈ *% άϧʔϓ+ͷߦಈ ݻఆͷϕΫτϧͷ࣍ݩ ֤જࡏతҙຯۭؒͷ࣍ݩ *% = *'(( -
4FMG"UUFOUJPO-BZFS • ,ݸͷ֤જࡏతҙຯۭؒͰߦಈؒͷ4FMG"UUFOUJPO
4FMG"UUFOUJPO-BZFS • จͷهड़Ͱ !" = $%&'()*()(," , ,: /" ))
ۭؒ1ʹ͓͚Δ"UUFOUJPOXFJHIUϕΫτϧͷߦྻ ) ," , ,: /" = ," 2" ,3 ۭؒ1ʹ͓͚Δ"UUFOUJPOϕΫτϧͷߦྻ 4" = !" 567 (,) ࠷ऴతͳग़ྗ 4 = 589:; (<%=<)' > (4> , 4? , … , 4" )) Ͱ্࣮݁ہͬͯΔ͜ͱ 567 , 589:; TJOHMFEFOTFMBZFS XJUI3F-6
%PXOTUSFBN"QQMJDBUJPO/FUXPSL • ͜͜·ͰϢʔβʔߦಈϞσϧ͕ • ͜ͷจͰϨίϝϯυλεΫΛߟ͑Δ ͬͪ͜ଆͷ
%PXOTUSFBN"QQMJDBUJPO/FUXPSL • Ϩίϝϯυରͷߦಈͱ4FMG"UUFOUJPOޙͷߦಈؒͰ7BOJMMB "UUFOUJPO • ͭ·ΓϢʔβʔߦಈଆΛΤϯίʔμɺϨίϝϯυରߦಈଆΛ σίʔμͱߟ͑ͨ4PVSDF5BSHFU"UUFOUJPO Τϯίʔμ σίʔμ
%PXOTUSFBN"QQMJDBUJPO/FUXPSL • Ϩίϝϯυରߦಈͷ&NCFEEJOHͰ͋Δ!"ʹରͯ͠ɺ͜Ε· Ͱͱ΄΅ಉ͡ԋࢉΛߦ͏ • ݻఆϕΫτϧͷมͱ.VMUJ)FBE"UUFOUJPO ℎ" = %&' "
(!" ) *+ = %,- (ℎ" ) .+ = */01234 3 *+ , 6; 8+ %9- (6) :; " = %<=>?@@= (./A.31 B (.B , .C , … , .+ )) ߦಈάϧʔϓͷΠϯσοΫεͷஔ %<=>?@@= TJOHMFEFOTFMBZFS XJUI3F-6
%PXOTUSFBN"QQMJDBUJPO/FUXPSL • QPJOUXJTFͷ༧ଌϞσϧͰߦಈ!͕औΒΕΔ֬Λ༧ଌ • ଛࣦؔʹγάϞΠυͷΫϩεΤϯτϩϐʔ − # $,& '$ ()*+(-
ℎ$ , /& $ ) + 1 − '$ log(1 − +(- ℎ$ , /& $ )) - ϥϯΩϯάؔʢจͰ୯७ͳੵʣ
࣮ݧ
%BUBTFU • "NB[PO%BUBTFU • Ϣʔβʔͷʹର͢ΔϨϏϡʔσʔλ • ߦಈͷάϧʔϓ͚ͭͩʢάϧʔϓʣ • ಛྔϢʔβʔ*%ɺ*%ɺΧςΰϦ*%ɺλΠϜελϯϓ •
Ϣʔβͷߦಈ("# , "% , … , "' )͕͋Δͱֶͯ͠शɾςετσʔλҎԼ ("# ) "% ("# , "% ) ") ("# , "% , … , "'*% ) "'*# *OQVU QSFEJDU ֶश ςετ ("# , "% , … , "'*# ) "' *OQVU QSFEJDU ˞OFHBUJWFTBNQMF QPTJUJWFTBNQMFҎ֎ͷΛϥϯμϜͰબ
%BUBTFU • 5BPCBP%BUBTFU • "MJCBCB͕ӡӦ͢Δ&$αΠτͷϩά • ߦಈͷάϧʔϓͭʢɺݕࡧɺΫʔϙϯडཧʣ • άϧʔϓ •
*%ɺళ*%ɺϒϥϯυ*%ɺΧςΰϦ*%ɺλΠϜελϯϓ • ߦಈλΠϓӾཡɺϚʔΫɺߪೖ • ݕࡧάϧʔϓ • ݕࡧτʔΫϯɺλΠϜελϯϓ • ߦಈλΠϓͭ • Ϋʔϙϯडཧάϧʔϓ • Ϋʔϙϯ*%ɺళ*%ɺΫʔϙϯλΠϓɺλΠϜελϯϓ • ߦಈλΠϓͭ
$PNQFUJUPST)ZQFSQBSBNFUFST • $PNQFUJUPST • #13.'#BZFTJBO1FSTPOBMJ[FE3BOLJOH • #J-45. • #J-45. "UUFOUJPO
• $// 1PPMJOH • )ZQFSQBSBNFUFST • શͯͷ&NCFEEJOHͷ࣍ݩ • શͯͷӅΕͷ࣍ݩ • જࡏతҙຯۭؒͷۭؒʢ.VMUJ)FBEͷIFBEʣ • όοναΠζ • ਖ਼ଇԽFͷ-ϊϧϜ • 0QUJNJ[FS4(%ɺֶशΛ͔Β࢝ΊͯͰEFDBZ
&WBMVBUJPO.FUSJDT • BWFSBHFVTFS"6$ !"# = 1 "&'() * +∈-./01 1
2+ 3 2+ 4 * 5∈67 8 * 5∈67 9 :(<+,5 > <+,? )
3FTVMUTPO4JOHMFUZQF#FIBWJPS%BUBTFU • "NB[PO%BUBTFU "6$"53BOL͕࠷ྑ ࣌ؒͷΧςΰϦ͝ͱͷ7BOJMMB"UUFOUJPOXFJHIUͷฏۉ ͕࣌ؒܦա͢ΔʹͭΕXFJHIU͕খ͘͞ 3//$//ͷ༻͕ग़དྷ͍ͯΔ "53BOLֶ͕श͕ૣ͘ऩଋ
3FTVMUTPO.VMUJUZQF#FIBWJPS%BUBTFU • 5BPCBP%BUBTFU "53BOL͕ྑ͍͕ɺதͰશͯͷߦಈάϧʔϓΛ༻͍ͯ ߦಈϞσϦϯάΛߦͬͨϞσϧ "53BOLBMMPOF ͕࠷ྑ
$BTF4UVEZ • 4FMG"UUFOUJPOͱ7BOJMMB"UUFOUJPOͷޮՌΛ֬ೝ ߦಈ Ϩίϝϯυ ର
$BTF4UVEZ • 4FMG"UUFOUJPOͷޮՌ ಛఆͷྻʢ7BMVFʣ͕ߴ͍XFJHIU ๅੴಉ࢜Ͱਖ਼ํܗΛܗɺ͓ͦΒ͘ΧςΰϦͷྨࣅੑΛݟ͍ͯΔ
$BTF4UVEZ • 7BOJMMB"UUFOUJPOͷޮՌ ؔ͋Γͦ͏ͳߦಈͷΈڧௐ શͯͷߦಈͰฏۉత