An_Attention-Based_User_Behavior_Modeling_Framework_for_Recommendation.pdf

Transcript

1. "53BOL
   "O
   "UUFOUJPO#BTFE
   6TFS
   #FIBWJPS
   .PEFMJOH
   'SBNFXPSL
   GPS
   3FDPNNFOEBUJPO 12 / 3/ 6 2 0 /6 6/ 2 0 2 1 # ( # )9 9
2. ࿦จͷ֓ཁ • "UUFOUJPOʹجͮ͘ϢʔβߦಈϞσϦϯάͱͦͷϨίϝϯυ λεΫ΁ͷԠ༻ΛఏҊ • 3//$//ϕʔεͷํ๏ΑΓ΋ֶशͷऩଋ͕ૣ͘ߴੑೳ • ͬ͘͟Γݴ͑͹5SBOTGPSNFSͷϨίϝϯυ΁ͷద༻ """*
    ஶऀΒ͸๺ژେֶͱ"MJCBCBͷάϧʔϓ
3. ಋೖ
4. *OUSPEVDUJPO • Ϣʔβʔ͸ࣗ਎ͷߦಈʹΑΓදݱՄೳ • ୯ޠ͕ͦͷपғͷίϯςΩετͰදݱͰ͖Δ͜ͱͱಉ༷ • ߦಈܥྻΛΤϯίʔυ͢ΔͨΊʹ3//$//͕සग़ • 3//͸ฒྻԽࠔ೉͔ͭ௕ظͷґଘؔ܎ͷҡ࣋΋ࠔ೉ • $//͸ฒྻԽՄೳ͕ͩہॴతͳґଘؔ܎͔͠ҡ࣋ෆՄ • 3//$//ͱ΋ʹ୹͍ܥྻͱ௕͍ܥྻͷ྆ํ΋্ख͘ѻ͑ͳ͍ • ܥྻͷ௕͞ʹؔ܎ͳ͘ґଘؔ܎Λҡ࣋Ͱ͖Δ"UUFOUJPO͕ొ৔ • ୯ͳΔ"UUFOUJPOͩͱϕΫτϧͷ֤࣍ݩʹ͍ͭͯಉ͡ॏΈͰ৐ࢉ • ֤࣍ݩͷҟͳΔlҙຯzΛ্ख͘ѻ͑ͳ͍ .VMUJ)FBE
   "UUFOUJPOͷ༧ײ
5. ํ๏
6. 4FMG"UUFOUJPO
   #BTFE
   #FIBWJPS
   .PEFMJOH
   'SBNFXPSL
7. 4FMG"UUFOUJPO
   #BTFE
   #FIBWJPS
   .PEFMJOH
   'SBNFXPSL ঎඼ άϧʔϓ ʢ঎඼*% ళ*% ʣ ݕࡧ άϧʔϓ ʢݕࡧ τʔΫϯʣ Ϋʔϙϯडཧ άϧʔϓ ʢΫʔϙϯ*% ళ*% ʣ Ϩίϝϯυ ର৅ ঎඼*% ళ*%  !" #$
8. 4FMG"UUFOUJPO
   #BTFE
   #FIBWJPS
   .PEFMJOH
   'SBNFXPSL ঎඼ άϧʔϓ ʢ঎඼*% ళ*% ʣ ݕࡧ άϧʔϓ ʢݕࡧ τʔΫϯʣ Ϋʔϙϯडཧ άϧʔϓ ʢΫʔϙϯ*% ళ*% ʣ Ϩίϝϯυ ର৅ ঎඼*% ళ*%  !" #$
9. 4FMG"UUFOUJPO
   #BTFE
   #FIBWJPS
   .PEFMJOH
   'SBNFXPSL ঎඼ άϧʔϓ ʢ঎඼*% ళ*% ʣ ݕࡧ άϧʔϓ ʢݕࡧ τʔΫϯʣ Ϋʔϙϯडཧ άϧʔϓ ʢΫʔϙϯ*% ళ*% ʣ Ϩίϝϯυ ର৅ ঎඼*% ళ*% 
10. 4FMG"UUFOUJPO
    #BTFE
    #FIBWJPS
    .PEFMJOH
    'SBNFXPSL  
     !"#     ঎඼ άϧʔϓ ʢ঎඼*% ళ*% ʣ ݕࡧ άϧʔϓ ʢݕࡧ τʔΫϯʣ Ϋʔϙϯडཧ άϧʔϓ ʢΫʔϙϯ*% ళ*% ʣ Ϩίϝϯυ ର৅ ঎඼*% ళ*% 
11. 4FMG"UUFOUJPO
    #BTFE
    #FIBWJPS
    .PEFMJOH
    'SBNFXPSL - ঎඼ άϧʔϓ ʢ঎඼*% ళ*% ʣ ݕࡧ άϧʔϓ ʢݕࡧ τʔΫϯʣ Ϋʔϙϯडཧ άϧʔϓ ʢΫʔϙϯ*% ళ*% ʣ Ϩίϝϯυ ର৅ ঎඼*% ళ*% 
12. 4FMG"UUFOUJPO
    #BTFE
    #FIBWJPS
    .PEFMJOH
    'SBNFXPSL ঎඼ άϧʔϓ ʢ঎඼*% ళ*% ʣ ݕࡧ άϧʔϓ ʢݕࡧ τʔΫϯʣ Ϋʔϙϯडཧ άϧʔϓ ʢΫʔϙϯ*% ళ*% ʣ Ϩίϝϯυ ର৅ ঎඼*% ళ*%  -
13. 4FMG"UUFOUJPO
    #BTFE
    #FIBWJPS
    .PEFMJOH
    'SBNFXPSL ঎඼ άϧʔϓ ʢ঎඼*% ళ*% ʣ ݕࡧ άϧʔϓ ʢݕࡧ τʔΫϯʣ Ϋʔϙϯडཧ άϧʔϓ ʢΫʔϙϯ*% ళ*% ʣ Ϩίϝϯυ ର৅ ঎඼*% ళ*%  - DPODBU
14. 4FMG"UUFOUJPO
    #BTFE
    #FIBWJPS
    .PEFMJOH
    'SBNFXPSL ঎඼ άϧʔϓ ʢ঎඼*% ళ*% ʣ ݕࡧ άϧʔϓ ʢݕࡧ τʔΫϯʣ Ϋʔϙϯडཧ άϧʔϓ ʢΫʔϙϯ*% ళ*% ʣ Ϩίϝϯυ ର৅ ঎඼*% ళ*%  - - - - - - -
15. 4FMG"UUFOUJPO
    #BTFE
    #FIBWJPS
    .PEFMJOH
    'SBNFXPSL ঎඼ άϧʔϓ ʢ঎඼*% ళ*% ʣ ݕࡧ άϧʔϓ ʢݕࡧ τʔΫϯʣ Ϋʔϙϯडཧ άϧʔϓ ʢΫʔϙϯ*% ళ*% ʣ Ϩίϝϯυ ର৅ ঎඼*% ళ*% 
         
16. 3BX
    'FBUVSF
    4QBDFT • ϢʔβʔͷߦಈΛ{", $, %}ͱͯ͠ఆࣜԽ • Ϣʔβʔ' = { ") , $) , %) |+ = 1,2, … , /} • 'Λߦಈͷੑ࣭ʹΑΓҟͳΔάϧʔϓʹ෼ׂ " $ % 
    ߦಈλΠϓ FH
    Ӿཡɺߪങɺ 
    ߦಈΦϒδΣΫτ FH
    \঎඼*%
    ళ*%^ɺ\ݕࡧτʔΫϯ^ɺ 
    ߦಈൃੜ࣌ͷλΠϜελϯϓ 0 = {123 , 124 , … , 125 } 123 ∩ 124 = 7 ' =∪9:9 5 129 ঎඼ άϧʔϓ ݕࡧ άϧʔϓ Ϋʔϙϯडཧ άϧʔϓ
17. #FIBWJPS
    &NCFEEJOH
    4QBDFT • άϧʔϓ!"#ʹ͓͍ͯ $% , '% , (% Λ&NCFEEJOH )#% = +# ($% , '% , (% ) $% '% (% 
    ී௨ʹ&NCFEEJOH 
    ී௨ʹ&NCFEEJOHͯ݁͠߹ʢ \঎඼*%
    ళ*%^ͳͲෳ਺ଘࡏ͢ΔͷͰʣ 
    ΧςΰϦԽͯ͠&NCFEEJOH ߦಈൃੜ࣌ͷλΠϜελϯϓ͔ΒϨίϝϯυ࣌఺·ͰͷܦաͷϨϯδ͝ͱʹΧςΰϦʹม׵ 0, 1 , 1,2 , 2,4 , … , [24, 2456) 0 1 2 7 + 1
18. #FIBWJPS
    &NCFEEJOH
    4QBDFT !"# = %&'" (# + *((+!," - '!.+%/01%" /# + *((+!," 2(4# ) ࿦จͰ͸Ճࢉ͕ͩ ࣮૷Ͱ͸݁߹ ͜ͷϨΠϠʔͷ࠷ऴతͳग़ྗ 6 = {!89: , !89< , … , !89> } !89@ = .(A.4/# (!"# ) ֤άϧʔϓͰ!"#ͷϕΫτϧͷTIBQFҟͳΔ ಉ͡ಛ௃ྔͷ&NCFEEJOH͸ڞ༗ ͨͩ࣌ؒ͠ͷ&NCFEEJOH͸ڞ༗͠ͳ͍
19. -BUFOU
    4FNBOUJD
    4QBDFT • ֤ߦಈΛ,ݸͷજࡏతҙຯۭؒʹ౤Ө • ͭ·Γ͸.VMUJ)FBE
    "UUFOUJPOΛߦ͏ • Ϣʔβʔͷߦಈ!Λάϧʔϓ͝ͱʹҟͳΔ౤Өؔ਺"#$ Λ༻͍ͯ ݻఆ௕ͷϕΫτϧʹม׵ • 4ΛͦΕͧΕͷજࡏతҙຯۭؒʹ౤Ө % = '()'*+ , ("#. /01. , "#3 /013 , … , "#5 (/015 )) %7 = "87 (%) 5SBOTGPSNFSͷ .VMUJ)FBE
    "UUFOUJPOͷ9:ʹ૬౰
20. -BUFOU
    4FNBOUJD
    4QBDFT • !"# ΍!$% ͸࿦จͰ͸୯ҰͷEFOTF
    MBZFSͰ׆ੑԽؔ਺͕3F-6 • ֤TIBQFΛ੔ཧ &'(( &) *'(( 
    શߦಈ਺ *% 
    άϧʔϓ+ͷߦಈ਺ 
    ݻఆ௕ͷϕΫτϧͷ࣍ݩ਺ 
    ֤જࡏతҙຯۭؒͷ࣍ݩ਺ *% = *'(( -
21. 4FMG"UUFOUJPO
    -BZFS • ,ݸͷ֤જࡏతҙຯۭؒͰߦಈؒͷ4FMG"UUFOUJPO
22. 4FMG"UUFOUJPO
    -BZFS • ࿦จͷهड़Ͱ͸ !" = $%&'()*()(," , ,: /" )) ۭؒ1ʹ͓͚Δ"UUFOUJPO
    XFJHIUϕΫτϧͷߦྻ ) ," , ,: /" = ," 2" ,3 ۭؒ1ʹ͓͚Δ"UUFOUJPOϕΫτϧͷߦྻ 4" = !" 567 (,) ࠷ऴతͳग़ྗ 4 = 589:; (<%=<)' > (4> , 4? , … , 4" )) Ͱ΋࣮૷্݁ہ΍ͬͯΔ͜ͱ͸ 567 , 589:; 
    TJOHMF
    EFOTF
    MBZFS
    XJUI
    3F-6
23. %PXOTUSFBN
    "QQMJDBUJPO
    /FUXPSL • ͜͜·ͰϢʔβʔߦಈϞσϧ͕׬੒ • ͜ͷ࿦จͰ͸ϨίϝϯυλεΫΛߟ͑Δ ͬͪ͜ଆͷ࿩
24. %PXOTUSFBN
    "QQMJDBUJPO
    /FUXPSL • Ϩίϝϯυର৅ͷߦಈͱ4FMG"UUFOUJPOޙͷߦಈؒͰ7BOJMMB
    "UUFOUJPO • ͭ·ΓϢʔβʔߦಈଆΛΤϯίʔμɺϨίϝϯυର৅ߦಈଆΛ σίʔμͱߟ͑ͨ4PVSDF5BSHFU"UUFOUJPO Τϯίʔμ σίʔμ
25. %PXOTUSFBN
    "QQMJDBUJPO
    /FUXPSL • Ϩίϝϯυର৅ߦಈͷ&NCFEEJOHͰ͋Δ!"ʹରͯ͠ɺ͜Ε· Ͱͱ΄΅ಉ͡ԋࢉΛߦ͏ • ݻఆ௕ϕΫτϧ΁ͷม׵ͱ.VMUJ)FBE
    "UUFOUJPO ℎ" = %&' " (!" ) *+ = %,- (ℎ" ) .+ = */01234 3 *+ , 6; 8+ %9- (6) :; " = %<=>?@@= (./A.31 B (.B , .C , … , .+ )) ߦಈάϧʔϓͷΠϯσοΫε΁ͷஔ׵ %<=>?@@= 
    TJOHMF
    EFOTF
    MBZFS
    XJUI
    3F-6
26. %PXOTUSFBN
    "QQMJDBUJPO
    /FUXPSL • QPJOUXJTFͷ༧ଌϞσϧͰ͸ߦಈ!͕औΒΕΔ֬཰Λ༧ଌ • ଛࣦؔ਺ʹ͸γάϞΠυͷΫϩεΤϯτϩϐʔ − # $,& '$ ()*+(- ℎ$ , /& $ ) + 1 − '$ log(1 − +(- ℎ$ , /& $ )) - 
    ϥϯΩϯάؔ਺ʢ࿦จͰ͸୯७ͳ಺ੵʣ
27. ࣮ݧ
28. %BUBTFU • "NB[PO
    %BUBTFU • Ϣʔβʔͷ঎඼ʹର͢ΔϨϏϡʔσʔλ • ߦಈͷάϧʔϓ͸͚ͭͩʢ঎඼άϧʔϓʣ • ಛ௃ྔ͸Ϣʔβʔ*%ɺ঎඼*%ɺΧςΰϦ*%ɺλΠϜελϯϓ • Ϣʔβͷߦಈ("# , "% , … , "' )͕͋Δͱֶͯ͠शɾςετσʔλ͸ҎԼ ("# ) "% ("# , "% ) ") ("# , "% , … , "'*% ) "'*#  *OQVU QSFEJDU ֶश ςετ ("# , "% , … , "'*# ) "' *OQVU QSFEJDU ˞OFHBUJWF
    TBNQMF͸ QPTJUJWF
    TBNQMFҎ֎ͷ঎඼ΛϥϯμϜͰબ୒
29. %BUBTFU • 5BPCBP
    %BUBTFU • "MJCBCB͕ӡӦ͢Δ&$αΠτͷϩά • ߦಈͷάϧʔϓ͸ͭʢ঎඼ɺݕࡧɺΫʔϙϯडཧʣ • ঎඼άϧʔϓ • ঎඼*%ɺళ*%ɺϒϥϯυ*%ɺΧςΰϦ*%ɺλΠϜελϯϓ • ߦಈλΠϓ͸ӾཡɺϚʔΫɺߪೖ • ݕࡧάϧʔϓ • ݕࡧτʔΫϯɺλΠϜελϯϓ • ߦಈλΠϓ͸ͭ • Ϋʔϙϯडཧάϧʔϓ • Ϋʔϙϯ*%ɺళ*%ɺΫʔϙϯλΠϓɺλΠϜελϯϓ • ߦಈλΠϓ͸ͭ
30. $PNQFUJUPST
    
    )ZQFSQBSBNFUFST • $PNQFUJUPST • #13.'
    #BZFTJBO
    1FSTPOBMJ[FE
    3BOLJOH • #J-45. • #J-45.
    
    "UUFOUJPO • $//
    
    1PPMJOH • )ZQFSQBSBNFUFST • શͯͷ&NCFEEJOHͷ࣍ݩ਺
     • શͯͷӅΕ૚ͷ࣍ݩ਺
     • જࡏతҙຯۭؒͷۭؒ਺ʢ.VMUJ)FBEͷIFBE਺ʣ
     • όοναΠζ
     • ਖ਼ଇԽ
    ܎਺Fͷ-ϊϧϜ • 0QUJNJ[FS
    4(%ɺֶश཰Λ͔Β࢝ΊͯͰEFDBZ
31. &WBMVBUJPO
    .FUSJDT • BWFSBHF
    VTFS
    "6$ !"# = 1 "&'() * +∈-./01 1 2+ 3 2+ 4 * 5∈67 8 * 5∈67 9 :(<+,5 > <+,? )
32. 3FTVMUT
    PO
    4JOHMFUZQF
    #FIBWJPS
    %BUBTFU • "NB[PO
    %BUBTFU "6$͸"53BOL͕࠷ྑ ࣌ؒͷΧςΰϦ͝ͱͷ7BOJMMB"UUFOUJPO
    XFJHIUͷฏۉ஋ ͕࣌ؒܦա͢ΔʹͭΕXFJHIU͕খ͘͞ 3//$//ͷ୅༻͕ग़དྷ͍ͯΔ "53BOLֶ͕श͕ૣ͘ऩଋ
33. 3FTVMUT
    PO
    .VMUJUZQF
    #FIBWJPS
    %BUBTFU • 5BPCBP
    %BUBTFU "53BOL͕ྑ͍͕ɺதͰ΋શͯͷߦಈάϧʔϓΛ༻͍ͯ ߦಈϞσϦϯάΛߦͬͨϞσϧ "53BOLBMMPOF ͕࠷ྑ
34. $BTF
    4UVEZ • 4FMG"UUFOUJPOͱ7BOJMMB"UUFOUJPOͷޮՌΛ֬ೝ ߦಈ Ϩίϝϯυ ର৅
35. $BTF
    4UVEZ • 4FMG"UUFOUJPOͷޮՌ ಛఆͷྻʢ7BMVFʣ͕ߴ͍XFJHIU ๅੴಉ࢜Ͱਖ਼ํܗΛܗ੒ɺ͓ͦΒ͘ΧςΰϦͷྨࣅੑΛݟ͍ͯΔ
36. $BTF
    4UVEZ • 7BOJMMB"UUFOUJPOͷޮՌ ؔ܎͋Γͦ͏ͳߦಈͷΈڧௐ શͯͷߦಈͰฏۉత