Upgrade to Pro — share decks privately, control downloads, hide ads and more …

An_Attention-Based_User_Behavior_Modeling_Framework_for_Recommendation.pdf

618513d42f7c20012930f20093759531?s=47 kishimoto
June 21, 2019

 An_Attention-Based_User_Behavior_Modeling_Framework_for_Recommendation.pdf

618513d42f7c20012930f20093759531?s=128

kishimoto

June 21, 2019
Tweet

More Decks by kishimoto

Other Decks in Research

Transcript

  1. "53BOL"O"UUFOUJPO#BTFE 6TFS#FIBWJPS.PEFMJOH'SBNFXPSL GPS3FDPNNFOEBUJPO 12 / 3/ 6 2 0 /6

    6/ 2 0 2 1 # ( # )9 9
  2. ࿦จͷ֓ཁ • "UUFOUJPOʹجͮ͘ϢʔβߦಈϞσϦϯάͱͦͷϨίϝϯυ λεΫ΁ͷԠ༻ΛఏҊ • 3//$//ϕʔεͷํ๏ΑΓ΋ֶशͷऩଋ͕ૣ͘ߴੑೳ • ͬ͘͟Γݴ͑͹5SBOTGPSNFSͷϨίϝϯυ΁ͷద༻ """* ஶऀΒ͸๺ژେֶͱ"MJCBCBͷάϧʔϓ

  3. ಋೖ

  4. *OUSPEVDUJPO • Ϣʔβʔ͸ࣗ਎ͷߦಈʹΑΓදݱՄೳ • ୯ޠ͕ͦͷपғͷίϯςΩετͰදݱͰ͖Δ͜ͱͱಉ༷ • ߦಈܥྻΛΤϯίʔυ͢ΔͨΊʹ3//$//͕සग़ • 3//͸ฒྻԽࠔ೉͔ͭ௕ظͷґଘؔ܎ͷҡ࣋΋ࠔ೉ •

    $//͸ฒྻԽՄೳ͕ͩہॴతͳґଘؔ܎͔͠ҡ࣋ෆՄ • 3//$//ͱ΋ʹ୹͍ܥྻͱ௕͍ܥྻͷ྆ํ΋্ख͘ѻ͑ͳ͍ • ܥྻͷ௕͞ʹؔ܎ͳ͘ґଘؔ܎Λҡ࣋Ͱ͖Δ"UUFOUJPO͕ొ৔ • ୯ͳΔ"UUFOUJPOͩͱϕΫτϧͷ֤࣍ݩʹ͍ͭͯಉ͡ॏΈͰ৐ࢉ • ֤࣍ݩͷҟͳΔlҙຯzΛ্ख͘ѻ͑ͳ͍ .VMUJ)FBE"UUFOUJPOͷ༧ײ
  5. ํ๏

  6. 4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL

  7. 4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL ঎඼ άϧʔϓ ʢ঎඼*% ళ*% ʣ ݕࡧ άϧʔϓ ʢݕࡧ τʔΫϯʣ

    Ϋʔϙϯडཧ άϧʔϓ ʢΫʔϙϯ*% ళ*% ʣ Ϩίϝϯυ ର৅ ঎඼*% ళ*%  !" #$
  8. 4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL ঎඼ άϧʔϓ ʢ঎඼*% ళ*% ʣ ݕࡧ άϧʔϓ ʢݕࡧ τʔΫϯʣ

    Ϋʔϙϯडཧ άϧʔϓ ʢΫʔϙϯ*% ళ*% ʣ Ϩίϝϯυ ର৅ ঎඼*% ళ*%  !" #$
  9. 4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL ঎඼ άϧʔϓ ʢ঎඼*% ళ*% ʣ ݕࡧ άϧʔϓ ʢݕࡧ τʔΫϯʣ

    Ϋʔϙϯडཧ άϧʔϓ ʢΫʔϙϯ*% ళ*% ʣ Ϩίϝϯυ ର৅ ঎඼*% ళ*% 
  10. 4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL   !"#     ঎඼ άϧʔϓ

    ʢ঎඼*% ళ*% ʣ ݕࡧ άϧʔϓ ʢݕࡧ τʔΫϯʣ Ϋʔϙϯडཧ άϧʔϓ ʢΫʔϙϯ*% ళ*% ʣ Ϩίϝϯυ ର৅ ঎඼*% ళ*% 
  11. 4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL - ঎඼ άϧʔϓ ʢ঎඼*% ళ*% ʣ ݕࡧ άϧʔϓ ʢݕࡧ

    τʔΫϯʣ Ϋʔϙϯडཧ άϧʔϓ ʢΫʔϙϯ*% ళ*% ʣ Ϩίϝϯυ ର৅ ঎඼*% ళ*% 
  12. 4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL ঎඼ άϧʔϓ ʢ঎඼*% ళ*% ʣ ݕࡧ άϧʔϓ ʢݕࡧ τʔΫϯʣ

    Ϋʔϙϯडཧ άϧʔϓ ʢΫʔϙϯ*% ళ*% ʣ Ϩίϝϯυ ର৅ ঎඼*% ళ*%  -
  13. 4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL ঎඼ άϧʔϓ ʢ঎඼*% ళ*% ʣ ݕࡧ άϧʔϓ ʢݕࡧ τʔΫϯʣ

    Ϋʔϙϯडཧ άϧʔϓ ʢΫʔϙϯ*% ళ*% ʣ Ϩίϝϯυ ର৅ ঎඼*% ళ*%  - DPODBU
  14. 4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL ঎඼ άϧʔϓ ʢ঎඼*% ళ*% ʣ ݕࡧ άϧʔϓ ʢݕࡧ τʔΫϯʣ

    Ϋʔϙϯडཧ άϧʔϓ ʢΫʔϙϯ*% ళ*% ʣ Ϩίϝϯυ ର৅ ঎඼*% ళ*%  - - - - - - -
  15. 4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL ঎඼ άϧʔϓ ʢ঎඼*% ళ*% ʣ ݕࡧ άϧʔϓ ʢݕࡧ τʔΫϯʣ

    Ϋʔϙϯडཧ άϧʔϓ ʢΫʔϙϯ*% ళ*% ʣ Ϩίϝϯυ ର৅ ঎඼*% ళ*%       
  16. 3BX'FBUVSF4QBDFT • ϢʔβʔͷߦಈΛ{", $, %}ͱͯ͠ఆࣜԽ • Ϣʔβʔ' = { ")

    , $) , %) |+ = 1,2, … , /} • 'Λߦಈͷੑ࣭ʹΑΓҟͳΔάϧʔϓʹ෼ׂ " $ % ߦಈλΠϓ FH Ӿཡɺߪങɺ ߦಈΦϒδΣΫτ FH \঎඼*% ళ*%^ɺ\ݕࡧτʔΫϯ^ɺ ߦಈൃੜ࣌ͷλΠϜελϯϓ 0 = {123 , 124 , … , 125 } 123 ∩ 124 = 7 ' =∪9:9 5 129 ঎඼ άϧʔϓ ݕࡧ άϧʔϓ Ϋʔϙϯडཧ άϧʔϓ
  17. #FIBWJPS&NCFEEJOH4QBDFT • άϧʔϓ!"#ʹ͓͍ͯ $% , '% , (% Λ&NCFEEJOH )#%

    = +# ($% , '% , (% ) $% '% (% ී௨ʹ&NCFEEJOH ී௨ʹ&NCFEEJOHͯ݁͠߹ʢ \঎඼*% ళ*%^ͳͲෳ਺ଘࡏ͢ΔͷͰʣ ΧςΰϦԽͯ͠&NCFEEJOH ߦಈൃੜ࣌ͷλΠϜελϯϓ͔ΒϨίϝϯυ࣌఺·ͰͷܦաͷϨϯδ͝ͱʹΧςΰϦʹม׵ 0, 1 , 1,2 , 2,4 , … , [24, 2456) 0 1 2 7 + 1
  18. #FIBWJPS&NCFEEJOH4QBDFT !"# = %&'" (# + *((+!," - '!.+%/01%" /#

    + *((+!," 2(4# ) ࿦จͰ͸Ճࢉ͕ͩ ࣮૷Ͱ͸݁߹ ͜ͷϨΠϠʔͷ࠷ऴతͳग़ྗ 6 = {!89: , !89< , … , !89> } !89@ = .(A.4/# (!"# ) ֤άϧʔϓͰ!"#ͷϕΫτϧͷTIBQFҟͳΔ ಉ͡ಛ௃ྔͷ&NCFEEJOH͸ڞ༗ ͨͩ࣌ؒ͠ͷ&NCFEEJOH͸ڞ༗͠ͳ͍
  19. -BUFOU4FNBOUJD4QBDFT • ֤ߦಈΛ,ݸͷજࡏతҙຯۭؒʹ౤Ө • ͭ·Γ͸.VMUJ)FBE"UUFOUJPOΛߦ͏ • Ϣʔβʔͷߦಈ!Λάϧʔϓ͝ͱʹҟͳΔ౤Өؔ਺"#$ Λ༻͍ͯ ݻఆ௕ͷϕΫτϧʹม׵ •

    4ΛͦΕͧΕͷજࡏతҙຯۭؒʹ౤Ө % = '()'*+ , ("#. /01. , "#3 /013 , … , "#5 (/015 )) %7 = "87 (%) 5SBOTGPSNFSͷ .VMUJ)FBE"UUFOUJPOͷ9:ʹ૬౰
  20. -BUFOU4FNBOUJD4QBDFT • !"# ΍!$% ͸࿦จͰ͸୯ҰͷEFOTFMBZFSͰ׆ੑԽؔ਺͕3F-6 • ֤TIBQFΛ੔ཧ &'(( &) *'((

    શߦಈ਺ *% άϧʔϓ+ͷߦಈ਺ ݻఆ௕ͷϕΫτϧͷ࣍ݩ਺ ֤જࡏతҙຯۭؒͷ࣍ݩ਺ *% = *'(( -
  21. 4FMG"UUFOUJPO-BZFS • ,ݸͷ֤જࡏతҙຯۭؒͰߦಈؒͷ4FMG"UUFOUJPO

  22. 4FMG"UUFOUJPO-BZFS • ࿦จͷهड़Ͱ͸ !" = $%&'()*()(," , ,: /" ))

    ۭؒ1ʹ͓͚Δ"UUFOUJPOXFJHIUϕΫτϧͷߦྻ ) ," , ,: /" = ," 2" ,3 ۭؒ1ʹ͓͚Δ"UUFOUJPOϕΫτϧͷߦྻ 4" = !" 567 (,) ࠷ऴతͳग़ྗ 4 = 589:; (<%=<)' > (4> , 4? , … , 4" )) Ͱ΋࣮૷্݁ہ΍ͬͯΔ͜ͱ͸ 567 , 589:; TJOHMFEFOTFMBZFS XJUI3F-6
  23. %PXOTUSFBN"QQMJDBUJPO/FUXPSL • ͜͜·ͰϢʔβʔߦಈϞσϧ͕׬੒ • ͜ͷ࿦จͰ͸ϨίϝϯυλεΫΛߟ͑Δ ͬͪ͜ଆͷ࿩

  24. %PXOTUSFBN"QQMJDBUJPO/FUXPSL • Ϩίϝϯυର৅ͷߦಈͱ4FMG"UUFOUJPOޙͷߦಈؒͰ7BOJMMB "UUFOUJPO • ͭ·ΓϢʔβʔߦಈଆΛΤϯίʔμɺϨίϝϯυର৅ߦಈଆΛ σίʔμͱߟ͑ͨ4PVSDF5BSHFU"UUFOUJPO Τϯίʔμ σίʔμ

  25. %PXOTUSFBN"QQMJDBUJPO/FUXPSL • Ϩίϝϯυର৅ߦಈͷ&NCFEEJOHͰ͋Δ!"ʹରͯ͠ɺ͜Ε· Ͱͱ΄΅ಉ͡ԋࢉΛߦ͏ • ݻఆ௕ϕΫτϧ΁ͷม׵ͱ.VMUJ)FBE"UUFOUJPO ℎ" = %&' "

    (!" ) *+ = %,- (ℎ" ) .+ = */01234 3 *+ , 6; 8+ %9- (6) :; " = %<=>?@@= (./A.31 B (.B , .C , … , .+ )) ߦಈάϧʔϓͷΠϯσοΫε΁ͷஔ׵ %<=>?@@= TJOHMFEFOTFMBZFS XJUI3F-6
  26. %PXOTUSFBN"QQMJDBUJPO/FUXPSL • QPJOUXJTFͷ༧ଌϞσϧͰ͸ߦಈ!͕औΒΕΔ֬཰Λ༧ଌ • ଛࣦؔ਺ʹ͸γάϞΠυͷΫϩεΤϯτϩϐʔ − # $,& '$ ()*+(-

    ℎ$ , /& $ ) + 1 − '$ log(1 − +(- ℎ$ , /& $ )) - ϥϯΩϯάؔ਺ʢ࿦จͰ͸୯७ͳ಺ੵʣ
  27. ࣮ݧ

  28. %BUBTFU • "NB[PO%BUBTFU • Ϣʔβʔͷ঎඼ʹର͢ΔϨϏϡʔσʔλ • ߦಈͷάϧʔϓ͸͚ͭͩʢ঎඼άϧʔϓʣ • ಛ௃ྔ͸Ϣʔβʔ*%ɺ঎඼*%ɺΧςΰϦ*%ɺλΠϜελϯϓ •

    Ϣʔβͷߦಈ("# , "% , … , "' )͕͋Δͱֶͯ͠शɾςετσʔλ͸ҎԼ ("# ) "% ("# , "% ) ") ("# , "% , … , "'*% ) "'*#  *OQVU QSFEJDU ֶश ςετ ("# , "% , … , "'*# ) "' *OQVU QSFEJDU ˞OFHBUJWFTBNQMF͸ QPTJUJWFTBNQMFҎ֎ͷ঎඼ΛϥϯμϜͰબ୒
  29. %BUBTFU • 5BPCBP%BUBTFU • "MJCBCB͕ӡӦ͢Δ&$αΠτͷϩά • ߦಈͷάϧʔϓ͸ͭʢ঎඼ɺݕࡧɺΫʔϙϯडཧʣ • ঎඼άϧʔϓ •

    ঎඼*%ɺళ*%ɺϒϥϯυ*%ɺΧςΰϦ*%ɺλΠϜελϯϓ • ߦಈλΠϓ͸ӾཡɺϚʔΫɺߪೖ • ݕࡧάϧʔϓ • ݕࡧτʔΫϯɺλΠϜελϯϓ • ߦಈλΠϓ͸ͭ • Ϋʔϙϯडཧάϧʔϓ • Ϋʔϙϯ*%ɺళ*%ɺΫʔϙϯλΠϓɺλΠϜελϯϓ • ߦಈλΠϓ͸ͭ
  30. $PNQFUJUPST)ZQFSQBSBNFUFST • $PNQFUJUPST • #13.'#BZFTJBO1FSTPOBMJ[FE3BOLJOH • #J-45. • #J-45. "UUFOUJPO

    • $// 1PPMJOH • )ZQFSQBSBNFUFST • શͯͷ&NCFEEJOHͷ࣍ݩ਺ • શͯͷӅΕ૚ͷ࣍ݩ਺ • જࡏతҙຯۭؒͷۭؒ਺ʢ.VMUJ)FBEͷIFBE਺ʣ • όοναΠζ • ਖ਼ଇԽ܎਺Fͷ-ϊϧϜ • 0QUJNJ[FS4(%ɺֶश཰Λ͔Β࢝ΊͯͰEFDBZ
  31. &WBMVBUJPO.FUSJDT • BWFSBHFVTFS"6$ !"# = 1 "&'() * +∈-./01 1

    2+ 3 2+ 4 * 5∈67 8 * 5∈67 9 :(<+,5 > <+,? )
  32. 3FTVMUTPO4JOHMFUZQF#FIBWJPS%BUBTFU • "NB[PO%BUBTFU "6$͸"53BOL͕࠷ྑ ࣌ؒͷΧςΰϦ͝ͱͷ7BOJMMB"UUFOUJPOXFJHIUͷฏۉ஋ ͕࣌ؒܦա͢ΔʹͭΕXFJHIU͕খ͘͞ 3//$//ͷ୅༻͕ग़དྷ͍ͯΔ "53BOLֶ͕श͕ૣ͘ऩଋ

  33. 3FTVMUTPO.VMUJUZQF#FIBWJPS%BUBTFU • 5BPCBP%BUBTFU "53BOL͕ྑ͍͕ɺதͰ΋શͯͷߦಈάϧʔϓΛ༻͍ͯ ߦಈϞσϦϯάΛߦͬͨϞσϧ "53BOLBMMPOF ͕࠷ྑ

  34. $BTF4UVEZ • 4FMG"UUFOUJPOͱ7BOJMMB"UUFOUJPOͷޮՌΛ֬ೝ ߦಈ Ϩίϝϯυ ର৅

  35. $BTF4UVEZ • 4FMG"UUFOUJPOͷޮՌ ಛఆͷྻʢ7BMVFʣ͕ߴ͍XFJHIU ๅੴಉ࢜Ͱਖ਼ํܗΛܗ੒ɺ͓ͦΒ͘ΧςΰϦͷྨࣅੑΛݟ͍ͯΔ

  36. $BTF4UVEZ • 7BOJMMB"UUFOUJPOͷޮՌ ؔ܎͋Γͦ͏ͳߦಈͷΈڧௐ શͯͷߦಈͰฏۉత