Upgrade to Pro — share decks privately, control downloads, hide ads and more …

An_Attention-Based_User_Behavior_Modeling_Framework_for_Recommendation.pdf

 An_Attention-Based_User_Behavior_Modeling_Framework_for_Recommendation.pdf

kishimoto

June 21, 2019
Tweet

More Decks by kishimoto

Other Decks in Research

Transcript

  1. "53BOL"O"UUFOUJPO#BTFE
    6TFS#FIBWJPS.PEFMJOH'SBNFXPSL
    GPS3FDPNNFOEBUJPO
    12 / 3/ 6 2 0 /6 6/ 2 0 2 1
    # ( #
    )9 9

    View full-size slide

  2. ࿦จͷ֓ཁ
    • "UUFOUJPOʹجͮ͘ϢʔβߦಈϞσϦϯάͱͦͷϨίϝϯυ
    λεΫ΁ͷԠ༻ΛఏҊ
    • 3//$//ϕʔεͷํ๏ΑΓ΋ֶशͷऩଋ͕ૣ͘ߴੑೳ
    • ͬ͘͟Γݴ͑͹5SBOTGPSNFSͷϨίϝϯυ΁ͷద༻
    """*
    ஶऀΒ͸๺ژେֶͱ"MJCBCBͷάϧʔϓ

    View full-size slide

  3. *OUSPEVDUJPO
    • Ϣʔβʔ͸ࣗ਎ͷߦಈʹΑΓදݱՄೳ
    • ୯ޠ͕ͦͷपғͷίϯςΩετͰදݱͰ͖Δ͜ͱͱಉ༷
    • ߦಈܥྻΛΤϯίʔυ͢ΔͨΊʹ3//$//͕සग़
    • 3//͸ฒྻԽࠔ೉͔ͭ௕ظͷґଘؔ܎ͷҡ࣋΋ࠔ೉
    • $//͸ฒྻԽՄೳ͕ͩہॴతͳґଘؔ܎͔͠ҡ࣋ෆՄ
    • 3//$//ͱ΋ʹ୹͍ܥྻͱ௕͍ܥྻͷ྆ํ΋্ख͘ѻ͑ͳ͍
    • ܥྻͷ௕͞ʹؔ܎ͳ͘ґଘؔ܎Λҡ࣋Ͱ͖Δ"UUFOUJPO͕ొ৔
    • ୯ͳΔ"UUFOUJPOͩͱϕΫτϧͷ֤࣍ݩʹ͍ͭͯಉ͡ॏΈͰ৐ࢉ
    • ֤࣍ݩͷҟͳΔlҙຯzΛ্ख͘ѻ͑ͳ͍
    .VMUJ)FBE"UUFOUJPOͷ༧ײ

    View full-size slide

  4. 4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL

    View full-size slide

  5. 4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL
    ঎඼
    άϧʔϓ
    ʢ঎඼*%
    ళ*% ʣ
    ݕࡧ
    άϧʔϓ
    ʢݕࡧ
    τʔΫϯʣ
    Ϋʔϙϯडཧ
    άϧʔϓ
    ʢΫʔϙϯ*%
    ళ*% ʣ
    Ϩίϝϯυ
    ର৅
    ঎඼*%
    ళ*%

    !"
    #$

    View full-size slide

  6. 4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL
    ঎඼
    άϧʔϓ
    ʢ঎඼*%
    ళ*% ʣ
    ݕࡧ
    άϧʔϓ
    ʢݕࡧ
    τʔΫϯʣ
    Ϋʔϙϯडཧ
    άϧʔϓ
    ʢΫʔϙϯ*%
    ళ*% ʣ
    Ϩίϝϯυ
    ର৅
    ঎඼*%
    ళ*%

    !"
    #$

    View full-size slide

  7. 4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL
    ঎඼
    άϧʔϓ
    ʢ঎඼*%
    ళ*% ʣ
    ݕࡧ
    άϧʔϓ
    ʢݕࡧ
    τʔΫϯʣ
    Ϋʔϙϯडཧ
    άϧʔϓ
    ʢΫʔϙϯ*%
    ళ*% ʣ
    Ϩίϝϯυ
    ର৅
    ঎඼*%
    ళ*%

    View full-size slide

  8. 4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL


    !"#


    ঎඼
    άϧʔϓ
    ʢ঎඼*%
    ళ*% ʣ
    ݕࡧ
    άϧʔϓ
    ʢݕࡧ
    τʔΫϯʣ
    Ϋʔϙϯडཧ
    άϧʔϓ
    ʢΫʔϙϯ*%
    ళ*% ʣ
    Ϩίϝϯυ
    ର৅
    ঎඼*%
    ళ*%

    View full-size slide

  9. 4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL
    -
    ঎඼
    άϧʔϓ
    ʢ঎඼*%
    ళ*% ʣ
    ݕࡧ
    άϧʔϓ
    ʢݕࡧ
    τʔΫϯʣ
    Ϋʔϙϯडཧ
    άϧʔϓ
    ʢΫʔϙϯ*%
    ళ*% ʣ
    Ϩίϝϯυ
    ର৅
    ঎඼*%
    ళ*%

    View full-size slide

  10. 4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL
    ঎඼
    άϧʔϓ
    ʢ঎඼*%
    ళ*% ʣ
    ݕࡧ
    άϧʔϓ
    ʢݕࡧ
    τʔΫϯʣ
    Ϋʔϙϯडཧ
    άϧʔϓ
    ʢΫʔϙϯ*%
    ళ*% ʣ
    Ϩίϝϯυ
    ର৅
    ঎඼*%
    ళ*%

    -

    View full-size slide

  11. 4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL
    ঎඼
    άϧʔϓ
    ʢ঎඼*%
    ళ*% ʣ
    ݕࡧ
    άϧʔϓ
    ʢݕࡧ
    τʔΫϯʣ
    Ϋʔϙϯडཧ
    άϧʔϓ
    ʢΫʔϙϯ*%
    ళ*% ʣ
    Ϩίϝϯυ
    ର৅
    ঎඼*%
    ళ*%

    -
    DPODBU

    View full-size slide

  12. 4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL
    ঎඼
    άϧʔϓ
    ʢ঎඼*%
    ళ*% ʣ
    ݕࡧ
    άϧʔϓ
    ʢݕࡧ
    τʔΫϯʣ
    Ϋʔϙϯडཧ
    άϧʔϓ
    ʢΫʔϙϯ*%
    ళ*% ʣ
    Ϩίϝϯυ
    ର৅
    ঎඼*%
    ళ*%

    -
    - -
    -
    - - -

    View full-size slide

  13. 4FMG"UUFOUJPO#BTFE#FIBWJPS.PEFMJOH'SBNFXPSL
    ঎඼
    άϧʔϓ
    ʢ঎඼*%
    ళ*% ʣ
    ݕࡧ
    άϧʔϓ
    ʢݕࡧ
    τʔΫϯʣ
    Ϋʔϙϯडཧ
    άϧʔϓ
    ʢΫʔϙϯ*%
    ళ*% ʣ
    Ϩίϝϯυ
    ର৅
    ঎඼*%
    ళ*%





    View full-size slide

  14. 3BX'FBUVSF4QBDFT
    • ϢʔβʔͷߦಈΛ{", $, %}ͱͯ͠ఆࣜԽ
    • Ϣʔβʔ' = { ")
    , $)
    , %)
    |+ = 1,2, … , /}
    • 'Λߦಈͷੑ࣭ʹΑΓҟͳΔάϧʔϓʹ෼ׂ
    "
    $
    %
    ߦಈλΠϓ FH
    Ӿཡɺߪങɺ
    ߦಈΦϒδΣΫτ FH
    \঎඼*% ళ*%^ɺ\ݕࡧτʔΫϯ^ɺ
    ߦಈൃੜ࣌ͷλΠϜελϯϓ
    0 = {123
    , 124
    , … , 125
    } 123
    ∩ 124
    = 7
    ' =∪9:9
    5 129
    ঎඼
    άϧʔϓ
    ݕࡧ
    άϧʔϓ
    Ϋʔϙϯडཧ
    άϧʔϓ

    View full-size slide

  15. #FIBWJPS&NCFEEJOH4QBDFT
    • άϧʔϓ!"#ʹ͓͍ͯ $%
    , '%
    , (% Λ&NCFEEJOH
    )#%
    = +#
    ($%
    , '%
    , (%
    )
    $%
    '%
    (%
    ී௨ʹ&NCFEEJOH
    ී௨ʹ&NCFEEJOHͯ݁͠߹ʢ \঎඼*% ళ*%^ͳͲෳ਺ଘࡏ͢ΔͷͰʣ
    ΧςΰϦԽͯ͠&NCFEEJOH
    ߦಈൃੜ࣌ͷλΠϜελϯϓ͔ΒϨίϝϯυ࣌఺·ͰͷܦաͷϨϯδ͝ͱʹΧςΰϦʹม׵
    0, 1 , 1,2 , 2,4 , … , [24, 2456)
    0 1 2 7 + 1

    View full-size slide

  16. #FIBWJPS&NCFEEJOH4QBDFT
    !"#
    = %&'"
    (#
    + *((+!,"
    - '!.+%/01%"
    /#
    + *((+!,"
    2(4#
    )
    ࿦จͰ͸Ճࢉ͕ͩ
    ࣮૷Ͱ͸݁߹
    ͜ͷϨΠϠʔͷ࠷ऴతͳग़ྗ
    6 = {!89:
    , !89<
    , … , !89>
    } !89@
    = .(A.4/#
    (!"#
    )
    ֤άϧʔϓͰ!"#ͷϕΫτϧͷTIBQFҟͳΔ
    ಉ͡ಛ௃ྔͷ&NCFEEJOH͸ڞ༗
    ͨͩ࣌ؒ͠ͷ&NCFEEJOH͸ڞ༗͠ͳ͍

    View full-size slide

  17. -BUFOU4FNBOUJD4QBDFT
    • ֤ߦಈΛ,ݸͷજࡏతҙຯۭؒʹ౤Ө
    • ͭ·Γ͸.VMUJ)FBE"UUFOUJPOΛߦ͏
    • Ϣʔβʔͷߦಈ!Λάϧʔϓ͝ͱʹҟͳΔ౤Өؔ਺"#$
    Λ༻͍ͯ
    ݻఆ௕ͷϕΫτϧʹม׵
    • 4ΛͦΕͧΕͷજࡏతҙຯۭؒʹ౤Ө
    % = '()'*+ , ("#.
    /01.
    , "#3
    /013
    , … , "#5
    (/015
    ))
    %7
    = "87
    (%) 5SBOTGPSNFSͷ
    .VMUJ)FBE"UUFOUJPOͷ9:ʹ૬౰

    View full-size slide

  18. -BUFOU4FNBOUJD4QBDFT
    • !"#
    ΍!$%
    ͸࿦จͰ͸୯ҰͷEFOTFMBZFSͰ׆ੑԽؔ਺͕3F-6
    • ֤TIBQFΛ੔ཧ
    &'((
    &)
    *'((
    શߦಈ਺
    *%
    άϧʔϓ+ͷߦಈ਺
    ݻఆ௕ͷϕΫτϧͷ࣍ݩ਺
    ֤જࡏతҙຯۭؒͷ࣍ݩ਺
    *%
    =
    *'((
    -

    View full-size slide

  19. 4FMG"UUFOUJPO-BZFS
    • ,ݸͷ֤જࡏతҙຯۭؒͰߦಈؒͷ4FMG"UUFOUJPO

    View full-size slide

  20. 4FMG"UUFOUJPO-BZFS
    • ࿦จͷهड़Ͱ͸
    !"
    = $%&'()*()(,"
    , ,: /"
    ))
    ۭؒ1ʹ͓͚Δ"UUFOUJPOXFJHIUϕΫτϧͷߦྻ
    ) ,"
    , ,: /"
    = ,"
    2"
    ,3
    ۭؒ1ʹ͓͚Δ"UUFOUJPOϕΫτϧͷߦྻ
    4"
    = !"
    567
    (,)
    ࠷ऴతͳग़ྗ
    4 = 589:;
    (<%=<)' > (4>
    , 4?
    , … , 4"
    ))
    Ͱ΋࣮૷্݁ہ΍ͬͯΔ͜ͱ͸
    567
    , 589:; TJOHMFEFOTFMBZFS
    XJUI3F-6

    View full-size slide

  21. %PXOTUSFBN"QQMJDBUJPO/FUXPSL
    • ͜͜·ͰϢʔβʔߦಈϞσϧ͕׬੒
    • ͜ͷ࿦จͰ͸ϨίϝϯυλεΫΛߟ͑Δ
    ͬͪ͜ଆͷ࿩

    View full-size slide

  22. %PXOTUSFBN"QQMJDBUJPO/FUXPSL
    • Ϩίϝϯυର৅ͷߦಈͱ4FMG"UUFOUJPOޙͷߦಈؒͰ7BOJMMB
    "UUFOUJPO
    • ͭ·ΓϢʔβʔߦಈଆΛΤϯίʔμɺϨίϝϯυର৅ߦಈଆΛ
    σίʔμͱߟ͑ͨ4PVSDF5BSHFU"UUFOUJPO
    Τϯίʔμ σίʔμ

    View full-size slide

  23. %PXOTUSFBN"QQMJDBUJPO/FUXPSL
    • Ϩίϝϯυର৅ߦಈͷ&NCFEEJOHͰ͋Δ!"ʹରͯ͠ɺ͜Ε·
    Ͱͱ΄΅ಉ͡ԋࢉΛߦ͏
    • ݻఆ௕ϕΫτϧ΁ͷม׵ͱ.VMUJ)FBE"UUFOUJPO
    ℎ"
    = %&' "
    (!"
    ) *+
    = %,-
    (ℎ"
    )
    .+
    = */01234 3 *+
    , 6; 8+
    %9-
    (6)
    :;
    " = %<=>?@@=
    (./A.31 B (.B
    , .C
    , … , .+
    ))
    ߦಈάϧʔϓͷΠϯσοΫε΁ͷஔ׵
    %<=>?@@= TJOHMFEFOTFMBZFS
    XJUI3F-6

    View full-size slide

  24. %PXOTUSFBN"QQMJDBUJPO/FUXPSL
    • QPJOUXJTFͷ༧ଌϞσϧͰ͸ߦಈ!͕औΒΕΔ֬཰Λ༧ଌ
    • ଛࣦؔ਺ʹ͸γάϞΠυͷΫϩεΤϯτϩϐʔ
    − #
    $,&
    '$
    ()*+(- ℎ$
    , /&
    $ ) + 1 − '$
    log(1 − +(- ℎ$
    , /&
    $ ))
    - ϥϯΩϯάؔ਺ʢ࿦จͰ͸୯७ͳ಺ੵʣ

    View full-size slide

  25. %BUBTFU
    • "NB[PO%BUBTFU
    • Ϣʔβʔͷ঎඼ʹର͢ΔϨϏϡʔσʔλ
    • ߦಈͷάϧʔϓ͸͚ͭͩʢ঎඼άϧʔϓʣ
    • ಛ௃ྔ͸Ϣʔβʔ*%ɺ঎඼*%ɺΧςΰϦ*%ɺλΠϜελϯϓ
    • Ϣʔβͷߦಈ("#
    , "%
    , … , "'
    )͕͋Δͱֶͯ͠शɾςετσʔλ͸ҎԼ
    ("#
    ) "%
    ("#
    , "%
    ) ")
    ("#
    , "%
    , … , "'*%
    ) "'*#

    *OQVU QSFEJDU
    ֶश ςετ
    ("#
    , "%
    , … , "'*#
    ) "'
    *OQVU QSFEJDU
    ˞OFHBUJWFTBNQMF͸
    QPTJUJWFTBNQMFҎ֎ͷ঎඼ΛϥϯμϜͰબ୒

    View full-size slide

  26. %BUBTFU
    • 5BPCBP%BUBTFU
    • "MJCBCB͕ӡӦ͢Δ&$αΠτͷϩά
    • ߦಈͷάϧʔϓ͸ͭʢ঎඼ɺݕࡧɺΫʔϙϯडཧʣ
    • ঎඼άϧʔϓ
    • ঎඼*%ɺళ*%ɺϒϥϯυ*%ɺΧςΰϦ*%ɺλΠϜελϯϓ
    • ߦಈλΠϓ͸ӾཡɺϚʔΫɺߪೖ
    • ݕࡧάϧʔϓ
    • ݕࡧτʔΫϯɺλΠϜελϯϓ
    • ߦಈλΠϓ͸ͭ
    • Ϋʔϙϯडཧάϧʔϓ
    • Ϋʔϙϯ*%ɺళ*%ɺΫʔϙϯλΠϓɺλΠϜελϯϓ
    • ߦಈλΠϓ͸ͭ

    View full-size slide

  27. $PNQFUJUPST)ZQFSQBSBNFUFST
    • $PNQFUJUPST
    • #13.'#BZFTJBO1FSTPOBMJ[FE3BOLJOH
    • #J-45.
    • #J-45."UUFOUJPO
    • $//1PPMJOH
    • )ZQFSQBSBNFUFST
    • શͯͷ&NCFEEJOHͷ࣍ݩ਺
    • શͯͷӅΕ૚ͷ࣍ݩ਺
    • જࡏతҙຯۭؒͷۭؒ਺ʢ.VMUJ)FBEͷIFBE਺ʣ
    • όοναΠζ
    • ਖ਼ଇԽ܎਺Fͷ-ϊϧϜ
    • 0QUJNJ[FS4(%ɺֶश཰Λ͔Β࢝ΊͯͰEFDBZ

    View full-size slide

  28. &WBMVBUJPO.FUSJDT
    • BWFSBHFVTFS"6$
    !"# =
    1
    "&'()
    *
    +∈-./01
    1
    2+
    3 2+
    4
    *
    5∈67
    8
    *
    5∈67
    9
    :(<+,5
    > <+,?
    )

    View full-size slide

  29. 3FTVMUTPO4JOHMFUZQF#FIBWJPS%BUBTFU
    • "NB[PO%BUBTFU
    "6$͸"53BOL͕࠷ྑ
    ࣌ؒͷΧςΰϦ͝ͱͷ7BOJMMB"UUFOUJPOXFJHIUͷฏۉ஋
    ͕࣌ؒܦա͢ΔʹͭΕXFJHIU͕খ͘͞
    3//$//ͷ୅༻͕ग़དྷ͍ͯΔ
    "53BOLֶ͕श͕ૣ͘ऩଋ

    View full-size slide

  30. 3FTVMUTPO.VMUJUZQF#FIBWJPS%BUBTFU
    • 5BPCBP%BUBTFU
    "53BOL͕ྑ͍͕ɺதͰ΋શͯͷߦಈάϧʔϓΛ༻͍ͯ
    ߦಈϞσϦϯάΛߦͬͨϞσϧ "53BOLBMMPOF
    ͕࠷ྑ

    View full-size slide

  31. $BTF4UVEZ
    • 4FMG"UUFOUJPOͱ7BOJMMB"UUFOUJPOͷޮՌΛ֬ೝ
    ߦಈ
    Ϩίϝϯυ
    ର৅

    View full-size slide

  32. $BTF4UVEZ
    • 4FMG"UUFOUJPOͷޮՌ
    ಛఆͷྻʢ7BMVFʣ͕ߴ͍XFJHIU
    ๅੴಉ࢜Ͱਖ਼ํܗΛܗ੒ɺ͓ͦΒ͘ΧςΰϦͷྨࣅੑΛݟ͍ͯΔ

    View full-size slide

  33. $BTF4UVEZ
    • 7BOJMMB"UUFOUJPOͷޮՌ
    ؔ܎͋Γͦ͏ͳߦಈͷΈڧௐ
    શͯͷߦಈͰฏۉత

    View full-size slide