Upgrade to Pro — share decks privately, control downloads, hide ads and more …

WWW2020 online報告会

WWW2020 online報告会

https://connpass.com/event/174856/

- Edge Formation In Social Networks To Nurture Content Creators
- OutfitNet: Fashion Outfit Recommendation with Attention-Based Multiple Instance Learning

Sekine Hiroto

April 30, 2020
Tweet

More Decks by Sekine Hiroto

Other Decks in Science

Transcript

  1. CONFIDENTIAL
    ©2020 Wantedly, Inc.
    WWW 2020 ΦϯϥΠϯൃදձ
    April 30, 2020 - ؔࠜ ༟ਓ

    View Slide

  2. CONFIDENTIAL
    ©2020 Wantedly, Inc.
    ࣗݾ঺հ
    ؔࠜ༟ਓ
    ɾ೥݄ʹ৽ଔೖࣾ
    ɾ8BOUFEMZ1FPQMFͷ%BUB$IBQUFSͱͯ͠+PJO
    ɾࣗવݴޠॲཧɺಛʹ-45.ʹΑΔݻ༗දݱநग़Λݚڀ

    View Slide

  3. CONFIDENTIAL
    ©2020 Wantedly, Inc.
    1. Edge Formation In Social Networks To Nurture Content Creators
    2. OutfitNet: Fashion Outfit Recommendation with
    3. Graph Enhanced Representation Learning for News Recommendation
    ໨࣍

    View Slide

  4. CONFIDENTIAL
    ©2020 Wantedly, Inc.
    &EHF'PSNBUJPO*O4PDJBM/FUXPSLT
    5P/VSUVSF$POUFOU$SFBUPST

    View Slide

  5. CONFIDENTIAL
    ©2020 Wantedly, Inc.
    Creatorʹରͯ͠ϦΞΫγϣϯΛ͘Εͦ͏ͳਓʹର্͠ҐʹϥϯΩϯάͯ͠ϨίϝϯσʔγϣϯΛߦ͏͜ͱͰɺ
    ΫϦΤΠλʔ͕ΑΓcontentsΛੜΈग़ͯ͘͠ΕΔ؀ڥΛ࡞Δɻ
    → linkedinαʔϏεʹͱͬͯॏཁ
    ຊ࿦จWWW2020ൃදࢿྉ͔ΒҾ༻
    ͲΜͳ࿦จ

    View Slide

  6. CONFIDENTIAL
    ©2020 Wantedly, Inc.
    ɾScoreؔ਺ΛCreatorͱConsumerʹ෼͚ͯఆٛ
    - Feedback Sensitivity
    - pResponse
    ɾCreatorͱConsumerʹ෼͚ͨ৔߹ͷΦϯϥΠϯA/B ςετͷ࣮ࢪํ๏
    ɾ৽ͨͳScoreؔ਺ʹΑΔCreator/Consumer΁ͷӨڹ
    ߩݙ

    View Slide

  7. CONFIDENTIAL
    ©2020 Wantedly, Inc.
    4DPSJOHํ๏
    Scoreu,e
    ͕େ͖͍ͱuserʹentity͕ਪન͞ΕΔɻ
    user͕entityʹରͯ͠ߦ͏
    like, share, comments, clickͷಛ௃ྔ

    View Slide

  8. CONFIDENTIAL
    ©2020 Wantedly, Inc.
    Q3FTQPOTF
    pResponseu,e
    ɾConsumer u͕Creator e΁FeedbackΛى֬͜͢཰
    ɾConsumerͱCreator͢΂ͯͷಛ௃ྔΛೖΕΔɻ
    Logistic regression modelͰֶश
    ɾlike΍comment͕༩͑ΒΕͨΒpositiveϥϕϧͱ͢Δɻ

    View Slide

  9. CONFIDENTIAL
    ©2020 Wantedly, Inc.
    'FFECBDL4FOTJUJWJUZ
    FeedBackΛड͚Δ਺͕ଟ͍΄ͲɺCreationΛߦ͏֬཰্͕͕Δɻ
    → FeedBackΛड͚ͨΒCreation͕৳ͼΔਓΛਪનͤ͞΍͘͢͢Δɻ
    ؍ଌҎ߱ʹҰͭͰ΋
    Creation͔ͨ͠ʁ

    View Slide

  10. CONFIDENTIAL
    ©2020 Wantedly, Inc.
    ࣮ݧσʔλ
    LinkedinͷϦΞϧσʔλΛ༻͍ͯonline A/BςετΛ࣮ࢪ (Follow Recommendation)
    Dual A/Bςετ
    ɾConsumerͱCreatorͷೋͭʹର͠ɺTreatmentͱControlΛ෼͚Δ
    ɾTeͱCeɺTuͱCuΛͦΕͧΕଌΔ͜ͱͰɺTradeoffͷؔ܎Λௐ΂Δ

    View Slide

  11. CONFIDENTIAL
    ©2020 Wantedly, Inc.
    $BOOJCBMJ[BUJPOFGGFDU
    Creatorʹ͓͍ͯɺTreatment܈(Value_creatorΛ଍ͨ͠΋ͷ)ͱControl(ͦΕҎ֎)܈Ͱ͸
    Treatmentͷํ͕ਪન͞Ε΍͘͢ͳͬͯ͠·͏ɻ

    View Slide

  12. CONFIDENTIAL
    ©2020 Wantedly, Inc.
    ݁Ռ
    ɾFollowerʹରͯ͠͸ɺFollowΫϦοΫ਺΍ίϯςϯπ΁ͷinteraction͕ݮͬͯ͠·ͬͨɻ
    ɾContribute(share΍like, comment, messageͳͲ)Λߦ͏΋ͷ͕1.13%૿͑ͨɻ
    ɾMonthly Contributions͸9%૿Ճͨ͠ɻ
    ɾContributor͕૿͑ɺContents͕૿͑Δ͜ͱ͸Linkedinʹͱͬͯخ͍͜͠ͱͩɻ

    View Slide

  13. CONFIDENTIAL
    ©2020 Wantedly, Inc.
    ٙ໰ɾײ૝
    ɾDual A/Bςετͷͱ͜ΖͰɺProducerͱViewerͷ෼͚ํ͕෼͔Βͳ͔ͬͨ
    - ͦ΋ͦ΋෼͚͍ͯΔͷ͔ʁ
    ɾFollowerͷFollow཰͕4%ۙ͘ݮͬͯ͠·͍ͬͯΔͷ͸େม?
    ɾOnline A/BςετΛͨ݁͠Ռɺ͔ͬ͠ΓͱContribution਺͕૿͍͑ͯΔͷ͸ૉ੖Β͍͠ɻ

    View Slide

  14. CONFIDENTIAL
    ©2020 Wantedly, Inc.
    0VUGJU/FU
    'BTIJPO0VUGJU3FDPNNFOEBUJPOXJUI
    "UUFOUJPO#BTFE.VMUJQMF*OTUBODF-FBSOJOH

    View Slide

  15. CONFIDENTIAL
    ©2020 Wantedly, Inc.
    ͲΜͳ࿦จ
    Fashion Recommendationʹ͓͍ͯΞΠςϜ୯ମͰਪનͯ͋͛͠ΔͷͰ͸ͳ͘ɺ
    Outfit(ίʔσΟωʔτ?)ͷ޷ΈΛֶश͠ɺͦͷ޷Έʹ͋ͬͨOutiftΛਪન͍ͨ͠ɻ
    1. OutfitΛ΋ͱʹΞΠςϜͷrelevancyΛֶशͤ͞Δ࢓૊Έ
    2. Ϣʔβʔͷ޷Έʹ͋ͬͨFashion outfitΛਪન
    Multiple instance learning (MIL)ͱͯ͠ղ͘ɻ
    ɾෳ਺ͷΞΠςϜʹରͯ͠Ұͭͷϥϕϧ͕͍͍ͭͯΔ໰୊
    ɾͲͷΞΠςϜ͕like/dislike͸ߟྀ͠ͳ͍

    View Slide

  16. CONFIDENTIAL
    ©2020 Wantedly, Inc.
    'BTIJPO*UFN3FMFWBODZOFUXPSL '*3

    ϑΝογϣϯΞΠςϜؒͷؔ܎ੑͷຒΊࠐΈֶश
    S: outfitͷsubset
    x: itemͷrepresentation
    ɾ xi (positive) : S + {x}ؚ͕·ΕΔoutfit͕ଘࡏ͢Δ
    ɾ xj (negative) : S + {x}ؚ͕·ΕΔoutfit͕ଘࡏ͠ͳ͍
    ಉ͡outfitʹೖΓͦ͏ͳΞΠςϜಉ࢜ͷڑ཭͕
    ۙ͘ͳΔΑ͏ʹֶश
    [email protected]ͱ4ͷSFMFWBODZTDPSF

    View Slide

  17. CONFIDENTIAL
    ©2020 Wantedly, Inc.
    'BTIJPO*UFN3FMFWBODZOFUXPSL '*3

    ΞΠςϜͷrepresentationͷt-SNEʹΑΔՄࢹԽ
    ɾFIR: ಉ͡ܥ౷(taste)ͷΞΠςϜ͕
    ɹɹɹۙ͘ʹ഑ஔ͞ΕΔΑ͏ʹݟ͑Δɻ
    ɾDenseNet: Visual΍γϧΤοτʹґଘͯ͠
    ɹɹɹΞΠςϜ͕഑ஔ͞Ε͍ͯΔɻ

    View Slide

  18. CONFIDENTIAL
    ©2020 Wantedly, Inc.
    0VUGJU1SFGFSFODFOFUXPSL 01

    Ϣʔβʔͷoutfit΁ͷڵຯΛଌΔωοτϫʔΫ
    '*3
    &NCFEEJOH
    "UUFOUJPOΛ༻͍ͯQPPMJOH

    View Slide

  19. CONFIDENTIAL
    ©2020 Wantedly, Inc.
    1FSTPOBMJ[FE0VUGJU4DPSJOH
    Personalized Outfit ScoringͰ͸poolingͷࡍʹAttentionΛߦ͍ͬͯΔɻ
    VTFSͷSFQSFTFOUBUJPO
    GVTFE VTFSͱ
    JUFNΛ݁߹ͨ͠΋ͷ

    ͷSFQSFTFOUBUJPO

    View Slide

  20. CONFIDENTIAL
    ©2020 Wantedly, Inc.
    "UUFOUJPOͷޮՌ
    Outfit 1Ͱ͸πͷ஋͸૯ͯ͡େ͖͍͕ɺOutfit 2, 3Ͱ͸খ͍͞ɻ
    Outfit 3ͷηʔλʔ͸πͷ஋͕େ͖͘ͳ͍ͬͯͯɺͦΕʹ൐ͬͯuser͕޲͚ΔAttention΋େ͖͘ͳ͍ͬͯΔɻ
    → ηʔλʔͷ৭ຯͱOutfit 1ͷ৭ຯ͕ࣅ͍ͯΔ͔Βೲಘ
    Outfit 1ͷΈUserͷ޷ΈͳOutfit

    View Slide

  21. CONFIDENTIAL
    ©2020 Wantedly, Inc.
    'JMM*O5IF#MBOL '*5#
    λεΫ
    ͋ΔOutfitʹର͠ҰͭMaskΛ͠ɺϥϯμϜʹ3͖ͭ࣋ͬͯͯ4୒Λߦ͏ͱ͍͏λεΫɻ
    ɾFIRʹରͯ͠ͷλεΫ

    View Slide

  22. CONFIDENTIAL
    ©2020 Wantedly, Inc.
    1FSTPOBMJ[FE0VUGJU1SFEJDUJPO
    Outfit iͱOutfit jʹରͯ͠ɺͲͪΒͷOutfit͕޷Έ͔Λ֤Ϣʔβʔʹରͯ͠ٻΊ͍ͯ͘ɻ

    View Slide

  23. CONFIDENTIAL
    ©2020 Wantedly, Inc.
    σʔληοτʹର͢Δิ଍
    ຊ࿦จWWW2020ൃදࢿྉ͔ΒҾ༻

    View Slide

  24. CONFIDENTIAL
    ©2020 Wantedly, Inc.
    ·ͱΊɾײ૝
    • FIRʹΑͬͯΞΠςϜಉ࢜ͷؔ࿈ੑΛֶश͢Δ͜ͱ͕Ͱ͖ͨɻ
    • OPʹΑͬͯoutfit಺ͷΞΠςϜΛߟֶྀͯ͠श͢ΔϑϨʔϜϫʔΫΛ࡞Εͨɻ
    • FIRͱOPʹΑͬͯ fill-in-the-blank(FITB)taskͰ SOTAΛ֫ಘͰ͖ͨɻ
    • AttentionΛར༻ͯ͠Ϣʔβʔʹpersonalized͞ΕͨfashionΛ֫ಘͰ͖ͨɻ

    View Slide