Share
Embed
Transcript
49 slides
-
Sequence-aware vs session-aware vs session-based session session session session session
session 2021/11/2 2021/11/6 session-based sequence-aware ੲͷηογϣϯͷใ༻͍ͯߦಈ༧ଌΛߦ͏߹Λɼsession-awareɼಉҰsessionͷใͷΈΛ༻͍ͯߦಈ༧ଌΛߦ͏ ߹Λɼsession-basedͱݺͿɽ·ͨɼҰൠʹsessionΛΒͣաڈͷߦಈ͔Β༧ଌΛߦ͏߹Λɼsequence-awareͱݺͿɽ session-aware [Ludwelg 2020] user 1 -
ຊษڧձͰΔ͜ͱ Session-awareͳϢʔβߦಈ༧ଌʹؔ͢Δݚڀͷ֓ཁͷհ աڈͷϢʔβߦಈΛͲ͏͏͔ ֘Ϣʔβͷۙͷηογϣϯใ ֘Ϣʔβͷ͜Ε·ͰͷશͯͷཤྺΛूܭͨ͠ใ ಛྔΤϯδχΞϦϯά SIGIR eCom 21 Data
Challengeʹ͓͚Δσʔλͷѻ͍ͷհ Session-basedͳϢʔβʔߦಈ༧ଌʹؔ͢Δίϯϖ ͦͷଞsession-basedͳ༧ଌʹ͍ͭͯͷݚڀྫͷհ ಛʹσʔλͷલॲཧ༻͍ͯ͠Δಛྔʹ͠ͳ͕Βɼ͜ΕΒʹ͍ͭͯઆ໌ -
ಛྔͷྨ ߦಈಛྔ Ϣʔβʔಛྔ ಛྔ ߦಈಛྔ ʢintra-sessionʣ ߦಈಛྔ ʢinter-sessionʣ Ϣʔβʔߦಈ༧ଌͷಛྔʮߦಈಛྔʯʮϢʔβʔಛྔʯʮΞΠςϜಛྔʯʹେผ͞ΕΔ ຊௐࠪͰಛʹͲͷΑ͏ͳߦಈಛྔ͕༻͍ΒΕ͍ͯΔͷ͔ʹͯ͠ௐࠪ
ΞΠςϜಛྔ ੑผɼྸɼɾɾ ໊ɼஈɼɾɾ ΫϦοΫɼɾɾ աڈͷ๚ɼɾɾ -
࣍ 1. Session-aware recommendationͷ֓ཁ 2. Session-based/aware recommendationͷ༧ଌͰॏཁͳಛྔʹ͍ͭͯͷௐࠪ • SIGIR eCom
21 Data Challenge • جຊߦಈಛྔͱಛྔબ • ͍͔ͭ͘ͷྫ • Struggling search • Information Seeking Conversation • Churn Prediction • ͦͷଞ 3. ·ͱΊ -
࣍ 1. Session-aware recommendationͷ֓ཁ 2. Session-based/aware recommendationͷ༧ଌͰॏཁͳಛྔʹ͍ͭͯͷௐࠪ • SIGIR eCom
21 Data Challenge • جຊߦಈಛྔͱಛྔબ • ͍͔ͭ͘ͷྫ • Struggling search • Information Seeking Conversation • Churn Prediction • ͦͷଞ 3. ·ͱΊ -
Session-awareͳਪનϞσϧͷྨͱಈɹ [Wang+ 2021] [Fang+ 2020] Session-based/aware recommendation Sequence-aware neural recommendation
[Wang+ 2021] ౷తʹkۙ๏Ϛϧίϑ࿈ͳͲ͕༻͍ΒΕ͖͕ͯͨɼݚڀʹ͓͍ͯۙχϡʔϥϧωο τϫʔΫΛ༻͍ͨͷ͕૿Ճ Session-based/aware recommendation -
ਪનΞϧΰϦζϜͷϦϙδτϦ/ϥΠϒϥϦ ۙͷਪનΞϧΰϦζϜ͕͙͢ʹ͑ΔϥΠϒϥϦ͕͋ΔͷͰɼ͜ͷลͰ৭ʑࢼͯ͠ΈΔͱָ͍͔͠͠Εͳ͍ RecBole Sequential recommendationؚΉ࣮ʹ70༨ΓͷϞσϧͱ28ͷσʔληοτ͕༻ՄೳͳϥΠϒϥϦ SASRecGRU4Recͱ͍ͬͨϞσϧ͔ΒBERT4Rec·Ͱ https://github.com/RUCAIBox/RecBole Recommenders Microsoft͕ఏڙ͢ΔύοέʔδͰ30લޙͷϞσϧ͕༻Մೳɽݹయతͳख๏͕ଟΊ https://github.com/microsoft/recommenders
Session-rec Session-awareͳख๏ؚΊͨ25ͷϞσϧ͕༻ՄೳͳϦϙδτϦ https://github.com/rn5l/session-rec Tutorial on Sequence-Aware Recommender Systems RecSys 2018ͰߦͳΘΕͨsequence-awareͳhands-on͕·ͱΊΒΕͨϦϙδτϦ https://github.com/mquad/sars_tutorial -
Session-aware RecommendationͰॏཁͳཁૉʢ1/3ʣ [Fang+ 2020] [Fang+ 2020] Fang+ 2020ɼෳͷsequential recommendationͷݚڀΛൺֱͨ݁͠Ռɼӈͷ දͷཁૉ͕ॏཁͰ͋ΔͱΘ͔ͬͨͱओு
͜ΕͦΕͧΕԼਤͷsequential recommendationͷֶशͷϑϩʔʹରԠ -
Input Side Information ಛྔɿͷΧςΰϦʔɼࣸਅɼઆ໌ͳͲ σʔλͷগͳ͞cold-startʹΑΔੑೳͷྼԽΛ؇ [Wang+ 2016] [Zhang+ 2019] etc
ߦಈಛྔɿdwell timeͳͲ Dwell timeͷՃGRU4RecͷੑೳΛେ෯ʹվળ [Hidasi+ 2016] Behavior Type click, purchase, collectͳͲ ϢʔβʔͷظͷᅂੑΛΑ͘ଊ͑Δͷߪങߦಈ͕ͩͦͷଞͷߦಈಛظͷᅂੑΛଊ͑Δͷʹཱͭ [Gao+ 2019] etc Repeated Consumption Ϣʔβʔͷ܁Γฦ͠ͷߪങߦಈΛߟྀͨ͠΄͏͕༧ଌʹΑ͍ [Ren+ 2019] recencyʢ࠷ऴߪങ͔Βͷ࣌ؒʣ͕repeated consumptionͷ༧ଌʹͱͬͯॏཁ [Anderson+ 2014] loyaltyΛද͢ಛྔΛՃ͢Δ͜ͱͰ༧ଌੑೳ্͕ [Wan+ 2018] RNN͕kNNʹਪનλεΫͰෛ͚Δͷɼrepeated consumptionΛ͏·͘ϞσϦϯάͰ͖ͳ͍͔Βʁ[Hu+ 2020] Session-aware RecommendationͰॏཁͳཁૉʢ2/3ʣ [Fang+ 2020] -
Data processing Embedding Design sessionͷຒΊࠐΈΛࣄલֶश͢ΔͳͲʢsession information embeddingʣ[Wu+ 2017] Data Augmentation
NݸͷΠϕϯτ͔ΒͳΔηογϣϯ͔Βk(1~N)൪·ͰͷΠϕϯτ͔ΒͳΔNݸͷηογϣϯΛ࡞ [Tan+ 2016] Model Structure Incorporating Attention Mechanisms AttentionϞσϧطଘϞσϧͷੑೳΛେ෯ʹ྇կ [Li+ 2017] [Kang+ 2018] [Zhang+ 2019] Adding Explicit User Representation User embedded models ϢʔβʔใͷຒΊࠐΈΛՃ͑Δ͜ͱͰੑೳ্͕ [Tang+ 2018] ͨͩ͠୯ͳΔϢʔβʔใͷ׆༻͚ͩͰcold-startͷɼϢʔβʔͷؔ৺ͷมԽͷରԠͷ͕ൃੜ User recurrent models ϢʔβʔใΛ࣌ܥྻతʹϞσϧԽ͢Δ͜ͱͰGRU4RecΛ3.5%վળ [Quadrana+ 2018] Session-aware RecommendationͰॏཁͳཁૉʢ3/3ʣ [Fang+ 2020] -
Session Length Long sessionsʢ10 ~ʣɿҰ൪ใྔ͕ଟ͍͕ͦͷϊΠζଟ͘ɼΠϕϯτؒͷؔෳࡶ Medium sessionsʢ4 ~ 9ʣɿ࠷ଟ͍έʔεͰɼ͍͔ʹͯ͠ΑΓ๛͔ͳจ຺Λ׆༻Ͱ͖Δ͔͕େࣄ User
Information Non-anonymous sessionsɿϢʔβʔͷաڈͷใΛར׆༻Ͱ͖ΔͷͰɼ͍͔ʹظͷᅂੑΛଊ͑Δ͔͕՝ Anonymous sessionsɿݱࡏηογϣϯͷใ͚͔ͩΒɼ͍͔ʹᅂੑΛଊ͑Δ͔͕՝ Session-data Structure Single-level session dataɿิॿใͷͳ͍anonymous sessionsͷ͜ͱͰɼcold-startdata sparsityͷͷରॲ͕՝ Multi-level session dataɿ Adding Explicit User Representation User embedded models ϢʔβʔใͷຒΊࠐΈΛՃ͑Δ͜ͱͰੑೳ্͕ [Tang+ 2018] ͨͩ͠୯ͳΔϢʔβʔใͷ׆༻͚ͩͰcold-startͷɼϢʔβʔͷؔ৺ͷมԽͷରԠͷ͕ൃੜ User recurrent models ϢʔβʔใΛ࣌ܥྻతʹϞσϧԽ͢Δ͜ͱͰGRU4RecΛ3.5%վળ [Quadrana+ 2018] Session-aware/based Recommendationʹ͓͚Δ՝ [Fang+ 2020] -
Session-aware recommendationͷݱঢ় session-awareͷݚڀࣗମ͕·ͩᴈ໌ظ session-awareͷݚڀ·ͩগͳ͘ɼͦͷେ͕2014Ҏ߱ʹ ग़൛͞ΕͨͷʢACM Digital Libraryʣ[Quadrana+ 2018] աڈͷཤྺ͕͍΄Ͳੑೳ্ʢw/๛ͳσʔλʣ [Pi+
2019] AUC 0.02ͷվળ͕අ༻ʹݟ߹͏͔ཁݕ౼ ~ 1000ͷܥྻ͕༻͍ΒΕΔ latencyͱstorage cost͕Ϣʔβʔߦಈܥྻͷ͞ʹґଘͯ͠ઢ ܗʹ૿Ճ [Pi+ 2019] աڈ50ͷϢʔβʔߦಈΛอ࣋ [Zhout+ 2018] աڈ100/200/1000ͷϢʔβʔߦಈΛอ࣋ [Pi+ 2019] Session-basedݹయతख๏ʹྼޙ͢Δ͜ͱ͕͋Δ [Dacrema+ 2019] [Latifi+ 2020] Session-awareΑΓ๛͔ͳใΛ༻͍ΔͷͰ࠷దԽ͕͍͠ ༧ଌରʹ࣌ؒతʹۙ͢Δߦಈ͕Ұ൪ॏཁ [Chen+ 2019] [Quadrana+ 2018] [Pi+ 2019] [Zhout+ 2018] [Pi+ 2019] -
session-aware vs session-based session session session session session session 2021/11/2
2021/11/6 session-based ΄ͱΜͲͷ߹session-awareಛྔͷҙຯͰsession-basedͱมΘΒͳ͍ ͲͪΒsession͕ೖྗͳͷมΘΒͣɼͦͷͦΕΛѻ͏ΞϧΰϦζϜ͕ҧ͏͚ͩͳͨΊ →ɹsession-based/awareʹؔΘΒͣ༧ଌʹॏཁͦ͏ͳಛྔΛௐࠪ͢Δ session-aware [Ludwelg 2020] user 1 -
࣍ 1. Session-aware recommendationͷ֓ཁ 2. Session-based/aware recommendationͷ༧ଌͰॏཁͳಛྔʹ͍ͭͯͷௐࠪ • SIGIR eCom
21 Data Challenge • جຊߦಈಛྔͱಛྔબ • ͍͔ͭ͘ͷྫ • Struggling search • Information Seeking Conversation • Churn Prediction • ͦͷଞ 3. ·ͱΊ -
SIGIR eCom 21 Data Challenge SIGIR eCom 21 ͰCoveoʹΑͬͯ։࠵͞Εͨίϯϖ 1ͭͷηογϣϯͷใ͔ΒϢʔβʔߦಈΛ༧ଌ͢Δ
ࢀՃऀҎԼͷ2ͭͷλεΫʹऔΓΉ ਪનλεΫʢsession-based recommendationʣ ॳΊͷkݸͷΠϕϯτ͔ΒಉηογϣϯͰͷΛΊ͙ΔߦಈΛ༧ଌ ҙਤ༧ଌλεΫʢcart-abandonment predictionʣ Χʔτʹ͕ೖΕΒΕͨޙɼಉηογϣϯͰ͕ߪೖ͞Ε͔ͨΛ༧ଌ -
σʔληοτ 36MΠϕϯτΛؚΉσʔλͰҎԼͷ3ͭͷcsvϑΝΠϧ͔ΒͳΔ browsing_train.csv ϖʔδͰͷϢʔβʔΠϕϯτͷϩάͱඇϖʔδʢFAQͱ͔ʣͰͷӾཡߦಈ Ӿཡ͔Πϕϯτ͔ɼΧʔτՃ͔ߪೖ͔ͷৄࡉΛݟΔ͔ͳͲ search_train.csv ηογϣϯʹؔΘΔݕࡧΠϕϯτ ݕࡧ୯ޠͷΫΤϦϕΫτϧɼݕࡧ݁ՌͷͷϦετɼΫϦοΫ͞ΕͨͳͲ sku_to_content.csv ͷϝλσʔλใ
Ձ֨ɼΧςΰϦʔɼը૾ͱͷઆ໌จΛදݱ͢ΔϕΫτϧͳͲ ৄࡉϦϙδτϦΛࢀর https://github.com/coveooss/SIGIR-ecom-data-challenge -
Accepted papers 1 . Transformers with Multi-modal Features and Post-fusion
Context for E-commerce Session- based Recommendation [Gabriel Moreira, Sara Rabhi, Ronay Ak, Md Yasin Kabir and Even Oldridge] Transformer-XLͱXLNetͷΞϯαϯϒϧ 2 . Comparison of Transformer-Based Sequential Product Recommendation Models for the Coveo Data Challenge [Elisabeth Fischer, Daniel Zoller and Andreas Hotho] SASRecɼBERT4RecɼKeBERT4RecͷΈ߹Θͤ 3 . Utilizing Graph Neural Network to Predict Next Items in Large-sized Session-based Recommendation Industry Data [Tianqi Wang, Zhongfen Deng, Houwei Chou, Lei Chen and Wei-Te Chen] KNN, s-KNN, SASRec, DynamicRec, SRGNNΛ༻ 4 . Session-based Recommender System Using an Ensemble of Multiple NN Models with LSTM and Matrix Factorization [Yoshihiro Sakatani] LSTMͱߦྻղ 5 . Adversarial Validation to Select Validation Data for Evaluating Performance in E-commerce Purchase Intent Prediction [Shotaro Ishihara, Shuhei Goda and Hidehisa Arai] GBDT, NN, ϧʔϧϕʔεͷΞϯαϯϒϧ 6 . A Session-aware DeepWalk Model for Session-based Recommendation [Kaiyuan Li, Pengfei Wang and Long Xia] page-viewͱproduct interactionͦΕͧΕͰάϥϑΛ࡞ͬͯDeepWalkΛ༻ͯ͠ϊʔυຒΊࠐΈΛͯ͠ɼGRU -
ใ͕গͳ͍σʔλͷѻ͍ ग़ݱස/interaction͕গͳ͍ͷѻ͍ [1] Interaction͕5ճҎԼͷΛಉ͡IDͱͯ͠·ͱΊΔ [2] Ұ͔͠interaction͕ͳ͍ΞΠςϜΛআڈ [4] ग़ݱස͕8ճҎԼͷsingle eventͱͯ͠·ͱΊΔ page-viewͷΈͷURLͷѻ͍
[1] page-viewͷURLΛԾతͳͱͯ͠ѻ͏ ɹʢඇϖʔδӾཡʢ70%ʣӾཡʢ28%ʣݕࡧΫϦοΫ( 2%)ΑΓଟ͍ʣ [3] ͱͷinteractionͷͳ͍page-viewΠϕϯτͷআڈ ใ͕গͳ͍sessionͷѻ͍ [2] Ұ͔͠interaction͕ͳ͍sessionΛআڈ [3] Ұͭͷؚ͔͠ΜͰ͍ͳ͍sessionΛςετηοτ͔Βআڈ ॏෳ͢ΔΠϕϯτͷѻ͍ [1] ͱͷ࠷ॳͷinteractionͷΠϕϯτ͚ͩΛ͢ʢશମͷ13%͕ॏෳʣ [4] ಉҰηογϣϯͰಉURLʹରͯ͠ى͖Δpage-viewΛআ [6] ॏෳͨ͠Ϣʔβʔinteraction࠷ޙͷ͚ͩ͢ -
ಛྔ [1] όέοτՁ֨ΛʢαϒʣΧςΰϦͷฏۉͰׂͬͨྔ ಛఆͷinteractionͷɼಛఆͷͷৄࡉΛݟ͔ͨɼಛఆͷΛΧʔτʹೖΕ͔ͨΛಛྔͱͯ͠Ճ [4] hashed product IDͷɼhashed categoriesɼ֤ηογϣϯͷ࠷ॳͷɼ࠷ॳͷͷΧςΰϦɼϝλσʔλͷ༗ແ Χϯτಛྔ
[4] Πϕϯτͷྦྷੵɼ֤ΠϕϯτؒͱΠϕϯτޙͷϖʔδϏϡʔͱݕࡧΠϕϯτͷճಛྔͱͯ͠༻ ࣌ؒಛྔ [1] ͕ॳΊͯݟΒΕ͔ͯΒͷ࣌ؒɽϩάʢʣɼ࣌ؒɼ༵ [4] िɼɼ࣌ؒͱɼि͔൱͔Λಛྔͱͯ͠༻ ͦͷଞಛྔ [1] ݕࡧςʔϒϧͰར༻ՄೳͳݕࡧΫϦοΫΠϕϯτΠϕϯτʹՃ ΠϕϯτλΠϓɼʢαϒʣΧςΰϦɼόέοτՁ֨ɼIDΛྡIDͷͱͯ͠·ͱΊΔ browsing interaction, search query information, categorical meta dataΛͻͱͭͷΠϕϯτͱͯ͠·ͱΊΔ [4] Πϕϯτͷ͞ಛྔͱͯ͠༻ ৽نಛྔͷ࡞ -
͋Δ༗໊ͳECαΠτͷ2018ͷ2ϲ݄ͷϒϥδϯάσʔλ͔Β৽͍͠σʔληοτΛ࡞ʢData Challengeͷσʔληοτʣ ϢʔβʔߦಈΛpage view, detail ,add, remove, purchase, clickͷ6ͭʹྨ ʮߪೖʯؚ͕·Ε͍ͯΔܥྻɼͦͷલ·Ͱͷ෦ܥྻͷΈΛ༻
͜ͷσʔληοτͰϢʔβʔ͕Λߪೖ͔ͨ͠൱͔Λ༧ଌ͠ɼ͔ͳΓجຊతͳಛྔ͚ͩͰ͋Δఔ༧ଌՄೳͰ͋Δ͜ͱΛओு લॲཧͳͲ 5 clickҎ্155 clickҎԼͷσʔλͷΈ༻ ʮߪೖʯ͕͓͜Δܥྻͱى͜Βͳ͍ܥྻͷ͕ۉߧ͕औΕΔΑ͏ʹαϯϓϦϯά ಛྔΛ࡞ͯ͠XGBoostͰ༧ଌ͢Δ߹ʢhand-craft feature engineeringʣͱneural networkͰ༧ଌ͢Δ߹ʢneural networkʣͦΕͧΕݕ౼ʢຊൃදͰޙऀͷΈઆ໌ʣ Shopper Intent Prediction from Clickstream E-commerce Data with Minimal Browsing Information [Requena+ SciRepo 2020] (Coveo) -
hand-craft feature engineering k-gram ϢʔβʔߦಈΛฒͨͷͷk-gram ྫɿ2-gramʮ34ʯʮ12ʯ K-gram୯ମ͚͔ͩΒϢʔβʔߦಈΛ༧ଌ͢Δͷͦ͠͏ horizontal visibility graph
motifs (HVGM) ϊʔυΛҰྻʹฒͨແάϥϑͰɼk-gramΑΓߴ࣍ͷύλʔϯʢZ1 ~ Z6ʣ͕ܭࢉՄೳ ͜ΕΒͷ֬ʹ͍ͭͯͷΤϯτϩϐʔʢhzʣܭࢉ ͜ΕΒͷಛྔΛͬͯXGboostͰߪೖ͔ͨ͠൱͔Λ༧ଌ Shopper Intent Prediction from Clickstream E-commerce Data with Minimal Browsing Information [Requena+ SciRepo 2020] (Coveo) -
ॏཁͳಛྔ/GBDT add (3) ͚ͩͰͳ͘add-view (31) ͕େࣄ ͨͩͷӾཡߦಈͰ͋Δview-detail (12) ͕େࣄ ϖʔδؒભҠview-view
(1)ؒભҠdetail-detail (2) ͋Δ͕ݕࡧ search (6) গͳ͍ ॏཁͳಛྔ/SHAP view-detail (12) detail (2)search (6)͕ߴ͍ͱߪങʹࢸΒͳ͍ (SHAP͕negative) ͜ͷͱ͖Z1͕ߴͯ͘hz͕͍ˠ͜ͷΑ͏ͳϢʔβʔߦಈ୯ௐ ྫɿview-view-view-detail-view-detail (111212)ͷ߹ʢϢʔβʔ͕Λݟ͚ͭΔ తͰϖʔδΛ୳ͯͬͨ͠ΓΛ͍ͯ͠Δʣ view-view (11) detail (2) ͕ߴ͘ͳΔ Z1 ͕2ͭͰ Z4͕1ͭͳͷͰhzத͘Β͍ʹͳΔ ϖʔδΛ๚Εͣଟ͘ͷϖʔδΛ๚ΕΔ߹Ͱ (high view P(1))ɼ༷ʑͳߦಈ͔ΒӾཡʹ ࢸΔ߹ (low view-view P(1, 1) and high detail-view P(2, 1), add-view P(3, 1))ɼߪೖ ଞͷϖʔδ͔ΒඈͿ߹ (high detail-detail P(2, 2))ߪങʹͭͳ͕Δ Τϯτϩϐʔhz͕ߴ͍ύλʔϯͱͯ࣍͠ͷΑ͏ͳͷ͕͋Δ view-add-detail-view-add-view (132131) ͕ͩ detail P(2) ͱ view-view P(1, 1)͕͘ɼ view P(1) ɼadd P(3), ɼadd-view P(3, 1) ɼdetail-view P(2, 1)͕ߴ͍ ༧ΊԿ͕΄͍͔ܾ͠·͍ͬͯΔΑ͏ͳڍಈͰ͋Γɼ͜Ε͕ߪೖʹͭͳ͕Δͷଥ Shopper Intent Prediction from Clickstream E-commerce Data with Minimal Browsing Information [Requena+ SciRepo 2020] (Coveo) -
͋Δe-commerceͷσʔληοτΛ༻͍ͯsequence-aware recommendationʹ͓͍ͯԿ͕ॏཁ͔Λௐࠪ 95ͷಛྔΛ࡞͠ɼGain ratioɼChi-squaredɼInformation gain ratioɼGini indexʹΑͬͯॏཁΛධՁ શಛྔHPࢀর https://rn5l.github.io/session-rec/umuai/ Exploring
Session-Awareness in E-Commerce [Ludewig 2020] [Jannach+ 2017] -
SIGIR e-commerce Data challengeɼ[Requena+ 2020]ɼ [Ludewig 2020]ͰࢀߟʹͳΔͷɼૉͳಛྔ࡞ → ಛྔબͱ͍͏ϓϩηε Ϣʔβʔߦಈੳʹ͓͍ͯɼ·ͣ͋Δಛఆͷʹରͯ͠ૉͳಛྔΛ࡞͠ɼ࣮ࡍʹ༧ଌΛͱ͍ͯͦ
ͷد༩ΛΈΔ͜ͱͰɼॏཁͳಛྔΛܦݧతʹධՁ͍ͯ͘͠ͷ͕ॏཁͩͱࢥΘΕΔ ॏཁͳಛྔͷԾઆ͕ੵΈ্͕ΕɼΑΓཉ͍͠ใͷղ૾্͕͕ΔͷͰɼઌߦݚڀɾࣄྫͷαʔϕΠޮ Խ͠ɼԾઆ͕ΑΓڧԽ͞Εɽɽͱ͍͏ਖ਼ͷϑΟʔυόοΫϧʔϓ͕ճΔ اۀͰϢʔβʔߦಈ༧ଌʹܞΘ͍ͬͯΔํʑ݁ہͦΕ͕େࣄͩͱ͍͍ͬͯΔ [Challenges, Best Practices and Pitfalls in Evaluating Results of Online Controlled Experiments, KDD 2019] ͕ͨͬͯ͠ɼॏཁͳಛྔʹ͍ͭͯͷԾઆݕূΛճ͢ΈࣗମΛͭ͘ΓͦΕΛճ͢͜ͱ͕ॏཁͰͳ͍͔ͱߟ͑Δ ͜͜·Ͱͷௐ͔ࠪΒͷࣔࠦ -
GRUΛ࣋ͭDNNʹΑΔϚϧνλεΫֶशͰuser intent prediction େͳσʔλʹର͢Δ౷ܭతͳੳͷ݁ՌɼҎԼͷಛྔ͕Ϣʔβʔͷߪങ༧ଌʹॏཁͰ͋Δ͜ͱΛൃݟ Ϣʔβʔͷجຊతͳใ ੑผɼྸɼաڈҰͷߪೖϨϕϧɼॅΜͰ͍ΔҬͳͲ Ϣʔβʔߦಈʢ୯Ґɼ݄୯Ґʣ աڈճͷߪങߦಈɼొ͔Βͷɼ࠷େ࿈ଓΞΫςΟϒɼաڈճͷ׆ಈͷมԽɼηʔϧεϓϩϞʔγϣϯ࣌ͷߪങߦಈ ಛྔΛͯ͢ΧςΰϦΧϧಛྔʹม One-hotͩͱεύʔεʹͳΔͷͰɼຒΊࠐΈ
TPG-DNN: A Method for User Intent Prediction Based on Total Probability Formula and GRU Loss with Multi-task Learning [Jiang+ ACM 2017] (Alibaba) -
ΤοδσόΠεʹ͓͚ΔDNNʹΑΔuser intent prediction swipe-interactive behaviorɼtap-interactive behaviorɼbrowse-interactive behaviorͷߦಈάϧʔϓΛ࡞ swipe-interactive behavior open
page, leave page, swipe, tap͕جຊߦಈʢtapҐஔswipe࢝ऴҐஔܧଓ࣌ؒهʣ time duration of a swipe, time gap between two actions, positional coordinates of actions (tap position X/Y, swipe start position X/Y, swipe end position X/Y and swipe length on X/Y) page indices, action indices and swipe directions tap-interactive behavior timestampɼpage indexɼevent indexɼbutton index browse-interactive behavior browse, search, collect, add to cart, purchaseͷ̐ͭͰɼ֤ߦಈʹରͯ࣍͠ͷ6ͭͷಛΛநग़ type index, top category index, leaf category index, page index, page stay time and timestamp ༧ଌ݁Ռʹج͍ͮͯɼϙοϓΞοϓࠂɼϓογϡ௨ʹ͍ͭͯෳͷઓུΛߟ͑ABςετ ఏҊख๏Ϣʔβʔͷreal-timeͳᅂੑΛ͏·͘ଊ͍͑ͯΔ͜ͱΛ࣮ূ EdgeDIPN: a Unified Deep Intent Prediction Network Deployed at the Edge [Guo+ VLDB 2020] (Alibaba, Peking University) -
جຊతͳߦಈಛྔΛ༻͍ͨɼݕࡧʹ͓͚Δຬͷ༧ଌ Deep Sequential Models for Task Satisfaction Prediction / User
Interaction Sequences for Search Satisfaction Prediction [Mehrotra+ CIKM/SIGIR 2017] (UCL, Microsoft) -
୳ࡧతݕࡧߦಈͱۤઓ͍ͯ͠Δ࣌ͷݕࡧߦಈͷफ़ผ ಛྔ Struggling or Exploring? Disambiguating Long Search Sessions [Hassan+
WSDM 2014] (Microsoft) ۤઓ͍ͯ͠Δ͍Δͱ͖ͷݕࡧߦಈ ۤઓ͍ͯ͠Δͱ͖࠷ॳͷΫΤϦͱͷྨࣅ͕ߴ͍͕୳ࡧͷ߹গͣͭ͠ྨࣅ͕Լ͕Δ ୳ࡧͷ߹ɼޙͷηογϣϯʹͳΔ΄ͲΫϦοΫ͕૿͑Δ -
ۤઓ͍ͯ͠Δ͕࠷ऴతʹॴͷ݁ՌΛಘΒΕͨ࣌ͷݕࡧߦಈ [Odijk+ 2015] ΫϦοΫ͕গͳ͍ɼΫΤϦΛΑΓ۩ମతͳͷʹมߋ͢ΔͳͲ ݕࡧ݁Ռʹຬ͢Δ͔൱͔ͷ༧ଌʹ࣍ͷΫΤϦͱͷྨࣅͳͲͷಛྔ͕େࣄ [Diriye+ 2012] ΫΤϦͷมߋݕࡧ݁ՌͷΫϦοΫݕࡧͷࠔ͞ݕࡧʹର͢ΔϑϥετϨʔγϣϯΛද͢ [Aula+ 2010]
[Allan+ 2010] ΫϦοΫΛڬ·ͣΫΤϦ͕Կมߋ͞Ε͍ͯΔͱ͖ݕࡧ݁ՌʹෆຬΛ͍͍ͩͯΔ [White+ 2009] E-commerceͷݕࡧʹ͓͍ͯɼΫΤϦมߋ͞ΕΔͨͼʹ͘ͳΓɼΫΤϦมߋΫϦοΫͷ૿Ճͱ࠷ऴతͳߪങͱͭͳ ͕ͬͨ ʢҎԼͷಛྔͰΫΤϦมߋͷ༧ଌΛߦͬͨʣ[Hirsch+ 2020] ݕࡧߦಈͱຬ/ෆຬ/ۤઓ -
conversational assistantͱͷϚϧνλʔϯͷձʹ͓͚Δuser intent prediction લॲཧ Ϣʔβʔͷ࣭ҙਤΛͦͷ༰͔Β12ͷΫϥεʹϥϕϧ͚ Greetings/Gratitude, Junk, Others༧ଌʹߩݙ͠ͳ͍ͷͰআ֎ ͜ͷϥϕϧͷΈ߹Θͤʹରͯ͠Ϣʔβʔߦಈ͔Β༧ଌΛߦ͏
ग़ݱස͕গͳ͍ϥϕϧͷΈ߹ΘͤͦΕΛߏ͢Δ͍ͣΕ͔ͷϥϕϧʹϥϯμϜʹஔ͖͑ ϥϕϧͷΈ߹ΘͤͰग़ݱස͕େ͖͘ҟͳΔʢτοϓ32ͷϥϕϧͷΈ߹Θ͕ͤશମͷ90ˋΛΊΔʣ ྫɿCQ+FD+IR+RQ → CQ User Intent Prediction in Information-seeking Conversations [Qu+ CHIIR 2019] (U M Amherst, RMIT U, Alibaba) ࢀߟ -
ಛྔ Ϣʔβʔͷൃʹ͍ͭͯɼ༰ʹؔ͢ΔͷʢContent/Conʣɼରͷߏʹؔ͢ΔͷʢStructure/Strʣɼײʹؔ͢Δͷ ʢSentiment/senʣͦΕͧΕʹରͯ͠ಛྔΛ࡞ ߏʹؔ͢Δಛྔ͕Ϣʔβʔҙਤͷ༧ଌʹॏཁ ಛʹɼൃݴ͕Ͳ͜Ͱൃੜ͔ͨ͠ʢAbsolute Position/AbsPosɼNormalized Position/NormPosʣͳͲ͕ॏཁͩͬͨ ༰ʹؔ͢ΔͷͰ࠷ॳͷൃͷྨࣅʢInitial Utterance Similarity/InitSimʣରͷྨࣅʢDialog
Similarity/DigSimʣ͕ॏཁ 15Ґ͔Β࠷ԼҐ·Ͱͯ͢ʮ͋ΔΩʔϫʔυΛؚΜͰ͍͔ͨʁʹؔ͢Δಛྔʯ User Intent Prediction in Information-seeking Conversations [Qu+ CHIIR 2019] (U M Amherst, RMIT U, Alibaba) ࢀߟ -
ήʔϜʹ͓͚ΔϢʔβʔ༧ଌ Churn Prediction (2/3) [Xi+ 2019 A Latent Feelings-aware RNN
Model for User Churn Prediction with Behavioral Data] -
Telco Customer ChurnΛ༻͍ͨɼ௨৴αʔϏεղ༧ଌ Churn Prediction (3/3) EDA ಛྔͷੳ [AI ʹΑΔୀձࢭ
γϦʔζ ʮࣄۀܦӦͷ AI ׆༻ʯᶃ ࡾඛUFJϦαʔν&ίϯαϧςΟϯά] -
࣍ 1. Session-aware recommendationͷ֓ཁ 2. Session-based/aware recommendationͷ༧ଌͰॏཁͳಛྔʹ͍ͭͯͷௐࠪ • SIGIR eCom
21 Data Challenge • جຊߦಈಛྔͱಛྔબ • ͍͔ͭ͘ͷྫ • Struggling search • Information Seeking Conversation • Churn Prediction • ͦͷଞ 3. ·ͱΊ -
݁ ༧ଌʹͱͬͯԿ͕ॏཁͳಛྔ͕Կ͔༧ଌର/υϝΠϯʹґଘ͢Δ ߪങߦಈͷ༧ଌʹߪങʹؔ࿈͢Δߦಈಛྔ͕ޮ͍ͯ͘Δ͠ɼͷ༧ଌʹrecency͕ޮ͘ ۜߦआೖΕͷ༧ଌͳΒआ͕ۚ͋Δ͔͕ޮ͍ͯ͘Δ͠ɼήʔϜͷ༧ଌʹͲΜͳήʔϜΛ͔͕ͬͨޮ͘ Session-awareʹϢχʔΫͳಛྔͷٞ͋·Γͳ͞Ε͍ͯͳ͍ҹ Session-awareͳख๏݁ہsession͕جຊ୯ҐͳͷͰɼsession-basedͱൺͯѻ͏sessionͷ͕૿͚͑ͨͩ Session-awareͷݱࡏͷख๏ͷओྲྀneural network͕ͩneural networkͰಛྔΛ࡞Γࠐ·ͳ͍ ίϯϖͰใ͕গͳ͍sessionͷใΛ͍͔ʹѻ͏͔͕ҰͭϙΠϯτͩͬͨҹ
ొස͕গͳ͍ͷΛআͨ͠ΓͳใΛͭͷΛ·ͱΊͨΓ ૉʹEDAΛͬͨ݁ՌΘ͔ͬͨ͜ͱͩͱ͍͏ͷ͕େࣄ -
ܥྻใͷอ࣋ͱτϨʔυΦϑ ใྔ ѹॖ ߦಈಛྔ ൚༻ੑ ੜσʔλ ྫɿclick جຊಛྔ ྫɿclick υϝΠϯಛԽಛྔ
ྫɿsnap_view ߴ গ ଟ ߴ ɾɾɾ ҰൠʹͲΕ͘Β͍ಛྔΛੜσʔλʹ͍ۙܗͰอ࣋͢Δ͔ଞͷ༷ʑͳཁૉͱτϨʔυΦϑͷؔʹ͋Δͣ Ϗδωε্ಛʹॏཁͳੳ࣠ຖʹͲ͜·ͰଥڠͰ͖Δ͔Λߟ͑Δ͜ͱͰɼͲͷཻͰσʔλΛอ࣋͢Δͷ͔͕ܾ·Γͦ͏ -
େࣄͩͱࢥͬͨ͜ͱ ར༻తͷ໌֬Խ Կʹ༻͍Δ͔͕ఆ·Γ͖͍ͬͯͳ͍ͳΒੜσʔλɾجૅతͳߦಈಛྔΛ࣋ͭ֎ͳ͍ ఆ·͍ͬͯͳ͍߹ɼͱΓ͋͑ͣجૅతͳಛྔΛ࡞্ͨ͠ͰͳಛྔΛআ͢Δ͘Β͍Ͱ͖ͦ͏ ग़ݱසͷগͳ͍/ॏෳ͢Δaction/session/itemͷআूͰσʔλอ࣋ͷίετΛҰ࣍తʹԼ͛ΔͳͲ ಛྔબͷԾઆݕূαΠΫϧ Ͳͷಛྔ͕ޮ͔͘ɾ൚༻త͔݁ہͬͯΈͳ͍ͱΘ͔Βͳ͍ͷͰԾઆݕূΛճ͍ͯ͘͠ΈࣗମΛ࡞Δͷ͕େࣄͦ͏ ·ͣԾઃΛཱͯͯૉͳಛྔΛࢁ࡞ΓɼGBDTrandom forestͳͲͰɼෳͷҟͳΔυϝΠϯͰਪ͢ΔͳͲ ͦͷޙɼ૬ؔSHAPͳͲΛௐͯ൚༻తʹ༧ଌʹޮ͍͍ͯͦ͏ͳಛྔΛ୳͍ͯ͘͠ͳͲ
Session-basedͰ༗ྗͳಛྔͷར༻ Session-awareͷಛྔͱsession-basedͷಛྔͱେ͖͘มΘΒͳ͍ʢҧ͍ओʹΞϧΰϦζϜͷ෦ʣ ݁ہ༧ଌΠϕϯτʹ࣌ؒతʹ͍ۙߦಈಛྔ͕ॏཁͰ͋Δ͜ͱ͕ࢦఠ͞Ε͍ͯΔ ϢʔβʔID͕खʹೖΒͳ͍ͱsession-awareͳख๏͑ͳ͍ Session-awareʹϢχʔΫͳ࣌ؒํʹ௵ͨ͠ಛྔΛ࡞Δ߹ɼ·ͣૉ/ҰൠతͳͷΛ࡞͠ɼԾઆݕূΛճ͢ RecencyɼϘοτͷ༻ճɼొ͔ΒͷͳͲ -
[Ludewig 2020] Advances in Session-based and Session-aware Recommendation [Fang+ 2020]
Deep Learning for Sequential Recommendation: Algorithms, Influential Factors, and Evaluations [Wang+ 2021] A Survey on Session-based Recommender Systems [Wang+ 2016] Collaborative Recurrent Autoencoder: Recommend While Learning to Fill in the Blank [Zhang+ 2019] Deep Learning Based Recommender System: A Survey and New Perspectives [Hidashi+ 2016] Session-based Recommendations with Recurrent Neural Networks [Gao+ 2019] Learning to Recommend with Multiple Cascading Behaviors [Ren+ 2019] RepeatNet: A Repeat Aware Neural Recommendation Machine for Session-based Recommendation [Anderson+ 2014] The Dynamics of Repeat Consumption [Wan+ 2018] Representing and Recommending Shopping Baskets with Complementarity, Compatibility and Loyalty [Hu+ 2020] Modeling Personalized Item Frequency Information for Next-basket Recommendation [Wu+ 2017] Session-aware Information Embedding for e-commerce Product Recommendation [Tan+ 2016] Improved Recurrent Neural Networks for Session-based Recommendations [Li+ 2017] Neural Attentive Session-based Recommendation [Kang+ 2018] Translation-based Recommendation [Tang+ 2018] Personalized top-n Sequential Recommendation via Convolutional Sequence Embedding [Quadrana+ 2018] Sequence-aware Recommender Systems ࢀߟจݙ -
[Zhou+ 2018] Deep Interest Evolution Network for Click-Through Rate Prediction
[Pi+ 2019] Practice on Long Sequential User Behavior Modeling for Click-Through Rate Prediction [Dacrema+ 2019] Are We Really Making Much Progress? A Worrying Analysis of Recent Neural Recommendation Approaches [Laitifi+ 2020] Session-aware Recommendation: A Surprising Quest for the State-of-the-art [Chen+ 2019] AntProphet: an Intention Mining System behind Alipay’s Intelligent Customer Service Bot [Jannach+ 2017] Determining Characteristics of Successful Recommendations from Log Data—A Case Study [Odijk+ 2015] Struggling and Success in Web Search [Diriye+ 2012] Leaving so soon? Understanding and predicting web search abandonment rationales [Aula+ 2010] How Does Search Behavior Change as Search Becomes More Difficult? [Feild+ 2010] Predicting Searcher Frustration [Hirsch+ 2020] Query Reformulation in E-Commerce Search [White+ 2009] Characterizing and Predicting Search Engine Switching Behavior [Zhang+ 2020] An Improved Deep Forest Model for Prediction of E-commerce Consumers’ Repurchase Behavior ࢀߟจݙ -
ΧϥΫϦͰαΠϨϯτΧελϚʔʢ*1ʣΛٹࡁ͢ΔͨΊͷαʔϏε ։ൃσʔλੳʹऔΓΜͰ͓ΓɺػցֶशΤϯδχΞWebΤϯ δχΞΛืू͓ͯ͠Γ·͢ɻ Ұॹʹಇ͘͜ͱʹڵຯͷ͋Δํੋඇ͝࿈བྷ͍ͩ͘͞ʂ Twitter: @not_oohikata Mail: [email protected] *1ɿαʔϏεӡӦऀଆʹٙෆ҆Λ͍߹ΘͤͣɺαΠτ͔Β ͯ͠͠·͏ސ٬
( https://karakuri.ai/lp_silentcustomer ) We’re hiring !