Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Billion-scale Embedding for E-commerce Recommendation in Alibaba

Billion-scale Embedding for E-commerce Recommendation in Alibaba

18d356eace1ae9fb3c1188871990a482?s=128

Hayato Maki

July 29, 2020
Tweet

Transcript

  1. BQQFBSFEJO,%%`

  2. #BDLHSPVOE 3FDPNNFOEFS4ZTUFNJO5BPCBP 1 billion users x 2 billion items

  3. #BDLHSPVOE 5XPTUBHFSFDPNNFOEBUJPO UPEBZ`TUBML

  4. #BDLHSPVOE 5BPCBP3FDPNNFOEBUJPO"SDIJUFDUVSF 3BOLJOH4FSWJDF1MBUGPSN 5BPCBP1FSTPOBMJ[F1MBUGPSN

  5. "CTUSBDU w 0CKFDUJWF$BMDVMBUFJUFNUPJUFN w 1SPQPTBM w 5PVTFTJEFJOGPSNBUJPO DBUFHPSZ  QSJDF

    ʜ GPS/PEF7FD w "MMFWJBUFDPMETUBSUQSPCMFN w &YQFSJNFOU w -JOL1SFEJDUJPO "NB[POEBUBTFUBOE UIFJSPXO5BPCBPEBUBTFU  w 7JTVBMJ[BUJPO
  6. 'SBNFXPSL

  7. 3FMBUFE8PSL  'BDUPSJ[BUJPONFUIPET USZUPBQQSPYJNBUFBEKBDFODZNBUSJY &YBNQMF-*/&  %FFQMFBSOJOHCBTFENFUIPE  3BOEPNXBMLCBTFENFUIPE FYUSBPSEJOBSZF⒏DJFOU

  8. #VJMEJOH*UFNJUFN(SBQI • Consider sequential information of behavior • D->A->B, B->E,

    D->E->F, … • Directed and weighted graph • Session-based • session = 1 hour time window • Noise Removal • Duration of the stay is less than 1 sec. • Over-active user: bought more than 1000 items or clicked 3500 times in three months • Updated item details: in the extreme case, a totally different item for the same identifier.
  9. /PEF&NCFEEJOH • Transition Probability 1. Generate item node sequence 2.

    Train skip-gram Based on DeepWalk’s framework
  10. 6TJOH4JEF*OGPSNBUJPO Embed other information, too. ঎඼Λಛఆ͢Δ POFIPUϕΫλ ൪໨ͷTJEFJOGPSNBUJPO Λಛఆ͢ΔPOFIPUϕΫλ O൪໨ͷTJEFJOGPSNBUJPO

    Λಛఆ͢ΔPOFIPUϕΫλ Simple average weighted average : v-th item’s s-th information
  11. &YQFSJNFOUBM&WBMVBUJPO Task: Link Prediction 1/3 of edeges are randomly removed,

    and predict it. Dataset Amazon and Taobao Side information L1 cat, Category, Shop, Brand, City, Spu, Style, Color, Gender, Age, Buying Power, Material
  12. 0GGMJOF&WBMVBUJPO OPTJEFJOGPSNBUJPO TJEFJOGPSNBUJPOXJUIXFJHIUFEBWFSBHJOH TJEFJOGPSNBUJPOXJUITJNQMFBWFSBHJOH 0OMJOF&WBMVBUJPO

  13. 3FTVMUGPSDPMEJUFNT 8FJHIU7JTVBMJ[BUJPO

  14. &NCFEEJOH7JTVBMJ[BUJPO

  15. 4ZTUFN%FQMPZNFOUBOE0QFSBUJPO w 6TFMPHTPGNPOUIT w "GUFSBOUJTQBNQSPDFTTJOH CJMMJPO FOUSJFTSFNBJOFE w (SBQIJTTQMJUJOUPTVCHSBQIT FBDI

    HSBQIIBTNJMMJPOOPEFT5PUBM OVNCFSPGHFOFSBUFETFRVFODFJT CJMMJPO w (16XBTVTFEUPUSBJOFNCFEEJOH w -FTTUIBOIPVSTUPEP MPHSFUSJFWBM BOUJTQBNQSPDFTTJOH  JUFNHSBQIDPOTUSVDUJPO TFRVFODF HFOFSBUJPO USBJOFNCFEEJOH JJ TJNJMBSJUZDPNQVUBUJPO
  16. .ZUIPVHIU w "OUJTQBNQSPDFTTJOHNBZCFVTFGVM  w 7JTVBMJ[BUJPOPGTJEFJOGPSNBUJPOJTJOUFSFTUJOH w 5SBJONJYUVSFSBUJPGPSFBDIJUFN 4PVOETUPPJOF⒏DJFOU w

    )PXXFMMXBTUIFDPMETUBSUQSPCMFNTPMWFE 5PPBNCJHVPVT w -JOLQSFEJDUJPOJTUPPFBTZCFDBVTFXFLOPXEBUBJTWFSZTQBSTF w 8IZOPUDPNQBSFUP%//CBTFENFUIPE  NBZCFUPPJOF⒏DJFOUGPSEFQMPZNFOU