Tweet
Tweet

Slide 1

Slide 1 text

©2018 Wantedly, Inc. BigQuery as a Recommendation System BigQuery Λ׆༻ͨ͠ਪનγεςϜࣄྫ(In Wantedly Visit) Data Driven Developer Meetup #1 11.Sep.2018 - Yuya Matsumura - @yu-ya4

Slide 2

Slide 2 text

©2018 Wantedly, Inc. •Yuya Matsumuraʢদଜ ༏໵ʣ •Wantedly, Inc. (ࣾձਓ6ϲ݄໨) •Recommendation Engineer •From Kyoto Self Introduction @yu-ya4 @yu__ya4 https://www.wantedly.com/users/2390451

Slide 3

Slide 3 text

©2018 Wantedly, Inc. ਪનγεςϜͱ͸ 8IZVTF#JH2VFSZ )PXVTF#JH2VFSZ Agenda ※ຊൃද͸ɼ2018೥9݄ݱࡏͷWantedly Visit ʹ͓͚ΔਪનγεςϜͷ։ൃϑϩʔɼӡ༻ํ๏ʹج͓ͮ͘࿩Ͱ͢ɽ ಉ͡࿩͕ଞͷόοΫάϥ΢ϯυͰ΋ඞͣਖ਼͍͠ͱ͸ݶΓ·ͤΜɽ

Slide 4

Slide 4 text

©2018 Wantedly, Inc. ਪનγεςϜͱ͸ 8IZVTF#JH2VFSZ )PXVTF#JH2VFSZ Agenda

Slide 5

Slide 5 text

©2018 Wantedly, Inc. It is often necessary to make choices without sufficient personal experience of the alternatives. In everyday life, we rely on recommendations from other people either by word of mouth, recommendation letters, movie and book reviews printed in newspapers, or general surveys such as Zagat’s restaurant guides. Recommender systems assist and augment this natural social process. ਪનγεςϜͱ͸ [Resnick+ 97] ࣗ෼ͷܦݧ͔ΒͷΈͰ͸͋·ΓΑ͘Θ͔Βͳ͍΋ͷͷத͔ΒɼͲ͏ ͯ͠΋ͲΕ͔Λબ͹ͳ͚Ε͹ͳΒͳ͍ͱ͍͏͜ͱ͸Α͋͘Δɽ͜ͷ Α͏ͳࡍΘͨͨͪ͠͸ɼޱίϛɼਪનঢ়ɼ ৽ฉͷॻධ΍өըධɼϨ ετϥϯΨΠυͳͲͷଞਓ͔ΒͷਪનʹཔΔ͜ͱΛ ೔ৗతʹߦͬͯ ͍Δɽ ৘ใਪનγεςϜͱ͸ɼ͜͏ͨࣾ͠ձͰී௨ʹߦΘΕ͍ͯΔ Ұ࿈ͷߦҝΛิॿͨ͠Γɼଅਐͨ͠Γ͢Δ΋ͷͰ͋Δɽ [Resnick 97] P. Resnick and H. R. Varian. Recommender systems. Communications of the ACM, Vol. 40, No. 3, pp. 56–58, 1997.

Slide 6

Slide 6 text

©2018 Wantedly, Inc. Recommenders: Tools to help identify worthwhile stuff ਪનγεςϜͱ͸ [Konstan+ 03] ਪનγεςϜ: Ձ஋ͷ͋Δ΋ͷ͕ͲΕ͔ಛఆ͢Δͷʹ໾ཱͭಓ۩ [Konstan 03] J. A. Konstan and J. Riedl. Recommender systems: Collaborating in commerce and communities. In Proc. of the SIGCHI Conf. on Human Factors in Computing Systems, Tutorial, 2003.

Slide 7

Slide 7 text

©2018 Wantedly, Inc. ৘ใਪનͷྫ ಛఆͷϢʔβͷᅂ޷ʹ ߹ͬͨ঎඼ͷਪન

Slide 8

Slide 8 text

©2018 Wantedly, Inc. ৘ใਪનͷྫ ྨࣅɾؔ࿈঎඼ ͷਪન (amazon.co.jp) ଞͷϢʔβʹΑΔධՁ

Slide 9

Slide 9 text

©2018 Wantedly, Inc. ৘ใਪનͷྫ ਓؾ঎඼ͷਪન (amazon.co.jp) ৽ண঎඼ͷਪન

Slide 10

Slide 10 text

©2018 Wantedly, Inc. Everything is a Recommendation

Slide 11

Slide 11 text

©2018 Wantedly, Inc. ਪનγεςϜͱ͸ 8IZVTF#JH2VFSZ )PXVTF#JH2VFSZ Agenda

Slide 12

Slide 12 text

©2018 Wantedly, Inc. ͱʹ͔͘ૣ͍ Why use BigQuery?

Slide 13

Slide 13 text

©2018 Wantedly, Inc. ݱࡏͷWantedly Visit ͷ Recommendation TeamʹٻΊΒΕΔ͜ͱ վળαΠΫϧΛૉૣͨ͘͘͞Μճ͢͜ͱ

Slide 14

Slide 14 text

©2018 Wantedly, Inc. ݱࡏͷWantedly Visit ͷ Recommendation ࣄ৘ γϯϓϧͳมߋͰվળͰ͖ͦ͏ͳՕॴ͕ෳ਺࢒͍ͬͯΔ νʔϜ͕খن໛ ࢲΛؚΊ໊ͯ αʔϏε͸খن໛͡Όͳ͍ ͨ͘͞ΜͷϢʔβ ͭͭͷվળʹΊͪΌͪ͘Ό࣌ؒΛ͔͚͍͍ͯΘ͚Ͱ͸ͳ͍

Slide 15

Slide 15 text

©2018 Wantedly, Inc. ͨͱ͑͹… Ϣʔβͷืू΁ͷΫϦοΫ৘ใΛར༻ͯ͠ɼ ͋ΔϢʔβʹืूΛਪન͍ͨ͠ ⭕ ⭕ ⭕ ⭕ ⭕ ⭕ ⭕ ʁ ⭕ - - - - - - - ืू Ϣʔβ

Slide 16

Slide 16 text

©2018 Wantedly, Inc. աڈͷΫϦοΫ৘ใΛجʹͨ͠Ϣʔβؒͷྨࣅ౓Λࢉग़ͯ͠ɼ ࣅ͍ͯΔϢʔβ͕ΫϦοΫͨ͠ืूΛਪન͠Α͏ʂ (ϢʔβϕʔεڠௐϑΟϧλϦϯά) ྨࣅ౓௿ ྨࣅ౓ߴ ⭕ ⭕ ⭕ ⭕ ⭕ ⭕ ⭕ ʁ ⭕ - - - - - - - ਪન ืू Ϣʔβ ͨͱ͑͹…

Slide 17

Slide 17 text

©2018 Wantedly, Inc. ୯७ͦ͏Ͱߟ͑Δ͜ͱ/΍Δ͜ͱ͸ͨ͘͞Μ… վળαΠΫϧ͕ͳ͔ͳ͔ճͤͳ͍ ࣮ߦ଎౓͸໰୊ͳ͍ʁ σʔλྔ͍͢͝ ΦϑϥΠϯධՁ͸Ͳ͏͢Δʁ ΦϯϥΠϯධՁ͸ʁ ࣮૷ݴޠ͸ʁ ෼ࢄॲཧͤ͞Δʁ σʔλͷύΠϓϥΠϯઃܭ͸ʁ ϚγϯϦιʔε଍ΓͯΔʁ σʔλͷݕূ͸Ͳ͏͢Δʁ

Slide 18

Slide 18 text

©2018 Wantedly, Inc.

Slide 19

Slide 19 text

©2018 Wantedly, Inc. BigQueryͰશ෦΍ͬͪΌ͑

Slide 20

Slide 20 text

©2018 Wantedly, Inc. ਪનγεςϜͱ͸ 8IZVTF#JH2VFSZ )PXVTF#JH2VFSZ Agenda

Slide 21

Slide 21 text

©2018 Wantedly, Inc. Overview of architecture of Recommendation System in Wantedly Visit BigQuery merge Job ͷهड़(΄΅SQL) Scheduler ʹొ࿥ ΫΤϦͷ࣮ߦ ࣮ߦ݁ՌΛRDBʹอଘ Ωϟογϡͱͯ͠ར༻

Slide 22

Slide 22 text

©2018 Wantedly, Inc. BigQuery by Ruby

Slide 23

Slide 23 text

©2018 Wantedly, Inc. Jobͷఆٛ

Slide 24

Slide 24 text

©2018 Wantedly, Inc. pros. w 42-͚ͩॻ͚Ε͹͍͍ͷͰɼ࣮૷ίετ͕௿͍ɽ w ແݶͷϦιʔε w (PPHMFઌੜʹ՝ۚ͢Δ͚ͩͰര଎ʂ w #JH2VFSZ಺Ͱॲཧ͕׬݁ w σʔλͷҠಈߟ͑Δඞཁͳ͠ w %PNP #*πʔϧ ্Ͱεέδϡʔϥ͕࣮ߦՄೳ w "#ςετͳͲͷΦϯϥΠϯධՁΛܧଓతʹ௥͍΍͍͢

Slide 25

Slide 25 text

©2018 Wantedly, Inc. cons. w ΫΤϦ͕ଐਓԽ͠΍͍͢ w ਓͷॻ͍ͨΫΤϦಡΉͷŨŽŘ w σόοά͠ʹ͍͘ w ຊ౰ʹਖ਼͍͠ग़ྗʁ w ෳࡶա͗Δॲཧ͸͠ΜͲ͍ w ;ͱͨ͠ॠؒʹ1ZUIPO͕࿀͘͠ͳΔ ݸਓతͳҙݟ

Slide 26

Slide 26 text

©2018 Wantedly, Inc. ·ͱΊ BigQueryųƄƃž