Go as an aggregator in recommendation systems

Transcript

1. ©2018 Wantedly, Inc. Go as an aggregator In Recommendation Systems

   26.Jul.2018 - Naomichi Agata

2. ©2018 Wantedly, Inc. agatan Software engineer at Wantedly, inc. Server

   side + Machine learning Github Twitter @agatan @agatan_

3. ©2018 Wantedly, Inc. Everything is a Recommendation https://medium.com/netflix-techblog/netflix-recommendations-beyond-the-5-stars-part-1-55838468f429

4. ©2018 Wantedly, Inc. Recommendations ΄ͱΜͲͷαʔϏεͰʮԿ͔Λਪન͢Δʯͱ͍͏ػೳ͸͋Δ

5. ©2018 Wantedly, Inc. Impact of Recommendations ⾣
   Linkedin
   ͷͭͳ͕Γͷ
   50%
   Ҏ্͸ʮ஌Γ߹͍Ͱ͔͢ʁʯܦ༝
   ⾣
   https://engineering.linkedin.com/teams/data/projects/pymk
   ⾣
   
   Netflix
   ͸ਪનγεςϜͷ
   competition

   Λ։࠵͠৆ۚ
   $1 Million Λग़͍ͯ͠Δ
   ⾣
   https://medium.com/netflix-techblog/netflix-recommendations-beyond-the-5-stars-part-1-55838468f429

6. ©2018 Wantedly, Inc. Components of Recommendations ਪનͷࠜڌ͸͍ΖΜͳ৔ॴʹ͋Δ
   ⾣ʮ˓˓͞Μ͕
   -JLF
   ͠·ͨ͠ʯ
   ⾣ʮ͜ͷ঎඼Λߪೖͨ͠ਓ͸͜ͷ঎඼΋ങ͍ͬͯ·͢ʯ
   ⾣ʮڞ௨ͷͭͳ͕Γ͕
   
   ਓ͍·͢ʯ
   

   ⾣ʮ࿩୊ͷχϡʔεʯ
   ⾣ʮ˓˓Λݕࡧͨ͠ํ΁ʯ
   ⾣ʮಉ͡ձࣾͰಇ͍͍ͯΔϢʔβʯ

7. ©2018 Wantedly, Inc. Order of Recommendations ΑΓྑ͍ΞΠςϜΛɺΑΓྑ͍ॱংͰఏࣔ͢Δ͜ͱ͕ٻΊΒΕΔ
   ⾣
   Hot Topics ͸ͳΔ΂͘଎͘ఏ͍ࣔͨ͠
   

   ⾣
   ֬ݻͨΔࣗ৴ͷ͋ΔਪનΛ༏ઌͯ͠ݟ͍ͤͨ
   ⾣
   શମͰͷਓؾॱΑΓ΋ύʔιφϥΠζͨ͠ॱংΛఏڙ͍ͨ͠
   ⾣
   αʔϏεݻ༗ͷׂΓࠐΈ΋͋Δ͔΋͠Εͳ͍ by Google

8. ©2018 Wantedly, Inc. Recommendations with strategies

9. ©2018 Wantedly, Inc. aggregator Strategy Strategy Strategy Strategy ༑ୡ͕
   -JLF
   ͨ͠ΞΠςϜΛఏࣔ ߪೖཤྺ͔Βͷ͓͢͢Ί

   ࿩୊ͷΞΠςϜ ϓϩϑΟʔϧ͔Βͷ͓͢͢Ί Recommendations with strategies Strategy Λ࣮ߦ
   ݁ՌΛू໿
   re-ordering ฒߦॲཧ

10. ©2018 Wantedly, Inc. Recommendations with strategies ֤
    strategy
    ͕ਪનΞΠςϜΛఏࣔ
    UZQF
    4USBUFHZ
    JOUFSGBDF
    \
    
    
    
    
    /BNF
    4USBUFHZ/BNF
    

    
    
    
    
    4VHHFTU DUY
    DPOUFYU$POUFYU
    VTFS*%
    JOU
    TJ[F
    JOU
    <> 4VHHFTU6TFS
    FSSPS
    ^ UZQF
    4VHHFTU6TFS
    TUSVDU
    \
    
    
    
    
    6TFS*%
    
    
    
    
    
    
    
    JOU
    
    
    
    
    4DPSF
    
    
    
    
    
    
    
    
    qPBU
    
    
    
    
    4USBUFHZ/BNF
    4USBUFHZ/BNF
    
    
    
    
    3FBTPO
    
    
    
    
    
    
    
    JOUFSGBDF\^
    
    GPS
    MPHHJOH
    ^

11. ©2018 Wantedly, Inc. Recommendations with strategies ͦΕΒΛฒߦʹ࣮ߦ͠ू໿
    ࠷ऴతͳॱংΛܾఆ͢Δ
    GPS
    @
    T
    
    SBOHF
    TUSBUFHJFT
    \
    

    
    
    
    
    XH"EE 
    
    
    
    
    HP
    GVOD T
    4USBUFHZ
    \
    
    
    
    
    
    
    
    
    EFGFS
    XH%POF
    
    
    
    
    
    
    
    
    TT
    FSS
    
    T4VHHFTU DUY
    VTFS*%
    TJ[F
    
    
    
    
    
    
    
    
    JG
    FSS
    
    OJM
    \
    
    
    
    
    
    
    
    
    
    
    
    
    
    SFQPSU
    FSSPS
    
    
    
    
    
    
    
    
    
    
    
    
    SFUVSO
    
    
    
    
    
    
    
    
    ^
    
    
    
    
    
    
    
    
    NV-PDL
    
    
    
    
    
    
    
    
    TVHHFTUJPOT
    
    BQQFOE TVHHFTUJPOT
    TT
    
    
    
    
    
    
    
    
    NV6OMPDL
    
    
    
    
    ^ T
    ^

12. ©2018 Wantedly, Inc. Why Go? Machine Learning ͱ Microservices ͳߏ੒
    

    
    
    ˠ
    ֤
    Strategy ͸
    API Call
    ΛؚΈ͏Δ
    
    
    ˠ
    ฒߦॲཧʹڧ͍͜ͱ͕׆͖Δ aggregator microservices

13. ©2018 Wantedly, Inc. Responsibility of Aggregator ⾣
    Logging ⾣ Ͳͷ
    Strategy ͕Ͳͷ͘Β͍੒ՌΛ͍͋͛ͯΔ͔
    

    ⾣
    ֤
    Strategy ͷείΞͷॏΈ෇͚࿨ʹΑΔϥϯΩϯά
    ⾣
    e.g. ͢Ͱʹఏࣔͨ͜͠ͱͷ͋ΔΞΠςϜͷείΞΛݮਰͤ͞Δ
    ⾣
    A/B Testing

14. ©2018 Wantedly, Inc. Problems… ⾣
    Frror reporting ⾣ ͋Δ
    strategy ͕ࢮΜͰ͍ͯ΋શମ͸ࢭ·Βͳ͍Ͱ΄͍͠
    ⾣
    ࢮΜͩ͜ͱʹ͸ؾ෇͖͍ͨ
    

    ⾣
    Frror reporting service Λ׆༻
    ⾣
    ෳ਺ͷ
    Strategy Ͱಉ͡
    API Call
    Λͨ͘͠ͳΔ
    ⾣
    e.g. Profile Service ʹॴଐΛ໰͍߹ΘͤΔ
    
    ࠷ۙങͬͨ঎඼ͷΧςΰϦ͕஌Γ͍ͨ
    ⾣
    HPMBOHPSHYTZODTJOHMFqJHIU ΍ΠϯϝϞϦΩϟογϡͰແཧ໼ཧଋͶΔ
    ⾣
    Ͳ͜·Ͱ
    aggregator ͕ܭࢉ͢Δ΂͖͔

15. ©2018 Wantedly, Inc. Conclusion ⾣
    ਪનγεςϜ͸͍ΖΜͳཁૉͷ૊Έ߹Θͤ
    ⾣
    Microservices / Machine Learning
    ⾣
    A/B

    Test ͕ॏཁ
    ⾣
    ࣮ࡍʹԿΛݟ͔ͤͨɺԿ͕
    Action ʹͭͳ͕͔ͬͨ
    Logging ͍ͨ͠
    ⾣
    લஈʹ
    Go Λ͓͘ͱศར
    ⾣
    Concurrent ʹ͍ΖΜͳ
    Strategy Λ࣮ߦ͢Δͷ͕؆୯