機械学習とのつきあいかた / How to get involved with Machine Learning @ Wantedly

Transcript

1. ػցֶशͱͷ͖͍͔ͭ͋ͨ @Wantedly New Grad Training 2019 April 24, 2019 -

   Makoto Tanji (@tan-z-tan)

2. ©2019 Wantedly, Inc. • ML Engineer at Wantedly, Inc. •

   Wantedly Visit 2015 - 2016 • Client Growth, Scout • Wantedly People 2016 - current • Server side • Machine Learning • Data Analysis ࣗݾ঺հ Who am I? Makoto Tanji

3. ©2019 Wantedly, Inc. ࠓ೔࿩͢͜ͱ

4. ©2019 Wantedly, Inc. 1. ςʔϚ 2. Wantedlyͷػցֶश 3. Take home

   messages 1. MLͱ૊৫ 2. MLͱσʔλ 3. MLϓϩδΣΫͷਐΊํ 4. ·ͱΊ Contents

5. ©2019 Wantedly, Inc. ϝσΟΞʹࡌΔΑ͏ͳ࠷৽ٕज़ͷػցֶशͷ׆༻͸՚΍͔Ͱ͕͢ɺ࣮ӡ༻ ͷͨΊʹ͸࣮ࡍ͸๲େͳσʔλ͕ඞཁͩͬͨΓɺਫ਼౓͕ग़ͳ͔ͬͨΓɺ҆ ఆͨ͠ӡ༻͕೉͍͠ͱݴ͏ࠔ೉΋ଘࡏ͠·͢ɻ
   8BOUFEMZͷ.-ΤϯδχΞ͸ɺ8&#ΤϯδχΞɾσʔλαΠΤϯςΟε τɾΠϯϑϥͱڠಇ͠ͳ͕Β͜ͷ໰୊ʹऔΓ૊ΜͰ͍·͢ɻ
   ·ͨকདྷ8&#ΤϯδχΞ΋ΠϯϑϥΤϯδχΞ΋ػցֶशͱԿΒ͔ͷܗͰ ؔΘΔ͜ͱ͕ࠓΑΓ΋૿͖͑ͯ·͢ɻ
   

   8BOUFEMZͰ࣮ࡍʹಈ͍͍ͯΔػցֶशΛݟͳ͕Βػցֶशͱͷ͖͍ͭ͋ ͔ͨΛߟ͑ͯߦ͖·͠ΐ͏ɻ
   ςʔϚ

6. ©2019 Wantedly, Inc. શମతʹػցֶशʹ·ͭΘΔϙΤϜͰ͢

7. ©2019 Wantedly, Inc. Wantedlyͷػցֶश׆༻ࣄྫ Machine Learnings working at Wantedly

8. ©2019 Wantedly, Inc. Wantedlyͷػցֶश׆༻ࣄྫ

9. ©2019 Wantedly, Inc. Wantedlyͷػցֶश׆༻ࣄྫ  7JTJU
   w ืूͷਪન
   w 1VTI௨஌ͷύʔιφϥΠζ
   

   w εΧ΢τϑΟϧλͷվળ
   w ʜ
    1FPQMF
   w ໊ࢗը૾ͷ0$3ͱ෼ྨ
   w ਓͷਪન
   w هࣄͷਪનɺ1VTIͷ։෧཰༧ଌ
   w ༷ʑͳݻ༗දݱநग़
   w ʢػցֶशͷϦϙδτϦ͸.-λά͕͍ͭͯ·͢ʣ
   w IUUQTHJUIVCDPNXBOUFEMZ VUG&$RNMUZQFMBOHVBHF

10. ©2019 Wantedly, Inc. ͳͥػցֶशΛಋೖ͢Δͷ͔ʁ

11. ©2019 Wantedly, Inc. Wantedlyͷػցֶश׆༻ࣄྫ  ఏڙ͍ͨ͠Ձ஋͕͋Δ͔Β
    • εΩϟϯ͔Β਺ඵͰσʔλԽͱ͍͏ମݧΛఏڙ͍ͨ͠ w ໊ࢗΛຕຕ࿈བྷઌʹҠ͢ͷਏ͍ˠͦΕਓؒͷ࢓ࣄ͡Όͳ͍Ͱ͢ɻΧϝϥͰࡱͬͨΒҰ౓ʹσʔλԽ
    

    • ίίϩΦυϧγΰτʹग़ձ͏ମݧΛఏڙ͍ͨ͠ w ͳΜ͔͍͍࢓ࣄͳ͍͔ͳʁ
    ˠ
    ͋ͳ͕ͨڵຯ͕͋Γͦ͏ͳืू͔ΒࣗಈͰਪન͠·͢Α
    

12. ©2019 Wantedly, Inc. ࣾ಺Ͱಈ͍͍ͯΔ.-ͷߏ੒ྫ

13. ©2019 Wantedly, Inc. ࣾ಺Ͱಈ͍͍ͯΔMLͷߏ੒ྫ  ֶशࡁΈͷ"1*ύλʔϯ
     ਪનύλʔϯ
     ͦͷଞ
    

14. ©2019 Wantedly, Inc. ֶशࡁΈͷAPIύλʔϯ  ϚΠΫϩαʔϏεͷαʔόͷ"1*ͱͯ͠ఏڙ
    1. OCRʢจࣈೝࣝʣAPIɺςΩετ͔Βͷநग़APIɺಉҰੑ൑ఆAPIͳͲ୔ࢁ 2. લ΋ֶͬͯशͨ͠ϞσϧΛಈ͔ͯ݁͠ՌΛฦ͢

    3. e.g. Peopleͷ໊ࢗೝࣝؔ࿈API͸͜ͷྫ͕ଟ͍  ߟ͑Δ͜ͱ
    • ਫ਼౓͕஌Βͳ͍͏ͪʹམ͍ͪͯͳ͍͔ • ϝτϦΫεΛຖ೔औΔɻ৽͘͠APIΛ࡞Δͱ͖͸νΣοΫϦετʹೖΕΔ • ίετ • CPU཯଎ʹͳ͍ͬͯΔ͜ͱ͕ଟ͘ɺkubernetesͷϦιʔεΛେྔʹ࢖ͬͯͳ͍͔

15. ©2019 Wantedly, Inc. ਪનύλʔϯ  લ΋͓ͬͯ͢͢ΊείΞΛܭࢉɾఏڙ
    1. Ϣʔβ͕ϖʔδʹΞΫηεͨ͠ͱ͖ʹҰॠͰΦεεϝͷืूΛग़͍ͨ͠ 2. Ϣʔβͷաڈͷߦಈ͔Βࣄલʹܭࢉ͓ͯ͘͠

    3. Ϣʔβ×ืूͷ݁ՌΛσʔλετΞʹอଘ  ߟ͑Δ͜ͱ
    • ʮϢʔβ×ืूʯ͕͸͍ΔσʔλετΞ • ຖ೔ͷֶशJob͕ࢭ·͍ͬͯͳ͍͔ʁ • Job͕ଟஈʹͳΔͱಛʹΘ͔Γʹ͘͘ͳΔˠData Pipelineͷ࿩

16. ©2019 Wantedly, Inc. ͦͷଞ  σʔλͷਖ਼نԽ
    1. ࡶଟͳ৘ใΛਖ਼نԽɾಉҰੑͳͲΛ൑ఆ͢Δ 2. ࣙॻΛ࡞Δ࢓ࣄ

    3. Ϣʔβʹ͸ݟ͑ͳ͍͚Ͳ಺෦Ͱݡ͘ͳ͍ͬͯΔ  #JH2VFSZ
    .-
    1. ಺෦ͷϩδοΫͰ࢖͍ͬͯΔ 2. ࣮͸࢖ΘΕͯ·͢

17. ©2019 Wantedly, Inc. ࠓ೔ͷTake-Home Messages

18. ©2019 Wantedly, Inc. 1. ૊৫ͷ࿩ 2. σʔλͷ࿩ 3. ϓϩδΣΫτͷਐΊํͷ࿩

19. ©2019 Wantedly, Inc. ૊৫ͷ࿩

20. ©2019 Wantedly, Inc. ʮ૊৫ߏ଄͸ઓུΛܾΊΔʯ ΠΰʔϧɾΞϯκϑ
    ʢ͔͍͍ͬ֨͜ݴΛݴ͍͔͚ͨͬͨͩʣ

21. ©2019 Wantedly, Inc. ૊৫ͷ࿩ 8BOUFEMZͰ͸ɺϓϩμΫτνʔϜʹػցֶश ΤϯδχΞ͕͍Δ MLΤϯδχΞ ̏ਓ MLΤϯδχΞ ̎ਓ

    Infrastructure Visit People

22. ©2019 Wantedly, Inc. ૊৫ͷ࿩  Ϣʔβ·Ͱͷڑ཭͕͍ۙ
    1. ߦͬͨվળ͕μΠϨΫτʹϢʔβ·Ͱಧ͘  ϓϩμΫτʹՁ஋ͷ͋ΔվળΛߦ͍΍͍͢
    

    1. ϓϩμΫτͷ޲͔͍ͬͯΔํ޲Λڞ༗͍ͯ͠ΔͷͰᴥᴪ͕ى͜ΓͮΒ͍ 2. ඞཁͰ͋Ε͹ϓϩμΫτͷϏδωεϩδοΫ·ͰखΛೖΕΒΕΔ  վળ͚ͩͰͳ͘৽͍͠ػೳΛࣗવͱٞ࿦͢Δ
    1. ։ൃνʔϜͷҰһͳͷͰ਺஋తͳվળ͚ͩͰͳ͘ʮ͜͏͋Δ΂͖ʯํ޲Λٞ࿦ͯ͠ਐΊΒΕΔ

23. ©2019 Wantedly, Inc. ૊৫ͷ࿩ ଞͷ૊৫ͷ͋Γํ σʔλαΠΤϯςΟετ ΤϯδχΞ σβΠφ Ϛωʔδϟ શࣾԣஅ

    MLνʔϜ ϓϩμΫτνʔϜ શࣾԣஅ σʔλ෼ੳνʔϜ MLΤϯδχΞ ґཔ ݁Ռ

24. ©2019 Wantedly, Inc. ૊৫ͷ࿩ ଞͷ։ൃνʔϜͱ͸Ͳ͏ؔΘΔͷ͔ʁ
    1. ։ൃελΠϧ: APIΛఆٛͯ͠WEBଆͱMLଆͰฒߦͯ͠։ൃ 1. e.g.

    Ϣʔβʹෳ਺ͷهࣄΛฦ͍ͨ͠ɻهࣄͷϦετ͸WEBଆͰऔಘ͢ΔɻMLͷAPIΛݺͼग़ͯ͠ॱংΛܾఆ͢Δ 2. ؔΘΓํ 1. WEBଆ: લ΋ͬͯAPI spec͚ܾͩΊ͓ͯ͘ͱɺSTUBͯ͠MLଆΛ଴ͨͣʹ։ൃՄೳɻ 2. Πϯϑϥ: service-in͢ΔલʹɺෛՙͷϝτϦΫεͱ࠷ѱࢮΜͰ΋͍͍API͔ΫϦςΟΧϧͳAPI͔Λ͢Γ߹Θͤ 3. ίϛϡχέʔγϣϯ 1. ࣄલʹʮਫ਼౓ͷظ଴஋ʯΛ͢Γ߹ΘͤΔͱ͍͍ɻ 2. ௒ݡ͍API͕αΫοͱͰ͖Δ͜ͱ͸΄΅ແ͍ɻ99.9ˋͷਫ਼౓͕ඞཁͳཁ݅ͳͷ͔ɺݟͤํΛڞ༗͢Δ

25. ©2019 Wantedly, Inc. 8BOUFUEMZͰ͸ɺϓϩμΫτνʔϜʹ.-ΤϯδχΞ͕ೖΔͱ͍͏ಇ͖ํΛ औ͍ͬͯ·͢ɻϢʔβʹۙ͘ɺϓϩμΫτυϦϒϯͳಇ͖ํ͕͠΍͍͢ͱ ͍͏ϝϦοτ͕͋Γ·͢ɻ
    ϓϩμΫτνʔϜͷதͰ͸ɺࣄલʹʮޓ͍ͷ੹೚ൣғʯͱʮਫ਼౓ͷظ଴஋ʯ Λ͸͖ͬΓͤ͞Δͱࠞཚͳ͘։ൃ͕ਐΈ·͢ɻ ૊৫ͷ࿩

26. ©2019 Wantedly, Inc. %FFQ-FBSOJOHྠߨձ΍ͬͯ·͢
    ຖिਫ༵೔ʙ!8BOUFEMZ

27. ©2019 Wantedly, Inc. σʔλ

28. ©2019 Wantedly, Inc. σʔλ ໘ന͍ྫ͑ʮσʔλ͸ݪ༉ʯ
     ͦͷ··Ͱ͸࢖͑ͳ͍ɻਫ਼੡͕ඞཁ
     Ճ޻͢Δͱ༷ʑͳ༻్ʹ࢖͑Δ
    

    ੈքதͰσʔλͷऔΓ߹͍Λ͍ͯ͠Δ
    ग़లɿෆ໌

29. ©2019 Wantedly, Inc. Wantedlyͷ໘ന͍σʔλ w ϢʔβͷϓϩϑΟʔϧ
    ਺ඦສΦʔμʔ
    w Ϣʔβͷͭͳ͕ΓωοτϫʔΫΤοδ
    ਺ԯΦʔμʔ
    w ಡΈऔΒΕ໊ͨࢗ
    ԯ͘Β͍

30. ©2019 Wantedly, Inc. Data lake ඞཁͳσʔλ͸#JH2VFSZʹ
    ू໿Ͱ͖Δ࢓૊Έ͕͋Δ
    "OBMZUJDT

31. ©2019 Wantedly, Inc. ؾΛ͚ͭΔ͜ͱ w σʔλपΓͰ࣮ࡍ͋ͬͨ໰୊
    1. RPAͷ׆༻Ͱҙຯͷͳ͍େྔͷΞΫηε͕͋ͬͨͨΊɺݟ͔͚ͷฏۉར༻਺্͕͕ͬ ͨɻίϯόʔδϣϯΛ൐Θͳ͍ϩά͕૿͑ͯ਺஋͕มԽͨ͠ 2.

    ৽͍͠ػೳͷϦϦʔεͰςʔϒϧͷΧϥϜʹ৽͍͠஋͕ೖΔΑ͏ʹͳͬͨɻલ΋ͬͯ ݕ஌ͨͨ͠ΊϦϦʔεલʹमਖ਼Ͱ͖͕ͨɺ஌Βͳ͔ͬͨΒϞσϧ͕յΕ͍͔ͯͨ΋

32. ©2019 Wantedly, Inc. ؾΛ͚ͭΔ͜ͱ w σʔλͷϓϥΠόγʔͷ໰୊
    1. ίϯϓϥΠΞϯεΛकΓ·͠ΐ͏

33. ©2019 Wantedly, Inc. 8BOUFEMZͰ͸େن໛ͳϢʔβؔ࿈ͷσʔλΛ#JH2VFSZʹू໿͞ΕΔͱ͍ ͏ஈ֊·Ͱ࣮ݱ͞Ε͓ͯΓɺσʔλΛ࢖͏͜ͱࣗମ͸༰қʹͳΓ·ͨ͠ɻ ࠓޙ͸ߋʹਐΜͰ׆༻͠΍͕͢͞ΛղܾʹͳΓ·͢ɻ
    σʔλ΍ϩά͸αʔόͷ࣮૷͚ͩʹ׬݁ͯ͠ͳ͘ɺϝτϦΫε΍σʔλΛ ࢖͏.-ͷϞσϧʹ΋ӨڹΛ༩͑·͢ɻαʔόͷมߋ͕.-ϞσϧΛյ͞ͳ ͍Α͏ʹपΓʹڞ༗͠·͠ΐ͏ɻʢຊ౰͸ҟৗݕ஌ͳͲͰγεςϜతʹक Γ͍ͨʣ

    σʔλ

34. ©2019 Wantedly, Inc. ϓϩδΣΫτͷਐΊํ

35. ©2019 Wantedly, Inc. ػցֶशͷϓϩδΣΫτ͸Ͳ͏΍ͬͯ࢝·Δͷʁ

36. ©2019 Wantedly, Inc. έʔεόΠέʔεͰҰൠԽ͕೉͍͠
    
    খ͍͞ϓϩδΣΫτ͸ࡶஊϕʔε͕
    ࢝·Γͷ͜ͱ͕ଟ͍ؾ͕͢Δ
    

37. ©2019 Wantedly, Inc. ੈͷதͷ#FTU
    1SBDUJDFΛ୳ͦ͏

38. ©2019 Wantedly, Inc. Machine Learning Best Practice • ϧʔϧ1: ػցֶशΛ࢖Θͳ͍Ͱ࢝ΊΒΕͳ͍͔ߟ͑Δ

    • ϧʔϧ2: ઃܭͯ͠ࢦඪΛ࡞ΔʢݱࡏͷγεςϜΛཧղ͔ͯ͠ΒࢦඪΛ࡞Δʣ • ϧʔϧ3: ϩδοΫ͕ෳࡶʹͳͬͬͨΒػցֶशΛબ୒͢Δ ref: https://developers.google.com/machine-learning/guides/rules-of-ml/

39. ©2019 Wantedly, Inc. ϓϩδΣΫτͷਐΊํ ྫɿʮ͓஌Γ߹͍Ͱ͔͢ʁʯػೳ

40. ©2019 Wantedly, Inc. ϓϩδΣΫτͷਐΊํ ख୳Γظ
    ϧʔϧ૿Ճظ
    ػցֶश • ڞ௨ͷ஌ਓ਺͕ଟ͍ਓʢΛਪન͢Δʣ •

    ϝτϦΫε=ϦΫΤετ਺ͱঝೝ཰ • ڞ௨ͷ஌ਓ਺͕ଟ͍ਓ • ಉ͡ձࣾͷਓ • ڞ௨ͷ໊ࢗΛ͍࣋ͬͯΔ਺͕ଟ͍ਓ • ಉ࣌ʹεΩϟϯ͞ΕͨਓͰڞ௨ͷͭ ͳ͕Γ͕͋Δ • ͜ͷ૊Έ߹Θͤ • ɾɾɾ • Deep Learningϕʔεͷਪન • + ABςετ

41. ©2019 Wantedly, Inc. ϓϩδΣΫτͷਐΊํ ػցֶशΛಋೖ͢Δͱ͖ʹ͸
    े෼ෳࡶͰݱঢ়ͷࢦඪΛվળͰ͖ͦ͏ͳ՝୊ΛબͿ

42. ©2019 Wantedly, Inc. ·ͱΊ

43. ©2019 Wantedly, Inc. ·ͱΊ  ػցֶशͷϓϩμΫτ͸ɺ8&#ΤϯδχΞɾΠ ϯϑϥνʔϜͱҰॹʹ࡞͍ͬͯΔ
     ϓϩμΫτνʔϜͷதʹ.-ΤϯδχΞ͕͍Δߏ ଄ͳͷͰɺҰॹʹٞ࿦ͯ͠։ൃͰ͖Δ؀ڥ
    

     ద੾ͳ՝୊Λݟ͚ͭͯ.-ͰՁ஋Λग़͢͜ͱʹڵ ຯΛ޿͛ͯ΄͍͠

44. ©2019 Wantedly, Inc. References • Rules of Machine Learning: Best

    Practices for ML Engineering • https://developers.google.com/machine-learning/guides/rules-of-ml/ • Wantedly ͷػցֶशϓϩμΫτ։ൃΛࢧ͑Δػցֶशج൫ / #rejectcon2018 • https://speakerdeck.com/south37/number-rejectcon2018 Photo Credit • https://unsplash.com/photos/PMwu9gfCSbw