Data Analysis Platform Development @M3, inc.

8274bab3875ee7d5d7482c4aae4f6990?s=47 hsasakawa
September 10, 2018
0
2.9k

Data Analysis Platform Development @M3, inc.

8274bab3875ee7d5d7482c4aae4f6990?s=128

hsasakawa

September 10, 2018
Tweet

More Decks by hsasakawa

See All by hsasakawa
8274bab3875ee7d5d7482c4aae4f6990?s=48 hsasakawa
0
2.7k
8274bab3875ee7d5d7482c4aae4f6990?s=48 hsasakawa
4
1.1k
8274bab3875ee7d5d7482c4aae4f6990?s=48 hsasakawa
0
560

Featured

See All Featured
7cbd3f5f922d798cc312eaf596de7ae6?s=48 iamctodd
9
1.3k
0c6fd6a08d0f898159cda7cafcacf07f?s=48 afnizarnur
175
14k
027d1ebf66cc039a0bd3b55eeadbe75d?s=48 sachag
447
35k
F68cb25ae3e5c2106997454b13b7737d?s=48 brad_frost
154
6.1k
1b75d89772b7eea1f6c89fbf362607d9?s=48 moore
123
21k
9fa239b3154a0169d99ab7bf1422dd12?s=48 marcelosomers
221
14k
78b475797a14c84799063c7cd073962f?s=48 holman
458
270k
5f83ef806155b403c3393160ce51f955?s=48 jlugia
215
16k
06f8b41980eb4c577fa40c41d5030c19?s=48 keathley
12
430
Bfd6b681ec6e8c9bef82ff0521c364f7?s=48 kastner
51
1.8k
A60068bce2e73de3a37ca9d2dbe36092?s=48 bryan
100
11k
96270e4c3e5e9806cf7245475c00b275?s=48 addyosmani
1348
190k

Transcript

  1. Data Analysis Platform Development merpay × M3 ػցֶश NIGHT Hirohito

    Sasakawa data engineer @ M3, inc.

  2. ࠓ೔࿩͢͜ͱ w .ͷσʔλ෼ੳج൫ʹ͍ͭͯ w σʔλ࿈ܞδϣϒͷ։ൃ w ·ͱΊ

  3. M3ͷσʔλ෼ੳج൫ʹ͍ͭͯ

  4. M3ͷσʔλ෼ੳج൫ͷݱঢ় 2VFSZ 2VFSZ 2VFSZ 1SPEVDUJPO … 3FQPSU … 4ZOD 4ZOD

    2VFSZ #JH2VFSZ

  5. M3ͷσʔλ෼ੳج൫ͷݱঢ় 2VFSZ 2VFSZ 2VFSZ 1SPEVDUJPO … 3FQPSU … 4ZOD 4ZOD

    2VFSZ #JH2VFSZ ҆Ձ͔ͭߴ଎ͳ #JH2VFSZΛ ׆༻͍͖͍ͯͨ͠

  6. σʔλ෼ੳج൫ͷ໰୊఺ Ͳ͜ʹɺͲΜͳ σʔλ͕͋Δͷ͔ Θ͔Βͳ͍ #JH2VFSZʹ ࿈ܞ͞Ε͍ͯͳ͍ σʔλ͕͋Δ  XJLJΛݟΔ ͳ͍৔߹΋

      ਓʹฉ͘  ෼ੳʹ͔͔Δ࣌ؒͷ
 େ෦෼͸͜͜ ݸਓͷײ૝  ࿈ܞδϣϒͷ࣮૷଴ͪ  ͳΔ΂͘؆୯ʹ࣮૷Ͱ͖Δ
 ͱخ͍͠

  7. σʔλ෼ੳج൫ͷ໰୊఺ Ͳ͜ʹɺͲΜͳ σʔλ͕͋Δͷ͔ Θ͔Βͳ͍ #JH2VFSZʹ ࿈ܞ͞Ε͍ͯͳ͍ σʔλ͕͋Δ  XJLJΛݟΔ ͳ͍৔߹΋

      ਓʹฉ͘  ෼ੳʹ͔͔Δ࣌ؒͷ
 େ෦෼͸͜͜ ݸਓͷײ૝  ࿈ܞδϣϒͷ࣮૷଴ͪ  ͳΔ΂͘؆୯ʹ࣮૷Ͱ͖Δ
 ͱخ͍͠

  8. ϝλσʔλͷݕࡧγεςϜ #JH2VFSZͷ wσʔληοτ໊ɺςʔϒϧ໊ɺΧϥϜ໊ wσʔληοτɺςʔϒϧɺΧϥϜͷEFTDSJQUJPO ͰΩʔϫʔυݕࡧͰ͖ΔγεςϜΛߏங

  9. ϝλσʔλͷݕࡧγεςϜ #JH2VFSZͷ wσʔληοτ໊ɺςʔϒϧ໊ɺΧϥϜ໊ wσʔληοτɺςʔϒϧɺΧϥϜͷEFTDSJQUJPO ͰΩʔϫʔυݕࡧͰ͖ΔγεςϜΛߏங Ωʔϫʔυݕࡧ

  10. ϝλσʔλͷݕࡧγεςϜ #JH2VFSZͷ wσʔληοτ໊ɺςʔϒϧ໊ɺΧϥϜ໊ wσʔληοτɺςʔϒϧɺΧϥϜͷEFTDSJQUJPO ͰΩʔϫʔυݕࡧͰ͖ΔγεςϜΛߏங Ωʔϫʔυݕࡧ ࠷ۙӾཡͨ͠ਓ ࠷΋Α͘Ӿཡͨ͠ਓ Λදࣔ͠໰͍߹ΘͤͨΓͰ͖ΔΑ͏ʹ

  11. σʔλ෼ੳج൫ͷ໰୊఺ Ͳ͜ʹɺͲΜͳ σʔλ͕͋Δͷ͔ Θ͔Βͳ͍ #JH2VFSZʹ ࿈ܞ͞Ε͍ͯͳ͍ σʔλ͕͋Δ  XJLJΛݟΔ ͳ͍৔߹΋

      ਓʹฉ͘  ෼ੳʹ͔͔Δ࣌ؒͷ
 େ෦෼͸͜͜ ݸਓͷײ૝  ࿈ܞδϣϒͷ࣮૷଴ͪ  ͳΔ΂͘؆୯ʹ࣮૷Ͱ͖Δ
 ͱخ͍͠

  12. σʔλ෼ੳج൫ͷ໰୊఺ Ͳ͜ʹɺͲΜͳ σʔλ͕͋Δͷ͔ Θ͔Βͳ͍ #JH2VFSZʹ ࿈ܞ͞Ε͍ͯͳ͍ σʔλ͕͋Δ  XJLJΛݟΔ ͳ͍৔߹΋

      ਓʹฉ͘  ෼ੳʹ͔͔Δ࣌ؒͷ
 େ෦෼͸͜͜ ݸਓͷײ૝  ࿈ܞδϣϒͷ࣮૷଴ͪ  ͳΔ΂͘؆୯ʹ࣮૷Ͱ͖Δ
 ͱخ͍͠

  13. σʔλ࿈ܞδϣϒͷ࣮૷

  14. ڊਓͷݞʹ৐Δ If I have seen further it is by standing

    on the shoulders of giants. - Bernardus Carnotensis ԕ͘·Ͱݟ౉ͤΔͷ͸ɺͻͱ͑ʹڊਓͷݞʹ৐͍ͬͯΔ͔Β γϟϧτϧͷϕϧφʔϧ

  15. ৽͍͠σʔλ࿈ܞδϣϒͷٕज़ελοΫ

  16. ৽͍͠σʔλ࿈ܞδϣϒͷٕज़ελοΫ σʔλͷόϧΫϩʔυπʔϧ ༷ʑͳιʔε λʔήοτʹ ରԠ ϓϥάΠϯػߏ   3%#.4 

    #JH2VFSZ  4  $47 +TPOpMF :BNMϕʔεͷ؆୯ͳهड़Ͱ ઃఆΛॻ͚Δ  ςʔϒϧ౰ͨΓΧϥϜ਺ ߦ
 ͘Β͍ͷهड़ྔ  ΤϯδχΞͳΒ෼͋Ε͹
 ॻ͚ΔΑ͏ʹ

  17. ৽͍͠σʔλ࿈ܞδϣϒͷٕज़ελοΫ

  18. ৽͍͠σʔλ࿈ܞδϣϒͷٕज़ελοΫ ϫʔΫϑϩʔ؅ཧπʔϧ ॲཧͷ࿈࠯ ϫʔΫϑϩʔ Λ
 ίʔυͰ؅ཧ͢Δπʔϧ  ΠέͯΔ$SPO  δϣϒͷґଘؔ܎Λ:BNM

    ϕʔε  Ͱهड़  ಠཱͳॲཧ͸ฒྻ࣮ߦ΋Մೳ  ஗Ԇ؂ࢹػೳ  ֤छ௨஌ ਖ਼ৗɺҟৗऴྃ࣌   ϦτϥΠػೳ ਓؒ͸ॲཧͷલޙͰႈ౳ʹͳΔ Α͏ʹॲཧΛॻ͚ͩ͘ͰΑ͍  ॲཧಉ࢜ͷؔ܎͸%JHEBH͕؅ཧɺ
 ࣮ߦͯ͘͠ΕΔ

  19. ϫʔΫϑϩʔઃܭͷϕετϓϥΫςΟε (WIP) w EJHEBHͷXPSLqPXઃఆϑΝΠϧ͸ɺͦͷϑΝΠϧͷ αϒσΟϨΫτϦͷϑΝΠϧ͔͠ॲཧର৅ʹͰ͖ͳ͍

  20. ϫʔΫϑϩʔઃܭͷϕετϓϥΫςΟε (WIP) w EJHEBHͷXPSLqPXઃఆϑΝΠϧ͸ɺͦͷϑΝΠϧͷ αϒσΟϨΫτϦͷϑΝΠϧ͔͠ॲཧର৅ʹͰ͖ͳ͍ EC@XPSLqPXEJH͸ɺ
 EC@MPBEҎԼͷFNCVMLͷ
 ϩʔυઃఆϑΝΠϧ΍ɺ DPOGҎԼͷڞ௨ઃఆΛ
 ࢀরͰ͖ͳ͍

  21. ϫʔΫϑϩʔઃܭͷϕετϓϥΫςΟε (WIP) w σΟϨΫτϦߏ੒ΛΉ΍Έʹਂͨ͘͘͠ͳ͍ w ιϑτϦϯΫͰରԠ

  22. ϫʔΫϑϩʔઃܭͰࠔ͍ͬͯΔ͜ͱ w FNCVMLͷQMVHJOΛCVOEMFͰ؅ཧ͢Δ৔߹ͷઃܭ w ݱঢ়͍͍ํ๏͕ݟ͔ͭΒͣɺXPSLqPXͷઌ಄Ͱ FNCVMLCVOEMFJOTUBMM͢ΔλεΫΛىಈ w ͍͍ํ๏͕͋Ε͹ڭ͍͑ͯͩ͘͞

  23. ·ͱΊ

  24. ·ͱΊ w .ͷσʔλ෼ੳج൫ʹ͍ͭͯ w #JH2VFSZͷར༻Λਪਐ͍͖͍ͯͨ͠ w ෼ੳج൫ͷ՝୊ w Ͳ͜ʹɺͳΜͷσʔλ͕͋Δʁ w

    #JH2VFSZʹ͞Ε͍ͯͳ͍σʔλ͕͋Δ w σʔλ࿈ܞδϣϒͷ࣮૷ w σʔλ࿈ܞδϣϒΛ؆୯ʹॻ͚ΔEJHEBH FNCVML͸ศར w ਓؒ͸ຊདྷ͢Δ΂͖࢓ࣄʹूத