アットホームな分析基盤の作り方 / Homemade Machine Learning Toolkits

7dc8611c26c3ca62c551109c65d04270?s=47 Yuichiro Someya
July 23, 2018
Programming
1
610

アットホームな分析基盤の作り方 / Homemade Machine Learning Toolkits

分析基盤トーク #1
https://daft.connpass.com/event/93036/

7dc8611c26c3ca62c551109c65d04270?s=128

Yuichiro Someya

July 23, 2018
Tweet

More Decks by Yuichiro Someya

See All by Yuichiro Someya
7dc8611c26c3ca62c551109c65d04270?s=48 ayemos
0
3.6k
7dc8611c26c3ca62c551109c65d04270?s=48 ayemos
3
1.5k
7dc8611c26c3ca62c551109c65d04270?s=48 ayemos
0
2.4k
7dc8611c26c3ca62c551109c65d04270?s=48 ayemos
15
4.4k
7dc8611c26c3ca62c551109c65d04270?s=48 ayemos
1
250
7dc8611c26c3ca62c551109c65d04270?s=48 ayemos
15
9.1k
7dc8611c26c3ca62c551109c65d04270?s=48 ayemos
1
2.3k
7dc8611c26c3ca62c551109c65d04270?s=48 ayemos
0
290
7dc8611c26c3ca62c551109c65d04270?s=48 ayemos
0
70

Other Decks in Programming

See All in Programming
3e31ffe1dc0eccbe2f30b99de11246cf?s=48 oikawat
0
100
770ede26fb450c104128e35ac37711fd?s=48 musaprg
0
710
91afa794270c0668bdc3462d7da3506e?s=48 gyulavoros
0
150
Acb6390b6c4b5192f40e10601b63dafc?s=48 twkiiim
0
1.2k
3499a1d71fa70b8ee44816ca9e7329fe?s=48 bells17
0
170
744a38d972036c3bd0bcdaddafdd5f26?s=48 mathetake
4
2.1k
0ca0c0ec6efe3a7f5220332a910e6da0?s=48 shinyoshiaki
1
520
C9ab1175a6981a2f67ce8d08aa17c15a?s=48 mpilquist
0
130
41a66760b3483d518d9e48a7da37f91b?s=48 shibadog1121
9
1.7k
88493e31e8ac7540094d35f7cda46c8a?s=48 lnit
8
3.2k
Fa54d97af93719f9aa82873de3acb3b3?s=48 decoc
1
460
Bf3acef686273e03fa4fdf125fdad3e9?s=48 kuncevic
0
120

Featured

See All Featured
6804f1775cb4babfcc3851298566fbce?s=48 tanoku
84
8.3k
Af6a12710770ad9a7cfd08c97efd40d3?s=48 pedronauck
648
110k
91cefdf141106fa10674aae74ce05890?s=48 yeseniaperezcruz
296
30k
C86443373fbfe92996aa882d0d7a59f8?s=48 imathis
477
150k
Ae14cc4491ac334f9cd23f9f93b4305e?s=48 orderedlist
325
35k
D36d2c1821af9249b69ff7f5ed60529b?s=48 tammielis
236
23k
95d9f37115fbb0d13135d0f77132f856?s=48 morganepeng
4
430
78b475797a14c84799063c7cd073962f?s=48 holman
287
130k
5b9fe87ec1faa67a4599782930f45ec9?s=48 sstephenson
144
11k
433acaea1012b25d97ae66da9b998dad?s=48 malarkey
189
8.2k
Dafc4723e9a1c067796c0fec6f509774?s=48 lemiorhan
620
40k
C4de88ea47538e4594750e3861a341c8?s=48 brettharned
91
2.8k

Transcript

  1. ΞοτϗʔϜͳ
 ෼ੳج൫ͷ࡞Γํ BZFNPT

  2. ࣗݾ঺հ  છ୩༔Ұ࿠<:VJDIJSP4PNFZB>  ౦ژ޻ۀେֶେֶӃܭࢉ޻ֶम࢜  ΫοΫύουגࣜձࣾݚڀ։ൃ෦
 ϦαʔνΤϯδχΞ೥݄d  ػցֶशج൫

    Ϩγϐσʔλͷ෼ੳ౳ UXJUUFSDPN!BZFNPT@Z HJUIVCDPNBZFNPT IUUQTXXXBZFNPTNF

  3. ΫοΫύουݚڀ։ൃ෦  ೥݄ʹൃ଍  ౰࣌͸໊ͷϝϯόʔ  ೥݄ݱࡏ͸ࠃ಺ʹ໊ ւ֎ʹ໊

  4. ΫοΫύουͱػցֶश  .ZϑΥϧμ ͓ؾʹೖΓػೳ ಺ͷϨγϐΛࣗಈΧςΰϦ෼ྨ  ʮྉཧ͖Ζ͘ʯεϚʔτϑΥϯ಺ͷྉཧࣸਅΛΧϨϯμʔܗࣜ ͰৼΓฦΓ  ࡐྉ໊ͷਖ਼نԽ

     ౳ʑ  ৄ͘͠͸IUUQTUFDIMJGFDPPLQBEDPN

  5. BHFOEB  ΫοΫύουͷ෼ੳج൫ͷ঺հ  ෼ੳج൫ͷ͜Ε͔Β

  6. ج൫঺հͦͷ;PPFZ

  7. None

  8. ෼ੳͱ࣮ݧΛ֤͕ࣗࣗ༝ʹߦ͏ͨΊͷ࠷௿ݶͷج൫

  9. ج൫঺հͦͷ̍;PPFZ  ܭࢉػ؀ڥߏங༻$IBU#PU  ܭࢉػ؀ڥͷ࡞੒ʗ্ཱͪ͛ʗఀࢭʗ࡟আ  ΞΠυϧঢ়ଶͷܭࢉػΛࣗಈఀࢭ

  10. None

  11.  $6%" DV%//  $6%" DV%//  %FFQ-FBSOJOH".*+BO
 FUD 0VUHPJOH8FCIPPLT

    TMBDL@VJE6  DPNNBOEDSFBUFXPSLCFODI MBNCEB*OWPLF  71$ 4VCOFU /BNFλά౳
 ؀ڥಛ༗ͷઃఆ΋͜͜Ͱ΍Δ  ΠϯελϯεʹATMBDL@VJEAΛ
 λά෇͚ͯ͠ॴ༗ऀΛ؅ཧ͢Δ DSFBUFXPSLCFODI ;PPFZ

  12. ATTIBZFNPTXPSLCFODIEOTDPNA ;PPFZ *ODPNJOH8FCIPPLT TTI

  13. ;PPFZ 4UPQ  ΞΠυϧͳΠϯελϯεΛࣗಈఀࢭ

  14. ج൫঺հͦͷ̍;PPFZ  ಺੡ͷԾ૝*NBHF %FFQ-FBSOJOH".*  Λར༻Մೳ  Πϯελϯε࡞੒ͷೖΓޱΛҰຊԽ  ωοτϫʔΫɺηΩϡϦςΟपΓͷࡉ͔͍ઃఆΛٵऩ


    ར༻ଆ͸*NBHFΛ൪߸ͰબͿ͚ͩ  ࣾ಺ΠϯϑϥͷมԽʹରͯ͠͸πʔϧͷΞοϓσʔτͰରԠ  ւ֎ͷϝϯόʔ΋ར༻  IUUQTBXTBNB[PODPNKQNBDIJOFMFBSOJOHBNJT

  15. ج൫঺հͦͷ̍;PPFZ  ֤͕ࣗSPPUΛऔΕΔΠϯελϯεΛ෷͍ग़͢  গʑલ࣌୅తʁ  ॊೈੑ͸ߴ͘ɺ࣮ݧஈ֊ͷ؀ڥͱͯ͠͸࢖͍৺஍͕Α͍  ࣗಈఀࢭ΋͋ΔͷͰ֤ࣗ҆৺ͯ͠ඞཁͳ্ཱ͚ͩͪ͛ΒΕΔ 

    ʮ࣮ݧʯΛؚΊαϙʔτ͢Δڞ௨ج൫Λ࣋ͨͳ͍ͷͰ
 ʮ࣮ݧʯʮຊ൪ʯͷ1PSUBCJMJUZ͸ผ్ิڧ͢Δඞཁ͕͋Δ

  16. ج൫঺հͦͷσʔλج൫

  17. None

  18. ͍ΘΏΔ%8) 42-ϕʔεͷ&5-ج൫

  19. σʔλج൫  ͜Ε͸ओʹผνʔϜ σʔλج൫άϧʔϓ ʹΑΔ؅ཧ  "NB[PO3FETIJGUʹΑΔ%8)ߏங  .Z42-3FETIJGU΁ͷΠϯϙʔτδϣϒΛίʔυ؅ཧ 

    ৄ͘͠͸IUUQTUFDIMJGFDPPLQBEDPNFOUSZ 

  20. σʔλج൫ͷར༻ঢ়گ  %8)͕ਆ  &5-  ࣮ݧͷ౓ʹ֤͕ࣗ౎౓ߦ͍ɺεΫϦϓτԽ͢Δࣄ͕ଟ͍  ڞ௨&5-ج൫ͷར༻ɺதؒσʔλͷڞ༗ͳͲʹର͢Δχʔζ ͸ͦ͜·Ͱେ͖͘ͳ͍

    ݱঢ়

  21. ج൫঺հͦͷίʔυ؅ཧ

  22. ج൫঺հͦͷίʔυ؅ཧ  ج൫ʁ   DPPLJFDVUUFSEBUBTDJFODF ࣾ಺GPSL Λར༻  ϓϩδΣΫτߏ੒ͷςϯϓϨʔτ

     ATSDEBUBA ATSDNPEFMAσʔλੜ੒ɺֶशεΫϦϓτ  AEBUBA ANPEFMTAσʔλɺϞσϧ  HJUʹ͸DIFDLJOͤͣɺ4ͱTZOD͢Δ ANBLFTZOD@EBUB@UP@TA

  23. ج൫঺հͦͷίʔυ؅ཧ  IUUQTHJUIVCDPNEPDLFSTDJFODFDPPLJFDVUUFSEPDLFS TDJFODF  DPPLJFDVUUFSEBUBTDJFODFΛࢀߟʹͨ͠ςϯϓϨʔτ  EPDLFSΛར༻͠ɺϓϩδΣΫτͷ࣮ݱੑΛ͞ΒʹߴΊΔ  OPUFCPPLͷ্ཱͪ͛

    1PSUGPSXBSE౳ߦ͏UBSHFU΋

  24. ج൫·ͱΊ  ݱঢ়͸౷ҰԽ͞ΕͨػցֶशϓϥοτϑΥʔϜΛར༻͍ͯ͠ͳ͍  ࣗ੡πʔϧͷ૊Έ߹Θͤ %8)Ͱ͓͓ΉͶճ͍ͬͯΔ  ج൫ͦͷ΋ͷͷ؅ཧίετͳͲߟྀͭͭ͠ਐΊͨ݁Ռ
 ݱঢ়͸ ൺֱతΧδϡΞϧͳӡ༻ͱͳ͍ͬͯΔ

  25. ෼ੳج൫ͷࠓޙ ʙΞοτϗʔϜͳ෼ੳج൫͔Βେ౷Ұج൫΁ͷಓͷΓʙ ͔͜͜Βߟ࡯

  26. ෼ੳج൫ͷࠜຊత՝୊  (FOFSJDBOE&YUFOTJCMF

  27. ෼ੳج൫ͷࠜຊత՝୊ 5'9"5FOTPS'MPX#BTFE1SPEVDUJPO4DBMF.BDIJOF-FBSOJOH1MBUGPSN ΑΓ l5IFNBDIJOFMFBSOJOHQMBUGPSNNVTUCFHFOFSJD FOPVHIUPIBOEMFUIFNPTUDPNNPOTFUPGMFBSOJOH UBTLTBTXFMMBTCFFYUFOTJCMFUPTVQQPSUPOFP⒎ BUZQJDBMVTFDBTFTz ҙ༁ ػցֶशج൫͸แׅత͔֦ͭுՄೳͰ͋Δ΂͖

  28. (FOFSJDBOE&YUFOTJWF  ʰ࣮ݧ͔Βຊ൪ӡ༻·Ͱɺ౷߹తͳ؀ڥͰػցֶशʱ
 ͠Α͏ͱ͍ͯ͠Δ  (FOFSJDͳΔ΂͘ଟ͘ͷϢʔεέʔεʹ ಁաతʹ ରԠ͍ͨ͠  ྑ͍ந৅Խͱ"1*֦ॆͷؤுΓ͖ͬͱେม

     &YUFOTJWFྫ֎తͳέʔεʹରͯ͠΋ গͳ͍࿑ྗͰ ରԠ͍ͨ͠  ೚ҙͷίʔυΛࠩ͠ࠐΊΔ৔ॴΛ༻ҙ͢Δɺͱ͔ʜ

  29. (FOFSJDBOE&YUFOTJWF  αϙʔτ͢Δ໰୊ͷόϦΤʔγϣϯͱͷઓ͍͸ଓ͘  ෼ྨʗճؼ͘Β͍ͷந৅Խ͔Β࿙Εͯ͠·͏෦෼͕ແࢹͰ͖ͳ͍ ྔʹͳ͍ͬͯΔ ཁग़య   ج൫ͱ͍͏ܕʹ͸ΊΔ͜ͱͰࣦΘΕΔॊೈੑͷ૯ྔΛ༧ଌ͢Δ͜

    ͱ͸ग़དྷͳ͍ ཁग़య

  30. ߟ࡯  ج൫͸େมͳ͸ͣͳͷͰ ࡞Δਓͱ࢖͏ਓ͕૿͑ͯίϛϡχςΟ͕੒௕ ͢Δඞཁ͕͋Δ  ҰํɺνʔϜͷεέʔϧʹ࠷దԽ͞ΕͨπʔϧΛར༻ʗࣗ੡ͯ͠ࡁ·ͤ Δͱ͍͏બ୒ࢶ΋͋Δ  ͦͷΑ͏ͳݱ৔͔Β͸౷Ұ͞Εͨ෼ੳج൫ʹΑͬͯ΋ͨΒ͞ΕΔϝϦο

    τ͕Πϝʔδ͠ʹ͍͘

  31. ߟ࡯  ͷͰɺ લड़ͨ͠Α͏ͳ՝୊Λ্๊͑ͨͰ ෼ੳج൫͕ଧͪग़͢ϝϦοτ͸Կ͔ɺΛߟ͑Δ ͷ͕େࣄͩͱࢥ͏  ػցֶशΛج൫ͳ͠Ͱεέʔϧͤ͞Δͷ͕ ෆՄೳʹۙ͘ ೉͍͔͠Βɺ


    ಋೖʹ൐͏ίετ΍՝୊Λड͚ೖΕͯͰ΋ج൫ʹैͬͯ։ൃ͢Δͱ͍͏બ୒Λ͢΂͖ɺ ͳͷ͔  εέʔϧ͕೉͍͠ͱ͍͏࣮ײΛ ۀքશମ͕ ࠓͷ࣌఺Ͱ ಘ͍ͯΔͷ͔  ڞ௨ج൫Խ͢Δ͜ͱʹΑͬͯಘΒΕΔߴڃͳػೳ "#ςετɺ؂ࢹͳͲ 
 ͷັྗΛԡ͠ग़͢ͷ͔  ౳ʑ

  32. ߟ࡯  ʮσʔλͷྲྀΕ͕͋ΓɺγεςϜ͕σʔλͱڞʹ੒௕͢ΔΑ͏ͳγε ςϜʯ·Ͱࢹ໺Λ޿͛Δͱʜ  ػցֶशΛ༻͍ͳ͍ ݕࡧΤϯδϯ΋ٞ࿦ͷର৅
 ͱͳΔͷ͕ඞવ  ݕࡧΤϯδϯࣗମ͸ಠࣗਐԽͯ͠ΔͷͰ৽ͨͳ


    ιϦϡʔγϣϯΛଧͪग़͢༨஍͸ͳ͍͔΋͠Εͳ͍͕ʜ  ͱ͸͍͑χϡʔϥϧݕࡧ౳૊Έ߹ΘͤͨγεςϜʹର͢Δ
 χʔζ͸ࠓޙ૿͍͑ͯ͘͸ͣ  ͜͜·Ͱ&YUFOTJCMFʹͳΕΔ͔ ͳΔ΂͖͔ IUUQTXXXBNB[PODPKQ#VJMEJOH*OUFMMJHFOU4ZTUFNT-FBSOJOH&OHJOFFSJOHFCPPLEQ##82)3

  33. ·ͱΊ  ΫοΫύουݚڀ։ൃ෦͕ར༻͍ͯ͠Δ෼ੳج൫Λ঺հ  ෦಺ʹج൫୲౰͕͍ͯɺϢʔεέʔεʹরΒ͠߹Θͤͳ͕Βۀ຿վળ  ݱঢ়͸ࣗ੡πʔϧͷ૊Έ߹Θͤ %8)Ͱ͓͓ΉͶຬ଍  ෼ੳج൫ͷ͜Ε͔Β

     ݱ৔ͱͯ͠͸ͨ͘͞ΜͷϢʔεέʔεΛൃ৴͍ͯ͘͠  ػցֶशͷ๊͑Δ՝୊Λ۩ମԽ͠ɺϝοηʔδͱͯ͠఻͍͑ͯ͘ͷ͕
 ॏཁͰେมͦ͏