201128_mishimasyk

KNIMEを使ったデータ前処理について

Transcript

1. NJTIJNBTZL!U@LBIJ
   ͦͷφΠϜ ,/*.&
   Ͱѱເ ίϐϖ
   Λஅͪ੾Ε
   
   

   View Slide

2. 
   w 1, !U@LBIJ
   w ੡ༀձࣾݚڀһ *OWJUSPQIBSNBDPMPHJTU
   w ओͳۀ຿ʜ
   ɾBTTBZEFWFMPQNFOU ESVHTDSFFOJOH
   ɾ5BSHFUWBMJEBUJPO"OBMZTJTPG.PEFPG"DUJPO
   ɾ,/*.&Λ࢖ͬͨݚڀۀ຿ͷޮ཰Խ
   ࣗݾ঺հ
   

   View Slide

3. ,/*.&BOBMZUJDTQMBUGPSNͱ͸
   w ϫʔΫϑϩʔܕσʔλ෼ੳϓϥοτϑΥʔϜ
   w ແঈͷΦʔϓϯιʔειϑτ΢ΣΞ
   w ʢ༗ঈͷ,/*.&TFSWFS΋͋ΔΑʣ
   w (6*Ͱ௚ײతʹΘ͔Γ΍͍͢
   w IUUQTXXXLOJNFDPN
   
   

   View Slide

4. ࢲͷ࢓ࣄͱ,/*.&
   ɾඇϧʔνϯۀ຿ͷ৔߹ɿԾઆΛ࣮ݧͰݕূͯ͠σʔλΛ·ͱΊͯ෼ੳ͠ɺݕূ͢Δ
   ɾϧʔνϯۀ຿ͷ৔߹ɿධՁ݁ՌΛૉૣ͘ղੳ͠ϑΟʔυόοΫ͢Δ
   ˠͲͪΒʹͯ͠΋σʔλͷղੳ͕ඞͣೖΔ
   
   

   View Slide

5. ࢲͷ࢓ࣄͱ,/*.&
   σʔλΛجʹԾઆΛཱͯΔ෦෼ʹҰ൪࣌ؒΛ࢖͍͍ͨɺͱօ͕ߟ͍͑ͯΔ
   ˠ݁Ռతʹσʔλղੳ͕ૄ͔ʹͳΓ͕ͪʹͳΔ
   શһ͕͜͜ΛָʹͰ͖Ε͹)BQQZͳ৬৔ʹͳΔͷͰ͸ͳ͍͔
   
   

   View Slide

6. ༷ʑͳଌఆ૷ஔΛ࢖ͬͯσʔλΛऔಘ͢Δ
   ଌఆ ૷ஔ
   ܬޫɾൃޫଌఆ ֤छϓϨʔτϦʔμʔ
   ࡉ๔ΞοηΠ
   '-*13 'MVPSPNFUSJD*NBHJOH
   1MBUF3FBEFS
   
   N3/"ྔ ϦΞϧλΠϜ1$3૷ஔ
   ࡉ๔છ৭
   )JHI$POUFOU*NBHFS FH*/
   $FMMBOBMZ[FS
   
   
   

   View Slide

7. ଌఆ૷ஔ͔Βग़ྗ͞ΕΔ৘ใ͸౷Ұ͞Ε͍ͯͳ͍
   w XFMM XFMMͷϓϨʔτͱಉ༷ͷܗࣜʹͳ͍ͬͯΔ
   w ֤8FMMͷ৘ใ͕ߦ͝ͱʹදࣔ͞ΕΔܗࣜ
   w ݚڀऀ͸&YDFMΛ࢖ͬͯɺଌఆ஋ͱ৘ใΛ੔ཧͯ͠ՄࢹԽ͢Δ͜ͱ͕ଟ͍
   w ݸผͷάϥϑ࡞੒ʹ͕͔͔࣌ؒΔɽίϐϖϛε͕ى͖Δɽվ᜵͕༰қɽ
   
   

   View Slide

8. ͳͥՄࢹԽ͕೉͍͠ͷ͔ˠUJEZEBUBͰ͸ͳ͍͔Β
   σʔλ͕UJEZEBUBʹͳ͍ͬͯΕ͹؆୯ʹάϥϑԽͰ͖Δ
   
   

   View Slide

9. σʔλΛՄࢹԽ͢Δͱ͖͸UJEZEBUB͕๬·͍͠
   w ੔વσʔλͱ͸
   ݸʑͷม਺͕ͭͷྻΛͳ͢
   ݸʑͷ؍ଌ͕ͭͷߦΛͳ͢
   ݸʑͷ؍ଌͷߏ੒୯Ґͷྨܕ͕ͭͷදΛͳ͢
   ݸʑͷ஋͕ͭͷηϧΛͳ͢
   w ͱ͍͏ͭͷ৚݅Λຬͨͨ͠දܕͷσʔλͷ͜ͱͰ͋Γߏ଄ͱҙຯ͕߹க͢Δͱ͍͏ಛ௃Λ࣋ͭ
   w IUUQTJEGOTISJOGPUJEZEBUBJOUSP
   
   

   View Slide

10. 5JEZEBUBͷΘ͔Γ΍͍࣮͢ྫ
    IUUQTJEGOTISJOGPUJEZEBUBJOUSP
    ఱؾͷه࿥Λσʔλʹͨ͠ྫɻਓؒʹͱͬͯ͸෼͔Γ΍͍͢ܗ
    Λ͍ͯ͠Δ͕ɺ੔વͰ͸ͳ͍ɻ
    ஍఺ʢ੨ʣ͸ྻʹͳ͍ͬͯΔ͕ɺ࣌ࠁʢ੺ʣ͸ߦʹͳ͍ͬͯ
    Δɻఱؾʢԫʣ͸ෳ਺ͷྻͱߦʹ·͕͍ͨͬͯΔɻ
    
    ੔વσʔλͰɺม਺͕ͲͷΑ͏ʹද͞ΕΔ͔Λࣔͨ͠ྫɻ
    ஍఺ʢ੨ʣɾ࣌ࠁʢ੺ʣɾఱؾʢԫʣͱ͍͏ͭͷม਺͸ɺ
    ͢΂ͯྻͱͯ͠දݱ͞Ε͍ͯΔɻ
    ੔વσʔλʹ͸ɺͭͷߏ଄্ͷ୯Ґͱͭͷҙຯ্ͷ୯Ґ
    ͱ͕ରԠ͍ͯ͠Δͱ͍͏ಛ௃͕͋Δɻྫ͑͹ɺ੔વσʔλʹ
    ͓͍ͯ͸ɺͭͷྻͱ͍͏ߏ଄্ͷ୯Ґ͕ɺͭͷม਺ͱ͍
    ͏σʔλͷҙຯ্ͷ୯ҐʹඞͣରԠ͢Δɻ
    ߏ଄ͱҙຯͱ͕߹க͍ͯ͠Δͱɺ෼ੳ͸ඇৗʹ༰қʹͳΔɻ
    

    View Slide

11. ༷ʑͳଌఆ૷ஔͷσʔλΛ,/*.&Ͱࣗಈม׵͢Δ
    ଌఆ ૷ஔ
    ܬޫɾൃޫଌఆ ֤छϓϨʔτϦʔμʔ
    ࡉ๔ΞοηΠ
    '-*13 'MVPSPNFUSJD*NBHJOH
    1MBUF3FBEFS
    
    N3/"ྔ ϦΞϧλΠϜ1$3૷ஔ
    ࡉ๔છ৭
    )JHI$POUFOU*NBHFS FH*/
    $FMMBOBMZ[FS
    
    5JEZEBUB
    
    

    View Slide

12. ,/*.&XPSLGMPX
    
    ͜ͷྫͰ͸ߦͱྻͷ৘ใͰ݁߹͢Δ
    ͚͕ͩͩɺ਺஋ॲཧΛ࣮ࢪͨ͠Γɺ
    *$஋Λܭࢉͨ͠ΓՄೳ
    

    View Slide

13. σʔλ४උ
    
    1MBUF-BZPVU
    ࣮ࡍͷ࣮ݧऀ͸ϓϨʔτఴՃͷ৘ใΛهೖ
    ͢ΔͷͰMBZPVU৘ใΛॻ͘ͷ͸ۤ͡Όແ͍
    3BXEBUB
    

    View Slide

14. ,/*.&XPSLGMPXઆ໌
    ϑΝΠϧ໊ͱ63-औಘ
    
    -JTUpMFTͰϑΝΠϧ৘ใΛऩू
    63-UP'JMF1BUIͰ'JMFOBNFΛऔಘ
    'JMFOBNFΛΩʔʹͯ͠දΛͭͳ͛Δ
    

    View Slide

15. ,/*.&XPSLGMPXઆ໌
    
    ੺ઢ͸WBSJBCMFʢม਺ʣͷड͚౉͠
    ϓϨʔτϑΥʔϚοτܗࣜͷσʔλΛม׵ͯ͘͠ΕΔ
    

    View Slide

16. ,/*.&XPSLGMPXઆ໌
    
    ੺ઢ͸WBSJBCMFʢม਺ʣͷड͚౉͠
    &YDFMSFBEFSͰ
    ಡΈࠐΈ
    $FMMTQMJUUFSͰߦ
    ͱྻΛ෼͚Δ
    3PXDPOWFSUFSͰ
    ߦͷӳޠΛ਺஋ʹ
    ม׵
    

    View Slide

17. ,/*.&XPSLGMPXઆ໌
    
    IUUQTXXXULBIJDPNFOUSZ
    σʔλߏ଄͕ҟͳͬͯ΋͍͍Α͏ʹɺϧʔϓऴྃ࣌ʹμϛʔ
    ςʔϒϧΛ࢖ͬͯσʔλߏ଄ΛҰఆʹอͭ
    ಡΈࠐΜͩϨΠΞ΢τϑΝΠϧͱੜσʔλ
    Λอଘ༻ϑΥϧμʹҠߦ͢Δ
    ग़ྗͨ͠FYDFMpMFΛTQPUpSF
    ͱ͔ͰՄࢹԽ͢Δ
    

    View Slide

18. ,/*.&಺ͰՄࢹԽΛ͢Δ৔߹͸ɺɺɺ
    
    3ͷΠϯετʔϧͱ3TFSWFͷઃఆ͕ඞཁ͚ͩͲɺ
    ʮ%PTFSFTQPOTFʯϊʔυ͕Ұ൪ྑ͍
    

    View Slide

19. ·ͱΊ
    w ଌఆ݁Ռͷੜ஋ͱϨΠΞ΢τ৘ใΛ8PSLqPXͰલॲཧͯ͠UJEZEBUBʹ͢Δ
    w ग़ྗͨ͠σʔλ͸5*#$04QPUpSFͰՄࢹԽ͢Δɽ,/*.&্ͷQMPUMZϊʔυͰ
    ՄࢹԽͯ͠΋ྑ͍ʢ࠷ޙͷग़ྗΛάϥϑʹ͢Δ
    w ࣮ݧݚڀऀͷݱ৔Ͱߟ͑Δͱɺ֤छػց͔Βग़ྗ͞ΕΔ݁ՌΛ੔વσʔλʹ
    Ճ޻ͯ͠σʔλՄࢹԽΛָʹ͢Δ͜ͱʹ͸Ձ஋͕͋Δ
    w ΋ͪΖΜ,/*.&͸ػցֶश΍ͦͷଞ౷ܭॲཧͷπʔϧɺ3&45"1*Λ࢖ͬͯ
    ֎෦%#ͷ৘ใΛू໿ͨ͠Γͱ༷ʑͳ༻్ʹ࢖༻Ͱ͖Δ
    
    

    View Slide

20. ͦͷଞۀ຿Ͱ׆༻͍ͯ͠Δ͜ͱ
    w ϧʔνϯͷεΫϦʔχϯάۀ຿
    ˠੜσʔλ͔Β%#ొ࿥·ͰΛ,/*.&XPSLqPXͰ׬݁ɽίϐϖ࡞ۀແ͠
    ˠσʔλվ᜵๷ࢭʹՃ͑ͯ࡞ۀһͷෛ୲͕େ෯ݮ
    w େྔσʔλͷલॲཧɾܭࢉ
    ˠ)$"΍3/"TFRͷσʔλΛલॲཧɺܭࢉͯ͠ՄࢹԽ͠΍͍͢σʔλʹ
    w ֤छϧʔνϯۀ຿Ͱͷ׆༻
    ˠ࡞ۀһ͕ίϐϖͰ࣮ࢪ͍ͯͨ͠࡞ۀʢྫ͑͹εϥΠυʹը૾ΛτϦϛϯά͠
    ͯషΓ෇͚Δ࡞ۀʣΛࣗಈԽ͢Δ͜ͱͰ޻਺Λେ෯࡟ݮ
    
    

    View Slide

21. ࠷ۙײ͍ͯ͡Δ͜ͱ
    w Ұਓ͚ͩ,/*.&Λ࢖͑ΔΑ͏ʹͳͬͯ΋શମ࠷దԽʹͭͳ͕Βͳ͍
    w ීٴ׆ಈΛ࢝Ίͯࣾ಺Ͱ΋ීஈͷ࣮ݧۀ຿ͷσʔλղੳʹ,/*.&Λಋೖͯ͠
    ͍Δํʑ͕૿͖͑ͯͨ
    ˠXPSLqPXΛҰ౓࡞ͬͯ͋͛Δͱࣗ෼ͨͪͰͦΕΛվม͠ͳ͕Βษڧͯ͘͠
    ΕΔ
    w खΛಈ͔࣮ͯ͠ݧ͠ɺσʔλΛղੳ͍ͯ͠Δݱ৔ͷਓ͕ͨͪ,/*.&Λ࢖ͬͯ
    ੜ࢈ੑΛ্͛ΒΕΔΑ͏ʹɺҾ͖ଓ͖ࣾ಺Ͱ΋ͦ΋ͦͱ׆ಈத
    
    

    View Slide

22. ͓·͚ɿ,/*.&ˠՄࢹԽʹ͍ͭͯ
    w ձࣾͰ͸4QPUpSFͱͷ࿈ܞ͕Ұ൪ָ
    w ,/*.&͔Β5BCMFBVɺ1PXFS#*ͱͷ࿈ܞ͕ڧԽ͞Εͨ
    IUUQTEPDTLOJNFDPNUBCMFBV@JOUFHSBUJPO@VTFS@HVJEFJOEFYIUNM
    IUUQTEPDTLOJNFDPNQPXFSCJ@JOUFHSBUJPO@VTFS@HVJEFJOEFYIUNM
    
    w 5BCMFBV͸༗ྉͷΈɽ1PXFS#*͸ແྉ൛΋͋Δ͚Ͳɺ૊৫ΞΧ΢ϯτ͕͍Δ
    ͷͱɺ.BDͰ͸࢖͑ͳ͍ͷͰͳ͔ͳ͔ख͕ग़ͤͳ͍ɽɽɽ
    
    

    View Slide

23. ͓·͚ɿ,/*.&7FSJGJFE$PNQPOFOUT
    IUUQTXXXLOJNFDPNWFSJpFEDPNQPOFOUT
    
    

    View Slide