Upgrade to Pro — share decks privately, control downloads, hide ads and more …

201128_mishimasyk

t_kahi
November 28, 2020

 201128_mishimasyk

KNIMEを使ったデータ前処理について

t_kahi

November 28, 2020
Tweet

Other Decks in Science

Transcript

  1. [email protected]
    ͦͷφΠϜ ,/*.&
    Ͱѱເ ίϐϖ
    Λஅͪ੾Ε

    View Slide


  2. w 1, [email protected]
    w ੡ༀձࣾݚڀһ *OWJUSPQIBSNBDPMPHJTU
    w ओͳۀ຿ʜ
    ɾBTTBZEFWFMPQNFOU ESVHTDSFFOJOH
    ɾ5BSHFUWBMJEBUJPO"OBMZTJTPG.PEFPG"DUJPO
    ɾ,/*.&Λ࢖ͬͨݚڀۀ຿ͷޮ཰Խ
    ࣗݾ঺հ

    View Slide

  3. ,/*.&BOBMZUJDTQMBUGPSNͱ͸
    w ϫʔΫϑϩʔܕσʔλ෼ੳϓϥοτϑΥʔϜ
    w ແঈͷΦʔϓϯιʔειϑτ΢ΣΞ
    w ʢ༗ঈͷ,/*.&TFSWFS΋͋ΔΑʣ
    w (6*Ͱ௚ײతʹΘ͔Γ΍͍͢
    w IUUQTXXXLOJNFDPN

    View Slide

  4. ࢲͷ࢓ࣄͱ,/*.&
    ɾඇϧʔνϯۀ຿ͷ৔߹ɿԾઆΛ࣮ݧͰݕূͯ͠σʔλΛ·ͱΊͯ෼ੳ͠ɺݕূ͢Δ
    ɾϧʔνϯۀ຿ͷ৔߹ɿධՁ݁ՌΛૉૣ͘ղੳ͠ϑΟʔυόοΫ͢Δ
    ˠͲͪΒʹͯ͠΋σʔλͷղੳ͕ඞͣೖΔ

    View Slide

  5. ࢲͷ࢓ࣄͱ,/*.&
    σʔλΛجʹԾઆΛཱͯΔ෦෼ʹҰ൪࣌ؒΛ࢖͍͍ͨɺͱօ͕ߟ͍͑ͯΔ
    ˠ݁Ռతʹσʔλղੳ͕ૄ͔ʹͳΓ͕ͪʹͳΔ
    શһ͕͜͜ΛָʹͰ͖Ε͹)BQQZͳ৬৔ʹͳΔͷͰ͸ͳ͍͔

    View Slide

  6. ༷ʑͳଌఆ૷ஔΛ࢖ͬͯσʔλΛऔಘ͢Δ
    ଌఆ ૷ஔ
    ܬޫɾൃޫଌఆ ֤छϓϨʔτϦʔμʔ
    ࡉ๔ΞοηΠ
    '-*13 'MVPSPNFUSJD*NBHJOH
    1MBUF3FBEFS

    N3/"ྔ ϦΞϧλΠϜ1$3૷ஔ
    ࡉ๔છ৭
    )JHI$POUFOU*NBHFS FH*/
    $FMMBOBMZ[FS


    View Slide

  7. ଌఆ૷ஔ͔Βग़ྗ͞ΕΔ৘ใ͸౷Ұ͞Ε͍ͯͳ͍
    w XFMM XFMMͷϓϨʔτͱಉ༷ͷܗࣜʹͳ͍ͬͯΔ
    w ֤8FMMͷ৘ใ͕ߦ͝ͱʹදࣔ͞ΕΔܗࣜ
    w ݚڀऀ͸&YDFMΛ࢖ͬͯɺଌఆ஋ͱ৘ใΛ੔ཧͯ͠ՄࢹԽ͢Δ͜ͱ͕ଟ͍
    w ݸผͷάϥϑ࡞੒ʹ͕͔͔࣌ؒΔɽίϐϖϛε͕ى͖Δɽվ᜵͕༰қɽ

    View Slide

  8. ͳͥՄࢹԽ͕೉͍͠ͷ͔ˠUJEZEBUBͰ͸ͳ͍͔Β
    σʔλ͕UJEZEBUBʹͳ͍ͬͯΕ͹؆୯ʹάϥϑԽͰ͖Δ

    View Slide

  9. σʔλΛՄࢹԽ͢Δͱ͖͸UJEZEBUB͕๬·͍͠
    w ੔વσʔλͱ͸
    ݸʑͷม਺͕ͭͷྻΛͳ͢
    ݸʑͷ؍ଌ͕ͭͷߦΛͳ͢
    ݸʑͷ؍ଌͷߏ੒୯Ґͷྨܕ͕ͭͷදΛͳ͢
    ݸʑͷ஋͕ͭͷηϧΛͳ͢
    w ͱ͍͏ͭͷ৚݅Λຬͨͨ͠දܕͷσʔλͷ͜ͱͰ͋Γߏ଄ͱҙຯ͕߹க͢Δͱ͍͏ಛ௃Λ࣋ͭ
    w IUUQTJEGOTISJOGPUJEZEBUBJOUSP

    View Slide

  10. 5JEZEBUBͷΘ͔Γ΍͍࣮͢ྫ
    IUUQTJEGOTISJOGPUJEZEBUBJOUSP
    ఱؾͷه࿥Λσʔλʹͨ͠ྫɻਓؒʹͱͬͯ͸෼͔Γ΍͍͢ܗ
    Λ͍ͯ͠Δ͕ɺ੔વͰ͸ͳ͍ɻ
    ஍఺ʢ੨ʣ͸ྻʹͳ͍ͬͯΔ͕ɺ࣌ࠁʢ੺ʣ͸ߦʹͳ͍ͬͯ
    Δɻఱؾʢԫʣ͸ෳ਺ͷྻͱߦʹ·͕͍ͨͬͯΔɻ

    ੔વσʔλͰɺม਺͕ͲͷΑ͏ʹද͞ΕΔ͔Λࣔͨ͠ྫɻ
    ஍఺ʢ੨ʣɾ࣌ࠁʢ੺ʣɾఱؾʢԫʣͱ͍͏ͭͷม਺͸ɺ
    ͢΂ͯྻͱͯ͠දݱ͞Ε͍ͯΔɻ
    ੔વσʔλʹ͸ɺͭͷߏ଄্ͷ୯Ґͱͭͷҙຯ্ͷ୯Ґ
    ͱ͕ରԠ͍ͯ͠Δͱ͍͏ಛ௃͕͋Δɻྫ͑͹ɺ੔વσʔλʹ
    ͓͍ͯ͸ɺͭͷྻͱ͍͏ߏ଄্ͷ୯Ґ͕ɺͭͷม਺ͱ͍
    ͏σʔλͷҙຯ্ͷ୯ҐʹඞͣରԠ͢Δɻ
    ߏ଄ͱҙຯͱ͕߹க͍ͯ͠Δͱɺ෼ੳ͸ඇৗʹ༰қʹͳΔɻ

    View Slide

  11. ༷ʑͳଌఆ૷ஔͷσʔλΛ,/*.&Ͱࣗಈม׵͢Δ
    ଌఆ ૷ஔ
    ܬޫɾൃޫଌఆ ֤छϓϨʔτϦʔμʔ
    ࡉ๔ΞοηΠ
    '-*13 'MVPSPNFUSJD*NBHJOH
    1MBUF3FBEFS

    N3/"ྔ ϦΞϧλΠϜ1$3૷ஔ
    ࡉ๔છ৭
    )JHI$POUFOU*NBHFS FH*/
    $FMMBOBMZ[FS

    5JEZEBUB

    View Slide

  12. ,/*.&XPSLGMPX

    ͜ͷྫͰ͸ߦͱྻͷ৘ใͰ݁߹͢Δ
    ͚͕ͩͩɺ਺஋ॲཧΛ࣮ࢪͨ͠Γɺ
    *$஋Λܭࢉͨ͠ΓՄೳ

    View Slide

  13. σʔλ४උ

    1MBUF-BZPVU
    ࣮ࡍͷ࣮ݧऀ͸ϓϨʔτఴՃͷ৘ใΛهೖ
    ͢ΔͷͰMBZPVU৘ใΛॻ͘ͷ͸ۤ͡Όແ͍
    3BXEBUB

    View Slide

  14. ,/*.&XPSLGMPXઆ໌
    ϑΝΠϧ໊ͱ63-औಘ

    -JTUpMFTͰϑΝΠϧ৘ใΛऩू
    63-UP'JMF1BUIͰ'JMFOBNFΛऔಘ
    'JMFOBNFΛΩʔʹͯ͠දΛͭͳ͛Δ

    View Slide

  15. ,/*.&XPSLGMPXઆ໌

    ੺ઢ͸WBSJBCMFʢม਺ʣͷड͚౉͠
    ϓϨʔτϑΥʔϚοτܗࣜͷσʔλΛม׵ͯ͘͠ΕΔ

    View Slide

  16. ,/*.&XPSLGMPXઆ໌

    ੺ઢ͸WBSJBCMFʢม਺ʣͷड͚౉͠
    &YDFMSFBEFSͰ
    ಡΈࠐΈ
    $FMMTQMJUUFSͰߦ
    ͱྻΛ෼͚Δ
    3PXDPOWFSUFSͰ
    ߦͷӳޠΛ਺஋ʹ
    ม׵

    View Slide

  17. ,/*.&XPSLGMPXઆ໌

    IUUQTXXXULBIJDPNFOUSZ
    σʔλߏ଄͕ҟͳͬͯ΋͍͍Α͏ʹɺϧʔϓऴྃ࣌ʹμϛʔ
    ςʔϒϧΛ࢖ͬͯσʔλߏ଄ΛҰఆʹอͭ
    ಡΈࠐΜͩϨΠΞ΢τϑΝΠϧͱੜσʔλ
    Λอଘ༻ϑΥϧμʹҠߦ͢Δ
    ग़ྗͨ͠FYDFMpMFΛTQPUpSF
    ͱ͔ͰՄࢹԽ͢Δ

    View Slide

  18. ,/*.&಺ͰՄࢹԽΛ͢Δ৔߹͸ɺɺɺ

    3ͷΠϯετʔϧͱ3TFSWFͷઃఆ͕ඞཁ͚ͩͲɺ
    ʮ%PTFSFTQPOTFʯϊʔυ͕Ұ൪ྑ͍

    View Slide

  19. ·ͱΊ
    w ଌఆ݁Ռͷੜ஋ͱϨΠΞ΢τ৘ใΛ8PSLqPXͰલॲཧͯ͠UJEZEBUBʹ͢Δ
    w ग़ྗͨ͠σʔλ͸5*#$04QPUpSFͰՄࢹԽ͢Δɽ,/*.&্ͷQMPUMZϊʔυͰ
    ՄࢹԽͯ͠΋ྑ͍ʢ࠷ޙͷग़ྗΛάϥϑʹ͢Δ
    w ࣮ݧݚڀऀͷݱ৔Ͱߟ͑Δͱɺ֤छػց͔Βग़ྗ͞ΕΔ݁ՌΛ੔વσʔλʹ
    Ճ޻ͯ͠σʔλՄࢹԽΛָʹ͢Δ͜ͱʹ͸Ձ஋͕͋Δ
    w ΋ͪΖΜ,/*.&͸ػցֶश΍ͦͷଞ౷ܭॲཧͷπʔϧɺ3&45"1*Λ࢖ͬͯ
    ֎෦%#ͷ৘ใΛू໿ͨ͠Γͱ༷ʑͳ༻్ʹ࢖༻Ͱ͖Δ

    View Slide

  20. ͦͷଞۀ຿Ͱ׆༻͍ͯ͠Δ͜ͱ
    w ϧʔνϯͷεΫϦʔχϯάۀ຿
    ˠੜσʔλ͔Β%#ొ࿥·ͰΛ,/*.&XPSLqPXͰ׬݁ɽίϐϖ࡞ۀແ͠
    ˠσʔλվ᜵๷ࢭʹՃ͑ͯ࡞ۀһͷෛ୲͕େ෯ݮ
    w େྔσʔλͷલॲཧɾܭࢉ
    ˠ)$"΍3/"TFRͷσʔλΛલॲཧɺܭࢉͯ͠ՄࢹԽ͠΍͍͢σʔλʹ
    w ֤छϧʔνϯۀ຿Ͱͷ׆༻
    ˠ࡞ۀһ͕ίϐϖͰ࣮ࢪ͍ͯͨ͠࡞ۀʢྫ͑͹εϥΠυʹը૾ΛτϦϛϯά͠
    ͯషΓ෇͚Δ࡞ۀʣΛࣗಈԽ͢Δ͜ͱͰ޻਺Λେ෯࡟ݮ

    View Slide

  21. ࠷ۙײ͍ͯ͡Δ͜ͱ
    w Ұਓ͚ͩ,/*.&Λ࢖͑ΔΑ͏ʹͳͬͯ΋શମ࠷దԽʹͭͳ͕Βͳ͍
    w ීٴ׆ಈΛ࢝Ίͯࣾ಺Ͱ΋ීஈͷ࣮ݧۀ຿ͷσʔλղੳʹ,/*.&Λಋೖͯ͠
    ͍Δํʑ͕૿͖͑ͯͨ
    ˠXPSLqPXΛҰ౓࡞ͬͯ͋͛Δͱࣗ෼ͨͪͰͦΕΛվม͠ͳ͕Βษڧͯ͘͠
    ΕΔ
    w खΛಈ͔࣮ͯ͠ݧ͠ɺσʔλΛղੳ͍ͯ͠Δݱ৔ͷਓ͕ͨͪ,/*.&Λ࢖ͬͯ
    ੜ࢈ੑΛ্͛ΒΕΔΑ͏ʹɺҾ͖ଓ͖ࣾ಺Ͱ΋ͦ΋ͦͱ׆ಈத

    View Slide

  22. ͓·͚ɿ,/*.&ˠՄࢹԽʹ͍ͭͯ
    w ձࣾͰ͸4QPUpSFͱͷ࿈ܞ͕Ұ൪ָ
    w ,/*.&͔Β5BCMFBVɺ1PXFS#*ͱͷ࿈ܞ͕ڧԽ͞Εͨ
    [email protected]@[email protected]
    [email protected]@[email protected]

    w 5BCMFBV͸༗ྉͷΈɽ1PXFS#*͸ແྉ൛΋͋Δ͚Ͳɺ૊৫ΞΧ΢ϯτ͕͍Δ
    ͷͱɺ.BDͰ͸࢖͑ͳ͍ͷͰͳ͔ͳ͔ख͕ग़ͤͳ͍ɽɽɽ

    View Slide

  23. ͓·͚ɿ,/*.&7FSJGJFE$PNQPOFOUT
    IUUQTXXXLOJNFDPNWFSJpFEDPNQPOFOUT

    View Slide