Rによるオープンデータ 前処理勉強会（医療データ） _オープニング

by mitti1210

Slide 1

Slide 1 text

RʹΑΔΦʔϓϯσʔλ   લॲཧษڧձʢҩྍσʔλʣ 2021೥7݄24೔

Slide 2

Slide 2 text

ීஈ͸පӃͰཧֶྍ๏࢜Λ͍ͯ͠·͢   ࠓ೥౓͔Βۀ຿ͷ൒෼͕σʔλ෼ੳʹͳΓ·ͨ͠ ೥ ҩྍ౷ܭͷಠֶΛ࢝ΊΔ &;3ʢ3ίϚϯμʔʣͱ͍͏ҩྍ౷ܭ༻ͷ3ύοέʔδΛ࢖͏Α͏ʹͳΔ ೥ 3ͱσʔλαΠΤϯεʹڵຯΛ࣋ͭΑ͏ʹͳΔ .00$ͰσʔλαΠΤϯεͷίʔε )BSWBSE9%BUB4DJFODF Λडߨ͢Δ ೥ QZUIPOʹ΋खΛग़͢ ౦ژେֶάϩʔόϧফඅΠϯςϦδΣϯεد෇ߨ࠲Λडߨ ࢲʹ͍ͭͯ 2

Slide 3

Slide 3 text

1SPGFTTJPOBM$FSUJ fi DBUFJO%BUB4DJFODF 3ͷجૅ͔ΒσʔλϋϯυϦϯάɺूܭɺՄࢹԽɺػցֶशɺϨϙʔτ࡞੒ 3

Slide 4

Slide 4 text

͖͔͚ͬ 4 ࠓ೔͸͜ͷ࿩

Slide 5

Slide 5 text

σʔλ෼ੳͷྲྀΕ 5 μ΢ϯϩʔυ લ ॲ ཧ ू ܭ ՄࢹԽ ΢ΣϒΞϓϦ ࠓ೔͸͜͜ͷ࿩

Slide 6

Slide 6 text

ҩྍͱσʔλαΠΤϯε ҩྍͰ͸ҩྍ౷ܭΛֶͿ͜ͱ͕ଟ͍ʢࣗࢪઃͰσʔλΛूΊΔʣ ࠃ͕ग़͍ͯ͠ΔΦʔϓϯσʔλΛ࢖͏ݚڀ΋͋Δ   ɹɾ%1$ɺ/%#   ɹɾ͙͢ʹ෼ੳͰ͖ΔΑ͏ͳߏ଄ʹͳ͍ͬͯͳ͍   ɹɾͰ͖Δਓ͸Ͳ͜ʹ͍ΔʁͲ͏΍ֶͬͯͿʁɹˠɹେֶӃ͕ଟ͍ 6 SPSS R STATA SAS ʢ౷ܭιϑτʣ ෼ੳͰ͖Δܗʹ࢓্͕ͬͯΔ

Slide 7

Slide 7 text

σʔλΛѻ͑Δਓ͸଴ͬͯͯ΋དྷͳ͍ 7 ҩྍػؔɿ0.8%

Slide 8

Slide 8 text

σʔλαΠΤϯεͷຊ͸͍ͬͺ͍͋Δʂ 8 3ͳΒӉ஦ຊʂ

Slide 9

Slide 9 text

ࢀՃऀͷଐੑʢ೥݄೔࣌఺ʣ 9

Slide 10

Slide 10 text

ࠓճͷԑ͕Կ͔ʹͭͳ͕Ε͹޾͍Ͱ͢ʂ 10 ର৅ ໨ࢦ͍ͨ͜͠ͱ 3࢖ͬͨ͜ͱͳ͍͚Ͳڵຯ͋Δํ 3Ͱҩྍ౷ܭ͚ͩͨ͜͠ͱ͋Δํ 3ͬͯ౷ܭ͚ͩ͡Όͳ͍͜ͱΛମײ   Ӊ஦ຊΛखʹऔͬͯΈ͍ͯͩ͘͞ʂ UJEZWFSTFʢӉ஦ຊʣษڧத Ұॹʹલॲཧษڧ͠·͠ΐ͏ʂʂʂ طʹલॲཧͯ͠Δํ ΞυόΠε͓ئ͍͠·͢ʂʂʂʂʂʂʂ ҩྍσʔλ΋ѻͬͯΈ͍ͯͩ͘͞ʂ %1$Λѻ͍ͬͯΔํ ෼ੳ͢Δࢹ఺Λڭ͑ͯ௖͖͍ͨͰ͢ʂʂʂ

Slide 11

Slide 11 text

ࠓ೔ͷ ˔ొஃऀ ᶃ/PSJNJUTV/JTIJEB͞Μ   /%#ΦʔϓϯσʔλͷϑΝΠϧΛେྔμ΢ϯϩʔυ͢Δ ᶄ.*55*   લॲཧΛ3Ͱ΍ͬͯΈͨʂ%1$σʔλʹ௅ઓʂ ˔αϙʔτ ɾԞॅܒ༞!ઉઉͷػೳΛ୳ٻத͞Μ 11

Slide 12

Slide 12 text

ࣄલ४උ   ʢMITTIͷൃද෼ʣ 12

Slide 13

Slide 13 text

NBDͱXJOEPXTͰͷจࣈԽ͚ʹ͍ͭͯ NBDͰ࡞ͬͨ3ͷϑΝΠϧ΍DTW ΤΫηϧϑΝΠϧΛXJOEPXTͰಡΈࠐΉ   XJOEPXTͰ࡞ͬͨ3ͷϑΝΠϧ΍DTW ΤΫηϧϑΝΠϧΛNBDͰಡΈࠐΉ ▶︎ จࣈԽ͚͕ൃੜ͢Δ 13 CP932ʢwindowsͷσϑΥϧτʣ UTF-8ʢmacͷσϑΥϧτʣ

Slide 14

Slide 14 text

14 #csvϑΝΠϧΛಡΈࠐΉ read.csv("input/MDC_02_07/MDC_02_8_07_2_2017.csv",fileEncoding = “UTF8" ) read.csv("input/MDC_02_07/MDC_02_8_07_2_2017.csv",fileEncoding = “CP932" ) #csvϑΝΠϧΛॻ͖ࠐΉ write.csv("input/MDC_02_07/MDC_02_8_07_2_2017.csv",fileEncoding = “UTF8" ) write.csv(“input/MDC_02_07/MDC_02_8_07_2_2017.csv",fileEncoding = "CP932") macͱwindowsͰͷจࣈԽ͚ʹ͍ͭͯ

Slide 15

Slide 15 text

ϑΥϧμͷ४උ .*55*ͷൃදͰ͸ҎԼͷߏ଄ͰϑΥϧμΛ࡞͍ͬͯ·͢ 3Ͱ΋Ͱ͖·͕࣌ؒ͢ͷ౎߹্ল͘ͷͰࣄલʹ࡞੒͢ΔͱਐΊ΍͍͢Ͱ͢ 15 ϓϩδΣΫτ ϑΥϧμ JOQVU TVNNBSZ .%$@@ PVUQVU JOQVU .%$@@

Slide 16

Slide 16 text

μ΢ϯϩʔυ 16 ͜ͷ4೥෼ ࢪઃ֓ཁද ʢ̔ʣ࣬ױผखज़ผूܭ MDC07 ˎ2016,2017೥͸2ͭʹ෼͔Ε͍ͯΔ MDC07ɿ੔ܗ֎Պ

Slide 17

Slide 17 text

μ΢ϯϩʔυͱอଘϑΝΠϧ໊ ͜ͷϑΥϧμ໊ͱϑΝΠϧ໊ͰਐΊ·͢ 17 ϓϩδΣΫτ ϑΥϧμ JOQVU TVNNBSZ .%$@@ PVUQVU TVNNBSZ .%$@@ ʢ̔ʣ࣬ױผखज़ผूܭ MDC07 ࢪઃ֓ཁද

Slide 18

Slide 18 text

ࣄલ४උ 18 #Πϯετʔϧͨ͜͠ͱͳ͍ํ͸ઌʹΠϯετʔϧ install.packages(“tidyverse") #ͲͪΒͷൃදͰ΋࢖͍·͢ install.packages(“rvest”) #੢ాઌੜͷൃදͰ࢖͍·͢ #Πϯετʔϧͨ͠ύοέʔδͷݺͼग़͠ library(tidyverse) #ࠓճ͸ಛʹdplyr,tidyr,stringr,purrrΛ࢖༻ library(readxl) #excelͷಡΈࠐΈʹ࢖༻

Slide 19

Slide 19 text

RΛ࢖ͬͨ͜ͱͳ͍ํ RίϚϯμʔ/EZRͷΈͷํ ʢ͜ΕҎ߱͸ຊ൪Ͱ͸࿩͠·ͤΜʣ 19

Slide 20

Slide 20 text

ࠓճ͸தڃऀ޲͚ʹͳΓ·͢ɻ IUUQTNJUUJEBUBDPNBSDIJWFTTJUFNBQIUNM ্هαΠτͷୈষɺୈষͷ஌͕ࣝલఏʹ͋Γ·͢ɻ 20 ҎԼͷ४උ·Ͱ͓ͯ͘͠ͱਅࣅͰ͖Δ͔΋ ಠֶͰ࢝ΊΔ౷ܭºσʔλαΠΤϯε

Slide 21

Slide 21 text

3ͱ͸ ɾ౷ܭʹڧ͍ϓϩάϥϛϯάݴޠʢεϚϗͰ͍͏J04 BOESPJEʣ ɾύοέʔδΛ௥Ճ͢Ε͹ػೳ͕௥Ճ͞ΕΔʢεϚϗͰ͍͏ΞϓϦʣ ɾ࠶ݱՄೳੑ͕ߴ͍ʢσʔλΛߋ৽ͯ͠΋ϓϩάϥϜ͸ม͑ͳ͍͍ͯ͘ʣ σʔλ ▶︎ ಡΈࠐΈ ▶︎ ूܭɾάϥϑԽɾ౷ܭ ▶︎ 1PXFS1PJOUʹग़ྗ   ɹɹɹɹɹσʔλΛߋ৽ͯ͠΋ϓϩάϥϜͷมߋͷඞཁੑ͕ͳ͍ʂ 21

Slide 22

Slide 22 text

&;3ͱ3TUVEJP 3ɿϓϩάϥϛϯάͷຊମ   ɹ͜Ε͚ͩͩͱ࢖͍ʹ͍͘ͷͰύοέʔδ΍ιϑτΛ࢖͏ 3ίϚϯμʔ&;3ɿϓϩάϥϛϯάͤͣʹ3Λ࢖͏͜ͱ͕Ͱ͖Δύοέʔδ   ɹΫϦοΫ͚ͩͰ࢖͑Δ͕ɺ࠶ݱੑ͸ͳ͍   ɹ&;3ʹೖ͍ͬͯͳ͍ख๏͸࢖͍ͮΒ͍ 3TUVEJPɿ3Λ࠷େݶ׆༻Ͱ͖Διϑτ   ɹ࠷ॳ͸࢖͍ʹ͍͕͘౓֮͑Δͱख์ͤͳ͍   ɹ 22

Slide 23

Slide 23 text

3ͰͰ͖Δ͜ͱ 23 ౷ܭ͕Ͱ͖Ε͹͍͍ σʔλϕʔεͰͷݚڀ͕͍ͨ͠ ಡΈࠐΊ͹͙͢ʹ౷ܭ͕Ͱ͖Δ&YDFMΛ࡞Δ   ▶︎ &YDFMͷϧʔϧ ಡΈࠐΜͩޙɺ෼ੳ͠΍͍͢&YDFMΛ࡞Δ   ▶︎ &YDFMͷϧʔϧ   ▶︎ ෳ਺γʔτͷϧʔϧ ౷ܭΛ͔͚Δ͜ͱ͕Ͱ͖Δ   ▶︎ &;3ʢΫϦοΫʣʴ&YDFMͰूܭάϥϑ ▶︎ 3TUVEJPʢϓϩάϥϜʣ ूܭɾάϥϑԽɾ౷ܭ͕Ͱ͖Δ ϓϩάϥϜͰࣗಈԽͰ͖Δ   ▶︎ 3TUVEJPʢϓϩάϥϜʣ ▶︎ σʔλϋϯυϦϯά ೉қ౓͸௿͍ ೉қ౓͸ߴ͍ ࠓճͷ࿩͸ͬͪ͜

Slide 24

Slide 24 text

Πϯετʔϧ 24

Slide 25

Slide 25 text

Πϯετʔϧ 3ΛΠϯετʔϧ 3TUVEJPΛΠϯετʔϧ 25

Slide 26

Slide 26 text

3ΛΠϯετʔϧ IUUQTDSBOJTNBDKQ 26 ࣗ෼ͷOSʹ߹ΘͤΔ

Slide 27

Slide 27 text

3TUVEJPͷΠϯετʔϧ IUUQTXXXSTUVEJPDPNQSPEVDUTSTUVEJP 27 ແྉ൛ΛΠϯετʔϧ

Slide 28

Slide 28 text

Rͷը໘ 28

Slide 29

Slide 29 text

3TUVEJPͷը໘ͱ·ͣ͢Δ͜ͱ ɹɹɹɹɹɹɹɹɹɹɹɹɹɹɹɹɹɹɹɹɹɹ34DSJQUΛબͿ 29 'JMFTϏϡʔ 1MPUTϏϡʔ ύοέʔδ

Slide 30

Slide 30 text

͜Ε͕جຊͷը໘ 30 'JMFTϏϡʔ 1MPUTϏϡʔ ύοέʔδ

Slide 31

Slide 31 text

ࠨ্ɿεΫϦϓτ΢ΟϯυΡ ϓϩάϥϜΛॻ͍ͨΓɺಡΈࠐΜͩΤΫηϧϑΝΠϧͷσʔλΛݟΔ͜ͱ͕Ͱ͖Δ εΫϦϓτ΢Οϯυ΢͕جຊతͳ࡞ۀ৔ʹͳΔ 31

Slide 32

Slide 32 text

ࠨԼɿίϯιʔϧ΢ΟϯυΡ 3ͷຊମͷΑ͏ͳ෦෼ɻ εΫϦϓτ΢Πϯυ΢Ͱॻ͍ͨϓϩάϥϜͷ ݁Ռ͕͜͜ʹग़Δ ϓϩάϥϜΛॻ͘͜ͱ΋Ͱ͖Δ͕ɺجຊ   ͜͜Ͱ͸ॻ͔ͳ͍ 32

Slide 33

Slide 33 text

ӈ্ɿ&OWJSPONFOUϝχϡʔ ϓϩάϥϜͰ࡞ͬͨม਺΍σʔλɺղੳͷ݁Ռɺؔ਺ͷҰཡ͕ࡌ͍ͬͯΔ 33

Slide 34

Slide 34 text

ӈԼɿ'JMFTϏϡʔɺ1MPUTϏϡʔɺύοέʔδ ύιίϯʹೖ͍ͬͯΔϑΝΠϧͷσʔλΛΈΔɾऔΓࠐΉ   ࡞੒ͨ͠άϥϑɾදΛ֬ೝ͢Δɺը૾ͱͯ͠ग़ྗ͢Δ 34

Slide 35

Slide 35 text

ϓϩδΣΫτʹ͍ͭͯ 35

Slide 36

Slide 36 text

·ͣ͸ϓϩδΣΫτΛ࡞ͬͯΈΔ 36

Slide 37

Slide 37 text

Slide 38

Slide 38 text

׬੒ 38

Slide 39

Slide 39 text

ԿΛͨ͠ͷ͔ʁϝϦοτ ͨ͠ࣄɿ   ࡞ۀ༻ͷϑΥϧμΛ࡞Γ࡞ۀ৔ॴΛࢦఆͨ͠ ϝϦοτ ϓϩδΣΫτ୯ҐͰϑΝΠϧ΍ϑΥϧμΛ؅ཧͰ͖Δ εΫϦϓτΛλϒͰෳ਺؅ཧͰ͖Δ ෼ੳͰ࢖͏&YDFMͷϑΝΠϧ͕؆୯ʹ֬ೝɾฤूͰ͖Δ ݁Ռʢද΍άϥϑͷը૾ʣ͕ࣗಈతʹ͜ͷϑΥϧμʹอଘ͞ΕΔ 39

Slide 40

Slide 40 text

ύοέʔδ 40

Slide 41

Slide 41 text

ύοέʔδɿ3ͷதͰ࢖͏ΞϓϦΈ͍ͨͳ΋ͷ 41

Slide 42

Slide 42 text

ύοέʔδͷΠϯετʔϧํ๏ 3TUVEJPͰΠϯετʔϧ ௚઀ίʔυΛॻ͘   JOTUBMMQBDLBHFT lύοέʔδ໊z 42

Slide 43

Slide 43 text

%>% ύΠϓԋࢉࢠ 43

Slide 44

Slide 44 text

ͰϓϩάϥϜΛܨ͙ 44 Rݴޠೖ໳ʢཪޱʣ-- Landscape with R —ɹhttps://qiita.com/kilometer/items/63f2eab36e268096d313