Share
Embed
Transcript
15 slides
-
ਅཅੑɺِཅੑ ਅཅੑʢTP: True Positiveʣ ཅੑͩͱஅͨ͠σʔλʹ͍ͭͯɺͦΕ͕ຊʹཅੑͩͬͨͷ ِཅੑʢFP: False Positiveʣ ཅੑͩͱஅͨ͠σʔλʹ͍ͭͯɺͦΕ͕࣮ӄੑͩͬͨͷ ྨ݁Ռ͕ཅੑ
ྨ݁Ռ͕ӄੑ ࣮ࡍཅੑ ʢt=1ʣ TP: True Positive ʢਅཅੑʣ FN: False Negative ࣮ࡍӄੑ ʢt=0ʣ FP: False Positive ʢِཅੑʣ TN: True Negative -
τϨʔυΦϑͰ͋Δ͜ͱΛτ ϨʔχϯάηοτͰߟ͑ͯΈΔ ཅੑͱஅ͢Δج४Λ ֬P͕͍ͭ͘Ҏ্ͱ͢ Δ͔ʢͲ͜ʹઢΛҾ͘ ͔ʣͰɺਅཅੑͱِ ཅੑมΘ͍ͬͯ͘ No. x y
type probability 17 3.112981 18.365505 1 0.974877 5 9.565425 14.490813 1 0.970444 4 16.518876 10.829925 1 0.968636 15 4.683143 14.311496 1 0.947828 0 -2.179448 17.027400 1 0.940079 19 6.697921 11.162725 1 0.916815 1 -4.503331 10.331480 0 0.720126 7 3.096324 5.841293 0 0.682496 11 -4.251525 8.810845 1 0.650768 8 12.351163 -2.448305 1 0.473750 13 0.135944 2.193228 1 0.398745 9 2.832298 0.529935 0 0.379728 18 12.742703 -6.120525 0 0.287259 12 -6.851055 2.156915 1 0.230266 6 -8.006545 2.658170 0 0.227698 16 4.473311 -8.369764 0 0.086250 2 -3.540915 -7.057080 0 0.049229 14 -1.728843 -8.918192 0 0.039690 10 -14.774465 -3.970796 0 0.028895 3 -4.767995 -9.256136 0 0.026421 ͜͜ʹઢΛҾ͚ਅཅੑ6/10ɺ ِཅੑ0͕ͩ…… -
ROCۂઢʢReceiver Operating Characteristicۂઢʣ அج४ͷมߋͰਅཅੑͱِཅ ੑ͕ͲͷΑ͏ʹมԽ͢Δ͔Λද ͨ͠ͷ͕ROCۂઢ ͜ΕΛݟͳ͕ΒͲ͜ʹஅج ४ΛҾ͔͘Λߟ͑Δͱ͍͍ ͜ΕΧΫΧΫ͍ͯ͠Δ͚Ͳɺτ Ϩʔχϯάηοτ͕͋Δఔଟ͚
Εࠨ্ʹுΓग़ͨ͠ۂઢʹͳΔ ROCۂઢ ϩδεςΟοΫճؼʹΑΔׂ -
͞ΒʹROCۂઢʹ͍ͭͯ ߟ͢Δ ࠨ্ʹுΓ͍͍ͯΔͳΒͦΕཧͷఆํ๏ ࠨԼΛج४ʹऔΔͳΒશͯΛӄੑͱஅ͢Δɺӈ ্Λج४ʹऔΔͳΒશͯΛཅੑͱஅ͢Δʢແ ʣ ର֯ઢ্Ͱ͋ΕɺҰఆ֬ͰϥϯμϜʹཅੑͱ அ͢Δʢແʣ ӈԼͷํʹுΓग़͍ͯ͠ΔͳΒɺҙਤతʹޡͬͨ அΛ͢Δʢѱҙʣ
݁ہɺਅཅੑͱِཅੑͷͲͪΒ͔͚ͩΛݟͯ ͍ͯΞϧΰϦζϜͷྑ͠ѱ͠Θ͔Βͳ͍ ROCۂઢ ϩδεςΟοΫճؼʹΑΔׂ -
ྨʹ͓͚ΔֶशϞσϧ ͷධՁࢦඪʹ͑Δ ਖ਼ղʢ·ͨਫ਼ʣʢaccuracyʣ ྨ݁Ռ͕ཅੑ ྨ݁Ռ͕ӄੑ ࣮ࡍཅੑ TP FN ࣮ࡍӄੑ FP
TN Accuracy = TP+TN TP+FP+FN+TN શମͷσʔλͷதͰਖ਼ ͘͠ྨͰ͖ͨσʔλ ͲΕ͘Β͍͔ Ͱྫ͑100ݸͷσʔληοτͷ͏ͪ95ݸ͕ཅੑͩͬͨ ͱ͢Δͱɺશ෦ཅੑͱஅ͢ΔֶशϞσϧʹͪ͠Ό͑ Accuracy0.95ʹͳͬͪΌ͏ͷͰɺAccuracy͚ͩͰࢦඪ ेͱݴ͑ͳ͍ΜͩΑͶ… -
ଞʹࢦඪ͋Δ ద߹ʢprecisionʣɺ࠶ݱʢrecallʣ Precision = TP TP+FP Recall = TP TP+FN
ྨ݁Ռ͕ཅੑ ྨ݁Ռ͕ӄੑ ࣮ࡍཅੑ TP FN ࣮ࡍӄੑ FP TN ʢPositiveΛج४ʹߟ͑ͨͱ͖ʹʣ ͲΕ͘Β͍ؒҧͬͨྨ͕গͳ͍͔ ʢPositiveΛج४ʹߟ͑ͨͱ͖ʹʣ ͲΕ͘Β͍औΓ͜΅͠ͳ͘ਖ਼͘͠ ྨ͍ͯ͠Δ͔ ͰҰൠతʹͲͪΒ͔͕ߴ͘ͳΔͱͲͪΒ͔͕ ͘ͳΔΑ͏ͳτϨʔυΦϑͷؔʹ͋ΔͷͰɺ ͜ΕΒ୯ಠͰݟͯेͱݴ͑ͳ͍ΜͩΑͶ… -
͏গ͠૯߹తͳੑೳΛ ਤΔࢦඪ F1ʢFmeasureʣ ଞʹࢦඪ͋Δ͕ɺ݁ہԿΛͲͷΑ ͏ʹ͏͔ࣗ࣍ୈ Fmeasure = 2 1 Precision
+ 1 Recall = 2 ⋅ Precision ⋅ Recall Precision + Recall ֶతʹద߹ͱ࠶ݱ ͷௐฏۉͷɻόϥϯε ͕͍͍ͱߴ͍ʹͳΔ -
ࢀߟจݙ தҪ ӻ࢘ʮITΤϯδχΞͷͨΊͷػցֶश ཧೖʯٕज़ධࣾ, 2015 ҏ౻ ਅʮPythonͰಈֶ͔ͯ͠Ϳʂ͋ͨΒ͠ ͍ػցֶशͷڭՊॻʯᠳӭࣾ, 2018 ཱੴݡޗʮֶ͘͞͠Ϳ
ػցֶशΛཧղ͢ ΔͨΊͷֶͷ͖΄Μ ʯϚΠφϏग़൛, 2017