TensorFlowと機械学習の今

by Kei Hirata

Slide 1

Slide 1 text

%FWFMPQFST*0 & ฏాܓ "84ίϯαϧςΟϯά෦ Ϋϥεϝιου ⡥$MBTTNFUIPE *OD ೥݄೔ 5FOTPS'MPXͱػցֶशͷࠓ

Slide 2

Slide 2 text

⡥$MBTTNFUIPE *OD ࣗݾ঺հ ໊લ : ฏా ܓ (@masuwo3) ॴଐ : σʔλ෼ੳνʔϜ ݱࡏ : 2015೥5݄ΑΓΫϥεϝιουೖࣾ աڈ : ಛ೚ॿڭɺSEɺITߨࢣɺetc... ML : ݚڀࣨͰ͔ͬͨ͡ఔ౓

Slide 3

Slide 3 text

⡥$MBTTNFUIPE *OD

Slide 4

Slide 4 text

⡥$MBTTNFUIPE *OD ࠓ೔͓࿩͢͠Δ͜ͱ ਂ૚ֶशͱ5FOTPS'MPXʹ͍ͭͯɺ ࣗ෼͕͜Ε·ͰʹֶΜͰ͖ͨ͜ͱΛɺ ͬ͘͟Γͱ࿩͠·͢ɻ

Slide 5

Slide 5 text

⡥$MBTTNFUIPE *OD ΞδΣϯμ w ਂ૚ֶशʹ͍ͭͯͷ֓ཁ w 5FOTPS'MPXͷ࠷ۙͷಈ޲ w ਂ૚ֶशͷࣄྫʹ͍ͭͯ %FFQ2/FUXPSL

Slide 6

Slide 6 text

ਂ૚ֶश

Slide 7

Slide 7 text

⡥$MBTTNFUIPE *OD ਂ૚ֶशͷ֓ཁ w ਂ૚ֶशͱ͸ͳʹ͔ʁ w ଟ૚͔ΒͳΔχϡʔϥϧωοτϫʔΫʹΑΔֶश

Slide 8

Slide 8 text

⡥$MBTTNFUIPE *OD w χϡʔϥϧωοτϫʔΫͱ͸ʁ w ਆܦࡉ๔ͷಈ͖Λ࠶ݱ͢ΔͨΊʹ࡞ΒΕͨϞσϧ w ݱࡏ͸ύʔηϓτϩϯϞσϧΛ༻͍ͨܭࢉωοτϫʔΫશൠ χϡʔϥϧωοτϫʔΫͷ͓͞Β͍ x1 x2 x3 w3 w2 w1 u y y = u ( w1x1 + w2x2 + ... )

Slide 9

Slide 9 text

⡥$MBTTNFUIPE *OD χϡʔϥϧωοτϫʔΫͷ͓͞Β͍ w χϡʔϥϧωοτϫʔΫʹ͓͚Δֶश w ֶश͸ύʔηϓτϩϯͷॏΈΛߋ৽ͯ͠ߦ͏ w ޡࠩؔ਺Λ࠷খͱ͢ΔॏΈΛ୳ࡧతʹٻΊΔ x1 x2 x3 u y w1 w2 w3

Slide 10

Slide 10 text

⡥$MBTTNFUIPE *OD χϡʔϥϧωοτϫʔΫͷ͓͞Β͍ w ύʔηϓτϩϯͷू߹ֶशϞσϧ

Slide 11

Slide 11 text

⡥$MBTTNFUIPE *OD w ଟ૚ωοτϫʔΫͷݶք w ૚Ҏ্ͷωοτϫʔΫͰ͸ֶश͕҆ఆ͠ͳ͍ w $//ͳͲɺҰ෦ͷख๏Ͱ͸੒ޭ w ͳͥࠓ·Ͱଟ૚ԽͰ͖ͳ͔ͬͨͷ͔ʁ w ޯ഑ফࣦ໰୊ w ଟ૚ͷ৔߹ɺೖྗ૚ʹۙͮ͘΄Ͳޡ͕ࠩগͳ͘ͳΔ w ݁Ռͱͯ͠ɺֶश͕҆ఆͤͣɺਫ਼౓͕޲্͠ͳ͍ ଟ૚ωοτϫʔΫͷ໰୊఺

Slide 12

Slide 12 text

⡥$MBTTNFUIPE *OD ਂ૚ֶशͷొ৔ w ଟ૚ωοτϫʔΫʹΑΔֶश͕࠶஫໨ w ͖͔͚ͬ͸%FFQ#FMJFG/FUXPSL w 3#.Λ༻͍ͯஈ֊తʹ//Λߏங w ͳͥͰ͖ΔΑ͏ʹͳͬͨͷ͔ʁ w ஈ֊తʹ//Λߏங͢Δ͜ͱͰɺॳظ஋Λ҆ఆԽ w ଟ૚//ʹ஫໨͕ू·Δ w ݱࡏ͸༷ʑͳख๏Ͱফࣦ໰୊Λճආ͍ͯ͠Δ

Slide 13

Slide 13 text

⡥$MBTTNFUIPE *OD ਂ૚ֶशͷಛ௃ w ෳࡶԽ͢ΔϞσϧ w HPPH-F/FU w ֶशʹ͔͔Δܭࢉίετ͕രൃ w ख๏ͷݕূ͕ࠔ೉

Slide 14

Slide 14 text

5FOTPS'MPX

Slide 15

Slide 15 text

⡥$MBTTNFUIPE *OD 5FOTPS'MPXʹ͍ͭͯ w (PPHMF੡ͷػցֶशϥΠϒϥϦ w %FFQ-FBSOJOHҎ߱ w 1ZUIPO w $6%" 2015/6/9 2015/11/20 2013/10/20 caffe v0.1 chainer ެ։ TensorFlow ެ։ …..

Slide 16

Slide 16 text

⡥$MBTTNFUIPE *OD w ॊೈੑ w ػցֶशͷϞσϧΛॊೈʹهड़Ͱ͖Δ w /FVSBM/FUXPSLʹݶఆ͠ͳ͍ w ϙʔλϏϦςΟ w ؀ڥʹ߹ΘͤͯܭࢉॲཧΛߦ͏ w $16(16 ϥοϓτοϓαʔόͳͲ w ݚڀ੒Ռͱ੡඼ͷ࿈݁ w ݚڀ੒ՌͷݕূΛߦ͍΍͘͢ w ϓϩμΫτʹస༻͠΍͘͢ 5FOTPS'MPXͷಛ௕ ެ͔ࣜΒ

Slide 17

Slide 17 text

⡥$MBTTNFUIPE *OD 5FOTPS'MPXʹ͓͚Δܭࢉॲཧ w 5FOTPS'MPX͸ܭࢉΛάϥϑߏ଄Ͱදݱ͢Δ Y ˎ ʴ Z C 8

Slide 18

Slide 18 text

⡥$MBTTNFUIPE *OD 5FOTPSͱ0QFSBUJPO σʔλ͸Tensor ܭࢉॲཧ͸Operation 5FOTPS 5FOTPS op 5FOTPS 5FOTPS

Slide 19

Slide 19 text

⡥$MBTTNFUIPE *OD 5FOTPSʹ͍ͭͯ ֊਺0ͷςϯιϧ (εΧϥ) ֊਺1ͷςϯιϧ (ϕΫτϧ) ֊਺2ͷςϯιϧ (ߦྻ) ֊਺3ͷςϯιϧ < ʜ> << ʜ> < ʜ> < ʜ> ʜ> <<< ʜ> ʜ> << ʜ> ʜ> << ʜ> ʜ> ʜ> B B<> B<><> B<><><>

Slide 20

Slide 20 text

⡥$MBTTNFUIPE *OD 4FTTJPOʹ͍ͭͯ w ܭࢉॲཧ͸ϑΣΠζ %FpOF3VO Define Run • ܭࢉͷάϥϑϞσϧΛߏங͢ΔϑΣΠζ • ͜ͷ࣌఺Ͱ͸ܭࢉ݁Ռ͸֬ఆ͠ͳ͍ • άϥϑϞσϧ͔Βܭࢉ݁ՌΛ֬ఆ͢ΔϑΣΠζ • SessionʹϞσϧΛ౤ೖ͠ɺܭࢉ݁ՌΛಘΔ

Slide 21

Slide 21 text

⡥$MBTTNFUIPE *OD 5FOTPSͱ0QFSBUJPO w 4FTTJPO w όοΫΤϯυͷ$ϞδϡʔϧͱͷίωΫγϣϯ w ࣮ࡍͷԋࢉ͸͜ͷ$Ϟδϡʔϧ্ͰߦΘΕΔ w ܭࢉϦιʔε͕ࣗಈతʹׂΓ౰ͯΒΕΔ Y ˎ ʴ Z C 8 cpu:0 gpu:0

Slide 22

Slide 22 text

⡥$MBTTNFUIPE *OD 0QUJNJ[FSʹ͍ͭͯ w ଛࣦؔ਺ͷ࠷খԽ w ػցֶशͷʮֶशʯ͸ɺଛࣦؔ਺ͷ࠷খԽʹஔ͖׵͑ΒΕΔ w ࠷খ఺ͷ୳ࡧʹ͸ɺޯ഑ܭࢉ͕ඞཁ w 5FOTPS'MPXͰ͸0QUJNJ[FSͰֶशΛҰׅͯ͠ߦ͏

Slide 23

Slide 23 text

⡥$MBTTNFUIPE *OD 0QUJNJ[FSʹ͍ͭͯ w 0QUJNJTFS w ޯ഑ܭࢉ͔Β୳ࡧ·ͰΛҰׅͰߦ͏ w ޯ഑ͷܭࢉ͸ɺάϥϑϞσϧΛࣗಈతʹม׵ w ֶशख๏ʹ߹Θͤͯ಺෦ͷॏΈΛߋ৽͍ͯ͘͠ w άϥϑͰදݱ͞Εͨଛࣦؔ਺͔ΒɺࣗಈతʹֶशΛߦ͏

Slide 24

Slide 24 text

⡥$MBTTNFUIPE *OD 5FOTPS'MPXͷػೳ w 5FOTPS#PBSE ֶशաఔ΍Ϟσϧͷߏ଄ΛՄࢹԽ

Slide 25

Slide 25 text

⡥$MBTTNFUIPE *OD 5FOTPS'MPXͷػೳ w 5FOTPS#PBSE ֶशաఔ΍Ϟσϧͷߏ଄ΛՄࢹԽ

Slide 26

Slide 26 text

⡥$MBTTNFUIPE *OD ͳͥ.-ϥΠϒϥϦ͕ٻΊΒΕ͍ͯΔ͔ w ੒ՌΛڞ༗͢Δ্Ͱͷڞ௨ج൫ͱͯ͠ w ͓ޓ͍ͷ੒ՌΛڞ༗͢Δ্Ͱͷڞ௨ݴޠͱͯ͠ w ϞσϧΛͲͷΑ͏ʹߏங͢Δ͔͸ϊ΢ϋ΢Ϩϕϧ w ࢼߦࡨޡʹΑͬͯ৽ͨͳൃݟΛظ଴ w ίετ໰୊ͷղܾ w ΑΓޮ཰తͳܭࢉॲཧͷͨΊͷج൫͕ඞཁ w (16Λ༻͍ͨฒྻͳԋࢉ w Ϛϧν(16ʹΑΔฒྻॲཧ w େن໛ΫϥελʹΑΔεέʔϧΞ΢τ

Slide 27

Slide 27 text

⡥$MBTTNFUIPE *OD %JTUSJCVUFE5FOTPS'MPX w ʮϚγϯΫϥελΛͭͷֶशػցͱͯ͠ѻ͏ʯ w 5FOTPS'MPX͸ɺʮ͍͔ʹͯ͠ܭࢉΛ෼ࢄͤ͞Δ͔ʯΛॏࢹ w ෳ਺Ϛγϯʹద༻ͨ͠ϥΠϒϥϦΛۙ೔ެ։༧ఆ w ؾʹͳΔ఺ w ֶशύϥϝʔλͷಉظ͕ϘτϧωοΫ w (PPHMF͸௿஗ԆωοτϫʔΫʹΑͬͯߴ଎ԽΛ࣮ݱ w ಈ͘؀ڥ͸͔ͳΓݶΒΕͦ͏

Slide 28

Slide 28 text

%FFQ2-FBSOJOH

Slide 29

Slide 29 text

⡥$MBTTNFUIPE *OD %FFQ2/FUXPSL w %FFQ-FBSOJOHڧԽֶश w Ϟχλը૾͔ΒήʔϜͷઓུΛֶश w ಉ͡ϞσϧͰ༷ʑͳήʔϜΛ߈ུ w ήʔϜʹΑͬͯ͸ϓϩҎ্ͷ੒Ռ XXXOBUVSFDPNOBUVSFKPVSOBMWOGVMMOBUVSFIUNM

Slide 30

Slide 30 text

⡥$MBTTNFUIPE *OD ڧԽֶश w ؀ڥͱΤʔδΣϯτ w ΤʔδΣϯτ͸؀ڥΛ஌֮͠ɺͦΕʹର͢ΔߦಈΛܾఆ w ߦಈʹΑͬͯརಘΛಘΒΕΔ ಘΒΕͳ͍৔߹΋͋Δ w աڈͷܦݧ͔Βɺ؀ڥʹରͯ͠࠷దͳߦಈΛܾఆ͢Δ ΤʔδΣϯτ ؀ڥ

Slide 31

Slide 31 text

⡥$MBTTNFUIPE *OD 2-FBSOJOH w ߦಈՁ஋ؔ਺ʹΑͬͯߦಈΛܾఆ͢Δ w ঢ়ଶɺߦಈΛೖྗͱ͢ΔߦಈՁ஋ؔ਺ΛٻΊΔ w աڈͷߦಈཤྺ͔ΒߦಈՁ஋ؔ਺Λߋ৽͠ɺ࠷దͳߦಈΛܾ ఆ͢Δ ߦಈঢ়ଶ T T T ʜ B B B ʜ

Slide 32

Slide 32 text

⡥$MBTTNFUIPE *OD 2/FUXPSL w ߦಈՁ஋ؔ਺Λ//Ͱදݱ w ݹయతͳςʔϒϧؔ਺ͩͱঢ়ଶ͕രൃ͠΍͍͢ w ϝϞϦͷ໰୊ɺαϯϓϦϯάͷ໰୊ w //ʹΑͬͯߦಈՁ஋ؔ਺Λۙࣅͤ͞Δ w ߦಈՁ஋ؔ਺ͷਫ਼౓͸//ͷදݱྗʹґଘ

Slide 33

Slide 33 text

⡥$MBTTNFUIPE *OD %FFQ2/FUXPSL w ৞ΈࠐΈ// $// ΛධՁؔ਺ʹར༻ w ը໘৘ใΛ௚઀ঢ়ଶͱͯ͠ѻ͍ɺߦಈΛܾఆ͢Δ

Slide 34

Slide 34 text

⡥$MBTTNFUIPE *OD ࣮ݧ݁Ռ w "UBSJ7JEFP0MZNQJDT

Slide 35

Slide 35 text

⡥$MBTTNFUIPE *OD %2/ͷ໘ന͍ͱ͜Ζ w ΞΠσΞ͸ͱͯ΋෼͔Γ΍͍͢ w 2/FUXPSLʹରͯ͠$//Λద༻ͯ͠Έͨ w ਂ૚ֶश͕ଞ෼໺ʹରͯ͠΋Өڹ͍ͯ͠Δ w ಛ௃ྔͷࣗಈநग़ͱ͍͏ੑ࣭Λ͏·͘ར༻ w ಉҰͷֶशϞσϧ͔ΒɺϧʔϧͷҟͳΔήʔϜΛ߈ུ͢Δ w $//Λར༻͢Δ͜ͱͰɺΑΓ޿൚ͳڧԽֶशϞσϧ

Slide 36

Slide 36 text

⡥$MBTTNFUIPE *OD ·ͱΊ w ػցֶशͷࠓਂ૚ֶश w ͨͩ͠ɺະͩʹख๏ʹ͍ͭͯ͸ࢼߦࡨޡ w .-ϥΠϒϥϦ 5FOTPS'MPX ͷొ৔ w ૿େ͢Δܭࢉίετ໰୊ͷղܾ w ੒ՌΛڞ༗͢ΔͨΊͷڞ௨ج൫ w ਂ૚ֶशͷ੒Ռ͸ଞ෼໺ͷػցֶशʹ΋Өڹ

Slide 37

Slide 37 text

%FWFMPQFST*0 " ⡥$MBTTNFUIPE *OD #cmdevio2016 ͝੩ௌ͋Γ͕ͱ͏͍͟͝·ͨ͠ɻ ϒϩά͸ޙ΄Ͳެ։͠·͢ɻ