Ruby脳で実装するCNN

by hatappi

Slide 1

Slide 1 text

Ruby೴Ͱ࣮૷͢ΔCNN 4QFFF,BJHJ UZOUΤϯδχΞാத༔࡞

Slide 2

Slide 2 text

self.intoroduction { name: "Yusaku Hatanaka", twitter: "@hatappi", github: "hatappi", hatena: "hatappi1225", company: "Speee, Inc." languages: ["Ruby", "Go", "Python"], icon: "ɹ " }

Slide 3

Slide 3 text

CNNͱ͸ w ৞ΈࠐΈχϡʔϥϧωοτϫʔΫ Convolutional Neural Network w શ݁߹Ͱ͸3(#ը૾ͷΑ͏ͳ࣍ݩͷը૾Ͱ͋ͬͯ΋̍࣍ݩͷ σʔλʹ͢ΔͨΊܗঢ়͕ແࢹ͞Εͯ͠·͏͕$//Ͱ͸ܗঢ়Λ ҡ࣋͢Δ͜ͱ͕ग़དྷΔ IUUQZBOOMFDVODPNFYECQVCMJTQEGMFDVOQEG શ݁߹ ৞ΈࠐΈ

Slide 4

Slide 4 text

*-473$ IUUQJNBHFOFUPSHDIBMMFOHFTUBMLT@*-473$@PWFSWJFXQEG AlexNet ZFNet GooLeNet ResNet SENet

Slide 5

Slide 5 text

࣮ྫ גࣜձࣾ7"4*-: 3FUUZגࣜձࣾ

Slide 6

Slide 6 text

ੈͷதͰ͸ͲͷΑ͏ʹ ࣮ݱ͞Ε͍ͯΔͷ͔

Slide 7

Slide 7 text

FUD

Slide 8

Slide 8 text

ͳͥRuby೴Ͱ࣮૷͢Δ ඞཁ͕͋ΔͷͰ͠ΐ͏͔ʁ

Slide 9

Slide 9 text

rmatz lRubyΛΩϝΔͱؾ͍͍࣋ͪz

Slide 10

Slide 10 text

3FE$IBJOFS

Slide 11

Slide 11 text

3FE$IBJOFSͱ͸ʁ w 1ZUIPO੡ͷ$IBJOFSΛ3VCZͰϙʔςΟϯάͨ͠ਂ ૚ֶशϑϨʔϜϫʔΫ w χϡʔϥϧωοτϫʔΫ΍$//ͳͲͷωοτϫʔ ΫߏஙΛ͢Δ্Ͱඞཁͳ"1*Λఏڙ͢Δ w ߦྻͷอ࣋ɾԋࢉʹ͸/VNP/"SSBZΛ࢖༻

Slide 12

Slide 12 text

3FE$IBJOFSͷಛ௃ w 3VCZͰ࣮ݱ͞Ε͍ͯΔ w 3VCZJTU͕3VCZΒ͘͠ਂ૚ֶशΛ͢Δ͜ͱ͕ग़དྷ ΔΑ͏ʹͳΔ͸ͣ w ./*45΍$*'"3Λࣝผ͢Δ΋ͷͰ͸ͳͦ͘ΕΒΛ ࣮ݱ͢ΔͨΊͷ"1*܈Λఏڙ͍ͯ͠Δ w 044Ͱఏڙ͞Ε͓ͯΓ୭Ͱ΋ιʔείʔυΛ  ݟΔ͜ͱ͕ग़དྷͯҰॹʹ։ൃΛ͢Δ͜ͱ͕ग़དྷΔ SFEEBUBUPPMTSFEDIBJOFS

Slide 13

Slide 13 text

$*'"3ͷࣝผ

Slide 14

Slide 14 text

$*'"3 w ܇࿅σʔλສຕɺςετσʔ λສຕ͔ΒͳΔը૾σʔλ ηοτ w ը૾͸YQYͷ3(#͕ DIBOOFMͰߏ੒͞ΕΔ IUUQTXXXDTUPSPOUPFEVdLSJ[DJGBSIUNM

Slide 15

Slide 15 text

࢖ͬͨϞσϧ w ೥ͷILSVRCͰҐͱͳͬͨ7((ϞσϧΛϕʔ εʹ͍ͯ͠·͢ w 7((͸৞ΈࠐΈ૚ͱϓʔϦϯά૚͔Βߏ੒͞ΕΔ γϯϓϧͳߏ଄ͷ$// w ύϥϝʔλͷ࠷దԽʹ͸MomentumSGD

Slide 16

Slide 16 text

࢖ͬͨϞσϧ

Slide 17

Slide 17 text

࢖ͬͨϞσϧ

Slide 18

Slide 18 text

࣮૷ͨ͠"1* • Convolution2D • Batch Normalization • MaxPooling • MomentumSGD • Dropout • WeightDecay • etc

Slide 19

Slide 19 text

σϞ

Slide 20

Slide 20 text

ݱঢ়ͷ՝୊଎౓໘ 3FE$IBJOFS $IBJOFS TPOPUTDVNP

Slide 21

Slide 21 text

ݱঢ়ͷ՝୊3VCZΒ͠͞

Slide 22

Slide 22 text

·ͱΊ w CIFARͷࣝผΛ͢ΔϞσϧΛߏங͢ΔͨΊʹඞཁͳ "1*܈Λ࣮૷ͨ͠ w Ruby೴ͰCNNΛߏங͢Δ͜ͱͰΩϝͯؾ࣋ͪΑ͘ ͳΕͨ w Red Chainer͕࣮༻తͳ΋ͷ΁ͱҰาલʹਐΜͩ