Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Speaker Deck
PRO
Sign in
Sign up
for free
Ruby脳で実装するCNN
hatappi
March 30, 2018
Technology
1
920
Ruby脳で実装するCNN
#speeekaigi
hatappi
March 30, 2018
Tweet
Share
More Decks by hatappi
See All by hatappi
hatappi
0
310
hatappi
2
1.1k
hatappi
0
100
hatappi
2
240
hatappi
1
600
hatappi
0
790
hatappi
2
1.4k
hatappi
1
1.3k
hatappi
1
380
Other Decks in Technology
See All in Technology
ocise
0
140
ytaka23
13
3.3k
kaga
0
350
autifyhq
1
830
ymatsuwitter
0
260
kadoppe
1
250
brtriver
1
540
legalforce
PRO
0
200
harshbothra
0
250
lambda
0
130
prog893
0
160
sayokomiura
0
240
Featured
See All Featured
stephaniewalter
262
11k
maggiecrowley
10
560
jonyablonski
22
1.3k
searls
204
37k
dotmariusz
94
5.5k
shlominoach
176
7.6k
chrislema
231
16k
carmenhchung
35
1.6k
colly
66
3k
roundedbygravity
242
21k
robhawkes
53
2.9k
ammeep
657
54k
Transcript
RubyͰ࣮͢ΔCNN 4QFFF,BJHJ UZOUΤϯδχΞാத༔࡞
self.intoroduction { name: "Yusaku Hatanaka", twitter: "@hatappi", github: "hatappi", hatena:
"hatappi1225", company: "Speee, Inc." languages: ["Ruby", "Go", "Python"], icon: "ɹ " }
CNNͱ w ΈࠐΈχϡʔϥϧωοτϫʔΫ Convolutional Neural Network w શ݁߹Ͱ3(#ը૾ͷΑ͏ͳ࣍ݩͷը૾Ͱ͋ͬͯ̍࣍ݩͷ σʔλʹ͢ΔͨΊܗঢ়͕ແࢹ͞Εͯ͠·͏͕$//Ͱܗঢ়Λ
ҡ࣋͢Δ͜ͱ͕ग़དྷΔ IUUQZBOOMFDVODPNFYECQVCMJTQEGMFDVOQEG શ݁߹ ΈࠐΈ
*-473$ IUUQJNBHFOFUPSHDIBMMFOHFTUBMLT@*-473$@PWFSWJFXQEG AlexNet ZFNet GooLeNet ResNet SENet
࣮ྫ גࣜձࣾ7"4*-: 3FUUZגࣜձࣾ
ੈͷதͰͲͷΑ͏ʹ ࣮ݱ͞Ε͍ͯΔͷ͔
FUD
ͳͥRubyͰ࣮͢Δ ඞཁ͕͋ΔͷͰ͠ΐ͏͔ʁ
rmatz lRubyΛΩϝΔͱؾ͍͍࣋ͪz
3FE$IBJOFS
3FE$IBJOFSͱʁ w 1ZUIPOͷ$IBJOFSΛ3VCZͰϙʔςΟϯάͨ͠ਂ ֶशϑϨʔϜϫʔΫ w χϡʔϥϧωοτϫʔΫ$//ͳͲͷωοτϫʔ ΫߏஙΛ͢Δ্Ͱඞཁͳ"1*Λఏڙ͢Δ w ߦྻͷอ࣋ɾԋࢉʹ/VNP/"SSBZΛ༻
3FE$IBJOFSͷಛ w 3VCZͰ࣮ݱ͞Ε͍ͯΔ w 3VCZJTU͕3VCZΒ͘͠ਂֶशΛ͢Δ͜ͱ͕ग़དྷ ΔΑ͏ʹͳΔͣ w ./*45$*'"3Λࣝผ͢ΔͷͰͳͦ͘ΕΒΛ ࣮ݱ͢ΔͨΊͷ"1*܈Λఏڙ͍ͯ͠Δ w
044Ͱఏڙ͞Ε͓ͯΓ୭ͰιʔείʔυΛ ݟΔ͜ͱ͕ग़དྷͯҰॹʹ։ൃΛ͢Δ͜ͱ͕ग़དྷΔ SFEEBUBUPPMTSFEDIBJOFS
$*'"3ͷࣝผ
$*'"3 w ܇࿅σʔλສຕɺςετσʔ λສຕ͔ΒͳΔը૾σʔλ ηοτ w ը૾YQYͷ3(#͕ DIBOOFMͰߏ͞ΕΔ IUUQTXXXDTUPSPOUPFEVdLSJ[DJGBSIUNM
ͬͨϞσϧ w ͷILSVRCͰҐͱͳͬͨ7((ϞσϧΛϕʔ εʹ͍ͯ͠·͢ w 7((ΈࠐΈͱϓʔϦϯά͔Βߏ͞ΕΔ γϯϓϧͳߏͷ$// w ύϥϝʔλͷ࠷దԽʹMomentumSGD
ͬͨϞσϧ
ͬͨϞσϧ
࣮ͨ͠"1* • Convolution2D • Batch Normalization • MaxPooling • MomentumSGD
• Dropout • WeightDecay • etc
σϞ
ݱঢ়ͷ՝໘ 3FE$IBJOFS $IBJOFS TPOPUTDVNP
ݱঢ়ͷ՝3VCZΒ͠͞
·ͱΊ w CIFARͷࣝผΛ͢ΔϞσϧΛߏங͢ΔͨΊʹඞཁͳ "1*܈Λ࣮ͨ͠ w RubyͰCNNΛߏங͢Δ͜ͱͰΩϝͯؾ࣋ͪΑ͘ ͳΕͨ w Red Chainer͕࣮༻తͳͷͱҰาલʹਐΜͩ