Share
Embed
170526_LeapMindイベント_三室
2017/05/26(金) 19:00〜
[LeapMind主催]FPGAを用いたディープラーニングのハードウェアアクセラレーションの前半partの資料です。
Yuki Mimuro
May 26, 2017
Transcript
35 slides
-
-FBQ.JOE *OD"MMSJHIUTSFTFSWFE ࡾࣨ༎و :VLJ.JNVSP ʻܦྺʼ Ұڮେֶֶ෦ܦӦֶՊଔۀޙɺ݄ʹ৫ ਓࣄίϯαϧςΟϯάϑΝʔϜʹ৽ଔͰೖࣾ͠ɺ தখϕϯνϟʔاۀͷ ίϯαϧςΟϯάͱࢿΛ୲͢Δɻ
-&"1.*/%Ͱ ࣄۀ։ൃɺ࠾༻ɺ৫։ൃɺใΛ୲͢Δɻ ࣗݾհ -
-FBQ.JOE *OD"MMSJHIUTSFTFSWFE ձ໊ࣾ LeapMindגࣜձࣾ ઃཱ 201212݄25 ࢿຊۚ 206,984,639ԁ ද দా૯Ұ
ओཁגओ ҏ౻ςΫϊϩδʔϕϯνϟʔζɺVisionnaire Ventures(ถ)ɺArchetype* Ventures() ैۀһ 35ਓ ॴࡏ ౦ژौ୩۠ौ୩3-15-3ɹϏϧ3F ࣄۀ༰ σΟʔϓϥʔχϯάʹؔΘΔγεςϜߏங͓Αͼࢧԉ ձࣾ֓ཁ -
-FBQ.JOE *OD"MMSJHIUTSFTFSWFE -FBQ.JOEͷԊֵ ౦ژࠇ۠ʹͯ -FBQ.JOEגࣜձࣾۀ ݄ ݄ ,%%*ແݶϥϘʹͯ/FX-JGFTUZMF Λड ݄
"SDIFUZQF 7FOUVSFT*ODΑΓ ສԁͷ$#ͰͷࢿۚௐୡΛ ͓͜ͳ͍·ͨ͠ ݄ ςϨϏ౦ژͷʮϫʔϧυϏδωεα ςϥΠτʯʹͯհ͞Ε·ͨ͠ ݄ γϦʔζ"ϥϯυͰ૯ֹԯ ສԁͷୈࡾऀׂ૿ࢿΛൃද ݄ ʰ'PSCFT+BQBOʱ݄߸ͷ ʮੈք͕ʂظͷελʔτΞο ϓຊͷࣾʯʹબग़͞Ε·ͨ͠ ݄ גࣜձࣾ/55σʔλͱ5XJUUFSࣾͷ શྔσʔλղੳʹ͓͍ͯۀఏܞ ͍ͨ͠·ͨ͠ -
-FBQ.JOE *OD"MMSJHIUTSFTFSWFE -FBQ.JOEͷಛ ϋʔυΣΞݚڀ লిྗߴޮΛࢦͨ͠ ճ࿏ઃܭ χϡʔϥϧωοτϫʔΫΛճ࿏ଆͰ ཧతʹ༻ҙ͢Δ͜ͱͰখ͍͞νοϓͰ σΟʔϓϥʔχϯάͷܭࢉ͕ग़དྷΔ ಠࣗΞʔΩςΫνϟΛݚڀ
ιϑτΣΞݚڀ σΟʔϓϥʔχϯάͷϞσϧ ਫ਼ͷ্ܭࢉྔѹॖ Ϟσϧࣗମͷਫ਼্ͱಉ࣌ʹɺܭࢉ ྔΛѹॖ͠খ͞ͳܭࢉڥͰσΟʔ ϓϥʔχϯάͷҖྗΛ࠷େݶൃشͤ͞ ΔಠࣗΞϧΰϦζϜͷݚڀ -
-FBQ.JOE *OD"MMSJHIUTSFTFSWFE ಠٕࣗज़Λ࣠ʹ ػց͕࣮ੈքೝࣝ Ұൠৄࡉମೝࣝ ࣮ੈքͷମʹରͯ͠ɺػց͕ ͦΕ͕Կ͔ೝࣝ͢Δ͜ͱ͕Ͱ͖Δ Α͏ʹͳΓ·͢ ମݕग़ ೋԽχϡʔϥϧωοτ
ڧԽֶश ࣌ܥྻσʔλղੳ Ϟσϧѹॖ ಠࣗͷίάχςΟϒٕज़ ͋Δγʔϯͷத͔ΒɺԿ͕Ͳ͜ʹ ͋Δͷ͔Λػց͕Ѳ͢Δ͜ͱ͕ Ͱ͖ΔΑ͏ʹͳΓ·͢ ܭࢉΛѹॖ͠ܭࢉࣜΛܰྔԽ͠ɺ ඇৗʹখ͞ͳϝϞϦফඅͰσΟʔ ϓϥʔχϯάΛಈ͔͠·͢ χϡʔϥϧωοτϫʔΫΛͱ ͷΈͰදݱ͠͠ɺߴԽͱলϝ ϞϦԽΛ࣮ݱ͠·͢ ࣌ؒ࣠Λߟྀͨ͠χϡʔϥϧωο τͰߴਫ਼ͷੳΛߦ͍·͢ ػց͕ঢ়گΛཧղ͠ͳ͕Βɺ࠷ద ͳղΛࣗΒݟ͚͍ͭͯ͘͜ͱ͕ Ͱ͖ΔΑ͏ʹͳΓ·͢ -
-FBQ.JOE *OD"MMSJHIUTSFTFSWFE 03 K 03 KF ())( 03 a G
1 2 K S ))( P -&"1.*/%ͷࣄۀྖҬ -
-FBQ.JOE *OD"MMSJHIUTSFTFSWFE 03 K 03 KF ())( 03 a G
1 2 K S ))( P -&"1.*/%ͷࣄۀྖҬ -
-FBQ.JOE *OD"MMSJHIUTSFTFSWFE ιϦϡʔγϣϯ׆༻ࣄྫ *OEVTUSZ $POTVN FS 8FC ɾࣗಈӡసϓϩδΣΫτ ɾנఫڈϩϘοτ ɾൃిॴҟৗݕ
ɾ৯ҟݕ ɾυϩʔϯΛͬͨݐݕ ɾ"*Ոి ɾ"*ϗʔϜ ɾ৯ࣄཧఏҊ ɾۀ ɾ4/4ͷτϨϯυղੳ ɾߪങσʔλղੳ ɾҩྍσʔλղੳ -
-FBQ.JOE *OD"MMSJHIUTSFTFSWFE ا ը ࢧ ԉ اը ݕ౼ ϓ Ϩ
Ϧ α ồ ν ཁ ݅ ఆ ٛ Ϧαʔν ઃܭɾ࣮ ֶशɾνϡʔχϯά ಋೖ ӡ༻ ཁ݅ఆٛ Ϧ α ồ ν ֶ श σ ồ λ ࡞ Ϟ σ ϧ ઃ ܭ Ϟ σ ϧ ࣮ Ϟ σ ϧ ֶ श Ϟ σ ϧ ݕ ূ ύ ϥ ϝ ồ λ ồ ν ϡ ồ χ ϯ ά ಋ ೖ ࢧ ԉ ӡ ༻ ࢧ ԉ Ϟ σ ϧ ͷ ࠶ ֶ श ݕূ༻ΠϯλϑΣʔε࡞ ӡ༻ઃܭɾӡ༻ϚχϡΞϧ࡞ %FFQ-FBSOJOHγεςϜ։ൃͷྲྀΕ -
-FBQ.JOE *OD"MMSJHIUTSFTFSWFE 45&1͝ͱʹߦ͏͜ͱ ༰ Ϧαʔν Ϟσϧߏங ݕূγεςϜӡ༻ త ࣮ݱ͢ΔͨΊͷΞϓϩʔνΛࡧ ֩ͱͳΔ//ϞσϧΛߏங
࣮γεςϜӡ༻Ͱ͖Δମ੍Λߏங ϝϯόʔ 3FTFBSDIFS %FFQ-FBSOJOH&OHJOFFS 3FTFBSDIFS %FFQ-FBSOJOH&OHJOFFS 8FC&OHJOFFS ํ๏ จͳͲ͔ΒదͳΞϓϩʔνΛ ୳͠ग़͠ɺTBNQMFDPEFΛॻ͍ͯ ؆୯ͳ࣮ݧΛߦ͍ɺQSJPSJUZΛܾΊΔ ˙ڥ 1ZUIPO9PS9 EFQFOETPOQSPKFDU $ TUBOEBSE FH 5FOTPSqPXWFS ֶशཧαʔόʔͱ"84 "[VSF ίʔυཧ(JU)VC ˙ڥ ɾόοΫΤϯυ ݴޠɿ1ZUIPOɺQIQͳͲ '8ɿqBTLɺMBSBWFMɺ$BLF1)1ͳͲ ɾϑϩϯτΤϯυ ݴޠɿ/PEF+4 3FBDU+4 )5.- $44 04ɿ։ൃ࣌ࣗ༝ɺσϓϩΠઌ-JOVY %#ɿ.Z42- -
-FBQ.JOE *OD"MMSJHIUTSFTFSWFE 03 K 03 KF ())( 03 a G
1 2 K S ))( P -&"1.*/%ͷࣄۀྖҬ -
-FBQ.JOE *OD"MMSJHIUTSFTFSWFE Labeled data ML algorithm Input data Trained network
prediction Training Prediction Training is usually off-line Needs a lot of time and power Usually requires big GPU. (some new ASIC chips are expected soon) Has to be on-line Time and power constraint Usually less computation than training. Currently GPU based. FPGA use expected in the future cloud edge %FFQ-FBSOJOHPOFEHF -
-FBQ.JOE *OD"MMSJHIUTSFTFSWFE ։ൃڥܥ౷ਤ ౷߹ڥ ϓϥοτϑΥʔϜ %BUB %BUB %BUB 'SBNFXPSL %BUB
ֶతʹਖ਼͍͠ܗ ͰܭࢉํࣜΛখ͞ ͘͢ΔϥΠϒϥϦ NJOJ TFHOFU ౷߹ڥ ϓϥοτϑΥʔϜ νοϓʹ χϡʔϥϧωοτ Λߏங͢Δ NJOJ $// NJOJ 3$// NJOJ "MFYOFU NJOJ 7((OFU NJOJ 3FTOFU Ոి༻ νοϓ ༻ νοϓ ࣗಈं༻ νοϓ υϩʔϯ༻ νοϓ ϩϘοτ༻ νοϓ 4PGU -BZFS )BSE -BZFS -
-FBQ.JOE *OD"MMSJHIUTSFTFSWFE %FFQ-FBSOJOH͕·Δϓϩηε *O *#. 1$ $IJQ 4PGU *O
-.#MBDLTUBS *OUFSGBDF $IJQ 4PGU ΞϓϦέʔγϣϯɾϋʔυΣΞɾσΟʔϓϥʔχϯά શͯͷύʔπ͕όϥόϥͳͷͰɺ౷߹ͨ͠αʔϏε͕ඞཁʹͳΔ -
-FBQ.JOE *OD"MMSJHIUTSFTFSWFE ࣄ༰ ɾΫϥΠΞϯτ͔Βड͚ͨ%FFQ-FBSOJOHʹؔ͢Δ։ൃҊ݅ͷऔΈ ɾ%FFQ-FBSOJOH .BDIJOF-FBSOJOH$PNQVUFS7*TJPO ؔͷϥ ΠϒϥϦɾϑϨʔϜϫʔΫͷௐࠪɺ࣮ɺվྑ ඞਢεΩϧ ɾ1ZUIPOɺ$
ͷߴ͍ϓϩάϥϛϯάεΩϧ ɾߦྻภඍͷֶతࣝ ܴεΩϧ ɾใֶܥͷֶҐͷอ༗ ɾ"OESPJEJ04ɺ3BTQCFSSZ1JͳͲΈࠐΈػثͷϓϩάϥϜ ࣮ͷܦݧ ٻΊΔਓ૾ ɾϓϩάϥϛϯά͢Δ͜ͱʹதͰ͖Δ ɾࣗࣗͷϓϩάϥϛϯάྗ্ͨΊʹɺϑΟʔυόοΫΛड͚ೖ ΕΔ͜ͱ͕Ͱ͖Δ ɾ࠷ઌͷٕज़ʹର͢ΔڧΈڵຯ͕͋Δʢ୳ڀ৺ʣ ɾՌग़ʹ͚ͯɺνʔϜͱͯ͠ઓ͏͜ͱʹތΓΛ͍࣋ͬͯΔ ɾৗʹ৽͍͠खஈʹΛ͚ͭɺ࣮ݧݕূ͢Δ͜ͱ͕Ͱ͖Δ ։ൃڥ $B⒎F5FOTPS'MPXΛओʹ༻ ίʔυنʹͬऔ͍ͬͯΕΤσΟλͳͲࣗ༝ %FFQ-FBSOJOHΤϯδχΞ -
-FBQ.JOE *OD"MMSJHIUTSFTFSWFE 8FCόοΫΤϯυΤϯδχΞ ࣄ༰ ɾࣗࣾαʔϏεϓϩμΫτͷ։ൃ ɾ৽نٕज़ͷௐ͓ࠪΑͼݚڀ։ൃͱͦͷڞ༗ ɾαʔϏεʹ߹Θͤͯɺ্ཱ͔͛Βӡ༻·ͰશͯͷڥίʔυΛߏங ඞਢεΩϧ ɾ8FCΞϓϦέʔγϣϯͷ։ൃɾӡ༻ܦݧ ɾ-JOVY6OJYʹؔ͢Δࣝɾܦݧ
ɾ1ZUIPO 1)1ͳͲͷϓϩάϥϛϯάܦݧ ܴεΩϧ ɾΞϧΰϦζϜʹؔ͢Δࣝ ɾϑϨʔϜϫʔΫʹؔ͢Δࣝɾܦݧ ɾσʔλϕʔεʹؔ͢Δࣝɾܦݧ ٻΊΔਓ૾ ɾ৽ͨͳαʔϏεʹର͢Δٕज़બఆ͕Ͱ͖Δ ɾଞऀΛר͖ࠐΈͳ͕ΒࣄΛߦ͏͜ͱ͕Ͱ͖Δ ɾ࠷ઌͷٕज़ʹର͢ΔڧΈڵຯ͕͋Δʢ୳ڀ৺ʣ ɾ৽ͨͳٕज़ΛࣗΒ࣮ݧɾݕূ͠ɺࣗࣾαʔϏεʹ׆͔͢ྗ͕͋Δ ɾૉͰ৽ֶ͘͠Ϳ͜ͱΛԀΘͳ͍ -
-FBQ.JOE *OD"MMSJHIUTSFTFSWFE 8FCϑϩϯτΤϯυΤϯδχΞ ࣄ༰ ɾσβΠϯɺاը͔ΒͷཁٻʹԠͨ͡)5.-$44+BWB4DSJQUQIQʹΑΔΣ ϒϑϩϯτΤϯυͷ࣮ ɾϞοΫΞοϓϓϩτλΠϓͷ࡞ͱ࣮ূ ɾ69Λߟྀͨ͠6*ͷఏҊ͓Αͼઃܭ ɾ৽نٕज़ͷௐ͓ࠪΑͼݚڀ։ൃͱͦͷڞ༗ ɾύϑΥʔϚϯεվળ࣭ҡ࣋ͷͨΊͷࢪࡦ࣮ࢪ
ɾ6*ίϯϙʔωϯτϥΠϒϥϦͷ੍࡞ ඞਢεΩϧ ɾ)5.-$44+BWB4DSJQUͷઐతͳਂ͍ࣝ ɾ1$εϚʔτϑΥϯͷΣϒΞϓϦέʔγϣϯͷ։ൃܦݧ ɾΞΫηγϏϦςΟɾϢʔβϏϦςΟʹؔ͢Δࣝ ܴεΩϧ ɾ$44ϓϦϓϩηοαʹؔ͢Δࣝ ɾJ04ɺ"OESPJEͳͲͷωΠςΟϒΞϓϦέʔγϣϯͷ։ൃܦݧ ɾ1ZUIPO ɺ+BWBͳͲͷαʔόʔαΠυݴޠͰͷ։ൃܦݧ ٻΊΔਓ૾ ɾ৽ͨͳαʔϏεʹର͢Δٕज़બఆ͕Ͱ͖Δ ɾ69Λߟ্͑ͨͰXFCσβΠϯΛ࡞Ͱ͖Δ ɾ࠷ઌͷٕज़ʹର͢ΔڧΈڵຯ͕͋Δʢ୳ڀ৺ʣ ɾ৽ͨͳٕज़ΛࣗΒ࣮ݧɾݕূ͠ɺࣗࣾαʔϏεʹ׆͔͢ྗ͕͋Δ ɾૉͰ৽ֶ͘͠Ϳ͜ͱΛԀΘͳ͍ -
-FBQ.JOE *OD"MMSJHIUTSFTFSWFE ݚڀऀϦαʔνϟʔ ࣄ༰ ɾظతͳࢹͰɺٕज़ͷϩʔυϚοϓΛͱΒ͑ɺݚڀΛߦ͍ࣗࣾಠ ࣗͷٕज़ΛੜΈग़͢ ɾੜΈग़ͨ͠ಠࣗͷٕज़ΛɺࠃࡍతͳֶձͳͲͰൃද͠ɺٕज़Λੈ ͷதʹؐݩ͢Δ ඞਢεΩϧ ɾػցֶशҨతΞϧΰϦζϜίϯϐϡʔλʔϏδϣϯͷͰ
म࢜ Ϛελʔ Ҏ্ͷֶҐΛ༗͍ͯ͠Δ͜ͱ ܴεΩϧ ɾࠃࡍֶձͷจܝࡌ࣮ ɾຽؒݚڀػؔͰͷ࣮ܦݧ ٻΊΔਓ૾ ɾ৽͍ٕ͠ज़Λٻ͢Δ͜ͱ͕ͱ͜ͱΜ͖ ɾจΛग़͢ͳͲɺੈͷதʹର͢ΔΠϯύΫτΛॏࢹ͢Δ ɾࣗࣗͱͯ͠ͷݚڀςʔϚΛ͍࣋ͬͯΔ ɾ৽͍ٕ͠ज़ʹର͢ΔΞϯςφ͕Ӷཱ͍ͬͯ͘Δ ɾ࠷େՌΛग़ͨ͢Ίʹɺࣝͷڞ༗ΛνʔϜͰߦ͏͜ͱ͕Ͱ͖Δ ։ൃڥ $B⒎F5FOTPS'MPXΛओʹ༻ ίʔυنʹͬऔ͍ͬͯΕΤσΟλͳͲࣗ༝ -
-FBQ.JOE *OD"MMSJHIUTSFTFSWFE '1("ΤϯδχΞ ࣄ༰ ɾ%FFQ-FBSOJOH ਂֶश Λߴ͔ͭলిྗͰఏڙ͢Δج൫ͷઃܭ ฐࣾϓϩμΫτ#MBDL4UBS ඞਢεΩϧ ɾߴҐ߹
)-4 ʹؔ͢Δઐతͳࣝ ɾ%FFQ-FBSOJOHʹؔ͢Δجૅతͳࣝ ɾ7FSJMPH)%-·ͨ7)%-ΛؚΉ35-։ൃͷࣝ ܴεΩϧ ɾ-JOVYͷࣝ ɾ$ݴޠͷϓϩάϥϛϯάεΩϧ ɾΈࠐΈϚΠίϯपลճ࿏ઃܭͷࣝ ɾϚΠίϯɺ'1(" $1-% Λͬͨࣗ࡞ϋʔυΣΞͷ࡞ܦݧ ٻΊΔਓ૾ ɾੈքతͳτϨϯυΛৗʹଊ͑ͭͭɺࣗࣾʹ࠷దͳٕज़ΛಋೖͰ͖Δ ɾ'1("ʹݶΒͣɺϋʔυΣΞશൠʹର͢ΔࣝΛ͍࣋ͬͯΔ ɾϋʔυ͚ͩͰͳ͘ɺιϑτʹؔ͢Δ͍ࣝ࣋ͬͯΔ ɾଞ෦ͱͷ࿈ܞͷͨΊʹɺԁͳίϛϡχέʔγϣϯΛऔΔ ։ൃڥ ɾ7JWBEP ɺ7JWBEP)-4 ɾ%FHJMFOUࣾͷ;ZCPɺ5SFO[ࣾͷϘʔυ