Network Pruning：枝刈り手法のサーベイ

/FUXPSL1SVOJOHɿࢬמΓख๏ͷαʔϕΠ খᖛେ࿨ɼฏ઒ཌྷɼࢁԼོٛɼ౻٢߂࿱ʢத෦େֶɾػց஌֮ϩϘςΟΫεݚڀάϧʔϓʣ IUUQNQSHKQ

w ωοτϫʔΫͷܰྔԽɾߴ଎Խख๏ʹ͍ͭͯ w 1SVOJOHͷ֓ཁ w 6OTUSVDUVSFE1SVOJOH w $//4USVDUVSFE1SVOJOH w 5SBOTGPSNFS4USVDUVSFE1SVOJOH
w ·ͱΊ αʔϕΠɿ໨࣍

χϡʔϥϧωοτϫʔΫͷܰྔԽɾߴ଎Խ ܰྔԽɾߴ଎Խ ,OPXMFEHF %JTUJMMBUJPO -PXSBOL %FDPNQPTJUJPO 2VBOUJ[BUJPO 1SVOJOH )BSEXBSF
৑௕ͳॏΈΛ࡟আ ॏΈΛදݱ͢Δ Ϗοτ௕Λ࡟ݮ େ͖ͳϞσϧͷग़ྗΛ খ͞ͳϞσϧͷֶशʹར༻ ܭࢉػʹΑΔܭࢉ ΞϧΰϦζϜΛ࠷దԽ w 4USVDUVSFE1SVOJOH w 6OTUSVDUVSFE1SVOJOH w 2VBOUJ[BUJPOBXBSF5SBJOJOH w 1PTUUSBJOJOH2VBOUJ[BUJPO w -PPLVQ5BCMF w $PNQVUBUJPO3FVTF w .FNPSZ0QUJNJ[BUJPO w 3FTQPOTFCBTFE,OPXMFEHF w 'FBUVSFCBTFE,OPXMFEHF w 3FMBUJPOCBTFE,OPXMFEHF w 4UBDLFE#PUUMFOFDL'FBUVSFT ಛҟ஋෼ղΛԠ༻ͯ͠ ߦྻΛখ͞ͳߦྻʹ෼ղ

w ີͳϞσϧʹؚ·ΕΔ৑௕ͳॏΈΛ࡟আʢࢬמΓʣ͢Δٕज़ %//ͷϞσϧαΠζΛ௚઀తʹ࡟ݮ͢Δ͜ͱ͕Մೳ w ਺ֶతͳදݱ 1SVOJOH͸ॏΈ ʹରͯ͠όΠφϦϚεΫ Λ͔͚Δ͜ͱͱಉٛ
W M 1SVOJOH M* = argmin L(f(W ⊙ M; x), y) 1SVOJOH W = w1,1 w1,2 w1,3 w2,1 w2,2 w2,3 w3,1 w3,2 w3,3 w4,1 w4,2 w4,3 W′ = W ⊙ M = 0 w1,2 0 0 0 w2,3 w3,1 0 0 w4,1 w4,2 0 W′ W

஫໨͞Ε࢝Ίͨ%//ͷѹॖٕज़ %//ͷࢬמΓͱѹॖख๏ʹؔ͢Δ࿦จ਺<$IFOH BS9JW`>

w ਓͷ೴͸֊૚త͔ͭϦΧϨϯτͳߏ଄<'SJTUPO 1-04`> %//ͷ΋ͭؼೲతόΠΞεͱͷྨࣅੑΛ֬ೝ w ೴ਆܦ͸ͦͷਆܦͷ਺͕ଟ͍΄ͲεύʔεʹͳΔ<)FSDVMBOP)PV[FM 1/"4`> ೴͸੒௕͢Δॳظஈ֊Ͱඇৗʹଟ͘ͷਆܦ͕ࢬמΓ͞Εͯޙ൒Ͱ҆ఆ
w ׬શʹ੒௕ͨ͠ޙ΋࠷େͰຖ೔ˋͷγφϓε͕มԽ<)BXLJOT *&&&`> ‎ੜ෺ͷγφϓεΛ໛฿͢Δ%//ʹ͓͍ͯύϥϝʔλ࡟ݮΛݚڀ͢Δ͜ͱ͸ࣗવ ࢬמΓͱੜ෺ֶͱͷΞφϩδʔ

w 2࠷ॳ͔Βখ͞ͳϞσϧΛֶशͤͯ͞΄͏͕ྑ͍ͷͰ͸ʁ w "͍͍͑ ॏΈ͕ա৒ʹ͋Δঢ়ଶʢΦʔόʔύϥϝʔλʣͰͷֶश͸ΑΓྑ͍ॏΈ͕ٻ·Γ΍͍͔͢Β ܦݧతͳࠜڌ ΦʔόʔύϥϝʔλԽ͞ΕͨϞσϧ͸4(%ʹΑΔ࠷దԽ͕༰қ<(MPSPU "*45"54`>
ΦʔόʔύϥϝʔλʹΑͬͯ໨తؔ਺͸ڧ͍ತੑΛࣔ͢<#SVU[LVT *$-3`%V *$-3> ཧ࿦తͳࠜڌ ֶशμΠφϛΫεͱ൚Խੑೳ͕Φʔόʔύϥϝʔλʹґଘ<"MMFO;IV *$.-`/FZTIBCVS *$-3`> ࢬמΓʹؔ͢ΔΑ͋͘Δ࣭໰

w 6OTUSVDUVSFE1SVOJOHWT4USVDUVSFE1SVOJOH ̎छྨͷࢬמΓํ๏ W 6OTUSVDUVSFE W′ = 0
w1,2 w1,3 0 0 w2,3 w3,1 0 0 w4,1 w4,2 0 W′ ॏΈߦྻͷཁૉ୯ҐͰࢬמΓ 4USVDUVSFE W′ = 0 w1,2 w1,3 0 0 0 0 w3,2 w3,3 0 w4,2 w4,3 W′ ′ = w1,2 w1,3 w3,2 w3,3 w4,2 w4,3 W′ ॏΈߦྻͷߦ΍ྻʹԊͬͯࢬמΓ W = w1,1 w1,2 w1,3 w2,1 w2,2 w2,3 w3,1 w3,2 w3,3 w4,1 w4,2 w4,3 ܭࢉྔ ܭࢉྔ ܭࢉྔ ܭࢉྔ

w ॏΈΛ࡟আ͢Δ৔ॴʹΑͬͯޮՌ͕ҟͳΔ w 6OTUSVDUVSFE1SVOJOH ॏΈߦྻͷཁૉ୯ҐͰࢬמΓ 4USVDUVSFE1SVOJOHͱൺֱͯ͠ੑೳΛҡ࣋͠΍͍͢<:BP """*`> 👎εύʔεͳߦྻ͕ੜ੒͞ΕΔͨΊߴ଎Խ͕೉͍͠
w 4USVDUVSFE1SVOJOH ॏΈߦྻͷ࣍ݩʹԊͬͯॏΈΛࢬמΓ 👍(16ͳͲʹΑΔߴ଎Խ͕༰қ 👎6OTUSVDUVSFE1SVOJOHͱൺֱͯ͠ੑೳ͕௿͍ ॏΈΛ࡟আ͢Δ୯Ґ 4USVDUVSFE 6OTUSVDUVSFE ͷॏΈΛࢬמΓ ͷॏΈΛࢬמΓ ࢒͍ͬͯΔॏΈ ࢬמΓͨ͠ॏΈ

6OTUSVDUVSFE1SVOJOH ޯ ഑ ϕ ε Ϛ ά χ ν
υ ϕ ε 0QUJNBM#SBJO%BNBHF <-F$VO /*14`> ΁γΞϯΛ༻͍ͯ ଛࣦ͕૿Ճ͠ͳ͍ॏΈΛಛఆ 0QUJNBM#SBJO4VSHFPO <)BTTJCJ4UPSL /*14`> ͋ΔॏΈ̍ͭʹର͢ΔςΠϥʔల։ Λ༻͍ͯ0#%ΛҰൠԽ -FBSOJOHCPUI 8FJHIUTBOE$POOFDUJPOT GPS& ffi DJFOU/FVSBM/FUXPSLT <)BO "$.`> ॏΈͷେ͖͞Λج४ʹࢬמΓ $PNQSFTTJPOPG /FVSBM.BDIJOF5SBOTMBUJPO.PEFMT WJB1SVOJOH <4FF "$-`> 3//΁֦ு &YQMPSJOHTQBSTJUZJO SFDVSSFOUOFVSBMOFUXPSLT </BSBOH *$-3`> )BOΒͷख๏Λ3//ͷֶशաఔͰ ޮ཰తʹద༻͢ΔͨΊͷ εέδϡʔϦϯάख๏ΛఏҊ /FVSBM5BOHFOU5SBOTGFS <-JV;FOLF *$.-`> /5,Ͱಛ௃ֶ͚ͮͨशμΠφϛΫε Λ໛฿͢ΔαϒωοτϫʔΫΛ୳ࡧ /5,4"1 <8BOH *$-3`> /5,ͷมԽ͕ খ͍͞ॏΈΛධՁ 4/*1 <-FF *$-3`> ଛࣦؔ਺ʹର͢Δ ॏΈͷײ౓ΛධՁ (SB41 <8BOH *$-3`> ΁γΞϯΛ༻͍ͯ ॏΈಉ࢜ͷؔ܎ΛධՁ 4ZO fl PX <5BOBLB /*14`> ैདྷख๏Ͱൃੜ͢Δ -BZFS$PMMBQTF΁ରԠ *UFSBUJWF4/*1 <%F+PSHF *$-3`> ϚϧνγϣοτͰద༻ͯ͠ 4/*1ͷਫ਼౓Λվળ ֶशલʹదԠՄೳͳࢬמΓख๏ 4JOHMFTIPU1SVOJOH 'PS1SFUSBJOFE.PEFMT <)JSPLB[V *$$78`> ࣄલֶशࡁΈϞσϧʹର͢Δ ࢬמΓख๏ΛఏҊ .PWFNFOU1SVOJOH <4BOI /*14`> ֶशաఔͰ͔Βԕ͔͟Δ ॏΈΛอ࣋ %ZOBNJDOFUXPSLTVSHFSZ GPSF ffi DJFOU%//T <(VP /*14`> ࢬמΓ͞ΕͨॏΈΛ ճ෮ͤ͞ΔͨΊͷΦϓγϣϯΛ௥Ճ 5IF-PUUFSZ5JDLFU)ZQPUIFTJT <'SBOLF *$-3`> ݩωοτϫʔΫʹ͸ɼಉ౳ͷੑೳΛ ൃش͢ΔΑ͏ͳαϒωοτϫʔΫ͕ଘࡏ͢Δ 1SVOJOH%FFQ/FVSBM/FUXPSLT GSPNB4QBSTJUZ1FSTQFDUJWF <%JBP *$-3`> ܦࡁֶͷ෋ͷ෼഑๏ଇΛ༻͍ͨ ࢬמΓ཰ͷಈతܾఆ $-*12 <5VOH $713`> ࢬמΓͱྔࢠԽΛซ༻ -FBSOBCMF1SVOJOH <:BP BS9JW`> ༧Ίઃఆͨ͠ࢬמΓ཰ʹ ରԠͨ͠ਖ਼ଇԽख๏ͷఏҊ ʢ4USVDUVSFEͱͯ͠঺հࡁΈʣ

w ଛࣦؔ਺ʹର͢Δ΁γΞϯΛ༻͍ͯॏΈͷॏཁ౓ΛධՁ ୯७ͳ΁γΞϯͷಋग़͸೉͍ͨ͠Ίͦͷର֯੒෼Λۙࣅ w ॏΈશମͰςΠϥʔల։͍ͯͨ͠0#%ΛॏΈຖʹల։ͯ͠ҰൠԽ<)BTTJCJ4UPSL /*14`> 0QUJNBM#SBJO%BNBHF 0#% <-F$VO
/*14`> δE = ∑ i ∂E ∂ui δui + 1 2 ∑ i ∂2E ∂uu ∂ui δu2 i + 1 2 ∑ i≠j ∂2E ∂uu ∂ui δui δuj + O(∥δU)∥3) 0#%͸ऩଋͨ͠%//Λର৅ʹ͍ͯ͠ΔͨΊɼ ୈҰ߲Λແࢹͨࣜ͠มܗ͕Մೳ Sk = hkk u2 k /2 ධՁ͕௿͍ʢଛࣦʹ༩͑Δޡ͕ࠩখ͍͞ʣ ༏ઌͯ͠ॏΈΛ࡟আ

w ॏΈͷେ͖͞Λج४ʹࢬמΓ<)BO "$.`> ࠷΋γϯϓϧͳࢬמΓख๏ ֶशͱࢬמΓͷαΠΫϧΛෳ਺ճ܁Γฦ͢ w )BOΒͷख๏Λ3//ϕʔεͷػց຋༁λεΫ΁֦ு<4FF "$-`>
3//શମɼ·ͨ͸૚ຖͰॏΈͷେ͖͞Λൺֱͯ͠ࢬמΓ w 3//ͷֶशաఔͰ)BOΒͷख๏Λద༻͢ΔͨΊͷεέδϡʔϦϯάख๏</BSBOH *$-3`> ॏΈͷେ͖͞Λج४ͱͨ͠ࢬמΓख๏ 5SBJO $POOFDUJWJUZ 1SVOF $POOFDUJPOT 5SBJO 8FJHIUT

w Ұ࿈ͷࢬמΓεΩʔϜ಺Ͱ࡟আ͞ΕͨॏΈΛ࠶ධՁͯ͠෮׆ͤ͞Δख๏ΛఏҊ %ZOBNJDOFUXPSLTVSHFSZ<(VP /*14`> min Wk ,Mk L(Wk ⊙
Mk ) s . t . M(i,j) k = hk (W(i,j) k ) hk (W(i,j) k ) = { M(i,j) k if ak ≤ |W(i,j) k | ≤ bk 1 if bk ≤ |W(i,j) k | W(i,j) k ← W(i,j) k − β ∂L(Wk ⊙ Mk ) ∂(W(i,j)M(i,j) k k ) ఆࣜԽ w ॏΈ͸ϚεΫΛద༻ͨ͠ঢ়ଶͷޯ഑Ͱߋ৽ ϚεΫ͸࠷ॳ̍ͰॳظԽ w ࡟আ͞Ε͍ͯΔॏΈͷେ͖͕͞ݱଘ͍ͯ͠ΔॏΈͷ େ͖͞Λ্ճͬͨΒ෮׆

w ॏΈͷେ͖͞ϕʔεͷࢬמΓͱεΧϥʔྔࢠԽΛ૊Έ߹Θͤͨख๏ $MJQQJOHɿखಈͰܾఆͨ͠ࢬמΓ཰ʹج͍ͮͨൣғʢ্ਤͰ͸ ʣͰΫϦοϓ 1BSUJUJPOJOHɿΫϦοϓͨ͠ൣғΛ࡟আ 2VBOUJ[JOHɿ࢒ͬͨॏΈΛ೚ҙͷ਺Ͱ෼ׂͯ͠ྔࢠԽ [−0.25,0.25]
$-*12<5VOH $713`> ˞7-෼໺ͷ$-*1ͱ͸ؔ܎͋Γ·ͤΜɽ

w ͋ΔॏΈʹର͢Δଛࣦؔ਺ͷײ౓ΛධՁ<-FF *$-3`> ϚϧνγϣοτͰద༻͢Δ*UFSBUJWF4/*1΋ఏҊ͞Ε͍ͯΔ<%F+PSHF *$-3`> w ΁γΞϯΛ༻͍ͯॏΈಉ࢜ͷؔ܎ੑΛߟྀ<8BOH *$-3`> w
্هͷख๏Ͱൃੜ͢Δ૚಺ͷશͯͷॏΈ͕࡟আ͞ΕΔ໰୊ʹରॲ<5BOBLB /*14`> ֶशΛඞཁͱ͠ͳ͍ࢬמΓख๏ SSNIP (mj) = | ∂L ∂θj 0 ⋅ θj 0 | SGraSP (mj) = − [H(θ0 ⊙ m; D) ∂L ∂θ0 ]j ⋅ θj 0 SSyn fl ow (mj) = | ∂∑ k f(1; |θ0 ⊙ m)k ∂|θj 0 | ⋅ |θj 0 ||

w /FVSBM5BOHFOU,FSOFM /5, ͷ৚݅਺͸ॏΈ΍ߏ଄ͷධՁʹ༗༻ ৚݅਺͕খ͍͞ʹऩଋ͠΍͍͢ʹߴਫ਼౓ /"4ͷ෼໺Ͱͦͷ༗༻ੑ͸ධՁ͞Ε͍ͯΔ<$IFO *$.-`8BOH $713`>
w චऀɿ৚݅਺ͷΈΛߟྀ͢ΔΑΓ΋/5,ͷݻ༗εϖΫτϧશମΛ੍ޚͨ͠΄͏͕ྑ͍ ‎ ࢬמΓͷલޙͰݻ༗εϖΫτϧ͕มԽ͠ͳ͍Α͏ͳධՁج४ΛఏҊ w /5,Ͱಛ௃͚ͮΔֶशμΠφϛΫεΛ໛฿͢ΔαϒωοτϫʔΫΛൃݟ<-JV;FOLF *$.-`> /5,4"1<8BOH $713`> SNTK−SAP (mj) = | ∂EΔθ 𝒩 (0,ϵI) [∥f(XD ; θ0 ⊙ m) − f(XD ; (θ0 + Δθ) ⊙ m)∥] ∂mj |

w े෼ʹࣄલֶश͞ΕͨϞσϧ͸ɼԼྲྀλεΫʹର͢Δ࠶ֶशͷલޙͰ΄΅มԽ͠ͳ͍ ࣄલֶशͷن໛ʹൺྫͯ͠ॏΈ͕มԽͮ͠Β͍͜ͱΛ༧උ࣮ݧʹΑΓ؍࡯ w ࣄલֶशͰ֫ಘͨ͠஌ࣝͱԼྲྀλεΫͰ֫ಘͨ͠஌ࣝͷ྆ํΛߟྀ͢ΔධՁࣜΛఏҊ 4JOHMFTIPU1SVOJOH'PS1SFUSBJOFE.PEFMT<)JSPLB[V *$$78`> S(mj)
= | ∂L ∂θj 0 ⋅ θj 0 | + αθ2 0 ᶃԼྲྀλεΫͰมԽ͠΍͍͢ॏΈΛධՁ ᶄࣄલֶशͰ֫ಘͨ͠ॏΈΛධՁ ᶃ ᶄ

w ܦࡁֶʹ͓͚Δ̒ͭͷ෋ͷ෼഑ʹؔ͢ΔಛੑΛ֤૚ͷࢬמΓ཰ͷ෼഑ʹԠ༻ શͯͷಛੑΛຬͨ͢ධՁࢦඪ12*OEFY 12* ΛఏҊ ࢬמΓ͢Δ୯Ґ͕খ͍͞΄Ͳߴ͍ޮՌ 12*OEFY<%JBP *$-3`>
w ෋ͷ෼഑ʹؔ͢Δ̒ͭͷಛੑ 3PCJO)PPEɿ๛͔ͳਓ͔Βශ͍͠ਓ΁෋Λ෼഑͢Δͱ෋ͷภΓ͸খ͘͞ͳΔ 4DBMJOHɿશମͷ෋Λ 𝛼 ഒͯ͠΋෋ͷภΓ͸มΘΒͳ͍ 3JTJOH5JEFɿશһʹఆֹͷ෋Λ෼഑͢Δͱ෋ͷภΓ͸খ͘͞ͳΔ $MPOJOJHɿಉ͡෋ͷภΓͷ··ͦͷن໛͕େ͖͘ͳͬͯ΋෋ͷภΓ͸มΘΒͳ͍ #JMM(BUFTɿԯສ௕ऀ͕͍Δͱ෋ͷภΓ͸ΑΓେ͖͘ͳΔ #BCJFTɿ෋ͷͳ͍ਓ͕૿͑Δͱ෋ͷภΓ͸େ͖͘ͳΔ

w ैདྷݚڀͰ͸ֶशࡁΈϞσϧͷѹॖΛ໨తʹߦΘΕ͖ͯͨ lখن໛ͳ%//Λ௚઀ֶश͢Δ͜ͱ͸೉͍͠zͱ͍͏͜ͱ͕ܦݧతɾཧ࿦తʹ஌ΒΕ͍͔ͯͨΒ w %//͕ա৒ύϥϝʔλͰऩଋ͠΍͍͢ಛੑͷղ໌ʹେ͖͘ߩݙ͢Δ஌ݟ 5IF-PUUFSZ5JDLFU)ZQPUIFTJT<'SBOLMF *$-3`> ϥϯμϜʹॳظԽ͞ΕͨີͳωοτϫʔΫʹ͸ɼ
ಉ౳ͷੑೳΛൃش͢ΔΑ͏ͳαϒωοτϫʔΫʢ౰ͨΓ͘͡ʣ͕ଘࡏ͢Δ ϥϯμϜʹॳظԽθ0 গֶ͠शθt ॏΈͷେ͖͞Λ ج४ʹࢬמΓ ߏ଄Λอ࣋ͭͭ͠ Ͱ࠶ॳظԽ θ0 ্ਤͷαΠΫϧΛ܁Γฦ͢͜ͱͰ౰ͨΓ͘͡Λൃݟ

-PUUFSZ5JDLFU)ZQPUIFTJT -5) ʹؔ͢Δݚڀ 5IF-PUUFSZ5JDLFU)ZQPUIFTJT <'SBOLF *$-3`> 0OFUJDLFUUPXJOUIFNBMM <.PSDPT /FVS*14`>
1JDLJOH8JOOJOH5JDLFUT <8BOH *$-3`> 3JHHJOHUIF-PUUFSZ .BLJOH"MM5JDLFUT8JOOFS <&WDJ *$.-`> 8IBUT)JEEFOJO B3BOEPNMZ8FJHIUFE/FVSBM/FUXPSL <3BNBOVKBO $713`> ଞͷσʔληοτͰ ౰ͨΓ͘͡Λ࠶ར༻ ֶशલʹ౰ͨΓ͘͡Λൃݟ શͯͷ͘͡ʢॏΈʣΛ ౰ͨΓ͘͡ʹ ݁߹ํ๏Λ୳ࡧ ೿ ੜ ख ๏ -5)ͷ༗ޮੑΛݕূ ߏ଄୳ࡧͱͯ͠ͷ-5) 3FUIJOLJOH5IF7BMVF0G/FUXPSL <-JV *$-3`> ݟ͔ͭͬͨߏ଄͕ॏཁ 8FJHIU"HOPTUJD/FVSBM/FUXPSL <(BJFS /*14`> ॳظ஋ͱߏ଄ͲͪΒ͕େࣄ͔ $PNQBSJOH3FXJOEJOHBOE'JOFUVOJOH JO/FVSBM/FUXPSL1SVOJOH <3BOEB *$-3`> ॏΈͷר͖໭͠WT'JOFUVOJOH %FDPOTUSVDUJOH-PUUFSZ5JDLFUT <;IPV /*14`> ౰ͨΓ͘͡Ͱੑೳ͕ग़Δཧ༝

w ൃݟͨ͠౰ͨΓ͘͡͸σʔληοτΛม͑ͯ΋౰ͨΓ͘͡ͷ··Ͱ͋Δ 0OFUJDLFUUPXJOUIFNBMM<.PSDPT /*14`> ΑΓଟ͘ͷαϯϓϧ਺ɼΫϥε਺ΛؚΉσʔληοτ͔Βൃݟͨ͠౰ͨΓ͘͡͸ ଞͷσʔληοτʹྲྀ༻ͯ͠΋ਫ਼౓͕མͪͮΒ͍͜ͱΛൃݟ

w ౰ͨΓ͘͡ʹͳΔ·ͰநબΛ܁Γฦ͢<&WDJ *$.-`> w ີͳωοτϫʔΫʹ͸ֶशෆཁͳ౰ͨΓ͕͘͡ଘࡏ<3BNBOVKBO $713`> ॏΈΛߋ৽ͤͣɼ઀ଓͷ༗ແͷΈΛ࠷దԽ ॳظ஋ͷ୳ࡧʹؔ͢Δ೿ੜख๏
εύʔεͳ%//Λ༻ҙʢϥϯμϜʹεύʔεԽʣ Ұఆ਺ֶश ॏΈͷେ͖͞ʹैͬͯࢬמΓ ޯ഑ͷେ͖͞Λج४ʹࢬמΓ͞Ε͍ͯΔॏΈΛ෮׆

w ౰ͨΓ͘͡ͷॴ༗ݖΛओு<$IFO /*14`> ౰ͨΓ͘͡͸ൃݟऀͷॏཁͳࢿݯ ➡︎ ౰ͨΓ͘͡ͷॴ༗ݖͷอޢ͕ඞཁ ౰ͨΓ͘͡ʹରͯ͠23ίʔυΛຒΊࠐΉख๏ΛఏҊ w
"&Tʹؤ݈ͳ౰ͨΓ͕͘͡ଘࡏ<'V /*14`> ൃݟͨ͠౰ͨΓ͘͡͸ఢରతֶशΛߦΘͳͯ͘΋"&Tʹରͯ͠ؤ݈ -5)ʹجͮ͘ϢχʔΫͳݚڀ

w ඇৗʹଟ͘ͷ࣮ݧʹج͍ͮͯɼૉૣ͘౰ͨΓ͘͡Λݟ͚ͭΔͨΊͷࢦ਑Λௐࠪ ஶऀΒͷओு ࠷దʹֶशͨ͠ݩωοτϫʔΫͷਫ਼౓͸αϒωοτϫʔΫͷਫ਼౓ΛԼճΒͳ͍ w ౰ͨΓ͘͡Λૉૣ͘ݟ͚ͭΔͨΊͷࢦ਑ * ࢒ࠩ઀ଓ খن໛σʔληοτͷ৔߹͸*.1
Λ࠾༻ͨ͠΄͏͕ྑ͍ ** ࢒ࠩ઀ଓ͕͋Δ৔߹͸খ͞ͳֶश཰Λ࠾༻ͨ͠΄͏͕ྑ͍ *** ωοτϫʔΫ͕े෼ʹେ͖͍৔߹ͷ΄͏͕౰ͨΓ͘͡͸ݟ͚ͭ΍͍͢ খن໛σʔληοτ େن໛ωοτϫʔΫͳͲ *7 ౰ͨΓ͕͘͡େ͖ͳֶश཰Ͱऩଋ͢Δ৔߹͸ɼॳظ஋ʹґଘ͍ͯ͠ͳ͍Մೳੑ͕͋ΔͷͰ஫ҙ -5)ʹؔ͢Δద੾ͳֶशઃఆΛௐࠪ<.B /*14`> *.1ࡉ͔ͳࢬמΓ཰Ͱෳ਺ճࢬמΓ͢Δํ๏

$//4USVDUVSFE1SVOJOHɹ /FUXPSL4MJNNJOH <-JV *$$7`> εέʔϦϯάϑΝΫλͷ ಋೖͱਖ਼ଇԽ 3FUIJOLJOHUIF4NBMMF/PSN -FTT*OGPSNBUJWF"TTVNQUJPO <:F
*$-3`> (BUF%FDPSBUPS <:PV /*14`> 1SVOJOH'JMUFST GPS& ffi DJFOU$POW/FUT <-J *$-3`> ॏΈͷେ͖͞Λج४ ਖ਼ଇԽ߲ʹܭࢉྔͷج४Λಋೖ (SPVQXJTF#SBJO%BNBHF <-FCFEFW-FNQJUTLZ $713`> -FTT*T.PSF <;IPV &$$7`> -FBSOJOH4USVDUVSFE4QBSTJUZ JO%FFQ-FBSOJOH <8FO /*14`> ༷ʑͳ୯ҐͰਖ਼ଇԽΛద༻ 4USVDUVSFE1SVOJOH <"OXBS "$.`> খ͞ͳॏΈ͕ूத͍ͯ͠ΔՕॴΛ ·ͱΊͯ࡟আ (SFFEZDPNQSFTTJPO <"CCBTJ"TM:V BS9JW`> /FU"EBQU <:BOH &$$7`> ࣮ߦ࣌ؒΛج४ʹࢬמΓ 'JMUFS1SVOJOH WJB(FPNFUSJD.FEJBO <)F $713`> Χʔωϧ಺ͷॏΈͷେ͖͞ͱ ͹Β͖ͭͷେ͖͞Λߟྀ *NQPSUBODF&TUJNBUJPO <.PMDIBOPW $713`> ΧʔωϧΛ࡟আͨ͠ࡍͷ ଛࣦͷมԽྔͷೋ৐Λॏཁ౓ͱఆٛ (SPVQ'JTIFS1SVOJOH <-JV *$.-`> 'JTIFSJOGPSNBUJPOΛ ༻͍ͨॏΈͷධՁ 3FT3FQ <%JOH *$$7`> ৑௕ͳॏΈʹͷΈ ਖ਼ଇԽΛద༻ ςΠϥʔల։ϕʔεͷ εέʔϦϯάϑΝΫλͷධՁ %FQ(SBQI <'BOH $713`> %//ͷ֤૚ͷґଘؔ܎Λ άϥϑͱͯ͠දݱ $1SVOF <,JN &$$7`> %//ίϯύΠϥΛ༻͍ͨ ࣮ߦ଎౓ϕʔεͷࢬמΓ "VUP$PNQSFTT <-JV """*`> ҟͳΔࢬמΓεΩʔϜͷબ୒ɼධՁɼ ࢬמΓͱ͍͏αΠΫϧΛࣗಈԽ $FOUSJQFUBM4(% <%JOH $713`> ΫϥελΛ༻͍ͨΧʔωϧ౷߹ $IBOOFM1SVOJOH <)F *$$7`> 5IJ/FU <-VP *$$7`> ѹॖޙͷಛ௃ྔͷ มԽΛ࠷খԽ ϨΠϠʔ୯ҐͰࢬמΓ %JTDSJNJOBUJPOBXBSF $IBOOFM1SVOJOH <;IVBOH /*14`> ૚ຖʹࣝผثΛಋೖ /*41 <:V $713`> ਖ਼ ଇ Խ ϕ ε ॏ Έ ͷ ධ Ձ ج ४ ͦ ͷ ଞ

w -BTTPਖ਼ଇԽ طଘͷଛࣦؔ਺ʹରͯ͠ॏΈͷେ͖͞ΛՃࢉ w Χʔωϧͷܗঢ়Λѹॖ<-FCFEFW-FNQJUTLZ $713`> w $//ͷχϡʔϩϯʹରͯ͠ਖ਼ଇԽΛద༻ͯ͠ϞσϧαΠζΛѹॖ<;IPV-FNQJUTLZ &$$7`>
w ΧʔωϧɼΧʔωϧͷܗঢ়ɼνϟϯωϧɼ૚ͷਂ͞ʹରͯ͠ਖ਼ଇԽΛద༻<8FO /*14`> w هԱΛ࢘Δ෦෼ͷॏΈҎ֎ʹͷΈʹਖ਼ଇԽΛద༻<%JOH *$$7`> ਖ਼ଇԽϕʔεͷΞϓϩʔν L(f(W; x), y) + λ∥W∥1 ଛࣦؔ਺ ਖ਼ଇԽ߲ w1 w2 w ଛࣦؔ਺ͷପԁͷ౳ߴઢʹରͯ͠ਖ਼ଇԽ߲͸௚ઢ w ࠷దԽͷաఔͰࣗવʹॏΈ͕෇ۙʹऩଋ

w νϟϯωϧ୯ҐͰεέʔϦϯάϑΝΫλ Λಋೖ<-JV *$$7`> εέʔϦϯάϑΝΫλʔ ʹ-BTTPਖ਼ଇԽΛద༻ֶͯ͠श w ਖ਼ଇԽ߲ʹܭࢉྔʹؔ͢Δج४Λಋೖͯ͠εέʔϦϯάϑΝΫλΛਖ਼ଇԽ<:F *$-3`>
w ςΠϥʔల։ϕʔεͷεέʔϦϯάϑΝΫλͷධՁํ๏ΛఏҊ<:PV /*14`> γ γ εέʔϦϯάϑΝΫλΛ༻͍ͨΞϓϩʔν

w ΧʔωϧͷॏΈͷઈର஋ͷ૯࿨͕খ͍͞ΧʔωϧΛࢬמΓ<-J *$-3`> w ΧʔωϧΛ࡟আͨ͠ࡍͷਫ਼౓ͷ௿ԼΛᩦཉʹࢉग़<"CCBTJ"TM:V BS9JW`> w ཻ౓ͷখ͍͞෦෼ʢখ͞ͳॏΈ͕ू·͍ͬͯΔ෦෼ʣΛ·ͱΊͯࢬמΓ<"OXBS "$.`> w
ॏΈͷେ͖͞ͱΧʔωϧ಺ͷॏΈͷ͹Β͖ͭΛಉ࣌ʹߟྀ<)F $713`> w Χʔωϧ಺Λ࡟আͨ͠ࡍͷଛࣦͷมԽྔͷೋ৐Λॏཁ౓ͱͯ͠ར༻<.PMDIBOPW $713`> Χʔωϧͷॏཁ౓Λج४ʹͨ͠Ξϓϩʔν

w Ϧιʔεͷফඅྔʢ࣮ߦ࣌ؒʣΛج४ͱͯ͠૚ຖʹ࣍ݩ਺ΛࢬמΓ<:BOH &$$7`> w 'JTIFSJOGPSNBUJPOʹΑΔॏཁ౓ͷධՁ<-JV *$.-`> ςΠϥʔల։Λ༻͍ͯಋग़ͨ͠ೋ࣍ಋؔ਺Λ'JTIFSJOGPSNBUJPO Ͱۙࣅ Hi,i
Χʔωϧͷॏཁ౓Λج४ʹͨ͠Ξϓϩʔν Hi,i = ∂2L ∂mw i ≈ 1 N N ∑ n=1 ( ∂Ln ∂mi )2

w ૚ͷલޙͷग़ྗͷมԽ͕࠷খʹͳΔΑ͏ʹѹॖ w ૚ͷલޙͰಛ௃ྔͷมԽ͕࠷খʹͳΔΑ͏ͳॏΈΛ࠶ߏ੒<)F *$$7`> w ᩦཉ๏Ͱޡ͕ࠩখ͘͞ͳΔΑ͏ͳ૚Λಛఆͯ͠࡟আ<-VP *$$7`> w ग़ྗ૚ͷ࠶ߏ੒ޡࠩΛ࠷దԽ֤ͯ͠ϑΟϧλͷॏཁ౓Λٯ఻೻<:V
$713`> w ࠶ߏ੒ޡࠩͱ૚ຖͷ௥Ճࣝผثͷ෼ྨޡࠩΛ૊Έ߹Θͤͨ࠷খԽ<;IVBOH /*14`> ೖग़ྗͷޡࠩΛ࠷খʹ͢ΔΞϓϩʔν

w ҟͳΔࢬמΓεΩʔϜͷબ୒ɼධՁɼࢬמΓͱ͍͏αΠΫϧΛࣗಈԽ͢Δख๏ΛఏҊ "VUP$PNQSFTT<-JV """*`> w 4UFQϋΠύϥΛϥϯμϜʹબ୒ w 4UFQώϡʔϦεςΟοΫͰ؆୯ʹධՁ
ϋΠύϥͷେ·͔ͳ஋Λਪఆ w 4UFQϋΠύϥΛܾఆ w 4UFQ4USVDUVSFE1SVOJOHͷίΞΞϧΰϦζϜͰࢬמΓ w ֶश࣌͸3JEHFਖ਼ଇԽϕʔεͷ"%..ਖ਼ଇԽΛద༻ ਖ਼ଇԽ໨ඪΛಈతʹબ୒ֶͯ͠श

w ෼෍͕͍ۙΧʔωϧͰΫϥελΛ࡞੒ͯ͠෼෍͕ࣅΔΑ͏ʹֶश<%JOH $713`> ΠϯσοΫεج४ɼ·ͨ͸L//Λ༻͍ͯΫϥελΛܗ੒ ܗ੒͢ΔΫϥελ਺͸໨ඪͱ͢ΔΧʔωϧ਺ʹରԠ w ࠷దԽख๏Λ޻෉͢ΔΞϓϩʔν
w ӈਤʣΫϥελ"#ؒͷॏΈΛ͚ۙͮΔ৔߹ Ϋϥελ಺ͷଞॏΈͱͷத఺Λࢉग़ ॏΈݮਰ࣌ͷޯ഑ͱ"#ؒͷޯ഑ΛϚʔδ Q3 = ⃗ AM Q4 = ⃗ Q2 Q4

w %//ίϯύΠϥͰߴ଎ʹॲཧՄೳͳαϒάϥϑߏ଄Λ୳ࡧ %//ίϯύΠϥɿλʔήοτσόΠεʹରͯ͠࠷దԽίʔυΛੜ੒͢ΔίϯύΠϥ $1SVOF$PNQJMFS*OGPSNFE.PEFM1SVOJOH<,JN &$$7`> ࢬמΓޙʹ࠷΋ߴ଎Ͱ͋ͬͯ΋ ίϯύΠϧޙʹߴ଎Ͱ͋Δͱ͸ݶΒͳ͍ ᶃ%//Λαϒάϥϑʹ෼ׂͯ͠ᶄίϯύΠϧɽ
֤αϒάϥϑͷ଎౓Λܭଌͯ͠ߴ଎ͳαϒάϥϑΛ࢒͢ɽ

w ૚ؒͷґଘؔ܎Λ໌ࣔతʹϞσϧԽ͢Δ%FQFOEFODZ(SBQI %FQ(SBQI ΛఏҊ ୯७ͳϚάχνϡʔυϕʔεͷج४Λ༻͍ͯҰ؏ͨ͠ੑೳΛൃش %FQ(SBQI<'BOH $713`> w
্ਤʣ̎࣍ݩॏΈߦྻ ͰύϥϝʔλԽͨ̏͠૚ͷ.-1ͷ৔߹ ͱ ͱͷؒͷґଘؔ܎Λ ͱදه ൪໨ͷχϡʔϩϯΛࢬמΓͨ͠৔߹͸ ͱ Λ࡟আ ͜ΕΒͷґଘؔ܎ΛάϥϑԽͯ͠࠷దԽ wl , wl+1 , wl+2 wl wl+1 wl ⇔ wl+1 k wl [k, :] wl+1 [: , k]

5SBOTGPSNFS4USVDUVSFE1SVOJOH ϔ υ ૚ ਺ ɾ ࣍ ݩ τ
Ϋ ϯ 1P8&3#&35 <(PZBM *$.-`> ৑௕ͳτʔΫϯΛ࡟আ ʢॏΈͷ਺͸ͦͷ··ʣ *"3&% <1BO /*14`> 2 7J5ͷ৑௕ͳύονΛਪ࿦தʹ࡟আ 1BUDI4MJNNJOH GPS& ff i DJFOU7JTJPO5SBOTGPSNFST <5BOH $713`> ਂ͍૚Ͱύονؒͷྨࣅ౓͕ ߴ͘ͳ͍ͬͯΔ͜ͱΛ؍࡯ -ਖ਼ଇԽΛ༻͍ͯϔουΛ࡟আ "OBMZ[JOH .VMUJ)FBE4FMG"UUFOUJPO <7PJUBM "$-`> "SF4JYUFFO)FBET 3FBMMZ#FUUFSUIBO0OF <.JDIFM /*14`> ϔουຖͷޯ഑ͷେ͖͞Λ ج४ʹࢬמΓ 3FEVDJOH5SBOTGPSNFS%FQUI PO%FNBOEXJUI4USVDUVSFE%SPQPVU <'BO *$-3`> ૚୯ҐͰ%SPQPVUΛద༻ $IBTJOHTQBSTJUZ JOWJTJPOUSBOTGPSNFST <$IFO /*14`> ϔουͷग़ྗಛ௃Λ ςΠϥʔల։ΛԠ༻ͯ͠ධՁ 8%1SVOJOH <:V """*`> ૚ͷਂ͞ͱ෯Λಉ࣌ʹ࡟ݮ %ZOBCFSU <)PV /*14`> ࢬמΓͱৠཹΛ૊Έ߹Θͤͯ ૚ͱ෯Λѹॖ 304*5" <-JV """*`> ࢬמΓʴ௿ϥϯΫҼ਺෼ղʴ ஌ࣝৠཹͷซ༻ ҟͳΔѹॖख๏Λซ༻ 6OJ fi FEWJTVBMUSBOTGPSNFS DPNQSFTTJPO <:V *$-3`> ࢬמΓɼϒϩοΫεΩοϓɼ ஌ࣝৠཹΛ૊Έ߹Θͤͨ67$ΛఏҊ 91SVOFS <:V *$$7`> 7J5ͷઆ໌ੑΛߟྀͨ͠ࢬמΓ 7JTJPO5SBOTGPSNFS1SVOJOH <;IV ,%%`> ֤૚ͷલޙͰτʔΫϯͷ ࣍ݩ਺Λѹॖ͢ΔͨΊͷର֯ߦྻΛಋೖ -FBSOBCMF1SVOJOH <:BP BS9JW`> ༧Ίઃఆͨ͠ࢬמΓ཰ͱ ରԠͨ͠ਖ਼ଇԽख๏ͷఏҊ 4USVDUVSFE1SVOJOHPG -BSHF-BOHVBHF.PEFMT <8BOH "$-`> ର֯ߦྻ͸)BSE$PODSFUF෼෍ ͔ΒαϯϓϦϯά #MPDLTQBSTF </BSBOH BS9JW`> ௿ϥϯΫҼ਺෼ղΛ༻͍ͨ ॏΈߦྻͷѹॖ 3// 'JOFUVOFEUSBOTGPSNFSTTIPX DMVTUFSTPGTJNJMBSSFQSFTFOUBUJPOT BDSPTTMBZFST <1IBOH BS9JW`> ޙ൒ͷ5SBOTGPSNFSϒϩοΫ͸༧ଌʹରͯ͠ ΄΅ӨڹΛ͠ͳ͍ͷͰ࡟আՄೳ

w ϔου୯ҐͷࢬמΓ .VMUJ)FBE"UUFOUJPO .)" ͷϔου਺ Λ࡟ݮ $PODBUͨ͠ࡍͷ࣍ݩ਺͕ݮগ w
࣍ݩ୯ҐͷࢬמΓ -JOFBSʹؚ·ΕΔॏΈߦྻΛߦ୯ҐͰࢬמΓ .)"ͷ2ɼ,ɼ7ʹରͯ͠΋ద༻Մೳ w ૚୯ҐͷࢬמΓ ૚਺ Λ࡟ݮ h N 5SBOTGPSNFS΁ͷࢬמΓ

w ֤ϔουʹϚεΫύϥϝʔλΛ෇༩͠-ਖ਼ଇԽΛద༻ͯ͠ϔουΛ࡟আ<7PJUB "$-`> ·ͨ͸ͷϚεΫΛੜ੒͢ΔͨΊʹ)BSE$PODSFUF෼෍<-PVJ[PTʴɼ*$-3>Λಋೖ w ΄ͱΜͲͷ૚͸ϔουΛ̍ͭʹ࡟আͯ͠΋໰୊ͳ͍<.JDIFM /*14`> ֤ΞςϯγϣϯϔουʹϚεΫύϥϝʔλΛ෇༩͠ɼͦͷޯ഑ͷେ͖͞Λج४ʹϔουΛ࡟আ
w ଛࣦؔ਺ʹର͢Δ֤ϔουͷग़ྗಛ௃ྔͷײ౓ΛධՁ<$IFO /*14`> Ξςϯγϣϯϔουͷ༗ޮੑʹؔ͢Δݚڀ

w 3//ʹରͯ͠௿ϥϯΫҼ਺෼ղΛద༻</BSBOH BS9JW`> ର֯੒෼ ͷখ͍͞ߦΛࢬמΓ w )BSE$PODSFUF෼෍<-PVJ[PTʴɼ*$-3`>͔ΒαϯϓϦϯάͨ͠ Λ࢖༻<8BOH "$-`>
ߦྻͷߦ୯ҐͰࢬמΓՄೳ w ύοντʔΫϯରֶͯ͠शՄೳͳର֯ߦྻΛ௥Ճ֤ͯ࣍͠ݩͷॏཁ౓ΛධՁ<;IV ,%%`> ର֯੒෼ͷେ͖͕͞खಈͰઃఆͨ͠ᮢ஋ΛԼճΔ৔߹ɼର৅ͷ࣍ݩΛ࡟আ z z ௿ϥϯΫҼ਺෼ղΛ༻͍ͨॏΈߦྻͷѹॖ W = PQG = r ∑ k=1 zk × (pk × qk ) ͔Β੒Δର֯ߦྻ z1 , . . . , zd

w ૚ຖͷखಈʹΑΔᮢ஋ͷઃఆ͕ෆཁͳਖ਼ଇԽख๏ΛఏҊ ਖ਼ଇԽ߲ͷ܎਺΋ࣗಈతʹબ୒ ൣғͷࢦఆ͸ඞཁ 4USVDUVSFE 6OTUSVDUVSFE໰Θͣซ༻͢Δ͜ͱ͕Մೳ -FBSOBCMF1SVOJOH<:BP
BS9JW`> K(σi ) := 100 ⋅ k(σi ), ࢬמΓ཰ ֶशՄೳͳύϥϝʔλ k(σi ) = Sigmoid(σi /T), for i = 1,...,n Թ౓ύϥϝʔλʢϋΠύϥʣ ॏΈͷ਺ ֶशՄೳͳύϥϝʔλΛ༻͍ͯ ݱࡏͷࢬמΓ཰Λදݱ R(σ) = Nremain (σ)/Ntotal ࢒͍ͬͯΔॏΈͷ਺ɿk(σi ) × Ntotal Lreg (σ) = { (R(σ) − Rtarget )2 R(σ) ≥ Rtarget 0 else . ਖ਼ଇԽ߲ ਖ਼ଇԽ߲ͷ܎਺ λreg = λmax { Lreg (1 − Rtarget )2 , λmin }

w 7J5ͷઆ໌ՄೳੑΛߟྀͨ͠ࢬמΓख๏Ͱ͋Δ91SVOFSΛఏҊ ߴ͍આ໌ੑͱਫ਼౓Λҡ࣋͢Δ͜ͱ͕Մೳ ઃఆͨ͠ࢬמΓ཰ʹԠ֤ͯ͡૚ͷࢬמΓ཰Λಈతʹܾఆ ॏΈߦྻΛߦ୯ҐͰࢬמΓ 91SVOFS<:V $713`>
Lsmooth (M) = L ∑ l=1 C ∑ c=1 |∇2Ml :,c | 1 Ϋϥε͕ಉ͡Ͱ͋Δ৔߹ɼ ϚεΫ ͸Ώͬ͘ΓͱมԽͯ͠΄͍͠ M ฏ׈ੑΛ੍໿͢Δਖ਼ଇԽ߲ Lsparse (M) = L ∑ l=1 C ∑ c=1 |Ml :,c | 2 ର৅Ϣχοτͷ৑௕ੑΛղܾ͍ͨ͠ εύʔεੑΛ੍໿͢Δਖ਼ଇԽ߲

w ࢬמΓͱϒϩοΫεΩοϓɼ஌ࣝৠཹΛซ༻͢Δ67$ΛఏҊ<:V *$-3`> ਂ͍5SBOTGPSNFS͸ϒϩοΫؒͰߴ͍ྨࣅੑΛ࣋ͭͱ͍͏ಛੑΛߟྀͨ͠ϒϩοΫεΩοϓͷಋೖ w ࢬמΓͱ஌ࣝৠཹͱ௿ϥϯΫҼ਺෼ղΛ૊Έ߹Θͤͨѹॖख๏ͷఏҊ<-JV """*`> w ࢬמΓͱ஌ࣝৠཹΛ૊Έ߹Θͤͨ࣍ݩ਺ɾ૚਺ͷѹॖख๏ΛఏҊ<)PV
/*14`> ҟͳΔѹॖख๏Λซ༻

w 7JTJPO5SBOTGPSNFSͷ෯ͱਂ͞Λಉ࣌ʹѹॖ͢Δख๏ΛఏҊ ૚ຖͷࢬמΓᮢ஋΋ࣗಈͰܾఆʢ૯ࢬמΓ཰͸ϋΠύϥʣ w ਂ͍5SBOTGPSNFSϞσϧͷޙ൒ϒϩοΫ͸༧ଌʹ΄΅د༩͠ͳ͍<1IBOH BS9JW`> 8%1SVOJOH8JEUI%FQUI1SVOJOH<:V """*`>
MHA(x) = Wproj H ∑ h=1 Mh Attn(x) ∂L ∂Sh = ∂L ∂MHA Attnh (x) ϚϧνϔουΞςϯγϣϯͷ ϔουຖʹϚεΫΛద༻ ֤ϔουͷείΞΛߋ৽ ϔου ͷධՁ ɿධՁ஋͸ԼͷࣜͰߋ৽ h Sh ਂ͞ํ޲΁ͷѹॖɿ૚ຖʹ෼ྨثΛ௥Ճͯ͠ҰׅͰֶश

w $//ʹ͓͚ΔΧʔωϧࢬמΓΛ5SBOTGPSNFSʹ֦ு<5BOH $713`> w τʔΫϯͷධՁ஋ͱͯ͠Ξςϯγϣϯ΢ΣΠτͷ૯࿨Λར༻<(PZBM *$.-`> w 7J5ʹϚϧνϔουΠϯλϓϦλΛ௥Ճͯ͠ύοντʔΫϯͷॏཁ౓ΛධՁ<1BO /*14`> ৑௕ͳτʔΫϯΛ࡟আ͢Δ͜ͱͰߴ଎Խ
7J5#BTFʹ͓͚Δύονؒͷฏۉྨࣅ౓ʢίαΠϯྨࣅ౓ʣ ૚ΛܦΔ͝ͱʹ ύονؒͷྨࣅ౓͸ߴ͘ͳ͍ͬͯΔ ྨࣅ͍ͯ͠Δύον͸͍Βͳ͍

w 1SVOJOH͸%//ͷѹॖख๏ͷ̍ͭ w ॏΈͷධՁํ๏ͷ܏޲ ॳظɿਖ਼ଇԽͱॏΈͷେ͖͞ʹج͍ͮͨॏΈͷධՁ ޙظɿ/5,ΛؚΉ%//ͷֶशμΠφϛΫεͷղੳʹج͍ͮͨॏΈͷධՁ w ݚڀಈ޲
(16Λ࢖༻ֶͨ͠श͕ྲྀߦ͍ͯ͠ΔͨΊ4USVDUVSFE1SVOJOH͕ਓؾ (16͸%άϥϑΟΫεॲཧʹಛԽ͓ͯ͠Γɼߦྻͷฒྻԋࢉ͕ಘҙ 6OTUSVDUVSFE1SVOJOHʹରԠͨ͠ઐ༻νοϓ͕։ൃ͞ΕͨΒٯస͢ΔՄೳੑ ·ͱΊ

Network Pruning：枝刈り手法のサーベイ

Network Pruning：枝刈り手法のサーベイ

More Decks by Hirokazu Kohama

Other Decks in Research

Featured

Transcript