DeepLearningBook 9.3-9.4

9.3 Pooling
9.4 Convolution and Pooling as an Infinitely Strong Prior

Transcript

1. Deep Learning Book 9.3-9.4 mtjuney
2. • ը૾ೝࣝʹ͓͍ͯ
 ը૾ͷେ͖͞΍޲͖͕มΘͬͨͱ͖Ͱ΋ಉ͡ग़ྗ͕ग़ͯཉ͍͠ • ࣮ࡍ͸มΘͬͯ͠·͏ • ͦ͜ͰPooling 9.3 Pooling Apple
3. • Pooling • ग़ྗΛԿΒ͔ͷ౷ܭྔͰஔ͖׵͑Δ • ౷ܭྔ: ࠷େ஋ɺฏۉ஋ɺL2ϊϧϜ etc 9.3 Pooling { { { ࠷େ஋ ࠷େ஋ ࠷େ஋ ྫ: ࠷େPooling
4. 9.3 Pooling • ೖྗͷখ͞ͳҠಈʹରͯ͠ෆมʹͳΔ • খ͞ͳεέʔϦϯάɺճసɺҠಈʹରͯ͠ؤ݈ • ग़ྗͷϢχοτ਺͕࡟ݮ͞ΕΔ • ܭࢉྔ࡟ݮ
5. { { { • Մม௕ͷೖྗʹରԠͰ͖Δ • Մม௕Λݻఆ௕ʹམͱ͠ࠐΉ 9.3 Pooling ࠷େ஋ ࠷େ஋ ࠷େ஋
6. 9.3 Pooling • Մม௕ͷೖྗʹରԠͰ͖Δ • Global Average Pooling[Lin 2013] • νϟωϧຖʹฏۉ஋Λग़͢ • શ݁߹૚ͷ୅ΘΓʹ࢖ΘΕͨΓ͢Δ
7. • Maxout Network [Goodfellow 2013] • νϟωϧ୯ҐͰͷPooling • ҟͳΔಛ௃ʹ൓Ԡ͢ΔϑΟϧλͷ͏ͪɺ
 ͲΕ͔ҰͭͰ΋൓Ԡ͢Ε͹ग़ྗ΋൓Ԡ͢Δ 9.3 Pooling
8. • Infinitely Strong Priorʢແݶʹڧ͍ࣄલ෼෍ʣ • ύϥϝʔλ͕͍͔ͭ͘ͷ஋ʹͳΔ֬཰Λ0ʹͯ͠
 ׬શʹ࢖༻ېࢭͱ͢Δ • ৞ΈࠐΈωοτϫʔΫ͸શ݁߹ωοτϫʔΫʹ
 ແݶʹڧ͍ࣄલ෼෍Λ༩͑ͨ΋ͷͱྨࣅ • ۙ๣Ҏ֎ͷॏΈ͕0 • ॏΈΛڞ༗ • Pooling΋ಉ༷ • ೖྗ͕খ͞ͳҠಈʹରͯ͠ෆม 9.4 Convolution and Pooling as an Infinitely Strong Prior
9. • ͜ΕΒͷࣄલ෼෍͸Ծఆ͕ଥ౰Ͱ͋Ε͹༗ޮ • ଥ౰Ͱͳ͍৔߹ɺUnderfittingͷݪҼͱͳΔ • Pooling • ͋Δಛ௃͕ग़Δݫີͳ৔ॴ͕஌Γ͍ͨ৔߹͸ٯޮՌ • GANͷֶशͳͲͷಛఆͷλεΫʹ΋ٯޮՌ • ৞ΈࠐΈ • ཭Εͨ৔ॴͷ৘ใΛ࢖͍͍ͨ৔߹ɺٯޮՌ 9.4 Convolution and Pooling as an Infinitely Strong Prior
10. • ৞ΈࠐΈϞσϧ͸৞ΈࠐΈϞσϧͷΈͱൺֱ͞ΕΔ΂͖ • ৞ΈࠐΈϞσϧ • ઃܭऀ͕ۭؒత஌ࣝΛ૊ΈࠐΜͰ͍Δ • ৞ΈࠐΈͰͳ͍Ϟσϧ • ۭؒత஌ࣝΛֶशͰ֫ಘ͢Δඞཁ͕͋Δ • ͜ΕΒΛಉ͡ϕϯνϚʔΫͰൺֱ͢Δ΂͖Ͱͳ͍ 9.4 Convolution and Pooling as an Infinitely Strong Prior