Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
DeepLearningBook 9.3-9.4
Search
mtjuney
January 16, 2018
Technology
0
47
DeepLearningBook 9.3-9.4
9.3 Pooling
9.4 Convolution and Pooling as an Infinitely Strong Prior
mtjuney
January 16, 2018
Tweet
Share
More Decks by mtjuney
See All by mtjuney
DeepLearningBook 9.5-9.7
mtjuney
0
44
Other Decks in Technology
See All in Technology
経理出身PdMがAIプロダクト開発を_ハンズオンで学んだ話.pdf
shunsukenarita
1
260
ecspressoの設計思想に至る道 / sekkeinight2025
fujiwara3
12
2.2k
LLM開発を支えるエヌビディアの生成AIエコシステム
acceleratedmu3n
0
350
GMOペパボのデータ基盤とデータ活用の現在地 / Current State of GMO Pepabo's Data Infrastructure and Data Utilization
zaimy
2
140
With Devin -AIの自律とメンバーの自立
kotanin0
2
970
製造業の課題解決に向けた機械学習の活用と、製造業特化LLM開発への挑戦
knt44kw
0
110
【CEDEC2025】現場を理解して実現!ゲーム開発を効率化するWebサービスの開発と、利用促進のための継続的な改善
cygames
PRO
0
550
Kiroでインフラ要件定義~テスト を実施してみた
nagisa53
1
130
テキストからの実世界知能の実現に向けて
sumoai
0
110
FAST導入1年間のふりかえり〜現実を直視し、さらなる進化を求めて〜 / Review of the first year of FAST implementation
wooootack
1
240
AI時代の経営、Bet AI Vision #BetAIDay
layerx
PRO
1
480
【CEDEC2025】LLMを活用したゲーム開発支援と、生成AIの利活用を進める組織的な取り組み
cygames
PRO
1
2k
Featured
See All Featured
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
tammyeverts
53
2.9k
GitHub's CSS Performance
jonrohan
1031
460k
Build your cross-platform service in a week with App Engine
jlugia
231
18k
Navigating Team Friction
lara
188
15k
Visualization
eitanlees
146
16k
Easily Structure & Communicate Ideas using Wireframe
afnizarnur
194
16k
Balancing Empowerment & Direction
lara
1
510
Documentation Writing (for coders)
carmenintech
72
4.9k
Unsuck your backbone
ammeep
671
58k
The Cost Of JavaScript in 2023
addyosmani
51
8.7k
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
addyosmani
7
770
Code Review Best Practice
trishagee
69
19k
Transcript
Deep Learning Book 9.3-9.4 mtjuney
• ը૾ೝࣝʹ͓͍ͯ ը૾ͷେ͖͖͕͞มΘͬͨͱ͖Ͱಉ͡ग़ྗ͕ग़ͯཉ͍͠ • ࣮ࡍมΘͬͯ͠·͏ • ͦ͜ͰPooling 9.3 Pooling Apple
• Pooling • ग़ྗΛԿΒ͔ͷ౷ܭྔͰஔ͖͑Δ • ౷ܭྔ: ࠷େɺฏۉɺL2ϊϧϜ etc 9.3 Pooling
{ { { ࠷େ ࠷େ ࠷େ ྫ: ࠷େPooling
9.3 Pooling • ೖྗͷখ͞ͳҠಈʹରͯ͠ෆมʹͳΔ • খ͞ͳεέʔϦϯάɺճసɺҠಈʹରͯ͠ؤ݈ • ग़ྗͷϢχοτ͕ݮ͞ΕΔ • ܭࢉྔݮ
{ { { • ՄมͷೖྗʹରԠͰ͖Δ • ՄมΛݻఆʹམͱ͠ࠐΉ 9.3 Pooling ࠷େ
࠷େ ࠷େ
9.3 Pooling • ՄมͷೖྗʹରԠͰ͖Δ • Global Average Pooling[Lin 2013] •
νϟωϧຖʹฏۉΛग़͢ • શ݁߹ͷΘΓʹΘΕͨΓ͢Δ
• Maxout Network [Goodfellow 2013] • νϟωϧ୯ҐͰͷPooling • ҟͳΔಛʹԠ͢ΔϑΟϧλͷ͏ͪɺ ͲΕ͔ҰͭͰԠ͢Εग़ྗԠ͢Δ
9.3 Pooling
• Infinitely Strong Priorʢແݶʹڧ͍ࣄલʣ • ύϥϝʔλ͕͍͔ͭ͘ͷʹͳΔ֬Λ0ʹͯ͠ શʹ༻ېࢭͱ͢Δ • ΈࠐΈωοτϫʔΫશ݁߹ωοτϫʔΫʹ ແݶʹڧ͍ࣄલΛ༩͑ͨͷͱྨࣅ
• ۙҎ֎ͷॏΈ͕0 • ॏΈΛڞ༗ • Poolingಉ༷ • ೖྗ͕খ͞ͳҠಈʹରͯ͠ෆม 9.4 Convolution and Pooling as an Infinitely Strong Prior
• ͜ΕΒͷࣄલԾఆ͕ଥͰ͋Ε༗ޮ • ଥͰͳ͍߹ɺUnderfittingͷݪҼͱͳΔ • Pooling • ͋Δಛ͕ग़Δݫີͳॴ͕Γ͍ͨ߹ٯޮՌ • GANͷֶशͳͲͷಛఆͷλεΫʹٯޮՌ
• ΈࠐΈ • ΕͨॴͷใΛ͍͍ͨ߹ɺٯޮՌ 9.4 Convolution and Pooling as an Infinitely Strong Prior
• ΈࠐΈϞσϧΈࠐΈϞσϧͷΈͱൺֱ͞ΕΔ͖ • ΈࠐΈϞσϧ • ઃܭऀ͕ۭؒతࣝΛΈࠐΜͰ͍Δ • ΈࠐΈͰͳ͍Ϟσϧ • ۭؒతࣝΛֶशͰ֫ಘ͢Δඞཁ͕͋Δ
• ͜ΕΒΛಉ͡ϕϯνϚʔΫͰൺֱ͢Δ͖Ͱͳ͍ 9.4 Convolution and Pooling as an Infinitely Strong Prior