Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
ソーイAI勉強会 第2回:深層学習の計算
Search
sewii
May 30, 2025
0
53
ソーイAI勉強会 第2回:深層学習の計算
sewii
May 30, 2025
Tweet
Share
More Decks by sewii
See All by sewii
第5回ソーイAI勉強会:自然言語処理 Part2
sewiiinc
0
36
第4回ソーイAI勉強会:自然言語処理
sewiiinc
0
26
第3回ソーイAI勉強会:深層学習基礎 最終回
sewiiinc
0
71
第1回ソーイAI勉強会:機械学習と深層学習
sewiiinc
0
63
Featured
See All Featured
Writing Fast Ruby
sferik
628
62k
Into the Great Unknown - MozCon
thekraken
40
1.9k
Code Review Best Practice
trishagee
69
19k
Responsive Adventures: Dirty Tricks From The Dark Corners of Front-End
smashingmag
251
21k
Designing Experiences People Love
moore
142
24k
JavaScript: Past, Present, and Future - NDC Porto 2020
reverentgeek
50
5.5k
VelocityConf: Rendering Performance Case Studies
addyosmani
332
24k
Art, The Web, and Tiny UX
lynnandtonic
301
21k
Agile that works and the tools we love
rasmusluckow
329
21k
Site-Speed That Sticks
csswizardry
10
720
Six Lessons from altMBA
skipperchong
28
3.9k
10 Git Anti Patterns You Should be Aware of
lemiorhan
PRO
656
60k
Transcript
ୈճɿਂֶशͷܭࢉ
ਂֶशͷ෮श
ਂֶशͰͲ͏ݴͬͨ͜ͱΛ͍ͯ͘͠ͷ͔ʁ ਓؒͷΛߟ͑Δ ਆܦࡉ๔ʢχϡʔϩϯʣͷܨ͕Γ ΛཧϞσϧԽ
ೖྗ தؒʢӅΕʣ ग़ྗ
ೖྗ தؒʢӅΕʣ ग़ྗ தؒͷ͕ଟ͍ˠਂֶशͱݺͿ
ͰதؒͰͲͷΑ͏ͳܭࢉΛߦ͏ͷ͔ʁ ࠓͷϝΠϯʂ
׆ੑԽؔͱԿ͔ʁ
தؒͰͷܭࢉͷྲྀΕ ॏΈͷֻ͚ࢉ χϡʔϩϯͷ͠ࢉ ׆ੑԽؔͷม
தؒͰͷܭࢉͷྲྀΕ ॏΈͷֻ͚ࢉ χϡʔϩϯͷ͠ࢉ ׆ੑԽؔͷม ೖྗͷॏཁੑΛԽͨ͠ͷɻ ॏΈΛௐ͢Δ͜ͱͰɺਖ਼֬ͳ༧ଌΛՄೳʹ͢Δɻ
YX YXB ˞ॏΈҎԼͷΑ͏ʹ͏ X XɿॏΈ Y
Yɿೖྗ ྫʣ͠Yͷೖྗ͕ॏཁͰͳͯ͘ɺYͷೖྗ͕ॏཁͩͬͨ߹ Y YB ͷΑ͏ʹ͏ɻ ˠೖྗ৴߸ͷBʹ͍ͨͯ͠ɺΑΓYͷ͕ө͞Ε͍ͯΔɻ
தؒͰͷܭࢉͷྲྀΕ ॏΈͷֻ͚ࢉ χϡʔϩϯͷ͠ࢉ ׆ੑԽؔͷม ೖྗ৴߸͔Βͷใ͕શͯඞཁͳΘ͚Ͱͳ͍ɻ ׆ੑԽؔΛ௨͢͜ͱͰʮͲͷΑ͏ͳใΛ͑Δͷ͔ʯΛܾΊΔɻ ೖྗͷॏཁੑΛԽͨ͠ͷ
Y Y C X X Z
ɿॏΈ X X CɿόΠΞε Yɿೖྗ৴߸ Zɿग़ྗ৴߸ χϡʔϥϧωοτϫʔΫͷܭࢉͷਤࣜԽ χϡʔϩϯͷ͠ࢉΛ ʮZʹมʯͯ͠ग़ྗ
Y Y C X X Z
ɿॏΈ X X CɿόΠΞε χϡʔϥϧωοτϫʔΫͷܭࢉͷਤࣜԽ ग़ྗ ॏΈ͚ͩͰදݱͰ͖ͳ͍෦ ΛόΠΞεͰิڧɻ
BɿZʹૹΒΕͯ͘Δೖྗ৴߸ͷ૯ C YX YXB ॏΈͷֻ͚ࢉ χϡʔϩϯͷ͠ࢉ
ZI B
BɿZʹૹΒΕͯ͘Δೖྗ৴߸ͷ૯ C YX YXB ZI B
׆ੑԽؔͷม ೖྗ৴߸ ೖʂʂ ग़ྗ৴߸ ͜ͷIΛ׆ੑԽؔͱ͍͏ ೖྗΛग़ྗʹมʂʂ
Y Y C X X B
χϡʔϥϧωοτϫʔΫͷܭࢉͷਤࣜԽʢΑΓৄࡉʹʣ Zͱͯ͠ग़ྗ Z I B
׆ੑԽؔͷछྨ γάϞΠυؔ ߃ؔ εςοϓؔ 3FMVؔ ਂֶशͰ ΘΕͳ͍ ݱࡏͰΘ Ε͍ͯΔ ݱࡏओྲྀ
ೖྗΛͦͷ· ·ฦ͢ʢճؼ Ͱ༻ʣ
ޯ๏ͱԿ͔ʁ
ػցֶशͷྲྀΕʢ͓͞Β͍ʣ ֶशʢ܇࿅ʣɿ σʔλΛ͏·͘આ໌Ͱ͖ͦ͏ͳϞσϧΛબͼɺͦͷϞσϧ Λσʔλʹ߹͏Α͏ʹௐ͢Δ͜ͱɻ ਪɿ ֶशͨ͠ϞσϧΛ͔ͭͬͯɺະͷσʔλΛ༧͢Δ͜ͱɻ ˞ʮֶशʹ͓͚Δਖ਼ʯͱʮਪʹ͓͚Δਖ਼ʯ͕͍ۙͱ͖ɺ ֶश͕͏·͍͍ͬͯ͘Δɻ
ਂֶशͰɺ ͲͷΑ͏ʹਖ਼Λ্͍͛ͯ͘ͷ͔ʁ
ଛࣦؔʢϩεؔʣΛ༻͍Δ ਂֶशͰɺ
ଛࣦʢϩεʣؔɿ ʮͲΕ͘Β͍ਖ਼ղσʔλͱҟͳΔ͔ʯΛදؔ͢ ଛࣦؔͱ ͭ·Γਖ਼Λ্͛Δʹɺଛࣦؔখ͍͞ํ͕͍͍ʂʂ
ޯ๏ͱɺ ͜ͷଛࣦؔΛখ͍ͯ͘͘͞͠ख๏Λࢦ͢
ͦͦޯͱʁ ଛࣦؔʹର͢ΔॏΈͷඍ ∂E ∂w = [ ∂E ∂w1 ⋯ ∂E
∂wn ] Ͱද͞ΕΔ XʢॏΈʣΛม͑ͨ࣌ʹɺ&ʢଛࣦؔʣ͕ͲΕ͘Β͍มΘΔ͔
ʮޯ๏ʯͷΠϝʔδ ॏΈ ଛࣦؔ ଛࣦ͕ؔݮগ͢Δํʹ ύϥϝʔλʢॏΈʣΛߋ৽ ˠଛࣦؔΛͰ͖Δ͚ͩখ͘͢͞Δɻ
ʮޯ๏ʯͷࣜ wnew = wold − η × ∂E ∂w ʢߋ৽ޙͷॏΈʣʢߋ৽લͷॏΈʣʢֶशʣºʢޯʣ
˞ֶशʢБʣɿճͷֶशͰͲΕ͘Β͍ύϥϝʔλΛߋ৽͢Δ͔ ޯํʹҠಈ͢Δྔ
ʮޯ๏ʯͷࣜͳʹΛද͍ͯ͠Δͷ͔ʁ ॏΈʢXʣ ଛࣦؔʢ&ʣ ϶X ޯෛ ߋ৽લ ߋ৽ޙ ͲͷΑ͏ʹॏΈ͕ߋ৽͞ΕΔͷ͔ʁ wnew =
wold − η × ∂E ∂w ʢྫʣޯ͕ෛ ˠ"ਖ਼ ˠߋ৽લͷXʹ"͕͞ΕΔ ˠXӈʹҠಈʢߋ৽ʣ "ͱ͢Δ
ɾޯ๏ͱଛࣦؔΛখ͘͢͞ΔͨΊʹɺॏΈΛߋ৽͍ͯ͘͜͠ͱɻ ޯ๏·ͱΊ ɾޯͱ ʮXʢॏΈʣΛม͑ͨ࣌ʹɺ&ʢଛࣦؔʣ͕ͲΕ͘Β͍มΘΔ͔ʯ Λද͢ɻ ɾ ʹΑͬͯॏΈͷߋ৽Λߦ͏ wnew = wold
− η × ∂E ∂w
ޡࠩٯ๏ͱԿ͔ʁ
wnew = wold − η × ∂E ∂w ˣˣˣॏΈͷܭࢉɺԼͷࣜͰٻΊ͍͚͍͍ͯ X
X X ॏΈͷมԽΛΈΑ͏ʂ ˠXΛಈ͔ͯ͠ΈΔ ˠXΛΛม͑Δͱͦͷ͋ͱશͯʹӨڹ ˠܭࢉ͕େมʂʂ ॱ
ޡࠩٯ๏ɿ ॏΈύϥϝʔλʹΑΔޯͷܭࢉΛޮྑ͘ߦͳ͏ํ๏ɻ
ޡࠩٯ๏ɿ ॏΈύϥϝʔλʹΑΔޯͷܭࢉΛޮྑ͘ߦͳ͏ํ๏ɻ ▶︎ ͳʹ͕ٯͳͷ͔ʁ
ޡࠩٯ๏ɿ ॏΈύϥϝʔλʹΑΔޯͷܭࢉΛޮྑ͘ߦͳ͏ํ๏ɻ ˞ॏΈͷߋ৽ˠޯ ▶︎ ͳʹ͕ٯͳͷ͔ʁ ग़ྗΛελʔτͱͯ͠ɺॏΈͷ ߋ৽Λߟ͑Δ ٯ
ޡࠩٯ๏ͰޯΛٻΊΔͷܭࢉ͕͍͠ͷͰলུ͢Δ͕ɺ ޡࠩٯ๏Λ͏ͱ ʮग़ྗͰͷਖ਼ղϥϕϧͱͷޡࠩʯ͕Θ͔Ε શͯͷޯ͕Θ͔Δɻ
ɾॱ༧ଌΛग़ྗ͢ΔͨΊʹ༻͍Δɻ ޡࠩٯ๏·ͱΊ ɾॱͰޯ๏Λܭࢉ͢ΔͱɺͰ͖ͳ͍͜ͱͳ͍͕ɺܭࢉ ίετ͕ߴ͗͢Δɻ ɾޡࠩٯํΛ༻͍Δ͜ͱͰɺ ʮग़ྗͰͷਖ਼ղϥϕϧͱͷޡࠩʯ͕Θ͔Εશͯͷޯ͕Θ͔Δɻ
ਂֶशͷֶशͱਪ·ͱΊ
ॱʹΑΓ༧ଌΛग़ྗ ਂֶशͷֶशํ๏ ༧ଌͱਖ਼ղϥϕϧͷζϨΛ Խ ͦͷζϨΛͬͯҰؾʹޯ Λܭࢉ ֶशΛ͔͚ͯॏΈΛम wnew = wold
− η × ∂E ∂w ▶︎ ▶︎ ▶︎ ▶︎
ਪͲͷΑ͏ʹߦͳ͏ͷ͔ʁ ώϯτɿਪͰະͷσʔλΛ༧ଌ͠ɺϞσϧͷධՁΛߦ͏
ॱʹΑΓ༧ଌΛग़ྗ ਂֶशͷਪํ๏ ༧ଌͱਖ਼ղϥϕϧͷζϨΛ Խ ͦͷζϨΛͬͯҰؾʹޯ Λܭࢉ ֶशΛ͔͚ͯॏΈΛम wnew = wold
− η × ∂E ∂w ▶︎ ▶︎ ▶︎ ▶︎
ॱʹΑΓ༧ଌΛग़ྗ ਂֶशͷਪํ๏ ༧ଌͱਖ਼ղϥϕϧͷζϨΛ Խ ▶︎ ˒ਪͰॱ͔͠ߦΘͳ͍ʂʂ
࣍ճͷ༧ఆ
ਖ਼ଇԽ ΈࠐΈχϡʔϥϧωοτϫʔΫ ࣗવݴޠॲཧಋೖ