LT20200129

ը૾ݕࡧͰͷֶशϞσϧʹ͍ͭͯ Ϡϑʔ෱Ԭ 5FDI.FFUVQ ೥݄೔

5BOBLB,FOUB ϕΨίʔϙϨʔγϣϯ 5XJUUFS !DVSSZ@PO@B@SJDF Ո۩ɾΠϯςϦΞͷ&$اۀ ʼ ෼ੳ(S ʼ 8&#γεςϜ .-Ϟσϧ։ൃ

࿩͢͜ͱ ฐࣾͷ&$αΠτʹ͸ ը૾ݕࡧͷػೳ͕͋Γ·͢ ͜ͷը૾ݕࡧΛ࣮૷͢Δ্Ͱ޻෉ͨ͠఺Λ঺հ͍͖ͤͯͨͩ͞·͢ ಛʹ ͲΜͳಛ௃Λֶ࣋ͬͨशϞσϧΛ࢖༻ͨ͠ͷ͔ͱ͍͏఺ʹϑΥʔΧεͯ͠࿩͠·͢

-08:"ʢฐࣾ&$αΠτʣͰͷը૾ݕࡧ

୳͍ͨ͠Ϟϊͷը૾ ྨࣅͷ঎඼ը૾ ˍ ඥ͍ͮͨ৘ใ *OQVU 0VUQVUͷ֓೦ਤ 8&#αʔόʔ

<7((MJLFDPOWOFU> <*ODFQUJPO> ʢฐࣾը૾ݕࡧͷʣֶशϞσϧͷߏ੒ɾ֓ཁ $BUFHPSZ ιϑΝͳͲ ৭ͷ෼ྨ ܗͷ෼ྨ $BUFHPSZ 4UZMF $PMPS
4UZMFϕΫτϧ $PMPSϕΫτϧ 45&1 ᶃ 45&1 ᶄ 45&1 ᶅ $BUFHPSZ 4UZMF $PMPS ͜ΕΒΛݩʹ42-ʹম͖௚͢ ۙࣆ๣୳ࡧ͸࢖༻͍ͯ͠ͳ͍ ෺ମݕग़ ʢΧςΰϦ෼ྨʣ *OQVU

ʢฐࣾը૾ݕࡧͷʣϑϨʔϜϫʔΫ .-%-ϑϨʔϜϫʔΫʢϓϥοτϑΥʔϜʣ 8&#ϑϨʔϜϫʔΫ ͦͷଞ ൺֱͱͯ͠ݕূͨ͠΋ͷ

ը૾ݕࡧγεςϜ࣮૷Ͱؾʹͨ͠఺ ਫ਼౓ ॲཧ଎౓ ετϨʔδ༰ྔʢϥϯχϯάίετʣ ͜ΕΒΛߟֶྀͨ͠शϞσϧʢ$//ʣͷબఆ͕ॏཁ

*OQVUEBUB $POWPMVUJPOBMOFVSBMOFUXPSL $// 'JMUFS ʷ ʷ ʷ
$POWPMVUJPO

*OQVUEBUB $POWPMVUJPOBMOFVSBMOFUXPSL $// 'JMUFS ʷ ʷ ʷ
ϑΟϧλʔͷ֤ϐΫηϧͷ஋͕ύϥϝʔλͱֶͯ͠श͞ΕΔ ࣮ࡍ͸$//Ͱ͸QPPMJOHॲཧ΋ߦΘΕ͍ͯΔ

*OQVUEBUB $POWPMVUJPOBMOFVSBMOFUXPSL $// 'JMUFS ʷ $POWPMVUJPO TUSJEF
جຊతʹύϥϝʔλ਺͕ଟ͍ʢϑΟϧλʔͷ໨͕͜·͔͍ʣํ͕ දݱྗ͕ߴ͘ ਫ਼౓ͷߴֶ͍शϞσϧʹͳΔ ͔͠͠ ύϥϝʔλ਺͕૿͑ΔͱετϨʔδͱਪ࿦ͷ࣮ߦ͕࣌ؒͱ΋ʹ૿Ճ͢Δ

$//ͷมԽͷྺ࢙ "MFYOFU 3FT/FU https://arxiv.org/abs/1512.03385 ,BJNJOH )F 9JBOHZV ;IBOH
4IBPRJOH 3FO +JBO4VO Alex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton ʷ$POW ʷ$POW ʷ$POW ϑΟϧλʔαΠζ͕খ͘͞ͳΓ ୅ΘΓʹ૚͕૿͍͑ͯΔ ଟ૚ߏ଄ʹͳΔ͜ͱͰදݱྗ͕ߴ͘ͳΔ ݩ૆త Ϟσϧ

$POWPMVUJPOBMOFVSBMOFUXPSL $// খ͍͞ϑΟϧλʔΛෳ਺ճ௨͢͜ͱͰύϥϝʔλ਺͕࡟ݮʷʷ̏ʷʷ 'JMUFS ʷ $POWPMVUJPO 'JMUFS ʷ $POWPMVUJPO *OQVUEBUB
$POWPMVUJPO 'JMUFS ʷ

*ODFQUJPOWW Christian Szegedy, Sergey Ioffe, Vincent Vanhoucke, Alex Alemi :
ԣɾॎϑΟϧλʔʹ෼͚Δ͜ͱͰύϥϝʔλ਺Λ࡟ݮ ʢֶशର৅ʹ΋ΑΔ͕ʣਫ਼౓Λམͱͣ͞ൺֱతʹૣ͍࣮ߦ࣌ؒΛ࣮ݱ ʷ$POW ʷ$POW ʷ$POW ʷ$POW https://arxiv.org/abs/1602.07261 ʷ ʷ ʷ

༨ஊɿΤοδίϯϐϡʔςΟϯά গ͠࿩͸มΘΔͷͰ͕͢ɾɾɾ ը૾ݕࡧʹݶΒͣΦϑϥΠϯͰεϚϗ୺຤ͳͲʢΤοδʣ্Ͱ ਪ࿦ॲཧΛ࣮ߦͰ͖ΔܰྔͳֶशϞσϧͷݚڀɾ։ൃ΋੝ΜʹਐΜͰ͍Δ ϝϦοτ ɾϦΞϧλΠϜੑ ɾωοτ؀ڥͷͳ͍৔ॴͰ΋࣮ߦՄೳʢ*P5ʣ ɾηΩϡϦςΟ

8&#ϑϨʔϜϫʔΫ .-%-ϑϨʔϜϫʔΫͱ΋ʹ1ZUIPOΛ࢖༻ ετϨʔδ ࣮ߦ଎౓ͷ໘͔Β ਫ਼౓Λʢࠩ΄Ͳʣམͱͣ͞ύϥϝʔλ਺͕࡟ݮ͞ΕֶͨशϞσϧ *ODFQUJPOΛ࢖༻ͨ͠ ύϥϝʔλ਺ͷ࡟ݮ͸ΤοδίϯϐϡʔςΟϯάͷจ຺Ͱ΋੝Μʹݚڀɾ։ൃ͕ਐΜͰ͍Δ

LT20200129

LT20200129

kenken

Featured

Transcript

ը૾ݕࡧͰͷֶशϞσϧʹ͍ͭͯ Ϡϑʔ෱Ԭ 5FDI.FFUVQ ೥݄೔

5BOBLB,FOUB ϕΨίʔϙϨʔγϣϯ 5XJUUFS !DVSSZ@PO@B@SJDF Ո۩ɾΠϯςϦΞͷ&$اۀ ʼ ෼ੳ(S ʼ 8&#γεςϜ .-Ϟσϧ։ൃ

࿩͢͜ͱ ฐࣾͷ&$αΠτʹ͸ ը૾ݕࡧͷػೳ͕͋Γ·͢ ͜ͷը૾ݕࡧΛ࣮૷͢Δ্Ͱ޻෉ͨ͠఺Λ঺հ͍͖ͤͯͨͩ͞·͢ ಛʹ ͲΜͳಛ௃Λֶ࣋ͬͨशϞσϧΛ࢖༻ͨ͠ͷ͔ͱ͍͏఺ʹϑΥʔΧεͯ͠࿩͠·͢

-08:"ʢฐࣾ&$αΠτʣͰͷը૾ݕࡧ

୳͍ͨ͠Ϟϊͷը૾ ྨࣅͷ঎඼ը૾ ˍ ඥ͍ͮͨ৘ใ *OQVU 0VUQVUͷ֓೦ਤ 8&#αʔόʔ

<7((MJLFDPOWOFU> <*ODFQUJPO> ʢฐࣾը૾ݕࡧͷʣֶशϞσϧͷߏ੒ɾ֓ཁ $BUFHPSZ ιϑΝͳͲ ৭ͷ෼ྨ ܗͷ෼ྨ $BUFHPSZ 4UZMF $PMPS

ʢฐࣾը૾ݕࡧͷʣϑϨʔϜϫʔΫ .-%-ϑϨʔϜϫʔΫʢϓϥοτϑΥʔϜʣ 8&#ϑϨʔϜϫʔΫ ͦͷଞ ൺֱͱͯ͠ݕূͨ͠΋ͷ

ը૾ݕࡧγεςϜ࣮૷Ͱؾʹͨ͠఺ ਫ਼౓ ॲཧ଎౓ ετϨʔδ༰ྔʢϥϯχϯάίετʣ ͜ΕΒΛߟֶྀͨ͠शϞσϧʢ$//ʣͷબఆ͕ॏཁ

*OQVUEBUB $POWPMVUJPOBMOFVSBMOFUXPSL $// 'JMUFS ʷ ʷ ʷ

*OQVUEBUB $POWPMVUJPOBMOFVSBMOFUXPSL $// 'JMUFS ʷ ʷ ʷ

*OQVUEBUB $POWPMVUJPOBMOFVSBMOFUXPSL $// 'JMUFS ʷ $POWPMVUJPO TUSJEF

$//ͷมԽͷྺ࢙ "MFYOFU 3FT/FU https://arxiv.org/abs/1512.03385 ,BJNJOH )F 9JBOHZV ;IBOH

$POWPMVUJPOBMOFVSBMOFUXPSL $// খ͍͞ϑΟϧλʔΛෳ਺ճ௨͢͜ͱͰύϥϝʔλ਺͕࡟ݮʷʷ̏ʷʷ 'JMUFS ʷ $POWPMVUJPO 'JMUFS ʷ $POWPMVUJPO *OQVUEBUB

*ODFQUJPOWW Christian Szegedy, Sergey Ioffe, Vincent Vanhoucke, Alex Alemi :

༨ஊɿΤοδίϯϐϡʔςΟϯά গ͠࿩͸มΘΔͷͰ͕͢ɾɾɾ ը૾ݕࡧʹݶΒͣΦϑϥΠϯͰεϚϗ୺຤ͳͲʢΤοδʣ্Ͱ ਪ࿦ॲཧΛ࣮ߦͰ͖ΔܰྔͳֶशϞσϧͷݚڀɾ։ൃ΋੝ΜʹਐΜͰ͍Δ ϝϦοτ ɾϦΞϧλΠϜੑ ɾωοτ؀ڥͷͳ͍৔ॴͰ΋࣮ߦՄೳʢ*P5ʣ ɾηΩϡϦςΟ

8&#ϑϨʔϜϫʔΫ .-%-ϑϨʔϜϫʔΫͱ΋ʹ1ZUIPOΛ࢖༻ ετϨʔδ ࣮ߦ଎౓ͷ໘͔Β ਫ਼౓Λʢࠩ΄Ͳʣམͱͣ͞ύϥϝʔλ਺͕࡟ݮ͞ΕֶͨशϞσϧ *ODFQUJPOΛ࢖༻ͨ͠ ύϥϝʔλ਺ͷ࡟ݮ͸ΤοδίϯϐϡʔςΟϯάͷจ຺Ͱ΋੝Μʹݚڀɾ։ൃ͕ਐΜͰ͍Δ