LT20200129

LT slides

Transcript

1. ը૾ݕࡧͰͷֶशϞσϧʹ͍ͭͯ Ϡϑʔ෱Ԭ 5FDI
   .FFUVQ
    ೥݄೔
2. 5BOBLB
   ,FOUB ϕΨίʔϙϨʔγϣϯ 5XJUUFS !DVSSZ@PO@B@SJDF Ո۩ɾΠϯςϦΞͷ&$اۀ ʼ ෼ੳ(S ʼ 8&#γεςϜ
   .-Ϟσϧ։ൃ
3. ࿩͢͜ͱ ฐࣾͷ&$αΠτʹ͸
   ը૾ݕࡧͷػೳ͕͋Γ·͢ ͜ͷը૾ݕࡧΛ࣮૷͢Δ্Ͱ޻෉ͨ͠఺Λ঺հ͍͖ͤͯͨͩ͞·͢ ಛʹ
   ͲΜͳಛ௃Λֶ࣋ͬͨशϞσϧΛ࢖༻ͨ͠ͷ͔ͱ͍͏఺ʹϑΥʔΧεͯ͠࿩͠·͢
4. -08:"ʢฐࣾ&$αΠτʣͰͷը૾ݕࡧ
5. ୳͍ͨ͠Ϟϊͷը૾ ྨࣅͷ঎඼ը૾ ˍ ඥ͍ͮͨ৘ใ *OQVU 0VUQVUͷ֓೦ਤ 8&#αʔόʔ
6. <
   7((MJLF
   DPOWOFU
   > <
   *ODFQUJPO
   > ʢฐࣾը૾ݕࡧͷʣֶशϞσϧͷߏ੒ɾ֓ཁ $BUFHPSZ ιϑΝͳͲ ৭ͷ෼ྨ ܗͷ෼ྨ $BUFHPSZ
   4UZMF
   $PMPS
   4UZMFϕΫτϧ $PMPSϕΫτϧ 45&1 ᶃ 45&1 ᶄ 45&1 ᶅ $BUFHPSZ
   4UZMF
   $PMPS ͜ΕΒΛݩʹ42-ʹম͖௚͢ ۙࣆ๣୳ࡧ͸࢖༻͍ͯ͠ͳ͍ ෺ମݕग़ ʢΧςΰϦ෼ྨʣ *OQVU
7. ʢฐࣾը૾ݕࡧͷʣϑϨʔϜϫʔΫ .-%-ϑϨʔϜϫʔΫʢϓϥοτϑΥʔϜʣ 8&#ϑϨʔϜϫʔΫ ͦͷଞ
   ൺֱͱͯ͠ݕূͨ͠΋ͷ
8. ը૾ݕࡧγεςϜ࣮૷Ͱؾʹͨ͠఺ ਫ਼౓ ॲཧ଎౓ ετϨʔδ༰ྔʢϥϯχϯάίετʣ ͜ΕΒΛߟֶྀͨ͠शϞσϧʢ$//ʣͷબఆ͕ॏཁ
9. *OQVU
   EBUB $POWPMVUJPOBM
   OFVSBM
   OFUXPSL
   $// 'JMUFS ʷ 
    
    
    ʷ
   ʷ $POWPMVUJPO 
   
10. *OQVU
    EBUB $POWPMVUJPOBM
    OFVSBM
    OFUXPSL
    $// 'JMUFS ʷ 
     
     
     ʷ
    ʷ 
     ϑΟϧλʔͷ֤ϐΫηϧͷ஋͕ύϥϝʔλͱֶͯ͠श͞ΕΔ ࣮ࡍ͸$//Ͱ͸QPPMJOHॲཧ΋ߦΘΕ͍ͯΔ
11. *OQVU
    EBUB $POWPMVUJPOBM
    OFVSBM
    OFUXPSL
    $// 'JMUFS ʷ 
     
     
     $POWPMVUJPO TUSJEF
     جຊతʹύϥϝʔλ਺͕ଟ͍ʢϑΟϧλʔͷ໨͕͜·͔͍ʣํ͕ දݱྗ͕ߴ͘
    ਫ਼౓ͷߴֶ͍शϞσϧʹͳΔ ͔͠͠
    ύϥϝʔλ਺͕૿͑ΔͱετϨʔδͱਪ࿦ͷ࣮ߦ͕࣌ؒͱ΋ʹ૿Ճ͢Δ
12. $//ͷมԽͷྺ࢙ "MFYOFU  3FT/FU  https://arxiv.org/abs/1512.03385 ,BJNJOH )F 9JBOHZV ;IBOH 4IBPRJOH 3FO +JBO
    4VO Alex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton ʷ
    $POW ʷ
    $POW ʷ
    $POW ϑΟϧλʔαΠζ͕খ͘͞ͳΓ
    ୅ΘΓʹ૚͕૿͍͑ͯΔ
    ଟ૚ߏ଄ʹͳΔ͜ͱͰදݱྗ͕ߴ͘ͳΔ ݩ૆త Ϟσϧ
13. $POWPMVUJPOBM
    OFVSBM
    OFUXPSL
    $// খ͍͞ϑΟϧλʔΛෳ਺ճ௨͢͜ͱͰύϥϝʔλ਺͕࡟ݮ
    
    
    ʷʷ
    
    ̏ʷʷ 'JMUFS ʷ $POWPMVUJPO 'JMUFS ʷ $POWPMVUJPO *OQVU
    EBUB $POWPMVUJPO 'JMUFS ʷ
14. *ODFQUJPO
    WW Christian Szegedy, Sergey Ioffe, Vincent Vanhoucke, Alex Alemi : ԣɾॎϑΟϧλʔʹ෼͚Δ͜ͱͰύϥϝʔλ਺Λ࡟ݮ
    ʢֶशର৅ʹ΋ΑΔ͕ʣਫ਼౓Λམͱͣ͞ൺֱతʹૣ͍࣮ߦ࣌ؒΛ࣮ݱ ʷ
    $POW ʷ
    $POW ʷ
    $POW ʷ
    $POW https://arxiv.org/abs/1602.07261 ʷ ʷ ʷ
16. ༨ஊɿΤοδίϯϐϡʔςΟϯά গ͠࿩͸มΘΔͷͰ͕͢ɾɾɾ ը૾ݕࡧʹݶΒͣΦϑϥΠϯͰεϚϗ୺຤ͳͲʢΤοδʣ্Ͱ ਪ࿦ॲཧΛ࣮ߦͰ͖ΔܰྔͳֶशϞσϧͷݚڀɾ։ൃ΋੝ΜʹਐΜͰ͍Δ ϝϦοτ ɾϦΞϧλΠϜੑ ɾωοτ؀ڥͷͳ͍৔ॴͰ΋࣮ߦՄೳʢ*P5ʣ ɾηΩϡϦςΟ
17. 8&#ϑϨʔϜϫʔΫ
    .-%-ϑϨʔϜϫʔΫͱ΋ʹ1ZUIPOΛ࢖༻ ετϨʔδ
    ࣮ߦ଎౓ͷ໘͔Β ਫ਼౓Λʢࠩ΄Ͳʣམͱͣ͞ύϥϝʔλ਺͕࡟ݮ͞ΕֶͨशϞσϧ *ODFQUJPOΛ࢖༻ͨ͠ ύϥϝʔλ਺ͷ࡟ݮ͸ΤοδίϯϐϡʔςΟϯάͷจ຺Ͱ΋੝Μʹݚڀɾ։ൃ͕ਐΜͰ͍Δ