ReLU6に関する検証

Cookpad Summer Internship 2018 5Day R&D

Transcript

1. 3F-6ʹؔ͢Δݕূ
   !$PPLQBE*OD
   $PPLQBE4VNNFS*OUFSOTIJQ%BZ3%
   ૣҴాେֶجװཧ޻ֶ෦৘ใཧ޻ֶՊ೥
   Ҫ্ߛଠ࿕ʢ!NVTBQSHʣ
   

   View Slide

2. ΋͘͡
   എܠ
   ࣮ݧ
   ݁Ռ
   ࢥͬͨ͜ͱ
   ·ͱΊ
   

   View Slide

3. എܠ
   

   View Slide

4. 3F-6
   w ׆ੑԽؔ਺ͷҰछ
   w 3F-6G Y
   NBY Y
   
   w ޯ഑ফࣦΛ๷͙ޮՌ͕͋Δͱ஌ΒΕ͍ͯΔ
   

   View Slide

5. 3F-6
   w .PCJMF/FUWͰ࢖༻͞Ε͍ͯΔ׆ੑԽؔ਺
   w 3F-6ͷ্ݶ஋Λʹ੍ݶͨ͠΋ͷ
   w 3F-6G Y
   NJO NBY Y
   
   
   w DG
   3F-6G Y
   NBY Y
   
   

   View Slide

6. ͳͥzzͳͷ͔
   w .PCJMF/FUWͷ࿦จʹ͸ɺҎԼͷΑ͏ʹॻ͔Ε͍ͯΔɻ

   8FVTF3F-6BTUIFOPOMJOFBSJUZCFDBVTFPGJUTSPCVTUOFTTXIFO
   VTFEXJUIMPXQSFDJTJPODPNQVUBUJPO<>
   w ͱ͋Δϒϩάʹ͸͜͏ॻ͔Ε͍ͯΔ

   5FOTPS'MPX΍5FOTPS'MPX-JUFʢͦͯ͠1Z5PSDIͳͲଞͷϥΠϒϥϦͰ΋ʣ
   Ͱ͸ܰྔͳϞσϧͷ࣮ݱͷͨΊʹݻఆখ਺఺਺ʹΑΔऔΓѻ͍͕αϙʔτ͞Ε
   ͍ͯΔɻʢதུʣ

   

   ˠলϝϞϦ࣮ݱͷͨΊʹ͋͑ͯ௿ਫ਼౓ͷԋࢉΛߦͬͨ৔߹Ͱ΋ɺ

   3F-6͸ൺֱతޮՌΛࣔ͢ʜʁͦΕΏ͑࢖༻͍ͯ͠Δʜʁ
   

   View Slide

7. w ͱΓ͋͑ͣݕূͯ͠Έ͍ͨͱࢥ͍·͢ɻ
   ͳͥzzͳͷ͔
   

   View Slide

8. ࣮ݧ
   

   View Slide

9. ݕূํ๏
   w ࢖༻͢ΔϞσϧ͸ɺ؆୯ͳ%FFQ$//
   w ,FSBTͷFYBNQMFTDJGBS@DOOQZͰ࢖༻͞Ε͍ͯΔϞσϧ
   w ࢖༻͢Δσʔληοτ͸ɺ$*'"3
   w %FFQ$//Ͱ࢖༻͞Ε͍ͯΔ3F-6ΛɺͦΕͧΕҎԼʹมߋ͠ൺֱ
   w 3F-6

   G Y
   NBY Y
   
   w 3F-6O

   G Y
   NJO NBY Y
   O
   O㱨\ ʜ ^

   

   View Slide

10. ݕূํ๏
    w ҎԼͷઃఆͰֶशΛߦ͍ɺ݁ՌΛൺֱ
    w &QPDI
    w #BUDI4J[F
    w ࡞ۀ࣌ؒͱܭࢉࢿݯ͕ݶΒΕ͍ͯͨͨΊ&QPDI਺Λ੍ݶ͍ͯ͠·͢
    

    View Slide

11. ࢖༻ͨ͠Ϟσϧ
    ͕͜͜3F-6
    

    View Slide

12. ݁Ռ
    

    View Slide

13. 
    
    
    
    
    3F-6 3F-6 3F-6 3F-6 3F-6 3F-6
    ࠷େ஋
    USBJO@BDDVSBDZ WBM@BDDVSBDZ
    
    
    
    
    
    3F-6 3F-6 3F-6 3F-6 3F-6 3F-6
    ࠷খ஋
    USBJO@MPTT WBM@MPTT
    

    View Slide

14. ࢥͬͨ͜ͱ
    

    View Slide

15. ࢥͬͨ͜ͱҰཡ
    w ݁ՌΛΈΔͱɺ3F-6͕֨ஈʹείΞ͕ߴ͍ͱ͍͏Θ͚Ͱ΋ͳ͍
    w ͱ͍͏਺ࣈʹؔͯ͠͸ಛʹҙຯ͕ͳ͍ͱࢥΘΕΔ
    w ࿦จͷBVUIPSʹฉ͔͘͠ͳͦ͞͏
    w ͱ͋ΔϒϩάͰ΋ݴٴ͍ͯ͠ΔΑ͏ʹɺ

    ࣮ࡍͷίϯϐϡʔλʔ্ʹ͓͚Δԋࢉ࣌ͷϘτϧωοΫղফΛ

    ໨తͱ͍ͯ͠Δؾ͕͢Δʜʁ
    w ΋͔ͨ͠͠Β࣮ࡍͷ.PCJMF/FUͷΑ͏ʹɺ૚͕ਂ͘ෳࡶͳϞσϧʹରͯ͠͸ɺ

    େ͖͘είΞʹ͕ࠩग़ͯ͘ΔͷͰ͸ͳ͍ͷ͔ɻ
    

    View Slide

16. ·ͱΊ
    

    View Slide

17. ·ͱΊ
    w 3F-6ͷʹಛʹҙຯ͸ͳ͍ʢ׬ʣ
    

    View Slide

18. ײ૝
    w ʢ'VUVSF8PSLʣͤΊͯ.PCJMF/FUWͰϕϯνϚʔΫΛͱΓ͍ͨɻ
    w ػցֶशͷཧ࿦ΑΓ΋ɺԠ༻ɾ࣮༻دΓʹڵຯ͕͋ΔͷͰɺ

    ܰྔϞσϧͱ͔͸΋͏গ͠ৄ͘͠ௐ΂͍ͨɻ
    w ݸਓϫʔΫͰຊ౰͸΍Γ͔ͨͬͨ,VCFSOFUFTΛݸਓతʹۃΊ͍ͨɻ
    

    View Slide

19. ೔͓ؒੈ࿩ʹͳΓ·ͨ͠
    

    View Slide

20. ࢀߟจݙ
    w ,FSBT%PDVNFOUBUJPOIUUQTLFSBTJP
    w IUUQTZPIFJLJLVUBHJUIVCJPSFMV
    w .BSL4BOEMFS "OESFX)PXBSE .FOHMPOH;IV "OESFZ;INPHJOPW
    BOE-JBOH$IJFI$IFO.P
    

    CJMFOFUW*OWFSUFESFTJEVBMTBOEMJOFBSCPUUMFOFDLT*O1SPDFFEJOHT
    PGUIF*&&&$POGFSFODFPO
    

    $PNQVUFS7JTJPOBOE1BUUFSO3FDPHOJUJPO QBHFTr
    

    w
    

    View Slide