$30 off During Our Annual Pro Sale. View Details »

ReLU6に関する検証

Kotaro Inoue
August 24, 2018

 ReLU6に関する検証

Cookpad Summer Internship 2018 5Day R&D

Kotaro Inoue

August 24, 2018
Tweet

More Decks by Kotaro Inoue

Other Decks in Research

Transcript

  1. 3F-6ʹؔ͢Δݕূ
    !$PPLQBE*OD
    $PPLQBE4VNNFS*OUFSOTIJQ%BZ3%
    ૣҴాେֶجװཧ޻ֶ෦৘ใཧ޻ֶՊ೥
    Ҫ্ߛଠ࿕ʢ!NVTBQSHʣ

    View Slide

  2. ΋͘͡
    എܠ
    ࣮ݧ
    ݁Ռ
    ࢥͬͨ͜ͱ
    ·ͱΊ

    View Slide

  3. എܠ

    View Slide

  4. 3F-6
    w ׆ੑԽؔ਺ͷҰछ
    w 3F-6G Y
    NBY Y

    w ޯ഑ফࣦΛ๷͙ޮՌ͕͋Δͱ஌ΒΕ͍ͯΔ

    View Slide

  5. 3F-6
    w .PCJMF/FUWͰ࢖༻͞Ε͍ͯΔ׆ੑԽؔ਺
    w 3F-6ͷ্ݶ஋Λʹ੍ݶͨ͠΋ͷ
    w 3F-6G Y
    NJO NBY Y


    w DG
    3F-6G Y
    NBY Y

    View Slide

  6. ͳͥzzͳͷ͔
    w .PCJMF/FUWͷ࿦จʹ͸ɺҎԼͷΑ͏ʹॻ͔Ε͍ͯΔɻ

    8FVTF3F-6BTUIFOPOMJOFBSJUZCFDBVTFPGJUTSPCVTUOFTTXIFO
    VTFEXJUIMPXQSFDJTJPODPNQVUBUJPO<>
    w ͱ͋Δϒϩάʹ͸͜͏ॻ͔Ε͍ͯΔ

    5FOTPS'MPX΍5FOTPS'MPX-JUFʢͦͯ͠1Z5PSDIͳͲଞͷϥΠϒϥϦͰ΋ʣ
    Ͱ͸ܰྔͳϞσϧͷ࣮ݱͷͨΊʹݻఆখ਺఺਺ʹΑΔऔΓѻ͍͕αϙʔτ͞Ε
    ͍ͯΔɻʢதུʣ


    ˠলϝϞϦ࣮ݱͷͨΊʹ͋͑ͯ௿ਫ਼౓ͷԋࢉΛߦͬͨ৔߹Ͱ΋ɺ

    3F-6͸ൺֱతޮՌΛࣔ͢ʜʁͦΕΏ͑࢖༻͍ͯ͠Δʜʁ

    View Slide

  7. w ͱΓ͋͑ͣݕূͯ͠Έ͍ͨͱࢥ͍·͢ɻ
    ͳͥzzͳͷ͔

    View Slide

  8. ࣮ݧ

    View Slide

  9. ݕূํ๏
    w ࢖༻͢ΔϞσϧ͸ɺ؆୯ͳ%FFQ$//
    w ,FSBTͷFYBNQMFTDJGBS@DOOQZͰ࢖༻͞Ε͍ͯΔϞσϧ
    w ࢖༻͢Δσʔληοτ͸ɺ$*'"3
    w %FFQ$//Ͱ࢖༻͞Ε͍ͯΔ3F-6ΛɺͦΕͧΕҎԼʹมߋ͠ൺֱ
    w 3F-6

    G Y
    NBY Y

    w 3F-6O

    G Y
    NJO NBY Y
    O
    O㱨\ ʜ ^


    View Slide

  10. ݕূํ๏
    w ҎԼͷઃఆͰֶशΛߦ͍ɺ݁ՌΛൺֱ
    w &QPDI
    w #BUDI4J[F
    w ࡞ۀ࣌ؒͱܭࢉࢿݯ͕ݶΒΕ͍ͯͨͨΊ&QPDI਺Λ੍ݶ͍ͯ͠·͢

    View Slide

  11. ࢖༻ͨ͠Ϟσϧ
    ͕͜͜3F-6

    View Slide

  12. ݁Ռ

    View Slide






  13. 3F-6 3F-6 3F-6 3F-6 3F-6 3F-6
    ࠷େ஋
    USBJO@BDDVSBDZ WBM@BDDVSBDZ





    3F-6 3F-6 3F-6 3F-6 3F-6 3F-6
    ࠷খ஋
    USBJO@MPTT WBM@MPTT

    View Slide

  14. ࢥͬͨ͜ͱ

    View Slide

  15. ࢥͬͨ͜ͱҰཡ
    w ݁ՌΛΈΔͱɺ3F-6͕֨ஈʹείΞ͕ߴ͍ͱ͍͏Θ͚Ͱ΋ͳ͍
    w ͱ͍͏਺ࣈʹؔͯ͠͸ಛʹҙຯ͕ͳ͍ͱࢥΘΕΔ
    w ࿦จͷBVUIPSʹฉ͔͘͠ͳͦ͞͏
    w ͱ͋ΔϒϩάͰ΋ݴٴ͍ͯ͠ΔΑ͏ʹɺ

    ࣮ࡍͷίϯϐϡʔλʔ্ʹ͓͚Δԋࢉ࣌ͷϘτϧωοΫղফΛ

    ໨తͱ͍ͯ͠Δؾ͕͢Δʜʁ
    w ΋͔ͨ͠͠Β࣮ࡍͷ.PCJMF/FUͷΑ͏ʹɺ૚͕ਂ͘ෳࡶͳϞσϧʹରͯ͠͸ɺ

    େ͖͘είΞʹ͕ࠩग़ͯ͘ΔͷͰ͸ͳ͍ͷ͔ɻ

    View Slide

  16. ·ͱΊ

    View Slide

  17. ·ͱΊ
    w 3F-6ͷʹಛʹҙຯ͸ͳ͍ʢ׬ʣ

    View Slide

  18. ײ૝
    w ʢ'VUVSF8PSLʣͤΊͯ.PCJMF/FUWͰϕϯνϚʔΫΛͱΓ͍ͨɻ
    w ػցֶशͷཧ࿦ΑΓ΋ɺԠ༻ɾ࣮༻دΓʹڵຯ͕͋ΔͷͰɺ

    ܰྔϞσϧͱ͔͸΋͏গ͠ৄ͘͠ௐ΂͍ͨɻ
    w ݸਓϫʔΫͰຊ౰͸΍Γ͔ͨͬͨ,VCFSOFUFTΛݸਓతʹۃΊ͍ͨɻ

    View Slide

  19. ೔͓ؒੈ࿩ʹͳΓ·ͨ͠

    View Slide

  20. ࢀߟจݙ
    w ,FSBT%PDVNFOUBUJPOIUUQTLFSBTJP
    w IUUQTZPIFJLJLVUBHJUIVCJPSFMV
    w .BSL4BOEMFS "OESFX)PXBSE .FOHMPOH;IV "OESFZ;INPHJOPW
    BOE-JBOH$IJFI$IFO.P

    CJMFOFUW*OWFSUFESFTJEVBMTBOEMJOFBSCPUUMFOFDLT*O1SPDFFEJOHT
    PGUIF*&&&$POGFSFODFPO

    $PNQVUFS7JTJPOBOE1BUUFSO3FDPHOJUJPO QBHFTr

    w

    View Slide