Upgrade to Pro — share decks privately, control downloads, hide ads and more …

輪講資料 / Rethinking ImageNet Pre-training

C31b5afbe1ffb5588b2fe5a9e39b357b?s=47 Takumi Karasawa
December 12, 2019

輪講資料 / Rethinking ImageNet Pre-training

2019/12/12 社内 AIシステム部全体の輪講にて発表させていただいた資料です。
データセット周りの基礎事項を拾いつつ論文紹介させていただきました。

C31b5afbe1ffb5588b2fe5a9e39b357b?s=128

Takumi Karasawa

December 12, 2019
Tweet

Transcript

  1. A 9 - /0 10 2 - - - 0

    0 1 20
  2. r g N 9 n N V ?Ct I 3

    10,0 0 2 2 1 e CX Cia e 9 28 n p m I ) - ( 0
  3. I 12 0 4C 11 01 9 9 4 G

  4. 2 ACA 0 6 HH AGH A B . B

    1 6 H G K 6 -44 9 - 56 K 6 AGH A B / -DC 5 - AA / 1 A . HI 6 -44 9 1-- K 6 AGH A B . HI G 6 -44 9 4157 K 4 3 C 2 0 6 AGH A B / 4 C 6 H4 I 9 - 56 , HI 5 F GK 2 0 6 7 C 4 3 C C: / 4 C 3 HB 6 -44 9 1-- , HI 5 F GK 2 0 . . D -DAAM 6 AGH A B 5 FIA 7 C I IA 9 - 56 K 0 AADJ 2 0 6 AGH A B , 3D -DAAM 6 I A BA 1C 4 I 5G IG A A 1-- K 2 0 6 AGH A B -DAAM G KKK DGG G C D C D
  5. / /- 01 / /-

  6. 0 @ 3 ) • P ) R N •

    h n P R SN • 9 3 T TWs ]c t l • P 1 ] 0 @ 3 z~mgh • ) P9 3 ] • - L F 2 A F 7 C Vh l i • P 845, ~ r ] n • M ) P0 @ 3 VW k tdl 0 @ 3 1 @ 6 8 I 5 @F F A F@ R01685 S ) eo nP u aai [ n
  7. 8 7 7 7 8 7

  8. None
  9. ( 1 * 15 5 ( - 0 ( 1

    * L agC p ( - LI o SI W [ n Rag e r ( - N V d S SI V ➤ V ]V[ N _ W _ _ m ag i 8 2 t V - 35- ) 0 3 0 ( 7 -3 0 ) 7 50 177 ) 09 3850 7 20 ) e gd 7 0 ai mo h l c n
  10. 4 414. 2 3 1 3. 1 3 3 1

    43
  11. - ke m 1 .2.2 RT C yrN nI odn

    sh il M tnM ga sh p • 2 1 . . 2 • .2.2 2 -
  12. . . 1 . inr m . 1 . l

    A MN d N b e a c M inr M . 1 . o . 1 1 . 1 1 . . 1 . 3
  13. 1 9 0 4 0 4 0 9 0 4

    1 4 4 40 4 0 4 [ XMi Ll t d rL U ILm t h z UGR v U • 0 4 9 9 9 0 4 1 4 40 4 0 4 . / 0 ao n] L U • 9 0 4 1 4 40 4 0 4 . / ao n] L U ➤ IN H 9 0 4 1 4 40 4 0 4 e
  14. 01 5 . 5 1 t oIM l M [

    c N ]h dm[ i n s L • 2 5 A B b e raIMC • 3 83 6 3 6 3 06 E1 2 • 3 4 83 6 3 6 3 06 E1 2 • 83 6 3 6 E1 2 1 2C 63 G I
  15. 2E B EGC BAN IAE IAK IAE EGC BAN IAE

    B M GH m ih a m a lgt X nygu l zp cb g YW[ [ ogx] • I 3EGC BAN IAE 21 8 s V eWvd r • 1 M G 3EGC BAN IAE G6AK 8 • HI 3EGC BAN IAE G6AK 8 • GE 3EGC BAN IAE , 4 8 ➤ LA 5 . 0 ACA 4 1
  16. - 1 1* 1 - -1 Bhml SBn 1 -

    -1 7 s o7 B zg e s B t r - - acb i 7 zg N fp o ➤ c fp r
  17. 1 * 1 * 1 sy B U * 1

    feda c B G B PU l P feda c ➤ t b edn s hi N S • 8 1 • * * 1 * S * o oz P 1 * m r u B p U S G S b edn sP G
  18. 1 - 1 1 T 9 p i g •

    - 1 1 3 I T n 3 1 f 9 • l3 1 l r tu a N ➤ h me T
  19. - - - 0* 3 ig 2 a - 0

    - - h n f l T g e n T o T = C O O O3 - 3 3 3 O -
  20. 25 . 2 1 [ S M C N R

    Ea ]D - [ . C I 5. 2 . 2 C . 2
  21. 2 ? 2 8 y v mb ]hmI f c

    • )2 twI ➤ P s 2? 8 2 .C 8 twD5 I • - F )) V I • .C 8 tw • i[di N s o V • r n k eac I 0 1 5 9 /. : : 2/ 2 / / /: K H CD 2 2 / :/ / : 2 / / : 2 ./ / : :/ . 2/. / / 2 : 2
  22. + E A BG 3 GG B F (E G

    GHE • / F 2 5 2 F G 2 F G GHE E A G CE • 2 CB EC CF G CE F 2 P / F 2 B GC B X • - 3 B ) S NR EC B ) P[ M . E E A G E • 9 . 2. 9 9 . 2( . 92. . 8 • 2 120. ( • 8:829 8( • - D 90 :9 21 ) • 8 9 . 0 2( 8. 2 2 - • 9: 1. . . 829 . :9 : 2 9 • :9 : :9 . 9 . 829 . :9 : . 9 9 • 8. 2 0. 2( G 2
  23. - D4= DD 9C 6E= 9 • D D a

    04C 2 11 6 =C D 4D C 8 DE 9 gf L l h N C 6E= * N C 6E= I * N C 6E= sM • /2 C 6E= 9 N C 6E= a ho .D 4D mʼ Ixe Ixe u f I • r ar D 4D ar D 4D md n • r ʻ ki h acc R f ar ar h R fS tp eI r r h R r c aS   
  24. A 58 7 . 5 O • C ( (

    ( E , , 5 • SC E , , 7 S • E 0 25 0 A 00 A ) 15 5 ) • P E 8 )
  25. , , fegi v fdc fegi K, , fegi t

    u , , a • cnd • fegi s • t • v + 8 ➤ 19 a p f S 8 at f r 17 19 8 P 19 7 7 19 • l kgca dmogia y ~ y S • t 8 • v 8 • Ofdc • ,1= 7 7 6 • 4C= 7 34 42 7 • 0 55 046 4 1 7 + 04 1 72 46 4 1 7 • 1 = 72 46 4 1 7 # #
  26. 6 5 7 • e R . 6 23 53

    - aA d c aA d • d . 6 A 56 - A R R ) ( ) - 10 ( ) ( ) - 10 ( ) - 10 0-&( 5
  27. 2 .81 8. 5 • -. 2 R T PRI

    Abagdc ufe 3582 858 fe i m T s • o p rPR bagdc u ➤ 7. 2 2 2 .5858 u tx y T PR A .00 .0 n l N T 6 G 2 6 N 2 - / - -
  28. - 29 2 - 9 -9- 9 c d lr

    K NR u . - 9 - dK A 9- 9 t IP - 9 dI - 9 -9- 9 i fyK R e a ➤ pmkg o fys n 3 - -9 - 9 - 9 -9- 9 K I  
  29. . / 1 ) / 5 A 0 / 0

    5 1/ / - -R a mi cl O I d a 8/3 , R R N eC • ➤ ? P - ) ) ( 1 8 • R aO g n N • R aO /5 5 3 Rg Okh 8 P
  30. .3 8 / /8C 1 / 15 A 5 83

    / / , , y x l iP N x l iP ~ / 3 3 wP O • ➤ I I • csk lt obps r nuda 3 / lt • RO / 3 3 x P a l ihkmebgP l iebg 3 / csk       l iebg 00 -
  31. 0 4= 0 0 20 4 5 0 9 0

    0 40= 5 , 0 ,1742 0 4 P nV 64 137 2 Sv C 6056 rsA i t LOO • a 9 • el 9 • 9 • 9 , =0 A0 C 4 C , =0 A0 C
  32. : 3 8 0C : ( + cjd V C

    L L I I C L I 8 C O L V +-. C A L (( / I I L LLC C CI fdcT CI fdc ( , cjd V C L IP IA I L I I C LI L 8 C O L V(, . C A L -+ I I L ( - h 2: C + : C , A + 7 8 8C C C : :: : 8 :+ : C : 7 8 8 : 7C 7 8 AC C 7 : CC + 7C : 8 7 : C : C I AC C 8 C O L V/ /,) C A L ( , I I L 7 A CI L rm 5 LI I L rm ulotV641 091 ➤ 05 n poNlf 7 8 Vyv 8 CI Arm ( . 8 C O V ) C A L ),) I I L 4 LCI Arm ( / 8 C O V- + C A L - ( . 642 I I L ) ( L A CI L PboNlkmp s du 3: A: C : Pb l h ( 8 C O V ) C A L () )- 642 I I L ( ) L A CI L 0 CI 1 LLC C CI L rm 237 61 a sU ( 8 C O V +) C A L (- + 642 I I L + ) L A CI L 0 CI 1 LLC C CI L cjd RI S n ( ( 8 C O V +) C A L (- + 642 I I L , /(/ L A CI L LLC C CI CI LI I h fegi 41( bvk L A CI pm (( + 2,3 ,/ 1 oNlkmp r w igpac )Pb h Y cL *Pb oNlf t V ) Sed Y O
  33. 0 ? 3 3 C 4 3?48 A ?8 /

    - 2. . . c u i P r L p sc u tw ? 3 7 V ➤ r ? 3 7 dc RLV l nh OS eau ga gau p • eau • . . ) • 2. • ga gau • . . ( • 2. .
  34. 3 33 . 4 4 D 4 - I 8

     
  35. -3 33- 3 . 4 1 4 - - 33

    N a 9 ? I . 4 e I ? 9 9 ? cg mi D
  36. 2 2 4 0. . . 4 0. . .

    2 2 0 C O r c?a d i ID D i I 4 2 2 zog s h I pm f V t . 2 .- ecf u . 2 2 0 n D pm N l
  37. .3 33. + ++ .- 4 1 + 4 .

    . - . + 4 . - dgb ei c abD ?f
  38. 2 422 . -- 4 24 4. 2 - 2

    . .2 4. 2 - 2 . .2 d c D S c ? . 4 e f a
  39. 9D DPDM D 9 0HP GH J 3 .NM GSD

    . PPDKK MC 3 6 KHJ 9H G D RSPD GHDP P GHD NP SP RD NAID R CDRD RHNM MC DL MRH DFLDMR RHNM 2M - 9 9 0HP GH J R 9 -77 2M 2-- : 9DM 4 1D 9 0HP GH J MC 3 :SM RDP 9 -77 N PC PD K RHLD NAID R CDRD RHNM HRG PDFHNM PN N K MDR NPJ 2M 72 : 4 1D G MF : 9DM MC 3 :SM .DD PD HCS K KD PMHMF NP HL FD PD NFMHRHNM 2M - 9 4 1D 0 0JHNV PH .NKK WP MC 9 0HP GH J 6 J 9 -77 2M 2-- , 4HPHKKNT 4 1D 9 0HP GH J - 9NRGDP MC .NKK WP MN RH :DFLDMR RHNM 2M - 9 3 .DMF .NMF 9 :N GDP 5 3 5H 4 5H MC 5 DH DH 2L FD7DR , 5 PFD : KD 1HDP P GH K 2L FD . R A D 2M - 9
  40. KLKVKSIK YWWGPTZWP 7 1KSM 5 Y 7 8VGYWK GXNKKWN :G

    F 5YGSM . 8GVUGXN . 8NTW G : /KVSWXKOS . 0 /KVM GSJ 9 3KO 3KO 6RGMK KX 9GVMK IG K BOWYG KITMSOXOTS 0NG KSMK 670B , D 4 TVTX GSJ E /KSMOT ASJKVWXGSJOSM XNK JObIY X TL XVGOSOSM JKKU LKKJLTV GVJ SKYVG SKX TVPW 6S .6 . 8 5K D FNGSM KS GSJ 7 YS 1K ZOSM JKKU OSXT VKIXO KVW- YVUGWWOSM NYRGS KZK UKVLTVRGSIK TS ORGMKSKX I GWWO IGXOTS 6S 600B 6TaK GSJ 0 KMKJ /GXIN STVRG O GXOTS- .IIK KVGXOSM JKKU SKX TVP XVGOSOSM H VKJYIOSM OSXKVSG ITZGVOGXK WNOLX 6S 60:9 7 9 /G 7 8OVTW GSJ 4 2 5OSXTS 9G KV STVRG O GXOTS GVDOZ- 1 A GSTZ . BKJG JO GSJ B 9KRUOXWP 6SWXGSIK STVRG O GXOTS- NK ROWWOSM OSMVKJOKSX LTV LGWX WX O GXOTS GVDOZ- E CY GSJ 8 5K 4VTYU STVRG O GXOTS 6S 200B 4OVWNOIP 6 GJTWGZTZOI 4 4POT GVO 1T G V GSJ 8 5K 1KXKIXVTS NXXUW- MOXNYH ITR LGIKHTTPVKWKGVIN JKXKIXVTS