Upgrade to Pro — share decks privately, control downloads, hide ads and more …

atmaCup#11 1st place solution

Avatar for ishikei ishikei
August 06, 2021

atmaCup#11 1st place solution

Avatar for ishikei

ishikei

August 06, 2021
Tweet

Other Decks in Technology

Transcript

  1. 0WFSWJFX 1IPUPT 1SFQSPDFTT .PEFM5SBJOJH 4UBDLJOH 1PTUQSPDFTT • $7 • 1VCMJD

    • 1SJWBUF 'JOBM4VC *NBHF1BEEJOH • ը૾ͷ௕ลʹ߹Θͤͯਖ਼ํܗʹ 1BEEJOH͔ͯ͠Β3FTJ[F %*/0QSFUSBJOJOH 'JOFUVOJOH • SFTOFUE 7J5@TNBMM 7J5@CBTF • 3FHSFTTJPO 4DSBUDI USBJOJOH • SFTOFUE • 3FHSFTTJPO $MBTTJGJDBUJPO -JHIU(#. • $MBTTJGJDBUJPOͷ৔߹͸֤MBCFM ͷQSPCBMJMJUZ΋ೖྗ OQDMJQ QSFE  
  2. 44- • .PEFMSFTOFUE 7J5@TNBMM 7J5@CBTF • &QPDIͷΈຊλεΫͷਫ਼౓Λ֬ೝ͠ͳ͕Βˠʹ૿΍ͨ͠ • 44-QSFUSBJOXFJHIUΛ࢖༻ͯ͠'JOFUVOJOH ॏΈݻఆͳ͠

    FQPDI Model SSL epoch SSL loss CV Public Private ViT_small_patch16 100 7.587 0.7422 0.7154 0.7002 ViT_small_patch16 300 3.814 0.6890 0.6574 0.6408
  3. *NBHF1BEEJOH • ը૾ͷॎԣൺ͕೥୅ʹΑͬͯۇ͔ʹ ภ͍ͬͯΔΑ͏ʹݟ͑ͨ • ը૾ͷ௕ลʹ߹Θͤͯਖ਼ํܗʹ QBEEJOH͔ͯ͠Β໨తͷղ૾౓ʹ 3FTJ[F • ͜ΕʹΑͬͯಉ͡QJYFM

    TJ[FͰ΋ *NBHF1BEEJOHΛೖΕͨ΄͏͕ είΞ͕վળͨ͠ Model Img Padding CV Public Private resnet18d - 0.6779 0.6758 0.6522 resnet18d ✓ 0.6674 0.6609 0.6474
  4. *NBHF1BEEJOH • 5BSHFU • TJ[FY • 5BSHFU • TJ[FY •

    5BSHFU • TJ[FY ݩը૾ ͦͷ··3FTJ[F *NBHF1BEEJOH
  5. 4DSBUDI5SBJOJOH • ࠷ॳ͸ %JTDVTTJPOʹ্͕͍ͬͯͨ 4JN4JBNΛࢼ͍͕ͯͨ͠શ͘͏·͘ ͍͔ͣ • ίϯϖத൫·Ͱ͸4DSBUDIֶशͷ &GGJDJFOU/FU# 3FT/FUEΛ

    ࢖͍ͬͯͨ • ʢ࠷ऴTVCʹ͸4DSBUDIֶशͷ 3FT/FUEͷΈ࢖༻ʣ 5SBJOJOH1BSBNFUFS • FQPDI • PQUJNJ[FS"EBN8 XFJHIUEFDBZ • MFBSOJOHSBUF $PTJOFEFDBZ • JNBHF@TJ[FY • CBUDI@TJ[F "VHNFOUBUJPO • )PSJ[POUBM'MJQ • 4IJGU4DBMF3PUBUF • #MVS • 3BOEPN#SJHIUOFTT$POUSBTU • .JYVQ $VUNJY
  6. 3FHSFTTJPO WT$MBTTJGJDBUJPO • جຊ͸3FHSFTTJPOΛ࢖͍͕ͬͯͨɺ͍͔ͭ͘$MBTTJGJDBUJPOϞσϧ΋ֶश • ͦ͜·Ͱେ͖ͳҧ͍͸ͳ͔͕ͬͨɺޙ͔Β֬ೝ͢ΔͱTJOHMFCFTU͸$MBTTJGJDBUJPO ͩͬͨΈ͍ͨ Model SSL Img

    size CV Public Private ViT_base_patch16 ✓ 224x224 0.6759 0.6400 0.6306 • $MBTTJGJDBUJPOͷ৔߹͸ͪ͜Βͷ%JTDVTTJPOʹ ͋ΔΑ͏ʹ༧ଌ஋Λ࿈ଓ஋ʹม׵
  7. 4UBDLJOH • -JHIU(#.Λ࢖ͬͨ4UBDLJOH • 3FHSFTTJPO $MBTTJGJDBUJPO૒ํͷϞσϧΛ࢖͏͕ɺ$MBTTJGJDBUJPOʹؔͯ͠͸ɺ ֤MBCFMͷQSPCBCJMJUZ΋ೖྗͱͯ͠Ճ͑ͨ 0 1 2

    3 5BSHFU 0.3 1.2 2.2 2.9 .PEFM 3FHSFTTJPO 0.1 1.3 2.1 2.8 .PEFM $MBTTJGJDBUJPO QSFE QSFE 0.8 0.1 0.0 0.0 QSPCB@    0.1 0.65 0.1 0.1 0.05 0.2 0.7 0.3 0.05 0.05 0.2 0.6 ➕ ɿ -JHIU(#. 4UBDLJOH
  8. TPMVUJPO·ͱΊ • .PEFM3FT/FUE 7J5@TNBMM 7J5@CBTF • %*/0QSFUSBJO FQPDI 'JOFUVOJOH4DSBUDIUSBJOJOJH MPOHFQPDI

    • *NBHF1BEEJOH • 3FHSFTTJPO$MBTTJGJDBUJPO • -(#.ͰTUBDLJOH $MBTTJGJDBUJPO͸֤MBCFMͷQSPCBCJMJUZ΋ೖྗ
  9. ʢ͓·͚ʣ๩͍͠ਓͷͨΊͷը૾ίϯϖͱͷ޲͖߹͍ํ ࿩͢͜ͱ • ීஈࣗ෼͕ը૾ίϯϖ΍Δͱ͖ʹؾʹͯ͠Δ͜ͱ • ಛʹɺ৭ʑͳࣄ৘ʹΑΓͳ͔ͳ͔ίϯϖ΍Δ͕࣌ؒͱΕͳ͍ਓ޲͚ ஫ҙ఺ • ҰԠը૾ίϯϖʹߜͬͯ࿩͠·͢ •

    ʢଞͷυϝΠϯͷίϯϖͰ΋ڞ௨ͳ෦෼͸͋Δ͔΋஌Ε·ͤΜ͕ʣ • ͋͘·Ͱ෼ੳίϯϖͱ͍͏ʮωοτήʔϜʯͰͲ͏্ҐΛૂ͏͔ɺʹয఺ ʢ࣮຿ͱ͸ผͷ؍఺ʣ
  10. Ͳ͏͢Δʁ FQPDIʹ͔͔Δ࣌ؒΛ୹͘͢Δ • ͓ۚͰͳ͙Δ • (16Λޮ཰తʹ࢖͏ • ྫɿը૾ΛOQZܗࣜͰ࣋ͬͨΓϝϞϦʹࡌ͓͍ͤͯͨΓ EBUBTFU಺Ͱ͸ಛ௃͸OQBSSBZͰ࣋ͭɺͳͲ •

    (16Ҏ֎Ͱॲཧʹ͕͔͔͍࣌ؒͬͯΔՕॴΛಛఆ͢Δ • খ͍͞ը૾αΠζɺGPMEͷΈɺҰ෦ͷը૾ͷΈͰ࣮ݧΛߴ଎ʹճ͢ • ͨͩ͠ɺ͋·Γಉ͡GPMEͰͷΈ֬ೝͯ͠ΔͱͦͷGPMEʹͲΜͲΜաֶशͯ͠͠·͏ͷͰ΄Ͳ΄Ͳʹ • ؾΛ͚ͭͳ͍ͱɺࢼߦճ਺㲈TIBLF֬཰ʹͳͬͯ͠·͍͕ͪʢͳؾ͕͍ͯ͠Δʣ
  11. Ͳ͏͢Δʁ ίϯϖং൫Ͱؾʹ͍ͯ͠Δ͜ͱ • ίϯϖಛ༗ͷੑ࣭͸Կ͔ • ࠓճͳΒ.BUFSJBMTͳͲͷ৘ใɺ֎෦σʔλېࢭɺը૾ൺ཰ʁ • ৭ʑࢼͯ͠ແཧͦ͏ͳΒ͙͢ଞͷํ਑ʹ੾Γସ͑Δ • ʢ݁ہ.BUFSJBMTͳͲͷ৘ใ͏·͘࢖͑·ͤΜͰͨ͠ʣ

    • &OTFNCMF 4UBDLJOHͰͷ্͕Γ෯͸ͲΕ͘Β͍͔ʁ • TJOHMFNPEFMʹݻࣥͨ͠ํ͕ྑ͍ͷ͔ɺϞσϧͷଟ༷ੑΛॏࢹͨ͠ํ͕ྑ͍ͷ͔ • ࣗ෼͸ͭҎ্͍͍ײ͡ͷϞσϧ͕Ͱ͖ͨ࣌఺Ͱ֬ೝ͍ͯ͠Δ • ࠷ऴతʹ͸͜͜ͷ൑அׂ͕ͱॏཁʹͳΔؾ͕͢Δ