Share
Embed
AI最新論文読み会2021年5月
AI最新論文読み会2021年5月【オンライン・Zoom配信】(旧 DL勉強会)
Arxivで直近1ヶ月人気の論文まとめ
https://deeplearning-b.connpass.com/event/209977/
の発表資料です。
M.Inomata
May 12, 2021
Transcript
70 slides
-
ࣗݾհ ழມ ॆԝ (͍ͷ·ͨ ΈͭͻΖ) גࣜձࣾ tech vein දऔక ݉
σϕϩούʔ twitter: @ino2222 IUUQTXXXUFDIWFJODPN -
Top10 Recent 1. Ef fi cientNetV2: Smaller Models and Faster
Training ← PickUp! 2. An Empirical Study of Training Self-Supervised Vision Transformers 3. Cross-validation: what does it estimate and how well does it do it? 4. GANcraft: Unsupervised 3D Neural Rendering of Minecraft Worlds 5. StyleCLIP: Text-Driven Manipulation of StyleGAN Imagery 6. LocalViT: Bringing Locality to Vision Transformers 7. Keyword Transformer: A Self-Attention Model for Keyword Spotting 8. Multiscale Vision Transformers 9. SiT: Self-supervised vIsion Transformer 10. Self-supervised Video Object Segmentation by Motion Grouping -
Top10 Hype 1. Minimum-Distortion Embedding 2. StyleCLIP: Text-Driven Manipulation of
StyleGAN Imagery 3. RepVGG: Making VGG-style ConvNets Great Again 4. Representation Learning for Networks in Biology and Medicine: Advancements, Challenges, and Opportunities 5. Cross-validation: what does it estimate and how well does it do it? 6. Factors of In fl uence for Transfer Learning across Diverse Appearance Domains and Task Types 7. Why Do Local Methods Solve Nonconvex Problems? 8. Scaling Scaling Laws with Board Games 9. Vision Transformers for Dense Prediction 10. Ef fi cientNetV2: Smaller Models and Faster Training) -
Top recent ᶃEf fi cientNetV2ɻΑΓখ͞ͳϞσϧͱΑΓ͍τϨʔχϯά (ݪจ: Ef fi cientNetV2: Smaller
Models and Faster Training) ຊจͰɺैདྷͷϞσϧΑΓߴͳֶशͱ༏ΕͨύϥϝʔλޮΛ࣋ͭɺ৽͍͠ΈࠐΈωοτϫʔΫͷϑΝϛ ϦʔͰ͋ΔEf fi cientNetV2Λհ͠·͢ɻ͜ͷϞσϧ܈Λ։ൃ͢ΔͨΊʹɺզʑτϨʔχϯάΛߟྀͨ͠χϡʔϥϧɾ ΞʔΩςΫνϟͷ୳ࡧͱεέʔϦϯάͷΈ߹ΘͤΛ༻͍ͯɺτϨʔχϯάͱύϥϝʔλޮΛڞಉͰ࠷దԽͨ͠ɻ ͜ͷϞσϧɺFused-MBConvͳͲͷ৽͍͠ػೳͰڧԽ͞Εͨ୳ࡧۭ͔ؒΒ୳ࡧ͞Ε·ͨ͠ɻ࣮ݧͷ݁Ռɺ Ef fi cientNetV2Ϟσϧɺ࠷ઌͷϞσϧΑΓΔ͔ʹߴʹֶशͰ͖ΔҰํͰɺ࠷ྑͰ6.8ഒখ͍͞αΠζʹͳΔ͜ͱ ͕͔Γ·ͨ͠ɻ ֶशதʹը૾αΠζΛஈ֊తʹେ͖͘͢Δ͜ͱͰɺֶशΛ͞ΒʹߴԽ͢Δ͜ͱ͕Ͱ͖·͕͢ɺ͠ ͠ਫ਼ͷԼΛҾ͖ى͜͠·͢ɻ͜ͷਫ਼ԼΛิ͏ͨΊʹɺυϩοϓΞτσʔλ૿ڧͳͲͷਖ਼ଇԽΛదԠతʹௐ ͢Δ͜ͱΛఏҊ͠ɺߴͳֶशͱྑͳਫ਼ͷཱ྆Λ࣮ݱ͍ͯ͠·͢ɻ ϓϩάϨογϒֶशʹΑΓɺEf fi cientNetV2 ImageNet͓ΑͼCIFAR/Cars/Flowersσʔληοτʹ͓͍ͯɺैདྷͷϞσϧΛେ෯ʹ্ճΔ݁ՌΛಘ·ͨ͠ɻಉ͡ ImageNet21kͰࣄલֶशΛߦ͏͜ͱͰɺզʑͷEf fi cientNetV2ImageNet ILSVRC2012ʹ͓͍ͯ87.3%ͷτοϓ1ਫ਼Λ ୡ͠ɺ࠷ۙͷViTΛ2.0%্ճΔਫ਼Λୡ͠·ͨ͠ɻҰํͰɺಉ͡ܭࢉࢿݯΛ༻͍ͯ5ഒ͔Β11ഒͷͰֶशΛߦ͍ ·ͨ͠ɻίʔυ https://github.com/google/automl/ef fi cientnetv2 Ͱެ։͞Ε·͢ɻ http://arxiv.org/abs/2104.00298v1 Google Research, Brain Team. ˠ& ffi DJFOU/FU7ͷൃදɻ ɹ& ffi DJFOU/FUΛ࣮༻తʹֶशͰ͖ΔΑ͏ʹɺܰྔԽɾߴԽɻ -
Ef fi cientNetV1ͷվળ • ֶशը૾αΠζΛॖখ͢Δ → Progressive Training •
ϞσϧͷϘτϧωοΫղফ →Fused-MBConv • Ϟσϧͷεέʔϧ(B0~B7)ͷํΛ → εέʔϧͷϧʔϧมߋˍը૾ͷ࠷େαΠζΛΑ Γখ͘͞ -
Ef fi cientNet V2 ॴײ • V2͕͍ܰͱ͍ͬͯEf fi cientNetB3~B4Ͱֶश Ͱ͖ΔεϖοΫඞཁɻ
• ResNet-RS ͱ Ef fi cientNet V2 ͕ ConvNetͷࠓ ޙͷϕʔεϥΠϯʹͳΔʁ • ެࣜͷιʔεެ։ָ͕͠Έɻ -
ᶃEf fi cientNetV2ɻΑΓখ͞ͳϞσϧͱΑΓ͍τϨʔχϯά (ݪจ: Ef fi cientNetV2: Smaller Models and
Faster Training) pickup -
ᶄSelf-Supervised Vision TransformersͷτϨʔχϯάʹؔ͢Δ࣮ূతͳݚڀ (ݪจ: An Empirical Study of Training Self-Supervised
Vision Transformers) ͜ͷจͰɺ৽͍͠ख๏Λઆ໌͢ΔͷͰ͋Γ·ͤΜɻͦͷΘΓʹɺ࠷ۙͷίϯϐϡʔλϏδϣ ϯͷਐาΛߟྀͯ͠ɺ୯७Ͱਐతͳɺ͔͓͔ͬͯ͠͠ͳ͚ΕͳΒͳ͍ϕʔεϥΠϯɺ͢ͳΘͪϏ δϣϯτϥϯεϑΥʔϚʔʢViTʣͷͨΊͷࣗݾڭࢣֶ͖शʹ͍ͭͯݚڀ͢Δɻඪ४తͳΈࠐΈ ωοτϫʔΫͷֶशϨγϐඇৗʹख़͍ͯͯ͠ݎ࿚Ͱ͋Δ͕ɺViTͷֶशϨγϐ·ͩߏங͞Ε͓ͯ Βͣɺಛʹࣗݾڭࢣ͖ͷγφϦΦͰֶश͕ΑΓࠔʹͳΔɻຊݚڀͰɺجຊʹཱͪฦͬͯɺࣗݾ ڭࢣ͖ViTΛֶश͢ΔͨΊͷ͍͔ͭ͘ͷجຊతͳίϯϙʔωϯτͷӨڹΛௐࠪ͠·ͨ͠ɻͦͷ݁Ռɺ ෆ҆ఆੑਫ਼ΛԼͤ͞Δେ͖ͳͰ͋ΓɺҰݟ͢Δͱྑ͍݁ՌʹӅ͞Ε͍ͯΔ͜ͱ͕͔Γ·͠ ͨɻ͜ΕΒͷ݁Ռ͔֬ʹ෦తͳࣦഊͰ͋ΓɺֶशΛΑΓ҆ఆͤ͞ΕվળͰ͖Δ͜ͱΛ໌Β͔ʹ͠ ͨɻViTͷ݁ՌΛMoCo v3ଞͷ͍͔ͭ͘ͷࣗݾࢹܕϑϨʔϜϫʔΫͰϕϯνϚʔΫͨ͠ͱ͜Ζɺ ༷ʑͳ໘ͰΞϒϨʔγϣϯ͕ൃੜ͠·ͨ͠ɻݱࡏͷϙδςΟϒͳূڌ͚ͩͰͳ͘ɺ՝ΦʔϓϯΫΤ ενϣϯʹ͍ͭͯٞ͢Δɻ͜ͷݚڀ͕ɺকདྷͷݚڀʹཱͭσʔλϙΠϯτͱܦݧΛఏڙ͢Δ͜ͱ Λظ͍ͯ͠·͢ɻ http://arxiv.org/abs/2104.02057v2 Facebook AI Research(FAIR) ˠ7J5ͷϋΠύʔύϥϝʔλݚڀɻ7J5ϕʔεͷ.P$PWϑϨʔϜϫʔΫ Λ࡞ͬͯɺੑೳʹӨڹΛ༩͑Δ7J5ͷύϥϝʔλΛൺֱܭଌͨ͠ɻ -
ᶅΫϩεόϦσʔγϣϯɿԿΛਪఆ͢Δͷ͔ɺͲͷఔͷޮՌ͕͋Δͷ͔ʁ (ݪจ: Cross-validation: what does it estimate and how well
does it do it?) ΫϩεόϦσʔγϣϯɼ༧ଌޡࠩΛਪఆ͢ΔͨΊʹ͘༻͍ΒΕ͍ͯΔख๏Ͱ͋Δ͕ɼͦͷڍಈෳࡶ Ͱ͋Γɼશʹཧղ͞Ε͍ͯͳ͍ɽཧతʹɼΫϩεόϦσʔγϣϯ๏ɼֶशσʔλʹద߹ͨ͠Ϟ σϧͷ༧ଌޡࠩΛਪఆ͢Δͱߟ͍͑ͨɽզʑɺ͜Ε͕௨ৗͷ࠷খೋ๏ʹΑΔઢܗϞσϧͷ߹Ͱͳ ͘ɺಉ͡ूஂ͔Βநग़͞Εͨଞͷݟͨ͜ͱͷͳ͍܇࿅ηοτʹద߹ͨ͠Ϟσϧͷฏۉ༧ଌޡࠩΛਪఆ͢ Δ͜ͱΛূ໌͢Δɻ͞Βʹɺ͜ͷݱɺσʔλׂɺϒʔτετϥοϓɺMallow's CpͳͲɺ༧ଌޡࠩ ͷҰൠతͳਪఆͰى͜Δ͜ͱΛࣔͨ͠ɻ࣍ʹɼΫϩεόϦσʔγϣϯ͔ΒಘΒΕΔ༧ଌޡࠩͷඪ४త ͳ৴པ۠ؒɼ·͍͠ϨϕϧΛΔ͔ʹԼճΔΧόϨοδΛ࣋ͭ߹͕͋Γ·͢ɽ͜Εɼ֤σʔλϙ Πϯτ͕τϨʔχϯάͱςετͷ྆ํʹ༻͞ΕΔͨΊɼ֤ϑΥʔϧυͷଌఆਫ਼ʹ૬͕ؔ͋Γɼ௨ৗͷ ࢄͷਪఆ͕খ͗͢͞ΔͨΊͰ͢ɽ͜ͷࢄΛΑΓਖ਼֬ʹਪఆ͢ΔͨΊʹɼωετͨ͠ΫϩεόϦσʔ γϣϯ๏Λಋೖ͠ɼ͜ͷमਖ਼ʹΑΓɼैདྷͷΫϩεόϦσʔγϣϯ๏Ͱࣦഊ͢ΔΑ͏ͳଟ͘ͷྫͰɼ΄ ΅ਖ਼͍͠ΧόϨοδΛ͕࣋ͭ۠ؒಘΒΕΔ͜ͱΛܦݧతʹࣔͨ͠ɽ࠷ޙʹɺզʑͷੳͰɺ୯७ͳσʔ λׂͰ༧ଌਫ਼ͷ৴པ۠ؒΛ࡞͢Δ߹ɺ৴པ͕۠ؒແޮʹͳΔͨΊɺ݁߹͞ΕͨσʔλʹϞσϧΛ ࠶ద߹ͤ͞Δ͖Ͱͳ͍͜ͱ͍ࣔͯ͠Δɻ http://arxiv.org/abs/2104.00673v2 ΧϦϑΥϧχΞେֶόʔΫϨʔߍˍελϯϑΥʔυେֶ ˠΫϩεόϦσʔγϣϯͷվળɻ୯७ͳΫϩεόϦσʔγϣϯͷ༧ଌਫ਼໊ΑΓ ͘ͳͬͯ͠·͏͕͋ͬͨɻωεςουΫϩεόϦσʔγϣϯ /$7 Λಋೖͨ͠ Β͜ͷ͕վળͨ͠ɻ -
ᶆGANcraft:Minecraftϫʔϧυͷڭࢣͳ͠ͷ3DχϡʔϥϧϨϯμϦϯά (ݪจ: GANcraft: Unsupervised 3D Neural Rendering of Minecraft Worlds)
GANcraftɺMinecraftͷΑ͏ͳେنͳ3DϒϩοΫੈքͷϑΥτϦΞϦεςΟοΫͳը૾Λੜ͢Δ ͨΊͷɺڭࢣͳ͠ͷχϡʔϥϧϨϯμϦϯάϑϨʔϜϫʔΫͰ͢ɻ͜ͷख๏ͰɺηϚϯςΟοΫϒ ϩοΫϫʔϧυΛೖྗͱ͠ɺ֤ϒϩοΫʹɺɺਫͳͲͷηϚϯςΟοΫϥϕϧΛ༩͠·͢ɻຊख ๏ͰɼੈքΛ࿈ଓతͳମੵؔͱͯ͠දݱ͠ɼϢʔβ͕ૢ࡞͢ΔΧϝϥʹରͯ͠Ұ؏ੑͷ͋ΔϑΥτ ϦΞϦεςΟοΫͳը૾ΛϨϯμϦϯά͢ΔΑ͏ʹϞσϧΛֶश͠·͢ɽϒϩοΫੈքͷϖΞͱͳΔά ϥϯυτΡϧʔεͷ࣮ը૾͕ͳ͍߹ɺٙࣅάϥϯυτΡϧʔεͱఢରతֶशʹجֶ͍ͮͨशٕज़Λߟ Ҋ͠·ͨ͠ɻ͜ΕɺϏϡʔ߹ͷͨΊͷχϡʔϥϧϨϯμϦϯάʹؔ͢ΔઌߦݚڀͱରরతͰ͢ɻ χϡʔϥϧϨϯμϦϯάͰɺγʔϯͷδΦϝτϦϏϡʔʹґଘ͢ΔΞϐΞϥϯεΛਪఆ͢ΔͨΊ ʹɺάϥϯυτΡϧʔεը૾͕ඞཁͱͳΓ·͢ɻGANcraftͰɺΧϝϥͷيಓʹՃ͑ͯɺγʔϯͷη ϚϯςΟΫεͱग़ྗελΠϧͷ྆ํΛϢʔβʔ੍͕ޚͰ͖·͢ɻڧྗͳϕʔεϥΠϯͱൺֱ࣮ͨ͠ݧ݁ ՌɺϑΥτϦΞϦεςΟοΫͳ3DϒϩοΫϫʔϧυ߹ͱ͍͏৽͍͠λεΫʹର͢ΔGANcraftͷ༗ ޮੑΛ͍ࣔͯ͠·͢ɻ͜ͷϓϩδΣΫτͷΣϒαΠτɺhttps://nvlabs.github.io/GANcraft/ ɻ http://arxiv.org/abs/2104.07659v1 NVIDIA ˠϚΠϯΫϥϑτͷ̏%ߏσʔλ͔Β ෩ܠࣸਅΛੜ͢Δ("/DSBGUΛެ։ͨ͠ -
ᶇStyleCLIP: StyleGANը૾ͷςΩετʹΑΔૢ࡞ํ๏ (ݪจ: StyleCLIP: Text-Driven Manipulation of StyleGAN Imagery) StyleGAN͕༷ʑͳͰඇৗʹϦΞϧͳը૾ΛੜͰ͖Δ͜ͱʹ৮ൃ͞Εɺ࠷ۙͰɺੜ͞Εͨը૾
࣮ͷը૾Λૢ࡞͢ΔͨΊʹStyleGANͷજࡏۭؒΛͲͷΑ͏ʹ༻͢Δ͔Λཧղ͢Δ͜ͱʹଟ͘ͷݚ ڀ͕ूத͍ͯ͠Δɻ͔͠͠ɺҙຯͷ͋Δજࡏతͳૢ࡞Λൃݟ͢ΔͨΊʹɺଟ͘ͷࣗ༝Λਓ͕ؒ୮೦ʹ ௐͨΓɺతͷૢ࡞͝ͱʹը૾ΛूΊͯऍΛ͚ͨΓ͢Δඞཁ͕͋Γ·͢ɻຊݚڀͰɺ࠷ۙಋೖ͞ ΕͨCLIPʢContrastive Language-Image Pre-trainingʣϞσϧΛ׆༻͢Δ͜ͱͰɺ͜ͷΑ͏ͳख࡞ۀΛඞ ཁͱ͠ͳ͍StyleGANը૾ૢ࡞ͷͨΊͷςΩετϕʔεͷΠϯλʔϑΣʔεΛ։ൃ͢Δ͜ͱΛݕ౼͢Δɻ ·ͣɺCLIPϕʔεͷଛࣦΛར༻ͯ͠ɺϢʔβʔ͕ఏڙ͢ΔςΩετϓϩϯϓτʹԠͯ͡ೖྗજࡏϕΫτϧ Λमਖ਼͢Δ࠷దԽεΩʔϜΛհ͠·͢ɻ࣍ʹɺ༩͑ΒΕͨೖྗը૾ʹର͢ΔςΩετ༠ಋͷજࡏతૢ࡞ εςοϓΛਪ͢ΔજࡏతϚούʔʹ͍ͭͯઆ໌͠ɺΑΓߴͰ҆ఆͨ͠ςΩετϕʔεͷૢ࡞ΛՄೳʹ ͠·͢ɻ࠷ޙʹɺςΩετϓϩϯϓτΛStyleGANͷελΠϧۭؒʹ͓͚Δೖྗʹґଘ͠ͳ͍ࢦࣔʹϚο ϐϯά͢Δํ๏Λࣔ͠ɺςΩετʹΑΔΠϯλϥΫςΟϒͳը૾ૢ࡞ΛՄೳʹ͢Δɻൣͳ݁Ռͱൺֱʹ ΑΓɺզʑͷΞϓϩʔνͷ༗ޮੑ͕࣮ূ͞Εͨɻ http://arxiv.org/abs/2103.17249v1 ϔϒϥΠେֶɾςϧΞϏϒେֶɾAdobe Research ˠ$-*1ͱ4UZMF("/ΛΈ߹Θͤͯɺ ςΩετͰը૾ૢ࡞Ͱ͖Δ4UZMF$-*1Λ࡞ͬͨɻ -
ᶈLocalViTɿϏδϣϯτϥϯεϑΥʔϚʔʹҬੑΛ࣋ͨͤΔ (ݪจ: LocalViT: Bringing Locality to Vision Transformers) ຊݚڀͰɺϏδϣϯมثʹҐஔใϝΧχζϜΛಋೖ͢Δํ๏Λݚڀ͢ΔɻมܗثωοτϫʔΫػց༁ʹ ༝དྷ͢ΔͷͰɺಛʹ͍γʔέϯεͷڑґଘؔΛϞσϧԽ͢Δͷʹద͍ͯ͠·͢ɻτʔΫϯΤϯϕσΟ
ϯάؒͷάϩʔόϧͳ૬ޓ࡞༻ɺτϥϯεϑΥʔϚͷࣗݾҙϝΧχζϜʹΑͬͯ͏·͘ϞσϧԽͰ͖·͕͢ɺ ϩʔΧϧͳྖҬͰͷใަͷͨΊͷϩʔΧϦςΟϝΧχζϜ͕ෆ͍ͯ͠·͢ɻ͔͠͠ɺը૾ʹͱͬͯہॴੑ ɺઢɺΤοδɺܗঢ়ɺ͞ΒʹମͳͲͷߏʹؔ͢ΔͨΊɺෆՄܽͰ͢ɻ ຊݚڀͰɺϑΟʔυϑΥϫʔυ ωοτϫʔΫʹਂ͞ํͷΈࠐΈΛಋೖ͢Δ͜ͱͰɺࢹ֮มஔʹہॴੑΛ࣋ͨͤ·͢ɻ͜ͷҰݟ୯७ͳղܾ ࡦɺϑΟʔυϑΥϫʔυωοτϫʔΫͱసͨࠩ͠ϒϩοΫͱͷൺֱ͔ΒணΛಘ͍ͯ·͢ɻہॴੑϝΧχζ Ϝͷॏཁੑɺ2ͭͷํ๏Ͱݕূ͞ΕΔɻ1) ہॴੑϝΧχζϜΛΈࠐΉͨΊʹɼ෯͍ઃܭ্ͷબࢶʢ׆ੑ Խؔɼͷஔɼ֦େʣ͕͋Γɼͯ͢ͷదͳબ͕ϕʔεϥΠϯΑΓੑೳ্ʹͭͳ͕Δ͜ͱɼ2) ಉ͡ ہॴੑϝΧχζϜΛ4ͭͷࢹ֮มثʹద༻͢Δ͜ͱʹޭ͠ɼہॴੑίϯηϓτͷҰൠԽΛࣔͨ͜͠ͱͰ͢ɽಛ ʹɼImageNet2012ͷྨͰɼύϥϝʔλͱܭࢉྔͷ૿ՃΛແࢹͯ͠ɼDeiT-TͱPVT-T͕ϕʔεϥΠϯΛ2.6%ͱ 3.1%্ճΔ݁Ռ͕ಘΒΕ·ͨ͠ɽίʔυɼURL{https://github.com/ofsoundof/LocalViT}Ͱެ։͞Ε͍ͯ·͢ɽ http://arxiv.org/abs/2104.05707v1 νϡʔϦοώՊେֶ, ϧʔϰΣϯɾΧτϦοΫେֶ ˠ7J5ͷվྑɻը૾ͷ࠲ඪใΛͨͤΔΛ 7J5ʹՃͨ͠Βੑೳ͕͕͋ͬͨ -
ᶉΩʔϫʔυτϥϯεϑΥʔϚʔΩʔϫʔυεϙοςΟϯάͷͨΊͷࣗݾݴٴϞ σϧ (ݪจ: Keyword Transformer: A Self-Attention Model for Keyword
Spotting) TransformerͷΞʔΩςΫνϟɺࣗવݴޠॲཧɺίϯϐϡʔλϏδϣϯɺԻೝࣝͳͲɺ͞· ͟·ͳྖҬͰޭΛऩΊ͍ͯ·͢ɻΩʔϫʔυɾεϙοςΟϯάͰɺओʹΈࠐΈΤϯίʔ μʔϦΧϨϯτɾΤϯίʔμʔͷ্ʹࣗݾٵண͕༻͞Ε͖ͯ·ͨ͠ɻຊݚڀͰɺ TransformerΞʔΩςΫνϟΛΩʔϫʔυɾεϙοςΟϯάʹదԠͤ͞ΔͨΊͷ༷ʑͳํ๏Λௐ ࠪ͠ɺࣄલֶशՃσʔλͳ͠ʹෳͷλεΫͰ࠷ઌͷੑೳΛ্ճΔશͳࣗݾҙܕ ΞʔΩςΫνϟͰ͋ΔΩʔϫʔυɾτϥϯεϑΥʔϚʔʢKWTʣΛհ͠·͢ɻڻ͖͘͜ͱ ʹɺ͜ͷγϯϓϧͳΞʔΩςΫνϟɺΈࠐΈɺϦΧϨϯτɺؾΓΛࠞࡏͤͨ͞Α ΓෳࡶͳϞσϧΑΓ༏Ε͍ͯ·͢ɻKWTɺ͜ΕΒͷϞσϧͷସͱͯ͠༻͢Δ͜ͱ͕Ͱ ͖ɺGoogle Speech Commandsσʔληοτʹ͓͍ͯɺ12ݸͷίϚϯυλεΫͰ98.6%ɺ 35ݸͷίϚϯυλεΫͰ97.7%ͷਫ਼ͱ͍͏2ͭͷ৽͍͠ϕϯνϚʔΫهΛୡ͠·ͨ͠ɻ http://arxiv.org/abs/2104.00769v2 Arm ML Reserch Lab, ϧϯυେֶ ˠ5SBOTGPSNFSͰԻೝࣝɻεϚʔτεϐʔΧʔͰΑ͋͘ΔԻ͔Βͷ ΩʔϫʔυೝࣝλεΫΛɺ5SBOTGPSNFSΛͬͨΒߴਫ਼ʹୡͰ͖ͨɻ -
ᶊϚϧνεέʔϧϏδϣϯτϥϯεϑΥʔϚʔ (ݪจ: Multiscale Vision Transformers) զʑɺϚϧνεέʔϧಛ֊ͷਫ਼៛ͳΞΠσΞΛτϥϯεϑΥʔϚʔϞσϧͱ݁ͼ͚ͭΔ͜ͱʹΑ ΓɺϏσΦ͓Αͼը૾ೝࣝͷͨΊͷϚϧνεέʔϧɾϏδϣϯɾτϥϯεϑΥʔϚʔʢMViTʣΛൃද ͢ΔɻϚϧνεέʔϧɾτϥϯεϑΥʔϚʔɼෳͷνϟϯωϧղ૾εέʔϧͷஈ֊Λ࣋ͭɽೖྗ ղ૾ͱখ͞ͳνϟωϧ࣍ݩ͔Βελʔτ֤ͨ͠εςʔδɼۭؒղ૾ΛԼ͛ͳ͕Βνϟωϧ༰ྔΛ ֊తʹ֦େ͍͖ͯ͠·͢ɽ͜ΕʹΑΓɺ୯७ͳϨϕϧͷࢹ֮ใΛϞσϧԽ͢ΔͨΊʹߴ͍ۭؒղ
૾Ͱಈ࡞͢Δॳظͷͱɺۭؒతʹૈ͍͕ෳࡶͳߴ࣍ݩͷಛΛ࣋ͭਂ͍͔ΒͳΔɺಛͷϚϧν εέʔϧɾϐϥϛου͕ܗ͞ΕΔɻզʑɺ༷ʑͳϏσΦೝࣝλεΫʹ͓͍ͯɺࢹ֮৴߸ͷ៛ີͳੑ ࣭ΛϞσϧԽ͢ΔͨΊͷ͜ͷجຊతͳΞʔΩςΫνϟ༏ઌΛධՁͨ͠ͱ͜Ζɺେنͳ֎෦ࣄલֶश ʹґଘ͠ɺܭࢉύϥϝʔλʹ͓͍ͯ5ʙ10ഒͷίετ͕͔͔Δطଘͷࢹ֮มثΑΓ༏Ε͍ͯ·͠ ͨɻ͞Βʹɺ࣌ؒతͳ࣍ݩΛऔΓআ͖ɺը૾ྨʹ͜ͷϞσϧΛద༻ͨ͠ͱ͜Ζɺઌߦ͢Δࢹ֮ม ஔΛ্ճΔ݁Ռ͕ಘΒΕ·ͨ͠ɻίʔυ https://github.com/facebookresearch/SlowFast ͔Βೖख ՄೳͰ͢ɻ http://arxiv.org/abs/2104.11227v1 Facebook AI Research,ΧϦϑΥϧχΞେֶόʔΫϨʔߍ ˠ7J5ͷվྑɻτϥϯεϑΥʔϚʔͷۭؒɾνϟωϧʹ͍ͭͯϚϧνεέʔϧಛ ͷ֊ԽΛͨ͠ΒγϯάϧεέʔϧτϥϯεϑΥʔϚʔΑΓੑೳ্͕ͨ͠ɻ طଘϥΠϒϥϦ1Z4MPX'BTUʹಉػೳΛՃͨ͠ɻ -
ᶋSiT: Self-supervised vIsion Transformer (ݪจ: SiT: Self-supervised vIsion Transformer) ࣗݾڭࢣֶ͖श๏ɺۙɺڭࢣֶ͖शͱͷࠩΛॖΊΔ͜ͱʹޭͨ͜͠ͱ͔ΒɺίϯϐϡʔλϏδϣϯͷͰ·
͢·͢ΛूΊ͍ͯ·͢ɻࣗવݴޠॲཧʢNLPʣͰɺࣗݾڭࢣֶ͖शͱมث͢Ͱʹબ͞Ε͍ͯΔख๏Ͱ͢ɻ ࠷ۙͷจݙʹΑΔͱɺτϥϯεϑΥʔϚʔίϯϐϡʔλϏδϣϯͰਓؾ͕ߴ·͍ͬͯΔΑ͏Ͱ͢ɻ͜Ε·Ͱͷͱ͜ ΖɺϏδϣϯมثɺେنͳڭࢣ͖σʔλΛ༻͍ͯࣄલֶशΛߦ͏͔ɺڭࢣωοτϫʔΫͳͲͷԿΒ͔ͷڞಉڭࢣ Λ༻͍ͯࣄલֶशΛߦ͏ͱɺ͏·͘ػೳ͢Δ͜ͱ͕ࣔ͞Ε͍ͯΔɻ͜ΕΒͷڭࢣ͖ࣄલֶश͞Εͨࢹ֮มثɺ࠷খ ݶͷมߋͰԼྲྀͷλεΫͰඇৗʹྑ͍݁ՌΛಘΔ͜ͱ͕Ͱ͖ΔɻຊݚڀͰɺը૾/ࢹ֮มثΛࣄલֶश͠ɺԼྲྀͷ ྨλεΫʹ༻͢ΔͨΊͷࣗݾڭࢣֶ͖शͷϝϦοτΛௐࠪ͢ΔɻզʑSelf-supervised vIsion Transformers (SiT)Λ ఏҊ͠ɺϓϨςΩετϞσϧΛಘΔͨΊͷ͍͔ͭ͘ͷࣗݾڭࢣֶ͖शϝΧχζϜʹ͍ͭͯٞ͢ΔɻSiTͷΞʔΩςΫ νϟͷॊೈੑʹΑΓɺΦʔτΤϯίʔμʔͱͯ͠༻͢Δ͜ͱ͕Ͱ͖ɺෳͷࣗݾڭࢣ͖λεΫΛγʔϜϨεʹѻ͏͜ ͱ͕Ͱ͖Δɻզʑɺඦສຕͷը૾Ͱͳ͘ઍຕͷը૾Ͱߏ͞ΕΔখنͳσʔληοτʹ͓͍ͯɺࣄલʹֶश͠ ͨSiTΛԼྲྀͷྨλεΫͷͨΊʹඍௐͰ͖Δ͜ͱΛࣔ͢ɻఏҊ͞ΕͨΞϓϩʔνɼҰൠతͳϓϩτίϧΛ༻͍ͨඪ ४తͳσʔληοτͰධՁ͞Εͨɽͦͷ݁Ռɺมثͷڧ͞ͱɺࣗݾڭࢣֶ͖शͷదੑ͕࣮ূ͞Εͨɻզʑɺطଘ ͷࣗݾڭࢣֶ͖श๏ΛେࠩͰ྇կͨ͠ɻ·ͨɺSiT͕γϣοτͷֶशʹద͍ͯ͠Δ͜ͱΛ֬ೝ͠ɺ͞ΒʹɺSiT͔Βֶ शͨ͠ಛྔͷ্ʹઢܗྨثΛֶश͢Δ͚ͩͰɺ༗༻ͳදݱΛֶश͍ͯ͠Δ͜ͱΛࣔ͠·ͨ͠ɻϓϨτϨʔχϯάɺ ϑΝΠϯνϡʔχϯάɺ͓ΑͼධՁίʔυɺhttps://github.com/Sara-Ahmed/SiTɻ http://arxiv.org/abs/2104.03602v1 IEEE ˠ*&&&ʹΑΔࣗݾڭࢣֶ͖ͭश5SBOTGPSNFS4J5ͷൃදɻ -
ᶌϞʔγϣϯɾάϧʔϐϯάʹΑΔࣗݾڭࢣ͖ө૾ΦϒδΣΫτɾηάϝϯ ςʔγϣϯ (ݪจ: Self-supervised Video Object Segmentation by Motion Grouping)
ಈӡಈΛཧղ͢ΔͨΊʹߴػೳͳࢹ֮γεςϜΛਐԽͤ͞ɺෳࡶͳڥԼͰ֮Λॿ͚͍ͯΔɻຊจͰ ɺϞʔγϣϯΩϡʔΛར༻ͯ͠ମΛׂ͢Δ͜ͱ͕Ͱ͖ΔίϯϐϡʔλϏδϣϯγεςϜɺ͢ͳΘͪϞʔ γϣϯηάϝϯςʔγϣϯͷ։ൃʹऔΓΜͰ͍·͢ɻຊจͰɺ࣍ͷΑ͏ͳߩݙΛ͍ͯ͠·͢ɻୈҰʹɺ Transformerͷ؆୯ͳվྑ൛Λಋೖ͠ɺΦϓςΟΧϧϑϩʔϑϨʔϜΛओཁͳΦϒδΣΫτͱഎܠʹׂ͠·͢ɻ ୈೋʹɺ͜ͷΞʔΩςΫνϟΛɺखಈͷΞϊςʔγϣϯΛ༻ͤͣʹɺࣗݾڭࢣ͖Ͱֶश͠·͢ɻୈ3ʹɺզʑ ͷख๏ͷॏཁͳίϯϙʔωϯτΛੳ͠ɺͦͷඞཁੑΛݕূ͢ΔͨΊʹపఈతͳΞϒϨʔγϣϯݚڀΛߦ͍· ͢ɻୈ4ʹɼఏҊͨ͠ΞʔΩςΫνϟΛύϒϦοΫϕϯνϚʔΫʢDAVIS2016ɼSegTrackv2ɼFBMS59ʣͰධՁ ͢ΔɽΦϓςΟΧϧϑϩʔͷΈΛೖྗͱ͍ͯ͠Δʹ͔͔ΘΒͣɼզʑͷΞϓϩʔνɼ͜Ε·Ͱͷ࠷ઌͷࣗ ݾڭࢣ͖ख๏ͱൺֱͯ͠ɼ༏Εͨɼ͋Δ͍ಉͷ݁ՌΛୡ͢Δͱͱʹɼܻҧ͍ʹߴͰ͋Δ͜ͱ͕Θ ͔ͬͨɽ͞Βʹɺқͷߴ͍ΧϞϑϥʔδϡσʔληοτʢMoCAʣΛ༻͍ͯධՁͨ͠ͱ͜Ζɺଞͷࣗݾڭࢣ ͖ΞϓϩʔνΛେ෯ʹ্ճΓɺτοϓͷڭࢣ͖ΞϓϩʔνͱͷൺֱྑͰɺϞʔγϣϯΩϡʔͷॏཁੑ ͱɺطଘͷϏσΦηάϝϯςʔγϣϯϞσϧʹ͓͚Δࢹ֮తͳ֎؍ͷજࡏతͳภΓ͕ڧௐ͞Ε·ͨ͠ɻ http://arxiv.org/abs/2104.07658v1 ΦοΫεϑΥʔυେֶ ˠಈըΛରʹͨࣗ͠ݾڭࢣ͋Γֶशͷݚڀɻಈըͷମͷಈ͖͚ͩΛ ώϯτʹࣗݾڭࢣ͋ΓֶशͰϏσΦσʔλ͔ΒମηάϝϯςʔγϣϯΛ ߦͬͨΒɺٖଶಈͷಈըͰߴɾߴਫ਼Ͱݕग़Ͱ͖ͨɻ -
ᶃ ࠷খݶͷΈΛར༻ͨ͠ΤϯϕοσΟϯά (ݪจ: Minimum-Distortion Embedding) ͜͜ͰɼϕΫτϧຒΊࠐΈΛߟ͑Δɽ༗ݶݸͷΞΠςϜͷू߹͕༩͑ΒΕɼ֤ΞΠςϜʹදతͳϕΫτϧΛׂ ΓͯΔ͜ͱ͕తͰ͋Δɽ͍͔ͭ͘ͷΞΠςϜͷϖΞ͕ྨࣅ͓ͯ͠Γɺҙʹ͍͔ͭ͘ͷଞͷϖΞ͕ඇྨࣅͰ͋Δ͜ ͱΛࣔ͢σʔλ͕༩͑ΒΕ·͢ɻྨࣅͨ͠ΞΠςϜͷϖΞͰɼରԠ͢ΔϕΫτϧ͕ޓ͍ʹۙ͘ʹ͋Δ͜ͱ͕·Εɼ ඇྨࣅͷϖΞͰɼରԠ͢ΔϕΫτϧ͕ޓ͍ʹۙ͘ͳ͍͜ͱ͕·Ε·͢ʢϢʔΫϦουڑͰଌఆ͞Ε·͢ʣɽզʑ ɺΞΠςϜͷ͍͔ͭ͘ͷϖΞʹ͍ͭͯఆٛ͞ΕͨΈؔΛಋೖ͢Δ͜ͱʹΑͬͯɺ͜ΕΛެࣜԽ͠·͢ɻզʑͷ
తɺ੍݅ͷͱͰɺશମͷΈΛ࠷খʹ͢ΔຒΊࠐΈΛબͿ͜ͱͰ͋Δɻ͜ΕΛɺ࠷খΈຒΊࠐΈʢMDEʣ ͱݺͿɻ MDEͷϑϨʔϜϫʔΫ୯७Ͱ͕͢ɺҰൠతͰ͢ɻMDEʹɺεϖΫτϧຒΊࠐΈɺओੳɺଟ࣍ݩ εέʔϦϯάɺIsomapUMAPͷΑ͏ͳ࣍ݩݮ๏ɺྗͤͷϨΠΞτͳͲɺ͞·͟·ͳຒΊࠐΈํ๏ؚ͕·Ε͍ͯ ·͢ɻ·ͨɺ৽͍͠ຒΊࠐΈ๏ؚ·Ε͓ͯΓɺྺ࢙తͳຒΊࠐΈ๏ͱ৽͍͠ຒΊࠐΈ๏Λಉ༷ʹݕূ͢Δݪཧతͳํ ๏Λఏڙ͍ͯ͠·͢ɻ MDEͷΛۙࣅతʹղܾ͠ɺେنͳσʔληοτʹରԠ͢ΔӨܕ४χϡʔτϯ๏Λ։ൃ ͠·ͨ͠ɻ͜ͷख๏ɺΦʔϓϯιʔεͷPythonύοέʔδͰ͋ΔPyMDEʹ࣮͞Ε͍ͯ·͢ɻPyMDEͰɺϢʔβ Έؔͱ੍ͷϥΠϒϥϦ͔Βબͨ͠ΓɺΧελϜͷͷΛࢦఆͨ͠Γ͢Δ͜ͱ͕Ͱ͖ɺ༷ʑͳຒΊࠐΈΛ؆୯ʹ ࢼ͢͜ͱ͕Ͱ͖·͢ɻ͜ͷιϑτΣΞɺඦສͷΞΠςϜͱઍສͷΈؔΛ࣋ͭσʔληοτʹରԠ͍ͯ͠· ͢ɻզʑͷख๏Λ࣮ূ͢ΔͨΊʹɼը૾ɼֶज़తͳڞஶऀωοτϫʔΫɼถࠃͷ܊ͷਓޱ౷ܭσʔλɼ୯Ұࡉ๔ͷ mRNAτϥϯεΫϦϓτʔϜͳͲɼ͍͔ͭ͘ͷ࣮ੈքͷσʔληοτͷຒΊࠐΈΛܭࢉͨ͠ɽ http://arxiv.org/abs/2103.02559v2 ελϯϑΥʔυେֶ ˠ$POUSBTUJWF-FBSOJOHʹؔ࿈͢Δجૅݚڀɻू߹ͷཁૉ͝ͱͷྨࣅΛϕΫτϧͰදݱ͢ΔΞϧΰϦζϜ ͷҰൠԽɾެࣜԽͱɺϑϨʔϜϫʔΫ1Z.%&ͷհ -
ᶅRepVGG: VGGελΠϧͷConvNetsΛ࠶ͼૉΒ͘͢͠Δ (ݪจ: RepVGG: Making VGG-style ConvNets Great Again) ΈࠐΈχϡʔϥϧωοτϫʔΫͷγϯϓϧͰڧྗͳΞʔΩςΫνϟΛఏҊ͢Δɻ͜ͷΞʔ
ΩςΫνϟɺ3x3ΈࠐΈͱReLUͷελοΫ͚ͩͰߏ͞ΕͨVGGͷΑ͏ͳਪ࣌ͷϘ σΟΛ࣋ͪɺτϨʔχϯά࣌ͷϞσϧଟࢬͷτϙϩδʔΛ࣋ͭɻ͜ͷΑ͏ͳֶश࣌ͱਪ ࣌ͷΞʔΩςΫνϟͷΓ͠ɺߏతͳ࠶ύϥϝʔλԽٕज़ʹΑ࣮ͬͯݱ͞Ε͓ͯΓɺ ͜ͷϞσϧRepVGGͱ໊͚ΒΕ͍ͯ·͢ɻImageNetʹ͓͍ͯɺRepVGG80%Ҏ্ͷ τοϓ1ਫ਼Λୡ͓ͯ͠Γɺ͜ΕզʑͷΔݶΓɺϓϨʔϯϞσϧͱͯ͠ॳΊͯͷ͜ͱ Ͱ͢ɻNVIDIA 1080Ti GPU্ͰɺRepVGGϞσϧɺResNet-50ΑΓ83ˋɺResNet-101 ΑΓ101ˋߴʹಈ࡞͠ɺߴਫ਼ͰɺEf fi cientNetRegNetͳͲͷ࠷ઌϞσϧͱൺֱ͠ ͯɺྑͳਫ਼-τϨʔυΦϑΛ͍ࣔͯ͠·͢ɻ ίʔυͱֶशࡁΈϞσϧɺhttps:// github.com/megvii-model/RepVGGɻ http://arxiv.org/abs/2101.03697v3 ਗ਼՚େֶ, Megvii, ߳ߓՊٕେֶ ˠ7((ͷվྑɻࠓͲ͖ͷϞσϧ'-01ίετ͕ߴ͗ͨ͢ΓඞཁҎ্ʹෳ ࡶͳͷͰɺ7((Λվྑͯ͠࠷ઌϞσϧฒΈͷੑೳʹͯ͠Έͨɻ -
ᶆੜֶͱҩֶʹ͓͚ΔωοτϫʔΫͷͨΊͷදݱֶशɻ ਐาɺઓɺͦͯ͠ػձ (ݪจ: Representation Learning for Networks in Biology and
Medicine: Advancements, Challenges, and Opportunities) දݱֶश͕ڧྗͳ༧ଌͱσʔλͷಎΛఏڙ͢Δ͜ͱʹޭͨ͜͠ͱͰɺදݱֶशٕज़ ωοτϫʔΫͷϞσϦϯάɺੳɺֶशͱٸʹ֦େ͍ͯ͠·͢ɻੜҩֶωοτϫʔΫ ɺλϯύΫ࣭ͷ૬ޓ࡞༻͔Β࣬පωοτϫʔΫɺ͞ΒʹҩྍγεςϜՊֶతࣝʹࢸ Δ·Ͱɺ૬ޓ࡞༻͢ΔཁૉͷγεςϜΛද͢ීวతͳهड़Ͱ͋Δɻ͜ͷϨϏϡʔͰɺωο τϫʔΫੜֶͱҩֶͷʹΘͨΔݪଇ͕ɺػցֶशͷݚڀͰޠΒΕͳ͍͜ͱ͕ଟ͍ ͕ɺදݱֶशͷ֓೦తͳج൫Λఏڙ͠ɺݱࡏͷޭͱݶքΛઆ໌͠ɺকདྷͷਐาʹཱͯΔ ͜ͱ͕Ͱ͖Δͱ͍͏ݟղΛ͍ࣔͯ͠ΔɻຊจͰɺωοτϫʔΫΛίϯύΫτͳϕΫτϧ ۭؒʹຒΊࠐΉͨΊʹҐ૬తͳಛΛར༻͢Δ͜ͱΛ֩ͱͨ͠ɺ͞·͟·ͳΞϧΰϦζϜͷ ΞϓϩʔνΛ·ͱΊ͍ͯΔɻ·ͨɺΞϧΰϦζϜͷֵ৽͔Β࠷ԸܙΛड͚ΔՄೳੑͷߴ͍ ੜҩֶͷྨ๏Λఏڙ͠·͢ɻදݱֶशٕज़ɺෳࡶͳܗ࣭ͷࠜఈʹ͋ΔҼՌؔΛ ಛఆͨ͠Γɺ୯Ұࡉ๔ͷߦಈͱ݈߁ͷӨڹΛͨ͠Γɺ҆શͰޮՌతͳҩༀͰපؾΛ அɾ࣏ྍͨ͠Γ͢ΔͨΊʹෆՄܽͳͷͱͳ͍ͬͯΔɻ http://arxiv.org/abs/2104.04883v1 ϋʔόʔυେֶҩֶେֶӃ ˠੜֶͱҩֶͰͷάϥϑදݱֶशʹ͍ͭͯͷϨϏϡʔ -
ᶈଟ༷ͳΞϐΞϥϯευϝΠϯͱλεΫλΠϓؒͷτϥϯεϑΝʔϥʔχϯάʹ ӨڹΛ༩͑ΔཁҼ (ݪจ: Factors of In fl uence for Transfer
Learning across Diverse Appearance Domains and Task Types) సҠֶशͱɺݩͱͳΔλεΫͰֶशͨࣝ͠ΛɺରͱͳΔλεΫͷֶशʹ࠶ར༻͢Δ͜ͱͰ͢ɻ ILSVRCσʔληοτΛ༻͍ͯը૾ྨϞσϧΛࣄલʹֶश͠ɺͦͷޙɺҙͷλʔήοτλεΫͰඍௐ Λߦ͏ͱ͍ͬͨ୯७ͳܗͷసҠֶशɺݱࡏͷ࠷ઌͷίϯϐϡʔλϏδϣϯϞσϧͰҰൠతʹߦΘ Ε͍ͯΔɻ͔͠͠ɺ͜Ε·Ͱͷୡֶशʹؔ͢ΔମܥతͳݚڀݶΒΕ͓ͯΓɺୡֶश͕ͲͷΑ͏ͳঢ় گͰػೳ͢Δ͜ͱ͕ظ͞ΕΔͷ͔ɺेʹཧղ͞Ε͍ͯͳ͍ɻຊจͰɺඇৗʹҟͳΔը૾υϝΠϯ ʢফඅऀͷࣸਅɺࣗߦɺߤۭࣸਅɺਫதɺγʔϯɺ߹ɺΫϩʔζΞοϓʣͱλεΫλΠϓʢη ϚϯςΟοΫηάϝϯςʔγϣϯɺΦϒδΣΫτݕग़ɺਂਪఆɺΩʔϙΠϯτݕग़ʣΛରʹɺసҠֶ शͷൣͳ࣮ݧతௐࠪΛ࣮ࢪ͠·ͨ͠ɻॏཁͳͷɺ͜ΕΒͷλεΫͯ͢ɺݱͷίϯϐϡʔλϏ δϣϯΞϓϦέʔγϣϯʹؔ࿈͢ΔɺෳࡶͰߏԽ͞Εͨग़ྗλεΫͰ͋Δͱ͍͏͜ͱͰ͢ɻ߹ܭͰ 1200Ҏ্ͷసૹ࣮ݧΛߦ͍·ͨ͠ɻͦͷதʹɺιʔεͱλʔήοτ͕ҟͳΔը૾υϝΠϯɺλεΫλ Πϓɺ·ͨͦͷ྆ํ͔Βߏ͞Ε͍ͯΔͷଟؚ͘·Ε͍ͯ·͢ɻ͜ΕΒͷ࣮ݧΛମܥతʹੳ͠ɺ ը૾υϝΠϯɺλεΫλΠϓɺσʔληοτͷαΠζ͕ୡֶशͷύϑΥʔϚϯεʹ༩͑ΔӨڹΛཧղ͠ ·͢ɻ͜ͷݚڀʹΑΓɺ͍͔ͭ͘ͷಎ͕ಘΒΕɺ࣮ऀͷ۩ମతͳఏҊʹͭͳ͕Γ·ͨ͠ɻ http://arxiv.org/abs/2103.13318v1 Google Research ˠը૾υϝΠϯͷసҠֶशͷௐࠪจ -
ᶃͲͷσʔληοτͰࣄલֶशͯ͠ɺ ᶄ Ͳ ͷ σ λ η τ ʹ స
Ҡ ֶ श ͠ ͨ ͔ ʁ -
ཁ • ը૾υϝΠϯ͕Ұ൪ॏཁɻ࠷ྑͷ݁ՌΛಘΔͨΊʹಉ͡ը૾ υϝΠϯΛؚΉλεΫ͔ΒͷసҠֶशʹ͖͢ • ಉ͡υϝΠϯͰͳͯ͘ɺ͍υϝΠϯ͔ΒͷసҠֶशෛͷ ޮՌຆͲͳ͍ɻେنσʔληοτΛ͓͚ͬͯେମେৎ ͕ͩޮՌ͕ͳ͍͜ͱ͋Δɻ(ྫ: COCO͔ΒͷసҠֶशશൠ) •
సҠݩɾసҠઌͷλεΫλΠϓͷؔʹΑͬͯɺλεΫλΠ ϓΛ͑ͨୡ͕༗ӹͳ͜ͱ͋Δɻ(ྫ:Driving → Aerial, Consumer → Indoor) -
ᶉͳͥہॴ๏Ͱඇತ͕ղ͚Δͷ͔ʁ (ݪจ: Why Do Local Methods Solve Nonconvex Problems?) ݱͷػցֶशͰɺඇತ࠷దԽ͕͍ͨΔͱ͜ΖͰߦΘΕ͍ͯ·͢ɻݚڀऀ
ඇತͷతؔΛߟҊ͠ɺہॴతͳܗঢ়Λར༻ͯ͠෮తʹߋ৽͢Δ֬తޯ ߱Լ๏ͦͷѥछͳͲͷࢢൢͷΦϓςΟϚΠβʔΛ༻͍ͯ࠷దԽ͠·͢ɻඇ ತؔͷղ๏࠷ѱͷ߹NPϋʔυͰ͋Δʹ͔͔ΘΒͣɺ࣮ࡍʹ࠷దԽͷ ࣭ʹͳΒͳ͍͜ͱ͕ଟ͍ɻΦϓςΟϚΠβʔۙࣅతʹάϩʔόϧϛχ ϚϜΛݟ͚ͭΔͱߟ͑ΒΕ͍ͯΔ͔Βͩɻݚڀऀͨͪɺ͜ͷڵຯਂ͍ݱΛ ౷Ұతʹઆ໌͢ΔԾઆΛཱͯ·ͨ͠ɻͦΕɺ࣮ࡍʹ༻͞Ε͍ͯΔతͷ΄ ͱΜͲͷϩʔΧϧϛχϚϜ͕ɺۙࣅతͳάϩʔόϧϛχϚϜͰ͋Δͱ͍͏ͷ Ͱ͢ɻຊݚڀͰɺ͜ͷԾઆΛػցֶशͷ۩ମతͳࣄྫʹରͯ͠ݫີʹܗ ࣜԽ͍ͯ͠·͢ɻ http://arxiv.org/abs/2103.13462v1 ελϯϑΥʔυେֶ ˠ0QUJNJ[FSΛͬͯͳֶͥश͕࠷దԽͰ͖͍ͯΔͷ͔ͷݚڀ -
ᶊϘʔυήʔϜʹΑΔεέʔϦϯάͷ๏ଇ (ݪจ: Scaling Scaling Laws with Board Games) ػցֶशͷେنͳ࣮ݧʹɺҰ෦ͷػؔΛআ͍ͯɺ༧ࢉΛΔ͔ʹ͑ΔϦ ιʔε͕ඞཁʹͳΓ·͢ɻ͍ͳ͜ͱʹɺ͜ͷΑ͏ͳେنͳ࣮ݧͷ݁Ռɺ
Δ͔ʹখنͰ҆ՁͳҰ࿈ͷ࣮ݧͷ݁Ռ͔ΒਪఆͰ͖Δ߹͕ଟ͍͜ͱ͕࠷ ۙ໌Β͔ʹͳΓ·ͨ͠ɻຊݚڀͰɺϞσϧͷେ͖͚ͩ͞Ͱͳ͘ɺͷେ͖ ͞ʹج͍ͮͯਪఆͰ͖Δ͜ͱΛ͍ࣔͯ͠·͢ɻAlphaZeroͱHexΛͬͯҰ࿈ ͷ࣮ݧΛߦ͏͜ͱͰɺҰఆͷܭࢉྔͰୡͰ͖Δੑೳ͕ɺήʔϜͷن͕େ͖ ͘ͳͬͯ͘͠ͳΔʹͭΕͯ༧ଌՄೳʹԼ͢Δ͜ͱΛࣔ͠·ͨ͠ɻ·ͨɺओ ͳ݁Ռͱͯ͠ɺΤʔδΣϯτ͕ར༻ՄೳͳςετλΠϜͱτϨʔχϯάλΠϜ ͷܭࢉྔɺੑೳΛҡ࣋͠ͳ͕ΒτϨʔυΦϑͰ͖Δ͜ͱΛ͍ࣔͯ͠·͢ɻ http://arxiv.org/abs/2104.03113v2 Andy Jones (ϩϯυϯ) ˠݱ࣮ࣾձʹػցֶशΛద༻͢Δ࣌ͷίετݟੵΓʹཱͭݚڀɻ"MQIB;FSP ͱ)FYΛྫʹͯ͠ϘʔυήʔϜͷ"*ΞϧΰϦζϜͷݚڀΛͨ͠ɻٻΊΔੑೳɾ ͷେ͖͞ʹΑͬͯɺֶशίετɾܭࢉίετ͕Ͳ͏มΘΔ͔Λ·ͱΊͨɻ -
ᶋDense PredictionΛՄೳʹ͢ΔϏδϣϯτϥϯεϑΥʔϚʔ (ݪจ: Vision Transformers for Dense Prediction) ີͳ༧ଌλεΫͷόοΫϘʔϯͱͯ͠ɺΈࠐΈωοτϫʔΫͷΘΓʹࢹ֮มثΛ׆༻͢ΔΞʔΩςΫ νϟͰ͋Δʮີͳࢹ֮มثʯΛհ͠·͢ɻࢹ֮มثͷ༷ʑͳஈ֊ͰಘΒΕͨτʔΫϯΛ༷ʑͳղ૾ͷ
ը૾ͷΑ͏ͳදݱʹΈཱͯɺΈࠐΈσίʔμΛ༻͍ͯϑϧղ૾ͷ༧ଌʹஈ֊తʹ݁߹͠·͢ɻมثͷ όοΫϘʔϯɺҰఆͷൺֱతߴ͍ղ૾ͰදݱΛॲཧ͠ɺͯ͢ͷஈ֊Ͱάϩʔόϧͳड༰Λ͍࣋ͬͯ· ͢ɻ͜ΕΒͷಛੑʹΑΓɺ͜ͷߴີϏδϣϯมثɺશͳΈࠐΈωοτϫʔΫͱൺֱͯ͠ɺΑΓ͖Ί ࡉ͔͘ɺΑΓάϩʔόϧʹҰ؏ͨ͠༧ଌΛߦ͏͜ͱ͕Ͱ͖·͢ɻզʑͷ࣮ݧʹΑΔͱɺ͜ͷΞʔΩςΫνϟ ɺಛʹେྔͷֶशσʔλ͕ར༻Մೳͳ߹ɺີͳ༧ଌλεΫʹ͓͍ͯେ෯ͳվળΛͨΒ͢ɻ୯؟ͷਂਪ ఆͰɼ࠷ઌͷશΈࠐΈωοτϫʔΫͱൺֱͯ͠ɼ૬ରతͳੑೳ͕࠷େͰ28%্ͨ͜͠ͱ͕֬ೝ͞Ε ͨɽ·ͨɺηϚϯςΟοΫηάϝϯςʔγϣϯʹద༻ͨ͠ͱ͜Ζɺີͷߴ͍ϏδϣϯมɺADE20Kʹ͓ ͍ͯ49.02%ͷmIoUΛୡ͠ɺ৽ͨͳٕज़ਫ४Λཱ֬͠·ͨ͠ɻ͞ΒʹɺNYUv2ɺKITTIɺPascal ContextͳͲ ͷখنͳσʔληοτʹ͓͍ͯɺΞʔΩςΫνϟͷඍௐ͕ՄೳͰ͋Δ͜ͱΛ͓ࣔͯ͠Γɺ͜͜Ͱ৽ͨ ͳٕज़ਫ४Λཱ͍֬ͯ͠·͢ɻզʑͷϞσϧɺhttps://github.com/intel-isl/DPTɻ http://arxiv.org/abs/2103.13413v1 Intel Labs ˠ7J5ͰηϚϯςΟοΫηάϝϯςʔγϣϯɻ ྫͱͯ͠ɺ୯؟ࣸਅͷਂਪఆɾηάϝϯςʔγϣϯͰ݁Ռʹͳͬͨɻ