Share
Embed
Transcript
28 slides
-
Top Recent in Last Year 1. Transformers in Vision: A
Survey 2. The Modern Mathematics of Deep Learning 3. High-Performance Large-Scale Image Recognition Without Normalization 4. Cross-validation: what does it estimate and how well does it do it? 5. How to avoid machine learning pitfalls: a guide for academic researchers 6. How to represent part-whole hierarchies in a neural network 7. Point Transformer 8. Every Model Learned by Gradient Descent Is Approximately a Kernel Machine 9. Switch Transformers: Scaling to Trillion Parameter Models with Simple and E ff i cient Sparsity 10.A Survey on Vision Transformer -
Top Recent in Last Year 1. Transformers in Vision: A
Survey 2. The Modern Mathematics of Deep Learning 3. High-Performance Large-Scale Image Recognition Without Normalization 4. Cross-validation: what does it estimate and how well does it do it? 5. How to avoid machine learning pitfalls: a guide for academic researchers 6. How to represent part-whole hierarchies in a neural network 7. Point Transformer 8. Every Model Learned by Gradient Descent Is Approximately a Kernel Machine 9. Switch Transformers: Scaling to Trillion Parameter Models with Simple and E ff i cient Sparsity 10.A Survey on Vision Transformer ษڧձͰѻͬͨจ -
Top Recent in Last Year 1. Transformers in Vision: A
Survey 2. The Modern Mathematics of Deep Learning 3. High-Performance Large-Scale Image Recognition Without Normalization 4. Cross-validation: what does it estimate and how well does it do it? 5. How to avoid machine learning pitfalls: a guide for academic researchers 6. How to represent part-whole hierarchies in a neural network 7. Point Transformer 8. Every Model Learned by Gradient Descent Is Approximately a Kernel Machine 9. Switch Transformers: Scaling to Trillion Parameter Models with Simple and E ff i cient Sparsity 10.A Survey on Vision Transformer ᶃTransformerͷը૾ͷԠ༻ͷReview -
Top Recent in Last Year 1. Transformers in Vision: A
Survey 2. The Modern Mathematics of Deep Learning 3. High-Performance Large-Scale Image Recognition Without Normalization 4. Cross-validation: what does it estimate and how well does it do it? 5. How to avoid machine learning pitfalls: a guide for academic researchers 6. How to represent part-whole hierarchies in a neural network 7. Point Transformer 8. Every Model Learned by Gradient Descent Is Approximately a Kernel Machine 9. Switch Transformers: Scaling to Trillion Parameter Models with Simple and E ff i cient Sparsity 10.A Survey on Vision Transformer ᶄBNͳ͠ͰEf fi cientNet͑ͨ࠷ઌϞσϧ -
Top Recent in Last Year 1. Transformers in Vision: A
Survey 2. The Modern Mathematics of Deep Learning 3. High-Performance Large-Scale Image Recognition Without Normalization 4. Cross-validation: what does it estimate and how well does it do it? 5. How to avoid machine learning pitfalls: a guide for academic researchers 6. How to represent part-whole hierarchies in a neural network 7. Point Transformer 8. Every Model Learned by Gradient Descent Is Approximately a Kernel Machine 9. Switch Transformers: Scaling to Trillion Parameter Models with Simple and E fi cientNet͑ͨ࠷ઌϞσϧ E ffi cientNetV2: Smaller Models and Faster Training ᶄ͞ΒʹͦΕΛ͑ͨEf fi cientNetV2 -
Top Recent in Last Year 1. Transformers in Vision: A
Survey 2. The Modern Mathematics of Deep Learning 3. High-Performance Large-Scale Image Recognition Without Normalization 4. Cross-validation: what does it estimate and how well does it do it? 5. How to avoid machine learning pitfalls: a guide for academic researchers 6. How to represent part-whole hierarchies in a neural network 7. Point Transformer 8. Every Model Learned by Gradient Descent Is Approximately a Kernel Machine 9. Switch Transformers: Scaling to Trillion Parameter Models with Simple and E ff i cient Sparsity 10.A Survey on Vision Transformer ᶅجຊ: ॳ৺ऀ/ݚڀऀ͚ -
Top Recent in Last Year 1. Transformers in Vision: A
Survey 2. The Modern Mathematics of Deep Learning 3. High-Performance Large-Scale Image Recognition Without Normalization 4. Cross-validation: what does it estimate and how well does it do it? 5. How to avoid machine learning pitfalls: a guide for academic researchers 6. How to represent part-whole hierarchies in a neural network 7. Point Transformer 8. Every Model Learned by Gradient Descent Is Approximately a Kernel Machine 9. Switch Transformers: Scaling to Trillion Parameter Models with Simple and E ff i cient Sparsity 10.A Survey on Vision Transformer ɾώϯτϯڭतͷϞσϧͷσβΠϯఏএͷPaper -
Top Recent in Last Year 1. Transformers in Vision: A
Survey 2. The Modern Mathematics of Deep Learning 3. High-Performance Large-Scale Image Recognition Without Normalization 4. Cross-validation: what does it estimate and how well does it do it? 5. How to avoid machine learning pitfalls: a guide for academic researchers 6. How to represent part-whole hierarchies in a neural network 7. Point Transformer 8. Every Model Learned by Gradient Descent Is Approximately a Kernel Machine 9. Switch Transformers: Scaling to Trillion Parameter Models with Simple and E ff i cient Sparsity 10.A Survey on Vision Transformer ɾޯ߱Լ๏Ͱͷಛநग़Χʔωϧ๏ͱࣅ͍ͯΔ -
Mobile-Forme r Bridging MobileNet and Transformer MobileVi T Light-weight, General-purpose,
and Mobile-friendly Vision Transformer Microsoft Apple -
Review of Transformers for Vision CCNet(Criss-cross Attention) Stand-alone Self-Attention Local
Relation Networks Attention Augmented Convolutional Networks Vectorized Self-Attention ViT(Vision Transformer) DeiT(Data-e ffi cient image Transformer) Classi fi cation Detection DETR(Detection Transformer) D-DETR(Deformable-DETR) Axial-attention for Panoptic Segmentation CMSA(Cross-modal Self-Attention) Segmentation Image generation iGPT(image GPT) Image Transformer High-resolution Image Synthesis SceneFormer Super resolution TTSR