顔認証・顔識別周りのサーベイ

Transcript

1. ٢ా ৻ଠ࿠
   إೝূɾإࣝผपΓͷαʔϕΠ
   EAGLYSגࣜձࣾ AI ษڧձ (2021/02/12 Fri)
   

   View Slide

2. ࠓ೔ͷѻ͏಺༰
   • DeepFakeͷ໰୊
   
   • 2014Ҏ߱ͷ஫໨࿦จ

   DeepFace, FaceNet, ArcFace
   
   • ະղܾͷ՝୊
   
   • ࣮૷
   

   View Slide

3. DeepFake
   • DeepFakeΛ༻͍ͨੈքॳͷ࠮ٗ

   ΠΪϦεͷΤωϧΪʔձ͕ࣾ

   ਌ձࣾͷϘε͔Βͷి࿩Ͱ໿2400ສԁΛϋϯΨϦʔͷձࣾʹৼΓࠐΉ 

   https://www.forbes.com/sites/jessedamiani/2019/09/03/a-voice-deepfake-
   was-used-to-scam-a-ceo-out-of-243000/?sh=3984a3802241
   
   • Joe Roganͷ੠ΛDeep FakeͰ࡞੒

   (Χφμͷ Dessaͱ͍͏AIձࣾ) 

   https://www.youtube.com/watch?v=DWK_iYBl8cA
   

   View Slide

4. إೝূͱإࣝผͷҧ͍
   • Face Identi
   fi
   cation إࣝผ 

   1 ର ଟͷྨࣅ౓൑ఆ 

   Ex) Google Photo΍Facebookͷը૾಺ͷਓΛಛఆɾਪન
   
   • Face Veri
   fi
   cation إೝূ 

   1 ର 1ͷྨࣅ౓൑ఆ 

   Ex) iPhone 8Ҏ߱ʹಋೖ͞Εͨإೝূٕज़
   

   View Slide

5. إೝূͱσʔληοτ
   • Face Identi
   fi
   cation إࣝผ 

   1 ର ଟͷྨࣅ౓൑ఆ 

   Ex) Google Photo΍Facebookͷը૾಺ͷਓΛಛఆɾਪન
   
   • Face Veri
   fi
   cation إೝূ 

   1 ର 1ͷྨࣅ౓൑ఆ 

   Ex) iPhone 8Ҏ߱ʹಋೖ͞Εͨإೝূٕज़
   

   View Slide

6. إೝূٕज़ͷਐԽ
   

   View Slide

7. إೝূٕज़ͷਐԽ
   ࠓ೔͸ίί!!
   

   View Slide

8. ϞσϧͱLossͷਐԽ
   

   View Slide

9. DeepFace(2014)
   • DNN ϕʔεͷॳΊͯͷإೝূϞσϧ 

   1.2ԯݸͷύϥϝʔλ
   
   • 2D Aligned ը૾͚ͩͰͳ͘ɺ

   3D Aligned ը૾΋࢖༻
   

   View Slide

10. DeepFace(2014)
    • ֶशͷࡍʹ͸ɺ෼ྨ໰୊(Cross Entropy Loss, 4030 Class, SFC Dataset)
    
    • ධՁͷࡍʹ͸ɺLFWσʔληοτͷશͯͷPairʹSVMͰ2Ϋϥε෼ྨ

    (Face Veri
    fi
    cationͷͨΊ)
    

    View Slide

11. DeepFace(2014)
    • ಛ௃ྔϕʔεͱൺ΂ͯ1%ͷੑೳ޲্
    
    • ධՁ͢Δσʔλ͕ෆۉߧσʔλͷͨΊɺROCۂઢͰ΋ධՁ
    

    View Slide

12. FaceNet (2015)
    • ௚઀ɺإࣝผ༻ͷϢʔΫϦουۭؒʹಛ௃ྔΛׂΓ౰ͯ
    
    • Triplet LossΛ࢖༻
    
    • ࣮ࡍʹ͸ɺHardest PositiveͰ͸ͳ͘ɺશϖΞͷ૊Έ߹ΘͤΛ༻͍͍ͯΔ

    Better Convergence
    

    View Slide

13. FaceNet (2015)
    • 1ͭ໨ͷ݁Ռ : ϕʔεϥΠϯͷൺֱ
    
    • 2ͭ໨ͷ݁Ռ : LFWσʔληοτͰSOTA
    

    View Slide

14. FaceNet (2015)
    • ਪ࿦ͷྲྀΕ
    FaceNet
    L2Norm
    160x160

    ը૾A
    512D

    Feature
    FaceNet
    160x160

    ը૾B
    512D

    Feature
    1.3
    

    View Slide

15. FaceNet (2015)
    https://colab.research.google.com/drive/
    1ZE3_ejPorSjw-6AJazd81CwaYxQT3npz?usp=sharing
    ࣮૷
    

    View Slide

16. ArcFace (2015)
    • Softmax ؔ਺ + Cross Entropy͸

    ಉ͡ը૾ؒͷڑ཭Λখ͘͞ɺ

    ҟͳΔը૾ؒͷڑ཭Λେ͖͘͢Δ

    Α͏ʹઃܭ͞Ε͍ͯͳ͍ 

    

    

    View Slide

17. ArcFace (2015)
    • https://
    colab.research.
    google.com/
    drive/
    1sFegHygowW
    eSzgSak_Zw1q
    2HNTx9T96s?
    usp=sharing 

    

    

    View Slide

18. ݱঢ়Α͘࢖ΘΕΔσʔληοτ
    • LFW 

    6000ਓͰ1ສຕ
    
    • VGGFace2 

    Celebͷࣸਅ

    Crop Bounding Box෇͖ 

    ެ։͞Ε͍͕ͯͨɺ࡟আ 

    VGG FaceͷΈ࢖༻Մೳ
    
    • MS-Celeb-1M 

    69ສͷਓؒ 500ສຕ 

    Ұൠͷਓ΋͓ࣸͬͯΓݱࡏඇެ։
    

    View Slide

19. ݱঢ়ͷσʔληοτͷ໰୊఺ 1
    • (1) Cross-Pose Face Recogntion 

    ਖ਼໘Λ޲͍ͨը૾͕গͳ͍
    
    • (2) Cross-Age Face Recognition

    ܦ೥มԽ 

    ೥ྸΛߟྀͨ͠σʔληοτ͕࡞੒
    
    • (3) Makeup Face Recognition 

    ϝʔΫΛ͢Δͱ൑ఆ͕೉͍͠
    
    • (4) NIR-VIC Face Recognition 

    ҉͍γʔϯͰͷFRͷ໰୊
    

    View Slide

20. ݱঢ়ͷσʔληοτͷ໰୊఺ 2
    • (5) Low-Resolution Face Recognition 

    ը࣭͕௿͍ͱ೉͍͠
    
    • (6) Photo-Sketch Face Recognition
    
    • (7) Low-Shot Face Recognition

    ࣮༻্ɺগͳ͍σʔλͰإࣝผΛ͢Δඞཁ͕͋Δ
    
    • (8) Set/Template Based Face Recognition 

    ը૾ͱಈըͷू߹Λѻ͏
    
    • (9) Video Face Recognition

    ಈըͰͷԠ༻͸೉͍͠
    

    View Slide

21. ݱঢ়ͷσʔληοτͷ໰୊఺ 3
    • (10) 3D Face Recognition
    
    • (11) Partial Face Recognition 

    إͷҰ෦ͷΈ༩͑ΒΕ͍ͯΔ࣌
    
    • (12) Face Anti-Spoo
    fi
    ng 

    ଟछଟ༷ͳAttackʹରԠ͠ͳ͍ͱ͍͚ͳ͍
    
    • (13) Face Recognition for Mobile Device 

    ϞόΠϧͰFRͰ͖Δ͔Ͳ͏͔
    

    View Slide

22. ࠷ޙʹ
    ௕͍͓ؒੈ࿩ʹͳΓ·ͨ͠ɻ
    

    View Slide