Upgrade to Pro — share decks privately, control downloads, hide ads and more …

顔認証・顔識別周りのサーベイ

 顔認証・顔識別周りのサーベイ

吉田 慎太郎 @微分

March 02, 2021
Tweet

Transcript

  1. ٢ా ৻ଠ࿠ إೝূɾإࣝผपΓͷαʔϕΠ EAGLYSגࣜձࣾ AI ษڧձ (2021/02/12 Fri)

  2. ࠓ೔ͷѻ͏಺༰ • DeepFakeͷ໰୊ • 2014Ҏ߱ͷ஫໨࿦จ
 DeepFace, FaceNet, ArcFace • ະղܾͷ՝୊

    • ࣮૷
  3. DeepFake • DeepFakeΛ༻͍ͨੈքॳͷ࠮ٗ
 ΠΪϦεͷΤωϧΪʔձ͕ࣾ
 ਌ձࣾͷϘε͔Βͷి࿩Ͱ໿2400ສԁΛϋϯΨϦʔͷձࣾʹৼΓࠐΉ 
 https://www.forbes.com/sites/jessedamiani/2019/09/03/a-voice-deepfake- was-used-to-scam-a-ceo-out-of-243000/?sh=3984a3802241 • Joe

    Roganͷ੠ΛDeep FakeͰ࡞੒
 (Χφμͷ Dessaͱ͍͏AIձࣾ) 
 https://www.youtube.com/watch?v=DWK_iYBl8cA
  4. إೝূͱإࣝผͷҧ͍ • Face Identi fi cation إࣝผ 
 1 ର

    ଟͷྨࣅ౓൑ఆ 
 Ex) Google Photo΍Facebookͷը૾಺ͷਓΛಛఆɾਪન • Face Veri fi cation إೝূ 
 1 ର 1ͷྨࣅ౓൑ఆ 
 Ex) iPhone 8Ҏ߱ʹಋೖ͞Εͨإೝূٕज़
  5. إೝূͱσʔληοτ • Face Identi fi cation إࣝผ 
 1 ର

    ଟͷྨࣅ౓൑ఆ 
 Ex) Google Photo΍Facebookͷը૾಺ͷਓΛಛఆɾਪન • Face Veri fi cation إೝূ 
 1 ର 1ͷྨࣅ౓൑ఆ 
 Ex) iPhone 8Ҏ߱ʹಋೖ͞Εͨإೝূٕज़
  6. إೝূٕज़ͷਐԽ

  7. إೝূٕज़ͷਐԽ ࠓ೔͸ίί!!

  8. ϞσϧͱLossͷਐԽ

  9. DeepFace(2014) • DNN ϕʔεͷॳΊͯͷإೝূϞσϧ 
 1.2ԯݸͷύϥϝʔλ • 2D Aligned ը૾͚ͩͰͳ͘ɺ


    3D Aligned ը૾΋࢖༻
  10. DeepFace(2014) • ֶशͷࡍʹ͸ɺ෼ྨ໰୊(Cross Entropy Loss, 4030 Class, SFC Dataset) •

    ධՁͷࡍʹ͸ɺLFWσʔληοτͷશͯͷPairʹSVMͰ2Ϋϥε෼ྨ
 (Face Veri fi cationͷͨΊ)
  11. DeepFace(2014) • ಛ௃ྔϕʔεͱൺ΂ͯ1%ͷੑೳ޲্ • ධՁ͢Δσʔλ͕ෆۉߧσʔλͷͨΊɺROCۂઢͰ΋ධՁ

  12. FaceNet (2015) • ௚઀ɺإࣝผ༻ͷϢʔΫϦουۭؒʹಛ௃ྔΛׂΓ౰ͯ • Triplet LossΛ࢖༻ • ࣮ࡍʹ͸ɺHardest PositiveͰ͸ͳ͘ɺશϖΞͷ૊Έ߹ΘͤΛ༻͍͍ͯΔ


    Better Convergence
  13. FaceNet (2015) • 1ͭ໨ͷ݁Ռ : ϕʔεϥΠϯͷൺֱ • 2ͭ໨ͷ݁Ռ : LFWσʔληοτͰSOTA

  14. FaceNet (2015) • ਪ࿦ͷྲྀΕ FaceNet L2Norm 160x160
 ը૾A 512D
 Feature

    FaceNet 160x160
 ը૾B 512D
 Feature 1.3
  15. FaceNet (2015) https://colab.research.google.com/drive/ 1ZE3_ejPorSjw-6AJazd81CwaYxQT3npz?usp=sharing ࣮૷

  16. ArcFace (2015) • Softmax ؔ਺ + Cross Entropy͸
 ಉ͡ը૾ؒͷڑ཭Λখ͘͞ɺ
 ҟͳΔը૾ؒͷڑ཭Λେ͖͘͢Δ


    Α͏ʹઃܭ͞Ε͍ͯͳ͍ 
 

  17. ArcFace (2015) • https:// colab.research. google.com/ drive/ 1sFegHygowW eSzgSak_Zw1q 2HNTx9T96s?

    usp=sharing 
 

  18. ݱঢ়Α͘࢖ΘΕΔσʔληοτ • LFW 
 6000ਓͰ1ສຕ • VGGFace2 
 Celebͷࣸਅ
 Crop

    Bounding Box෇͖ 
 ެ։͞Ε͍͕ͯͨɺ࡟আ 
 VGG FaceͷΈ࢖༻Մೳ • MS-Celeb-1M 
 69ສͷਓؒ 500ສຕ 
 Ұൠͷਓ΋͓ࣸͬͯΓݱࡏඇެ։
  19. ݱঢ়ͷσʔληοτͷ໰୊఺ 1 • (1) Cross-Pose Face Recogntion 
 ਖ਼໘Λ޲͍ͨը૾͕গͳ͍ •

    (2) Cross-Age Face Recognition
 ܦ೥มԽ 
 ೥ྸΛߟྀͨ͠σʔληοτ͕࡞੒ • (3) Makeup Face Recognition 
 ϝʔΫΛ͢Δͱ൑ఆ͕೉͍͠ • (4) NIR-VIC Face Recognition 
 ҉͍γʔϯͰͷFRͷ໰୊
  20. ݱঢ়ͷσʔληοτͷ໰୊఺ 2 • (5) Low-Resolution Face Recognition 
 ը࣭͕௿͍ͱ೉͍͠ •

    (6) Photo-Sketch Face Recognition • (7) Low-Shot Face Recognition
 ࣮༻্ɺগͳ͍σʔλͰإࣝผΛ͢Δඞཁ͕͋Δ • (8) Set/Template Based Face Recognition 
 ը૾ͱಈըͷू߹Λѻ͏ • (9) Video Face Recognition
 ಈըͰͷԠ༻͸೉͍͠
  21. ݱঢ়ͷσʔληοτͷ໰୊఺ 3 • (10) 3D Face Recognition • (11) Partial

    Face Recognition 
 إͷҰ෦ͷΈ༩͑ΒΕ͍ͯΔ࣌ • (12) Face Anti-Spoo fi ng 
 ଟछଟ༷ͳAttackʹରԠ͠ͳ͍ͱ͍͚ͳ͍ • (13) Face Recognition for Mobile Device 
 ϞόΠϧͰFRͰ͖Δ͔Ͳ͏͔
  22. ࠷ޙʹ ௕͍͓ؒੈ࿩ʹͳΓ·ͨ͠ɻ