顔認証・顔識別周りのサーベイ

Transcript

1. ٢ా ৻ଠ࿠ إೝূɾإࣝผपΓͷαʔϕΠ EAGLYSגࣜձࣾ AI ษڧձ (2021/02/12 Fri)
2. ࠓ೔ͷѻ͏಺༰ • DeepFakeͷ໰୊ • 2014Ҏ߱ͷ஫໨࿦จ
 DeepFace, FaceNet, ArcFace • ະղܾͷ՝୊ • ࣮૷
3. DeepFake • DeepFakeΛ༻͍ͨੈքॳͷ࠮ٗ
 ΠΪϦεͷΤωϧΪʔձ͕ࣾ
 ਌ձࣾͷϘε͔Βͷి࿩Ͱ໿2400ສԁΛϋϯΨϦʔͷձࣾʹৼΓࠐΉ 
 https://www.forbes.com/sites/jessedamiani/2019/09/03/a-voice-deepfake- was-used-to-scam-a-ceo-out-of-243000/?sh=3984a3802241 • Joe Roganͷ੠ΛDeep FakeͰ࡞੒
 (Χφμͷ Dessaͱ͍͏AIձࣾ) 
 https://www.youtube.com/watch?v=DWK_iYBl8cA
4. إೝূͱإࣝผͷҧ͍ • Face Identi fi cation إࣝผ 
 1 ର ଟͷྨࣅ౓൑ఆ 
 Ex) Google Photo΍Facebookͷը૾಺ͷਓΛಛఆɾਪન • Face Veri fi cation إೝূ 
 1 ର 1ͷྨࣅ౓൑ఆ 
 Ex) iPhone 8Ҏ߱ʹಋೖ͞Εͨإೝূٕज़
5. إೝূͱσʔληοτ • Face Identi fi cation إࣝผ 
 1 ର ଟͷྨࣅ౓൑ఆ 
 Ex) Google Photo΍Facebookͷը૾಺ͷਓΛಛఆɾਪન • Face Veri fi cation إೝূ 
 1 ର 1ͷྨࣅ౓൑ఆ 
 Ex) iPhone 8Ҏ߱ʹಋೖ͞Εͨإೝূٕज़
6. إೝূٕज़ͷਐԽ
7. إೝূٕज़ͷਐԽ ࠓ೔͸ίί!!
8. ϞσϧͱLossͷਐԽ
9. DeepFace(2014) • DNN ϕʔεͷॳΊͯͷإೝূϞσϧ 
 1.2ԯݸͷύϥϝʔλ • 2D Aligned ը૾͚ͩͰͳ͘ɺ
 3D Aligned ը૾΋࢖༻
10. DeepFace(2014) • ֶशͷࡍʹ͸ɺ෼ྨ໰୊(Cross Entropy Loss, 4030 Class, SFC Dataset) • ධՁͷࡍʹ͸ɺLFWσʔληοτͷશͯͷPairʹSVMͰ2Ϋϥε෼ྨ
 (Face Veri fi cationͷͨΊ)
11. DeepFace(2014) • ಛ௃ྔϕʔεͱൺ΂ͯ1%ͷੑೳ޲্ • ධՁ͢Δσʔλ͕ෆۉߧσʔλͷͨΊɺROCۂઢͰ΋ධՁ
12. FaceNet (2015) • ௚઀ɺإࣝผ༻ͷϢʔΫϦουۭؒʹಛ௃ྔΛׂΓ౰ͯ • Triplet LossΛ࢖༻ • ࣮ࡍʹ͸ɺHardest PositiveͰ͸ͳ͘ɺશϖΞͷ૊Έ߹ΘͤΛ༻͍͍ͯΔ
 Better Convergence
13. FaceNet (2015) • 1ͭ໨ͷ݁Ռ : ϕʔεϥΠϯͷൺֱ • 2ͭ໨ͷ݁Ռ : LFWσʔληοτͰSOTA
14. FaceNet (2015) • ਪ࿦ͷྲྀΕ FaceNet L2Norm 160x160
 ը૾A 512D
 Feature FaceNet 160x160
 ը૾B 512D
 Feature 1.3
15. FaceNet (2015) https://colab.research.google.com/drive/ 1ZE3_ejPorSjw-6AJazd81CwaYxQT3npz?usp=sharing ࣮૷
16. ArcFace (2015) • Softmax ؔ਺ + Cross Entropy͸
 ಉ͡ը૾ؒͷڑ཭Λখ͘͞ɺ
 ҟͳΔը૾ؒͷڑ཭Λେ͖͘͢Δ
 Α͏ʹઃܭ͞Ε͍ͯͳ͍ 
 

17. ArcFace (2015) • https:// colab.research. google.com/ drive/ 1sFegHygowW eSzgSak_Zw1q 2HNTx9T96s? usp=sharing 
 

18. ݱঢ়Α͘࢖ΘΕΔσʔληοτ • LFW 
 6000ਓͰ1ສຕ • VGGFace2 
 Celebͷࣸਅ
 Crop Bounding Box෇͖ 
 ެ։͞Ε͍͕ͯͨɺ࡟আ 
 VGG FaceͷΈ࢖༻Մೳ • MS-Celeb-1M 
 69ສͷਓؒ 500ສຕ 
 Ұൠͷਓ΋͓ࣸͬͯΓݱࡏඇެ։
19. ݱঢ়ͷσʔληοτͷ໰୊఺ 1 • (1) Cross-Pose Face Recogntion 
 ਖ਼໘Λ޲͍ͨը૾͕গͳ͍ • (2) Cross-Age Face Recognition
 ܦ೥มԽ 
 ೥ྸΛߟྀͨ͠σʔληοτ͕࡞੒ • (3) Makeup Face Recognition 
 ϝʔΫΛ͢Δͱ൑ఆ͕೉͍͠ • (4) NIR-VIC Face Recognition 
 ҉͍γʔϯͰͷFRͷ໰୊
20. ݱঢ়ͷσʔληοτͷ໰୊఺ 2 • (5) Low-Resolution Face Recognition 
 ը࣭͕௿͍ͱ೉͍͠ • (6) Photo-Sketch Face Recognition • (7) Low-Shot Face Recognition
 ࣮༻্ɺগͳ͍σʔλͰإࣝผΛ͢Δඞཁ͕͋Δ • (8) Set/Template Based Face Recognition 
 ը૾ͱಈըͷू߹Λѻ͏ • (9) Video Face Recognition
 ಈըͰͷԠ༻͸೉͍͠
21. ݱঢ়ͷσʔληοτͷ໰୊఺ 3 • (10) 3D Face Recognition • (11) Partial Face Recognition 
 إͷҰ෦ͷΈ༩͑ΒΕ͍ͯΔ࣌ • (12) Face Anti-Spoo fi ng 
 ଟछଟ༷ͳAttackʹରԠ͠ͳ͍ͱ͍͚ͳ͍ • (13) Face Recognition for Mobile Device 
 ϞόΠϧͰFRͰ͖Δ͔Ͳ͏͔
22. ࠷ޙʹ ௕͍͓ؒੈ࿩ʹͳΓ·ͨ͠ɻ