顔認証・顔識別周りのサーベイ

Slide 1

Slide 1 text

٢ా ৻ଠ࿠ إೝূɾإࣝผपΓͷαʔϕΠ EAGLYSגࣜձࣾ AI ษڧձ (2021/02/12 Fri)

Slide 2

Slide 2 text

ࠓ೔ͷѻ͏಺༰ • DeepFakeͷ໰୊ • 2014Ҏ߱ͷ஫໨࿦จ  DeepFace, FaceNet, ArcFace • ະղܾͷ՝୊ • ࣮૷

Slide 3

Slide 3 text

DeepFake • DeepFakeΛ༻͍ͨੈքॳͷ࠮ٗ  ΠΪϦεͷΤωϧΪʔձ͕ࣾ  ਌ձࣾͷϘε͔Βͷి࿩Ͱ໿2400ສԁΛϋϯΨϦʔͷձࣾʹৼΓࠐΉ   https://www.forbes.com/sites/jessedamiani/2019/09/03/a-voice-deepfake- was-used-to-scam-a-ceo-out-of-243000/?sh=3984a3802241 • Joe Roganͷ੠ΛDeep FakeͰ࡞੒  (Χφμͷ Dessaͱ͍͏AIձࣾ)   https://www.youtube.com/watch?v=DWK_iYBl8cA

Slide 4

Slide 4 text

إೝূͱإࣝผͷҧ͍ • Face Identi fi cation إࣝผ   1 ର ଟͷྨࣅ౓൑ఆ   Ex) Google Photo΍Facebookͷը૾಺ͷਓΛಛఆɾਪન • Face Veri fi cation إೝূ   1 ର 1ͷྨࣅ౓൑ఆ   Ex) iPhone 8Ҏ߱ʹಋೖ͞Εͨإೝূٕज़

Slide 5

Slide 5 text

إೝূͱσʔληοτ • Face Identi fi cation إࣝผ   1 ର ଟͷྨࣅ౓൑ఆ   Ex) Google Photo΍Facebookͷը૾಺ͷਓΛಛఆɾਪન • Face Veri fi cation إೝূ   1 ର 1ͷྨࣅ౓൑ఆ   Ex) iPhone 8Ҏ߱ʹಋೖ͞Εͨإೝূٕज़

Slide 6

Slide 6 text

إೝূٕज़ͷਐԽ

Slide 7

Slide 7 text

إೝূٕज़ͷਐԽ ࠓ೔͸ίί!!

Slide 8

Slide 8 text

ϞσϧͱLossͷਐԽ

Slide 9

Slide 9 text

DeepFace(2014) • DNN ϕʔεͷॳΊͯͷإೝূϞσϧ   1.2ԯݸͷύϥϝʔλ • 2D Aligned ը૾͚ͩͰͳ͘ɺ  3D Aligned ը૾΋࢖༻

Slide 10

Slide 10 text

DeepFace(2014) • ֶशͷࡍʹ͸ɺ෼ྨ໰୊(Cross Entropy Loss, 4030 Class, SFC Dataset) • ධՁͷࡍʹ͸ɺLFWσʔληοτͷશͯͷPairʹSVMͰ2Ϋϥε෼ྨ  (Face Veri fi cationͷͨΊ)

Slide 11

Slide 11 text

DeepFace(2014) • ಛ௃ྔϕʔεͱൺ΂ͯ1%ͷੑೳ޲্ • ධՁ͢Δσʔλ͕ෆۉߧσʔλͷͨΊɺROCۂઢͰ΋ධՁ

Slide 12

Slide 12 text

FaceNet (2015) • ௚઀ɺإࣝผ༻ͷϢʔΫϦουۭؒʹಛ௃ྔΛׂΓ౰ͯ • Triplet LossΛ࢖༻ • ࣮ࡍʹ͸ɺHardest PositiveͰ͸ͳ͘ɺશϖΞͷ૊Έ߹ΘͤΛ༻͍͍ͯΔ  Better Convergence

Slide 13

Slide 13 text

FaceNet (2015) • 1ͭ໨ͷ݁Ռ : ϕʔεϥΠϯͷൺֱ • 2ͭ໨ͷ݁Ռ : LFWσʔληοτͰSOTA

Slide 14

Slide 14 text

FaceNet (2015) • ਪ࿦ͷྲྀΕ FaceNet L2Norm 160x160  ը૾A 512D  Feature FaceNet 160x160  ը૾B 512D  Feature 1.3

Slide 15

Slide 15 text

FaceNet (2015) https://colab.research.google.com/drive/ 1ZE3_ejPorSjw-6AJazd81CwaYxQT3npz?usp=sharing ࣮૷

Slide 16

Slide 16 text

ArcFace (2015) • Softmax ؔ਺ + Cross Entropy͸  ಉ͡ը૾ؒͷڑ཭Λখ͘͞ɺ  ҟͳΔը૾ؒͷڑ཭Λେ͖͘͢Δ  Α͏ʹઃܭ͞Ε͍ͯͳ͍    

Slide 17

Slide 17 text

ArcFace (2015) • https:// colab.research. google.com/ drive/ 1sFegHygowW eSzgSak_Zw1q 2HNTx9T96s? usp=sharing    

Slide 18

Slide 18 text

ݱঢ়Α͘࢖ΘΕΔσʔληοτ • LFW   6000ਓͰ1ສຕ • VGGFace2   Celebͷࣸਅ  Crop Bounding Box෇͖   ެ։͞Ε͍͕ͯͨɺ࡟আ   VGG FaceͷΈ࢖༻Մೳ • MS-Celeb-1M   69ສͷਓؒ 500ສຕ   Ұൠͷਓ΋͓ࣸͬͯΓݱࡏඇެ։

Slide 19

Slide 19 text

ݱঢ়ͷσʔληοτͷ໰୊఺ 1 • (1) Cross-Pose Face Recogntion   ਖ਼໘Λ޲͍ͨը૾͕গͳ͍ • (2) Cross-Age Face Recognition  ܦ೥มԽ   ೥ྸΛߟྀͨ͠σʔληοτ͕࡞੒ • (3) Makeup Face Recognition   ϝʔΫΛ͢Δͱ൑ఆ͕೉͍͠ • (4) NIR-VIC Face Recognition   ҉͍γʔϯͰͷFRͷ໰୊

Slide 20

Slide 20 text

ݱঢ়ͷσʔληοτͷ໰୊఺ 2 • (5) Low-Resolution Face Recognition   ը࣭͕௿͍ͱ೉͍͠ • (6) Photo-Sketch Face Recognition • (7) Low-Shot Face Recognition  ࣮༻্ɺগͳ͍σʔλͰإࣝผΛ͢Δඞཁ͕͋Δ • (8) Set/Template Based Face Recognition   ը૾ͱಈըͷू߹Λѻ͏ • (9) Video Face Recognition  ಈըͰͷԠ༻͸೉͍͠

Slide 21

Slide 21 text

ݱঢ়ͷσʔληοτͷ໰୊఺ 3 • (10) 3D Face Recognition • (11) Partial Face Recognition   إͷҰ෦ͷΈ༩͑ΒΕ͍ͯΔ࣌ • (12) Face Anti-Spoo fi ng   ଟछଟ༷ͳAttackʹରԠ͠ͳ͍ͱ͍͚ͳ͍ • (13) Face Recognition for Mobile Device   ϞόΠϧͰFRͰ͖Δ͔Ͳ͏͔

Slide 22

Slide 22 text

࠷ޙʹ ௕͍͓ؒੈ࿩ʹͳΓ·ͨ͠ɻ