Virtual influencer를 위한 face swapping 기술 개발기

Slide 1

Slide 1 text

ա࢚അ0SDB/B ஠஠য়࠳ۨੋ $PQZSJHIU,BLBP$PSQ"MMSJHIUTSFTFSWFE3FEJTUSJCVUJPOPSQVCMJDEJTQMBZJTOPUQFSNJUUFEXJUIPVUXSJUUFOQFSNJTTJPOGSPN,BLBP 7JSUVBMJO fl VFODFSܳਤೠ GBDFTXBQQJOHӝࣿѐߊӝ

Slide 2

Slide 2 text

7JSUVBMJO fl VFODFSۆ 'BDFTXBQQJOH੉ۆ ӝઓݽ؛੄ೠ҅ ਋ܻ੄ݽ؛ .'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO খਵ۽ӝ؀غח੼

Slide 3

Slide 3 text

7JSUVBMJO fl VFODFSۆ

Slide 4

Slide 4 text

7JSUVBMJO fl VFODFSۆ ୹୊IUUQT LPXJLJQFEJBPSHXJLJ&##&$#&$#$@&$%#&%$&#""&$#&$$

Slide 5

Slide 5 text

7JSUVBMJO fl VFODFSۆ ୹୊IUUQT XXXTBNTVOHQPQDPNDPNNPOEP DNEEPXOTBWF,FZSFTFBSDIQEG fi MF/BNF,@@QEGDPOUFOU5ZQFBQQMJDBUJPOQEG

Slide 6

Slide 6 text

7JSUVBMJO fl VFODFSۆ ؀৉ߓ਋оౠ੿৔࢚ਸ୫৔ ੋҕ૑מӝࣿਸ੉ਊೞৈ৔࢚੄঴ҷਸਗೞח঴ҷ۽߄Է

Slide 7

Slide 7 text

7JSUVBMJO fl VFODFSۆ ؀৉ߓ਋оౠ੿৔࢚ਸ୫৔ ੋҕ૑מӝࣿਸ੉ਊೞৈ৔࢚੄঴ҷਸਗೞח঴ҷ۽߄Է Face swapping

Slide 8

Slide 8 text

'BDFTXBQQJOH੉ۆ

Slide 9

Slide 9 text

'BDFTXBQQJOH੉ۆ + = ਗࠄ ৔࢚ ਗೞח ঴ҷ Face swapping!

Slide 10

Slide 10 text

*%JNBHFࢎਊ੗оਗೞח঴ҷ ↟ ׀ݽন ঴ҷഋ١JEFOUJUZীҙ۲ػ੿ࠁ *%੿ࠁ ઁҕ "* 'BDFTXBQQJOH੉ۆ

Slide 11

Slide 11 text

3FGFSFODFJNBHFWJEFPਗࠄ৔࢚ ↟ ߓ҃ ݠܻझఋੌ١JEFOUJUZܳઁ৻ೠաݠ૑੿ࠁ SFGFSFODF੿ࠁ ઁҕ 'BDFTXBQQJOH੉ۆ *%JNBHFࢎਊ੗оਗೞח঴ҷ ↟ ׀ݽন ঴ҷഋ١JEFOUJUZীҙ۲ػ੿ࠁ *%੿ࠁ ઁҕ "*

Slide 12

Slide 12 text

'BDF - TXBQQFEJNBHFWJEFPо૞۽ࢤࢿػ৔࢚ ↟ ઱য૓SFGFSFODF *%੿ࠁܳ೤ࢿ೧ࢲ࢜۽਍৔࢚ࢤࢿ 3FGFSFODFJNBHFWJEFPਗࠄ৔࢚ ↟ ߓ҃ ݠܻझఋੌ١JEFOUJUZܳઁ৻ೠաݠ૑੿ࠁ SFGFSFODF੿ࠁ ઁҕ 'BDFTXBQQJOH੉ۆ *%JNBHFࢎਊ੗оਗೞח঴ҷ ↟ ׀ݽন ঴ҷഋ١JEFOUJUZীҙ۲ػ੿ࠁ *%੿ࠁ ઁҕ "*

Slide 13

Slide 13 text

'BDF - TXBQQJOHNPEFM 'BDFTXBQQJOH੉ۆ "*

Slide 14

Slide 14 text

(FOFSBUJWF"EWFSTBSJBM/FUXPSLT ("/ ↟ ѐਃ ↟ ૓૞э਷о૞੉޷૑ܳࢤࢿ೧ղח"*ݽ؛ ↟ 5BTL ↟ 3BOEPNJNBHFHFOFSBUJPO ↟ ೟णঌҊ્ܻ ↟ "EWFSTBSJBMMPTT 14 ੉޷૑୹୊,BSSBT 5FSP FUBM"OBMZ[JOHBOEJNQSPWJOHUIFJNBHFRVBMJUZPGTUZMFHBO1SPDFFEJOHTPGUIF*&&&$7'DPOGFSFODFPODPNQVUFSWJTJPOBOEQBUUFSOSFDPHOJUJPO 'BDFTXBQQJOH੉ۆ 4UZMF("/ (FOFSBU 3BOEPNDPEF 3BOEPNDPEF 3BOEPNDPEF 3BOEPNDPEF 3BOEPNJNBHF 3BOEPNJNBHF 3BOEPNJNBHF 3BOEPNJNBHF

Slide 15

Slide 15 text

'BDFTXBQQJOH੉ۆ 'BDFTXBQQJOHXJUI("/ *%JNBHF 3FGFSFODF JNBHF (FOFSBUFE JNBHF "* "EWFSTBSJBM MPTT *%MPTT 3FDPOTUSVDUJPOMPTT

Slide 16

Slide 16 text

૓૞୊ۢࠁੌ੿ب۽ࢎप੸ੋ о૞੉޷૑ܳࢤࢿೞب۾೟ण 'BDFTXBQQJOHXJUI("/ 'BDFTXBQQJOH੉ۆ *%JNBHF 3FGFSFODF JNBHF (FOFSBUFE JNBHF "* "EWFSTBSJBM MPTT *%MPTT 3FDPOTUSVDUJPOMPTT

Slide 17

Slide 17 text

*%JNBHF੄*%੿ࠁ ׀ݽন ঴ҷഋ ܳ ୭؀ೠ߈৔೧ࢲ੉޷૑ܳࢤࢿೞب۾೟ण 'BDFTXBQQJOHXJUI("/ 'BDFTXBQQJOH੉ۆ *%JNBHF 3FGFSFODF JNBHF (FOFSBUFE JNBHF "* "EWFSTBSJBM MPTT *%MPTT 3FDPOTUSVDUJPOMPTT

Slide 18

Slide 18 text

3FGFSFODFJNBHF੄SFGFSFODF੿ࠁ ߓ҃ ݠܻझఋੌ١ ܳ୭؀ೠ߈৔೧ࢲ ੉޷૑ܳࢤࢿೞب۾೟ण 'BDFTXBQQJOHXJUI("/ 'BDFTXBQQJOH੉ۆ *%JNBHF 3FGFSFODF JNBHF (FOFSBUFE JNBHF "* "EWFSTBSJBM MPTT *%MPTT 3FDPOTUSVDUJPOMPTT

Slide 19

Slide 19 text

ӝઓݽ؛੄ೠ҅

Slide 20

Slide 20 text

ӝઓݽ؛੄ೠ҅ ࢤࢿػ੉޷૑੄௬ܻ౭о୽࠙൤જ૑ঋ਺ ↟ അ੤ࢎۈ঴ҷࢤࢿӝࣿ਷NFHBQJYFM੉޷૑ܳࢤࢿೡࣻ੓਺ ↟ ೞ૑݅ GBDFTXBQӝࣿ਷ই૒੉ী୽࠙൤޷஖૑ޅೣ ੉޷૑୹୊,BSSBT 5FSP FUBM"OBMZ[JOHBOEJNQSPWJOHUIFJNBHFRVBMJUZPGTUZMFHBO1SPDFFEJOHTPGUIF*&&&$7'DPOGFSFODFPODPNQVUFSWJTJPOBOEQBUUFSOSFDPHOJUJPO 4UZMF("/੉ࢤࢿೠNFHBQJYFM੉޷૑

Slide 21

Slide 21 text

ӝઓݽ؛੄ೠ҅ 'BDFTFHNFOUBUJPONPEFM੄ب਑ਸ߉ইঠೣ ↟ 3FGFSFODFJNBHF੄BUUSJCVUFT ߓ҃ ಴੿ оੜ߈৔غ૑ޅೞӝٸޙ ↟ 4FHNFOUBUJPONPEFM੄ب਑ਸ߉ইSFGFSFODFJNBHF۽ࠗఠ೙ਃೠٜࠗ࠙ਸੜۄࢲоઉ১ 'BDFTFNHFOUBUJPO৘द ੉޷૑୹୊IUUQT HJUIVCDPNTXJUDIBCMFOPSNT$FMFC".BTL - )2

Slide 22

Slide 22 text

ӝઓݽ؛੄ೠ҅ ߈৔غযঠೡBUUSJCVUFTо୽࠙൤߈৔غ૑ঋ਺ ↟ 3FGFSFODFJNBHF੄಴੿ ݠܻпب ↟ *%JNBHF੄঴ҷഋ 3FGFSFODFJNBHF *%JNBHF 'BDF - TXBQQFEJNBHF 3FGFSFODF *%੉޷૑୹୊,BSSBT 5FSP FUBM1SPHSFTTJWF(SPXJOHPG("/TGPS*NQSPWFE2VBMJUZ 4UBCJMJUZ BOE7BSJBUJPO*OUFSOBUJPOBM$POGFSFODFPO-FBSOJOH3FQSFTFOUBUJPOT

Slide 23

Slide 23 text

਋ܻ੄ݽ؛ .'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO

Slide 24

Slide 24 text

ӝઓ੄ޙઁ੼ࢤࢿػ੉޷૑੄௬ܻ౭о୽࠙൤જ૑ঋ਺ ↟ 4PMVUJPO("/JOWFSTJPOӝ߈੄NPEFM٣੗ੋ .'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO

Slide 25

Slide 25 text

("/JOWFSTJPO 1SF - USBJOFE 4UZMF("/ (FOFSBUPS 1SF - USBJOFE 4UZMF("/ (FOFSBUPS &ODPEFS .BOJQVMBUJPO 0SJHJOBMJNBHF 3FDPOTUSVDUFEJNBHF &EJUFEJNBHF w ̂ w &YUSBDUFEDPEF .BOJQVMBUFEDPEF 3FDPOTUSVDUJPOMPTT ੉޷૑୹୊"MBMVG :VWBM 0S1BUBTIOJL BOE%BOJFM$PIFO - 0S3FTUZMF"SFTJEVBM - CBTFETUZMFHBOFODPEFSWJBJUFSBUJWFSF fi OFNFOU1SPDFFEJOHTPGUIF*&&&$7'*OUFSOBUJPOBM$POGFSFODFPO$PNQVUFS7JTJPO .'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO

Slide 26

Slide 26 text

ӝઓ੄ޙઁ੼ࢤࢿػ੉޷૑੄௬ܻ౭о୽࠙൤જ૑ঋ਺ ↟ 4PMVUJPO("/JOWFSTJPOӝ߈੄NPEFM٣੗ੋ 1SF - USBJOFE   4UZMF("/ 'BDJBM "UUSJCVUF &ODPEFS &YUSBDUFEDPEF 3FGFSFODFJNBHF *%JNBHF 'BDF - TXBQQFEJNBHF 3FGFSFODFJNBHF 'BDF - TXBQQFEJNBHF *%JNBHF 'BDF - TXBQQFEJNBHF 'BDF - TXBQQFEJNBHF 3FDPOTUSVDUJPO MPTT *%MPTT "EWFSTBSJBMMPTT ("/JOWFSTJPOӝ߈NPEFM .'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO

Slide 27

Slide 27 text

ӝઓ੄ޙઁ੼ࢤࢿػ੉޷૑੄௬ܻ౭о୽࠙൤જ૑ঋ਺ ↟ 4PMVUJPO("/JOWFSTJPOӝ߈੄NPEFM٣੗ੋ 1SF - USBJOFE   4UZMF("/ 'BDJBM "UUSJCVUF &ODPEFS &YUSBDUFEDPEF 3FGFSFODFJNBHF *%JNBHF 'BDF - TXBQQFEJNBHF "* 3FGFSFODFJNBHF *%JNBHF 'BDF - TXBQQFEJNBHF *%MPTT 3FDPOTUSVDUJPOMPTT "EWFSTBSJBMMPTT ("/JOWFSTJPOӝ߈NPEFM .'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO

Slide 28

Slide 28 text

3FGFSFODFJNBHF *%JNBHF W#BTFMJOF 'BDF - TXBQQFEJNBHF 3FGFSFODF *%੉޷૑୹୊,BSSBT 5FSP FUBM1SPHSFTTJWF(SPXJOHPG("/TGPS*NQSPWFE2VBMJUZ 4UBCJMJUZ BOE7BSJBUJPO*OUFSOBUJPOBM$POGFSFODFPO-FBSOJOH3FQSFTFOUBUJPOT ? ? W W 'BDF - TXBQQFEJNBHF 'BDF - TXBQQFEJNBHF .'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO

Slide 29

Slide 29 text

ӝઓ੄ޙઁ੼'BDFTFHNFOUBUJPONPEFM੄ب਑ਸ߉ইঠೣ ↟ 4PMVUJPO'BDJBMBUUSJCVUFFODPEFSীࢲDPEF৻ীNBQө૑୶୹ೞب۾٣੗ੋ &YUSBDUFENBQ 1SF - USBJOFE   4UZMF("/ 'BDJBM "UUSJCVUF &ODPEFS &YUSBDUFEDPEF 3FGFSFODFJNBHF *%JNBHF 'BDF - TXBQQFEJNBHF .'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO

Slide 30

Slide 30 text

3FGFSFODFJNBHF *%JNBHF W#BTFMJOF W#BTFMJOF &YUSBDUFENBQ 'BDF - TXBQQFEJNBHF 'BDF - TXBQQFEJNBHF 3FGFSFODF *%੉޷૑୹୊,BSSBT 5FSP FUBM1SPHSFTTJWF(SPXJOHPG("/TGPS*NQSPWFE2VBMJUZ 4UBCJMJUZ BOE7BSJBUJPO*OUFSOBUJPOBM$POGFSFODFPO-FBSOJOH3FQSFTFOUBUJPOT ? 'BDF - TXBQQFEJNBHF W .'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO

Slide 31

Slide 31 text

ӝઓ੄ޙઁ੼߈৔غযঠೡBUUSJCVUFTо୽࠙൤߈৔غ૑ঋ਺ ↟ 3FGFSFODFJNBHF۽ࠗఠ಴੿ ݠܻпب ↟ *%JNBHF۽ࠗఠ঴ҷഋ ↟ 4PMVUJPO%..TVQFSWJTJPOਸ೟णҗ੿ী୶о .'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO

Slide 32

Slide 32 text

%.. ↟ %੉޷૑۽ࠗఠ%QBSBNUFSܳ୶୹೧ࢲ%SFDPOTUSVDUJPO%NBOJQVMBUJPO %..   &ODPEFS %..   %FDPEFS 4IBQF &YQSFTTJPO 1PTF %JOQVUJNBHF %SFDPOTUSVDUJPO ੉޷૑୹୊'FOH :BP FUBM-FBSOJOHBOBOJNBUBCMFEFUBJMFE%GBDFNPEFMGSPNJO - UIF - XJMEJNBHFT"$.5SBOTBDUJPOTPO(SBQIJDT 5P( .'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO

Slide 33

Slide 33 text

ӝઓ੄ޙઁ੼߈৔غযঠೡBUUSJCVUFTо୽࠙൤߈৔غ૑ঋ਺ ↟ 4PMVUJPO%..TVQFSWJTJPOਸ೟णҗ੿ী୶о 1SF - USBJOFE   4UZMF("/ 'BDJBM "UUSJCVUF &ODPEFS &YUSBDUFEDPEF 3FGFSFODFJNBHF *%JNBHF 'BDF - TXBQQFEJNBHF *%JNBHF %..   &ODPEFS sref sswap sid pref pswap pid eref eswap eid 3FGFSFODFJNBHF 'BDF - TXBQQFEJNBHF &YUSBDUFENBQ 4IBQF &YQSFTTJPO 1PTF .'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO

Slide 34

Slide 34 text

3FGFSFODFJNBHF *%JNBHF W#BTFMJOF W#BTFMJOF &YUSBDUFENBQ W#BTFMJOF &YUSBDUFENBQ %..TVQFSWJTJPO 'BDF - TXBQQFEJNBHF 'BDF - TXBQQFEJNBHF 'BDF - TXBQQFEJNBHF 3FGFSFODF *%੉޷૑୹୊,BSSBT 5FSP FUBM1SPHSFTTJWF(SPXJOHPG("/TGPS*NQSPWFE2VBMJUZ 4UBCJMJUZ BOE7BSJBUJPO*OUFSOBUJPOBM$POGFSFODFPO-FBSOJOH3FQSFTFOUBUJPOT .'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO

Slide 35

Slide 35 text

*EFOUJUZ 4IBQF &YQSFTTJPO 1PTF 1PTF - )/ %FFQGBLFT FaceShifter 4JNTXBQ )J fi 'BDF *OGP4XBQ .FHB'4 4NPPUI4XBQ .'*. PVST .'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO

Slide 36

Slide 36 text

3FGFSFODFJNBHF *%JNBHF 'BDF - TXBQQFEJNBHF 3FGFSFODF *%੉޷૑୹୊,BSSBT 5FSP FUBM1SPHSFTTJWF(SPXJOHPG("/TGPS*NQSPWFE2VBMJUZ 4UBCJMJUZ BOE7BSJBUJPO*OUFSOBUJPOBM$POGFSFODFPO-FBSOJOH3FQSFTFOUBUJPOT .'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO

Slide 37

Slide 37 text

Slide 38

Slide 38 text

Slide 39

Slide 39 text

Slide 40

Slide 40 text

Slide 41

Slide 41 text

Slide 42

Slide 42 text

'BDFTXBQQJOH 3FGFSFODF WJEFP *%JNBHF 'BDF - TXBQQFE GSBNFT 1SF - QSPDFTT     'BDFEFUFDUJPO   4NPPUIJOH $SPQQJOH "MJHONFOU 1SF - QSPDFTT     'BDFEFUFDUJPO   4NPPUIJOH $SPQQJOH "MJHONFOU 1PTU - QSPDFTT   3FUPVDI   6ODSPQQJOH 'BDF - TXBQQJOHQJQFMJOF GPSWJEFP 3FGFSFODF GSBNFT 'BDF - TXBQQFE WJEFP .'*. .'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO

Slide 43

Slide 43 text

.'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO

Slide 44

Slide 44 text

.'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO

Slide 45

Slide 45 text

খਵ۽ӝ؀غח੼

Slide 46

Slide 46 text

খਵ۽ӝ؀غח੼ օܻഝਊغחѪ ؀৉ߓ਋оౠ੿৔࢚ਸ୫৔ ੋҕ૑מӝࣿਸ੉ਊೞৈ৔࢚੄঴ҷਸਗೞח঴ҷ۽߄Է ↟ ਬݺো৘ੋ੉૒੽৔࢚ਸ୫৔ೡ೙ਃহ੉GBDFTXBQQJOHਵ۽ઁ੘ ↟ ઓ੤ೞ૑ঋח࢜۽਍JEFOUJUZ٣੗ੋറ٣૑ణോݢਵ۽ٜ݅ӝ

Slide 47

Slide 47 text

хࢎ೤פ׮