#DigitalHuman #GenerativeModel
카카오브레인에서 개발한 face swapping 기술을 소개합니다.
발표자 : orca.na 카카오브레인 Digital Human Studio 에서 딥러닝 기반 생성 모델을 연구하고 있는 Orca입니다.
ա࢚അ0SDB/Bয়࠳ۨੋ$PQZSJHIU,BLBP$PSQ"MMSJHIUTSFTFSWFE3FEJTUSJCVUJPOPSQVCMJDEJTQMBZJTOPUQFSNJUUFEXJUIPVUXSJUUFOQFSNJTTJPOGSPN,BLBP7JSUVBMJOflVFODFSܳਤೠGBDFTXBQQJOHӝࣿѐߊӝ
View Slide
7JSUVBMJOflVFODFSۆ 'BDFTXBQQJOHۆ ӝઓݽ؛ೠ҅ ܻݽ؛ .'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO খਵ۽ӝغח
7JSUVBMJOflVFODFSۆ
7JSUVBMJOflVFODFSۆIUUQTLPXJLJQFEJBPSHXJLJ#&$#&$#$@&$%#&%$""&$#&$$
7JSUVBMJOflVFODFSۆIUUQTXXXTBNTVOHQPQDPNDPNNPOEP DNEEPXOTBWF,FZSFTFBSDIQEGfiMF/BNF,@@QEGDPOUFOU5ZQFBQQMJDBUJPOQEG
7JSUVBMJOflVFODFSۆ ߓоౠ࢚ਸ୫ ੋҕמӝࣿਸਊೞৈ࢚ҷਸਗೞחҷ۽߄Է
7JSUVBMJOflVFODFSۆ ߓоౠ࢚ਸ୫ ੋҕמӝࣿਸਊೞৈ࢚ҷਸਗೞחҷ۽߄ԷFace swapping
'BDFTXBQQJOHۆ
'BDFTXBQQJOHۆ+ =ਗࠄ ࢚ਗೞח ҷFace swapping!
*%JNBHFࢎਊоਗೞחҷ↟ ׀ݽন ҷഋ١JEFOUJUZীҙ۲ػࠁ*%ࠁઁҕ"*'BDFTXBQQJOHۆ
3FGFSFODFJNBHFWJEFPਗࠄ࢚↟ ߓ҃ ݠܻझఋੌ١JEFOUJUZܳઁ৻ೠաݠࠁSFGFSFODFࠁઁҕ'BDFTXBQQJOHۆ*%JNBHFࢎਊоਗೞחҷ↟ ׀ݽন ҷഋ١JEFOUJUZীҙ۲ػࠁ*%ࠁઁҕ"*
'BDF-TXBQQFEJNBHFWJEFPо۽ࢤࢿػ࢚↟ যSFGFSFODF *%ࠁܳࢿ೧ࢲ࢜۽࢚ࢤࢿ3FGFSFODFJNBHFWJEFPਗࠄ࢚↟ ߓ҃ ݠܻझఋੌ١JEFOUJUZܳઁ৻ೠաݠࠁSFGFSFODFࠁઁҕ'BDFTXBQQJOHۆ*%JNBHFࢎਊоਗೞחҷ↟ ׀ݽন ҷഋ١JEFOUJUZীҙ۲ػࠁ*%ࠁઁҕ"*
'BDF-TXBQQJOHNPEFM'BDFTXBQQJOHۆ"*
(FOFSBUJWF"EWFSTBSJBM/FUXPSLT ("/↟ ѐਃ↟ эоܳࢤࢿ೧ղח"*ݽ؛↟ 5BTL↟ 3BOEPNJNBHFHFOFSBUJPO↟ णঌҊ્ܻ↟ "EWFSTBSJBMMPTT14,BSSBT 5FSP FUBM"OBMZ[JOHBOEJNQSPWJOHUIFJNBHFRVBMJUZPGTUZMFHBO1SPDFFEJOHTPGUIF*&&&$7'DPOGFSFODFPODPNQVUFSWJTJPOBOEQBUUFSOSFDPHOJUJPO'BDFTXBQQJOHۆ4UZMF("/(FOFSBU3BOEPNDPEF 3BOEPNDPEF3BOEPNDPEF 3BOEPNDPEF3BOEPNJNBHF 3BOEPNJNBHF3BOEPNJNBHF3BOEPNJNBHF
'BDFTXBQQJOHۆ'BDFTXBQQJOHXJUI("/*%JNBHF3FGFSFODFJNBHF(FOFSBUFEJNBHF"*"EWFSTBSJBMMPTT*%MPTT3FDPOTUSVDUJPOMPTT
ۢࠁੌب۽ࢎपੋоܳࢤࢿೞب۾ण'BDFTXBQQJOHXJUI("/'BDFTXBQQJOHۆ*%JNBHF3FGFSFODFJNBHF(FOFSBUFEJNBHF"*"EWFSTBSJBMMPTT*%MPTT3FDPOTUSVDUJPOMPTT
*%JNBHF*%ࠁ ׀ݽন ҷഋܳ୭ೠ߈೧ࢲܳࢤࢿೞب۾ण'BDFTXBQQJOHXJUI("/'BDFTXBQQJOHۆ*%JNBHF3FGFSFODFJNBHF(FOFSBUFEJNBHF"*"EWFSTBSJBMMPTT*%MPTT3FDPOTUSVDUJPOMPTT
3FGFSFODFJNBHFSFGFSFODFࠁߓ҃ ݠܻझఋੌ١ܳ୭ೠ߈೧ࢲܳࢤࢿೞب۾ण'BDFTXBQQJOHXJUI("/'BDFTXBQQJOHۆ*%JNBHF3FGFSFODFJNBHF(FOFSBUFEJNBHF"*"EWFSTBSJBMMPTT*%MPTT3FDPOTUSVDUJPOMPTT
ӝઓݽ؛ೠ҅
ӝઓݽ؛ೠ҅ ࢤࢿػ௬ܻ౭о࠙જঋ↟ അࢎۈҷࢤࢿӝࣿNFHBQJYFMܳࢤࢿೡࣻ↟ ೞ݅ GBDFTXBQӝࣿইী࠙ޅೣ,BSSBT 5FSP FUBM"OBMZ[JOHBOEJNQSPWJOHUIFJNBHFRVBMJUZPGTUZMFHBO1SPDFFEJOHTPGUIF*&&&$7'DPOGFSFODFPODPNQVUFSWJTJPOBOEQBUUFSOSFDPHOJUJPO4UZMF("/ࢤࢿೠNFHBQJYFM
ӝઓݽ؛ೠ҅'BDFTFHNFOUBUJPONPEFMبਸ߉ইঠೣ↟ 3FGFSFODFJNBHFBUUSJCVUFT ߓ҃ оੜ߈غޅೞӝٸޙ↟ 4FHNFOUBUJPONPEFMبਸ߉ইSFGFSFODFJNBHF۽ࠗఠਃೠٜࠗ࠙ਸੜۄࢲоઉ১'BDFTFNHFOUBUJPOदIUUQTHJUIVCDPNTXJUDIBCMFOPSNT$FMFC".BTL-)2
ӝઓݽ؛ೠ҅߈غযঠೡBUUSJCVUFTо࠙߈غঋ↟ 3FGFSFODFJNBHF ݠܻпب↟ *%JNBHFҷഋ3FGFSFODFJNBHF *%JNBHF 'BDF-TXBQQFEJNBHF3FGFSFODF *%,BSSBT 5FSP FUBM1SPHSFTTJWF(SPXJOHPG("/TGPS*NQSPWFE2VBMJUZ 4UBCJMJUZ BOE7BSJBUJPO*OUFSOBUJPOBM$POGFSFODFPO-FBSOJOH3FQSFTFOUBUJPOT
ܻݽ؛.'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO
ӝઓޙઁࢤࢿػ௬ܻ౭о࠙જঋ↟ 4PMVUJPO("/JOWFSTJPOӝ߈NPEFM٣ੋ.'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO
("/JOWFSTJPO1SF-USBJOFE4UZMF("/(FOFSBUPS1SF-USBJOFE4UZMF("/(FOFSBUPS&ODPEFS.BOJQVMBUJPO0SJHJOBMJNBHF 3FDPOTUSVDUFEJNBHF&EJUFEJNBHFŵw&YUSBDUFEDPEF.BOJQVMBUFEDPEF3FDPOTUSVDUJPOMPTT"MBMVG :VWBM 0S1BUBTIOJL BOE%BOJFM$PIFO-0S3FTUZMF"SFTJEVBM-CBTFETUZMFHBOFODPEFSWJBJUFSBUJWFSFfiOFNFOU1SPDFFEJOHTPGUIF*&&&$7'*OUFSOBUJPOBM$POGFSFODFPO$PNQVUFS7JTJPO.'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO
ӝઓޙઁࢤࢿػ௬ܻ౭о࠙જঋ↟ 4PMVUJPO("/JOWFSTJPOӝ߈NPEFM٣ੋ1SF-USBJOFE 4UZMF("/'BDJBM"UUSJCVUF&ODPEFS&YUSBDUFEDPEF3FGFSFODFJNBHF *%JNBHF 'BDF-TXBQQFEJNBHF3FGFSFODFJNBHF 'BDF-TXBQQFEJNBHF*%JNBHF 'BDF-TXBQQFEJNBHF'BDF-TXBQQFEJNBHF3FDPOTUSVDUJPOMPTT*%MPTT"EWFSTBSJBMMPTT("/JOWFSTJPOӝ߈NPEFM.'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO
ӝઓޙઁࢤࢿػ௬ܻ౭о࠙જঋ↟ 4PMVUJPO("/JOWFSTJPOӝ߈NPEFM٣ੋ1SF-USBJOFE 4UZMF("/'BDJBM"UUSJCVUF&ODPEFS&YUSBDUFEDPEF3FGFSFODFJNBHF *%JNBHF 'BDF-TXBQQFEJNBHF"*3FGFSFODFJNBHF*%JNBHF'BDF-TXBQQFEJNBHF*%MPTT3FDPOTUSVDUJPOMPTT"EWFSTBSJBMMPTT("/JOWFSTJPOӝ߈NPEFM.'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO
3FGFSFODFJNBHF *%JNBHFW#BTFMJOF'BDF-TXBQQFEJNBHF3FGFSFODF *%,BSSBT 5FSP FUBM1SPHSFTTJWF(SPXJOHPG("/TGPS*NQSPWFE2VBMJUZ 4UBCJMJUZ BOE7BSJBUJPO*OUFSOBUJPOBM$POGFSFODFPO-FBSOJOH3FQSFTFOUBUJPOT? ?W W'BDF-TXBQQFEJNBHF 'BDF-TXBQQFEJNBHF.'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO
ӝઓޙઁ'BDFTFHNFOUBUJPONPEFMبਸ߉ইঠೣ↟ 4PMVUJPO'BDJBMBUUSJCVUFFODPEFSীࢲDPEF৻ীNBQө୶ೞب۾٣ੋ&YUSBDUFENBQ1SF-USBJOFE 4UZMF("/'BDJBM"UUSJCVUF&ODPEFS&YUSBDUFEDPEF3FGFSFODFJNBHF *%JNBHF 'BDF-TXBQQFEJNBHF.'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO
3FGFSFODFJNBHF *%JNBHFW#BTFMJOF W#BTFMJOF&YUSBDUFENBQ'BDF-TXBQQFEJNBHF 'BDF-TXBQQFEJNBHF3FGFSFODF *%,BSSBT 5FSP FUBM1SPHSFTTJWF(SPXJOHPG("/TGPS*NQSPWFE2VBMJUZ 4UBCJMJUZ BOE7BSJBUJPO*OUFSOBUJPOBM$POGFSFODFPO-FBSOJOH3FQSFTFOUBUJPOT?'BDF-TXBQQFEJNBHFW.'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO
ӝઓޙઁ߈غযঠೡBUUSJCVUFTо࠙߈غঋ↟ 3FGFSFODFJNBHF۽ࠗఠ ݠܻпب↟ *%JNBHF۽ࠗఠҷഋ↟ 4PMVUJPO%..TVQFSWJTJPOਸणҗী୶о.'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO
%..↟ %۽ࠗఠ%QBSBNUFSܳ୶೧ࢲ%SFDPOTUSVDUJPO%NBOJQVMBUJPO%.. &ODPEFS%.. %FDPEFS4IBQF&YQSFTTJPO1PTF%JOQVUJNBHF %SFDPOTUSVDUJPO'FOH :BP FUBM-FBSOJOHBOBOJNBUBCMFEFUBJMFE%GBDFNPEFMGSPNJO-UIF-XJMEJNBHFT"$.5SBOTBDUJPOTPO(SBQIJDT 5P( .'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO
ӝઓޙઁ߈غযঠೡBUUSJCVUFTо࠙߈غঋ↟ 4PMVUJPO%..TVQFSWJTJPOਸणҗী୶о1SF-USBJOFE 4UZMF("/'BDJBM"UUSJCVUF&ODPEFS&YUSBDUFEDPEF3FGFSFODFJNBHF *%JNBHF 'BDF-TXBQQFEJNBHF*%JNBHF%.. &ODPEFSsrefsswapsidprefpswappiderefeswapeid3FGFSFODFJNBHF'BDF-TXBQQFEJNBHF&YUSBDUFENBQ4IBQF&YQSFTTJPO1PTF.'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO
3FGFSFODFJNBHF *%JNBHFW#BTFMJOF W#BTFMJOF&YUSBDUFENBQW#BTFMJOF&YUSBDUFENBQ%..TVQFSWJTJPO'BDF-TXBQQFEJNBHF 'BDF-TXBQQFEJNBHF 'BDF-TXBQQFEJNBHF3FGFSFODF *%,BSSBT 5FSP FUBM1SPHSFTTJWF(SPXJOHPG("/TGPS*NQSPWFE2VBMJUZ 4UBCJMJUZ BOE7BSJBUJPO*OUFSOBUJPOBM$POGFSFODFPO-FBSOJOH3FQSFTFOUBUJPOT.'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO
*EFOUJUZ 4IBQF &YQSFTTJPO 1PTF 1PTF-)/%FFQGBLFT FaceShifter 4JNTXBQ )Jfi'BDF *OGP4XBQ .FHB'4 4NPPUI4XBQ .'*. PVST .'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO
3FGFSFODFJNBHF *%JNBHF 'BDF-TXBQQFEJNBHF3FGFSFODF *%,BSSBT 5FSP FUBM1SPHSFTTJWF(SPXJOHPG("/TGPS*NQSPWFE2VBMJUZ 4UBCJMJUZ BOE7BSJBUJPO*OUFSOBUJPOBM$POGFSFODFPO-FBSOJOH3FQSFTFOUBUJPOT.'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO
'BDFTXBQQJOH3FGFSFODFWJEFP*%JNBHF'BDF-TXBQQFEGSBNFT1SF-QSPDFTT 'BDFEFUFDUJPO 4NPPUIJOH$SPQQJOH"MJHONFOU1SF-QSPDFTT 'BDFEFUFDUJPO 4NPPUIJOH$SPQQJOH"MJHONFOU1PTU-QSPDFTT 3FUPVDI 6ODSPQQJOH'BDF-TXBQQJOHQJQFMJOFGPSWJEFP3FGFSFODFGSBNFT'BDF-TXBQQFEWJEFP.'*..'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO
.'*..FHBQJYFM'BDJBM*EFOUJUZ.BOJQVMBUJPO
খਵ۽ӝغח
খਵ۽ӝغחօܻഝਊغחѪ ߓоౠ࢚ਸ୫ ੋҕמӝࣿਸਊೞৈ࢚ҷਸਗೞחҷ۽߄Է↟ ਬݺোੋ࢚ਸ୫ೡਃহGBDFTXBQQJOHਵ۽ઁ↟ ઓೞঋח࢜۽JEFOUJUZ٣ੋറ٣ణോݢਵ۽ٜ݅ӝ
хࢎפ