카카오브레인의 텍스트 기반 이미지 생성 기술

$PQZSJHIU ,BLBP $PSQ"MMSJHIUTSFTFSWFE3FEJTUSJCVUJPOPSQVCMJDEJTQMBZJTOPUQFSNJUUFEXJUIPVUXSJUUFOQFSNJTTJPOGSPN,BLBP ஠஠য়࠳ۨੋ੄ ఫझ౟ ӝ߈ ੉޷૑ ࢤࢿ ӝࣿ JG
LBLBP ஠஠য়࠳ۨੋ ӣࣁള TBNLTI

஠஠য়࠳ۨੋ੄ 5*ࢤࢿ ݽ؛ ࣗѐ അ੤ ݽ؛ ѐࢶਸ ਤೠ োҳ ೐۽ં౟

஠஠য়࠳ۨੋ੄ 5*ࢤࢿ ݽ؛ ࣗѐ 5PXBSET&GGJDJFOU5FYU$POEJUJPOBM%JGGVTJPO.PEFMT CZ"EWFSTBSJBM5SBJOJOH

%FOPJTJOH%JGGVTJPO1SPCBCJMJTUJD.PEFMT "QIPUPPGBUFEEZCFBSPOUIFSPBE "IJHIRVBMJUZ QJDUVSFPGBNFEJFWBMLOJHIUXJUIHPMEFOBSNPS +)P "+BJO BOE1"CCFFMt%FOPJTJOH%JGGVTJPO1SPCBCJMJTUJD.PEFMTu /FVS*14s

0WFSBMM"SDIJUFDUVSF VO$-*1 BLB%"--& ਬࢎೞѱ 1SJPSm %FDPEFSm 43 ݽٕ۽ ҳࢿغয
੓णפ׮ "3BNFTI 1%IBSJXBM "/JDIPM $$IV BOE.$IFOu)JFSBSDIJDBM5FYU$POEJUJPOBM*NBHF(FOFSBUJPOXJUI$-*1-BUFOUTuBS9JWW

0WFSBMM"SDIJUFDUVSF A high quality picture of a medieval knight with
golden armor Prior Y/ Y Y CLIP (text encoder) Y/ CLIP (image feature)

0WFSBMM"SDIJUFDUVSF A high quality picture of a medieval knight with
golden armor Y/ Y Y CLIP (text encoder) Y/ CLIP (image feature) Prior

0WFSBMM"SDIJUFDUVSF 1SJPS m %FDPEFSm 43

0WFSBMM"SDIJUFDUVSF 1SJPS m %FDPEFSm 43 $-*1UFYUGFBUVSF QPPMJOH੹ ੿ࠁب ನೣ

0WFSBMM"SDIJUFDUVSF 1SJPS m %FDPEFSm 43 $-*1UFYUGFBUVSF UJNF

0WFSBMM"SDIJUFDUVSF 1SJPSm %FDPEFS m 43 A high quality picture of
a medieval knight with golden armor Causal Transformer Y/ Y Y/ CLIP (text encoder) CLIP (image feature)

0WFSBMM"SDIJUFDUVSF 1SJPSm %FDPEFSm 43 Y Y/

0WFSBMM"SDIJUFDUVSF 1SJPSm %FDPEFSm *NQSPWFE43 Y Y/ Y 1SFUSBJOFE 'SFF[F 5SBJOBCMF
JOJUJBMJ[FEGSPNUIF QSFUSBJOFEOFU MSE loss Perceptual loss Adversarial loss

&YQFSJNFOU4FUVQ 1SJPS %FDPEFS 43 ೟ण ؘ੉ఠ .JNBHFUFYUQBJST $0:0ؘ੉ఠࣇ ನೣ ೟ण
ߑध झ௼ې஖ ೟ण $-*1ݽ؛ 7J5- 7J5- QBSBNFUFST # . . . PQUJNJ[BUJPO TUFQT . . . . TBNQMJOHTUFQT TUFQT TUFQT TUFQT

2VBOUJUBUJWF3FTVMUT $$. $0$0 ,GSPNWBM $-*1T 7J5# '*%

2VBOUJUBUJWF3FTVMUT $$. $0$0 ,GSPNWBM $-*1T 7J5# '*%
"3BNFTI 1%IBSJXBM "/JDIPM $$IV BOE.$IFOu)JFSBSDIJDBM5FYU$POEJUJPOBM*NBHF(FOFSBUJPOXJUI$-*1-BUFOUTuBS9JWW WT GSPNVO$-*1

2VBMJUBUJWF3FTVMUT ࠂ੟ೠ ஶࣆী ؀ೠ ؀਽ מ۱ ಣо

2VBMJUBUJWF3FTVMUT ࠂ੟ೠ ஶࣆী ؀ೠ ؀਽ מ۱ ಣо (PSZFP DFMBEPOJOUIFTIBQFPGEBSUI WBEFS
IPMEJOHBTXPSE (PSZFP DFMBEPOJOUIFTIBQFPGEBSUI WBEFS

2VBMJUBUJWF3FTVMUT ࠂ੟ೠ ஶࣆী ؀ೠ ؀਽ מ۱ ಣо (PSZFP DFMBEPOJOUIFTIBQFPGEBSUI WBEFS
IPMEJOHBTXPSE "TVQFSNBUIXJ[BSEDBU SJDIMZUFYUVSFEPJMQBJOUJOH

2VBMJUBUJWF3FTVMUT ࠂ੟ೠ ஶࣆী ؀ೠ ؀਽ מ۱ ಣо "OBTUSPOBVUSJEJOHBIPSTF DIJMESFOESBXJOHTUZMF "OBTUSPOBVUSJEJOHBIPSTF
DIJMESFOESBXJOHTUZMF

2VBMJUBUJWF3FTVMUT 1IPUPSFBMJTUJDࢤࢿ оמ ৈࠗ ಣо

2VBMJUBUJWF3FTVMUT 1IPUPSFBMJTUJDࢤࢿ оמ ৈࠗ ಣо "OBTUSPOBVUSJEJOHBIPSTF DIJMESFOESBXJOHTUZMF BQIPUPPGBCBCZQVQQZXBJUJOHGPSIFSNPN

2VBMJUBUJWF3FTVMUT 1IPUPSFBMJTUJDࢤࢿ оמ ৈࠗ ಣо 1IPUPPGBZFBSPME XIJUFNBO TJMWFSIBJS OFBUCFBSE XFBSJOHBSFEHJMFU
UIJDLSJNNFEHMBTTFT

2VBMJUBUJWF3FTVMUT 1IPUPSFBMJTUJDࢤࢿ оמ ৈࠗ ಣо "OBTUSPOBVUSJEJOHBIPSTF DIJMESFOESBXJOHTUZMF BQPSUSBJUPGBOPMENPOL

2VBMJUBUJWF3FTVMUT *NBHFWBSJBUJPOоמ ৈࠗ ಣо

അ੤ ݽ؛ ѐࢶਸ ਤೠ োҳ ೐۽ં౟ 0VS "QQSPBDIFT UP *NQSPWF
5XPTUBHF *NBHF (FOFSBUJPO 'SBNFXPSL

5XP4UBHF*NBHF(FOFSBUJPO'SBNFXPSL "0PSE 07JOZBMT BOE,,BWVLDVPHMVt/FVSBM%JTDSFUF3FQSFTFOUBUJPO-FBSOJOHu/FVS*14s

5XP4UBHF*NBHF(FOFSBUJPO'SBNFXPSL "0PSE 07JOZBMT BOE,,BWVLDVPHMVt/FVSBM%JTDSFUF3FQSFTFOUBUJPO-FBSOJOHu/FVS*14s 4UBHF

5XP4UBHF*NBHF(FOFSBUJPO'SBNFXPSL "0PSE 07JOZBMT BOE,,BWVLDVPHMVt/FVSBM%JTDSFUF3FQSFTFOUBUJPO-FBSOJOHu/FVS*14s 4UBHF"3PSOPO"3NPEFMJOH

അ੤ ݽ؛ ѐࢶਸ ਤೠ োҳ ೐۽ં౟ %-FF $,JN 4,JN
.$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s 5:V 4,JN $,JN %-FF BOE#)BOt-PDBMMZ)JFSBSDIJDBM"VUPSFHSFTTJWF.PEFMJOHGPS*NBHF(FOFSBUJPOt/FVS*14s %-FF $,JN 4,JN .$IP BOE8)BOt%SBGUBOE3FWJTF&GGFDUJWF*NBHF(FOFSBUJPOXJUI$POUFYUVBM325SBOTGPSNFSt/FVS*14s 327"& $713s )27"& /FVS*14s %SBGUBOE3FWJTF /FVS*14s

4FRVFODF-FOHUIBOE"3.PEFM

3FTJEVBM2VBOUJ[FE7"& 327"& %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s

3FTJEVBM2VBOUJ[FE7"& 327"& %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s $PEF3FTPMVUJPO )
Y 8 Y % $PEFCPPL4J[F S'*% 72("/ YY m QBQFS YY 327"& YY YY

3FTJEVBM2VBOUJ[FE5SBOTGPSNFS 325SBOTGPSNFS %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s

325SBOTGPSNFSز੘ ߑध

3FTJEVBM2VBOUJ[FE5SBOTGPSNFS 325SBOTGPSNFS %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s

)JFSBSDIJDBM2VBOUJ[FE7"& )27"& 5:V 4,JN $,JN %-FF BOE#)BOt-PDBMMZ)JFSBSDIJDBM"VUPSFHSFTTJWF.PEFMJOHGPS*NBHF(FOFSBUJPOt/FVS*14s

$POUFYUVBM325SBOTGPSNFS %-FF $,JN 4,JN .$IP BOE8)BOt%SBGUBOE3FWJTF&GGFDUJWF*NBHF(FOFSBUJPOXJUI$POUFYUVBM325SBOTGPSNFSt/FVS*14s

ߊ಴ܳ ݃஖ݶࢲ

ଵҊ ޙ೴ +)P "+BJO BOE1"CCFFMt%FOPJTJOH%JGGVTJPO1SPCBCJMJTUJD.PEFMTu /FVS*14s "3BNFTI 1%IBSJXBM
"/JDIPM $$IV BOE.$IFOu)JFSBSDIJDBM5FYU$POEJUJPOBM*NBHF(FOFSBUJPOXJUI$-*1-BUFOUTuBS9JWW "0PSE 07JOZBMT BOE,,BWVLDVPHMVt/FVSBM%JTDSFUF3FQSFTFOUBUJPO-FBSOJOHu/FVS*14s %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s 5:V 4,JN $,JN %-FF BOE#)BOt-PDBMMZ)JFSBSDIJDBM"VUPSFHSFTTJWF.PEFMJOHGPS*NBHF(FOFSBUJPOt/FVS*14s %-FF $,JN 4,JN .$IP BOE8)BOt%SBGUBOE3FWJTF&GGFDUJWF*NBHF(FOFSBUJPOXJUI$POUFYUVBM325SBOTGPSNFSt/FVS*14s

카카오브레인의 텍스트 기반 이미지 생성 기술

카카오브레인의 텍스트 기반 이미지 생성 기술

More Decks by kakao

Other Decks in Programming

Featured

Transcript