Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
카카오브레인의 텍스트 기반 이미지 생성 기술
Search
kakao
December 09, 2022
Programming
0
400
카카오브레인의 텍스트 기반 이미지 생성 기술
#GenerativeModel
카카오브레인에서 개발한 텍스트 기반 이미지 생성 기술을 소개합니다
발표자 : sam.ksh
카카오브레인에서 생성 모델을 개발하고 있는 연구원입니다.
kakao
December 09, 2022
Tweet
Share
More Decks by kakao
See All by kakao
이 세상 모든 물체를 검출할 수 있는 AI 기술을 만들 수 있을까요?
kakao
0
470
좌충우돌 애니모지 개발기
kakao
0
340
AI로 난치병을 치료할 수 있을까요?
kakao
0
260
초거대모델 학습을 위한 이미지-텍스트 데이터셋
kakao
0
610
코끼리를 GPU에 넣는 법
kakao
0
390
의료영상이 인공지능을 만났을 때: To be or Not to be
kakao
0
310
초거대 AI 기술은 헬스케어에 어떻게 활용될까?
kakao
0
390
Druid 반정형 데이터 고군분투기
kakao
0
340
WebRTC 기반 게임 리모트 플레이
kakao
0
1k
Other Decks in Programming
See All in Programming
GoのIteratorに詳しくなってしまう
inatonix
1
180
Some more adventure of Happy Eyeballs
coe401_
2
160
Method Swizzlingを行うライブラリにおけるマルチモジュール設計
yoshikma
0
110
ECMAScript、Web標準の型はどう管理されているか / How ECMAScript and Web standards types are maintained
petamoriken
3
370
初めてのiOS関連GitHub ActionsをMarketplaceに公開するまでの実録
konifar
3
200
令和トラベルにおけるLLM活用事例:社内ツール開発から得た学びと実践
ippo012
0
120
dotfiles について話したい #湘なんか
stefafafan
2
290
Using Livebook to build and deploy internal tools @ ElixirConf 2024
hugobarauna
0
220
労務ドメインを快適に開発する方法 / How to Comfortably Develop in the Labor Domain
yuki21
1
250
詳解UIWindow
natmark
3
2.1k
状態管理ライブラリZustandの導入から運用まで
k1tikurisu
2
310
1人で挑むSwiftコンパイラ 〜型システム入門編〜
s_shimotori
0
320
Featured
See All Featured
Documentation Writing (for coders)
carmenintech
65
4.3k
5 minutes of I Can Smell Your CMS
philhawksworth
201
19k
Teambox: Starting and Learning
jrom
131
8.7k
Clear Off the Table
cherdarchuk
90
320k
Dealing with People You Can't Stand - Big Design 2015
cassininazir
363
22k
YesSQL, Process and Tooling at Scale
rocio
167
14k
Automating Front-end Workflow
addyosmani
1365
200k
Responsive Adventures: Dirty Tricks From The Dark Corners of Front-End
smashingmag
248
20k
How to Think Like a Performance Engineer
csswizardry
15
920
The Language of Interfaces
destraynor
153
23k
Making Projects Easy
brettharned
113
5.8k
The Power of CSS Pseudo Elements
geoffreycrofte
71
5.2k
Transcript
$PQZSJHIU ,BLBP $PSQ"MMSJHIUTSFTFSWFE3FEJTUSJCVUJPOPSQVCMJDEJTQMBZJTOPUQFSNJUUFEXJUIPVUXSJUUFOQFSNJTTJPOGSPN,BLBP য়࠳ۨੋ ఫझ ӝ߈ ࢤࢿ ӝࣿ JG
LBLBP য়࠳ۨੋ ӣࣁള TBNLTI
য়࠳ۨੋ 5*ࢤࢿ ݽ؛ ࣗѐ അ ݽ؛ ѐࢶਸ ਤೠ োҳ ۽ં
য়࠳ۨੋ 5*ࢤࢿ ݽ؛ ࣗѐ 5PXBSET&GGJDJFOU5FYU$POEJUJPOBM%JGGVTJPO.PEFMT CZ"EWFSTBSJBM5SBJOJOH
%FOPJTJOH%JGGVTJPO1SPCBCJMJTUJD.PEFMT "QIPUPPGBUFEEZCFBSPOUIFSPBE "IJHIRVBMJUZ QJDUVSFPGBNFEJFWBMLOJHIUXJUIHPMEFOBSNPS +)P "+BJO BOE1"CCFFMt%FOPJTJOH%JGGVTJPO1SPCBCJMJTUJD.PEFMTu /FVS*14s
0WFSBMM"SDIJUFDUVSF VO$-*1 BLB%"--& ਬࢎೞѱ 1SJPSm %FDPEFSm 43 ݽٕ۽ ҳࢿغয
णפ "3BNFTI 1%IBSJXBM "/JDIPM $$IV BOE.$IFOu)JFSBSDIJDBM5FYU$POEJUJPOBM*NBHF(FOFSBUJPOXJUI$-*1-BUFOUTuBS9JWW
0WFSBMM"SDIJUFDUVSF A high quality picture of a medieval knight with
golden armor Prior Y/ Y Y CLIP (text encoder) Y/ CLIP (image feature)
0WFSBMM"SDIJUFDUVSF A high quality picture of a medieval knight with
golden armor Y/ Y Y CLIP (text encoder) Y/ CLIP (image feature) Prior
0WFSBMM"SDIJUFDUVSF A high quality picture of a medieval knight with
golden armor Y/ Y Y CLIP (text encoder) Y/ CLIP (image feature) Prior
0WFSBMM"SDIJUFDUVSF 1SJPS m %FDPEFSm 43
0WFSBMM"SDIJUFDUVSF 1SJPS m %FDPEFSm 43 $-*1UFYUGFBUVSF QPPMJOH ࠁب ನೣ
0WFSBMM"SDIJUFDUVSF 1SJPS m %FDPEFSm 43 $-*1UFYUGFBUVSF UJNF
0WFSBMM"SDIJUFDUVSF 1SJPSm %FDPEFS m 43 A high quality picture of
a medieval knight with golden armor Causal Transformer Y/ Y Y/ CLIP (text encoder) CLIP (image feature)
0WFSBMM"SDIJUFDUVSF 1SJPSm %FDPEFSm 43 Y Y/
0WFSBMM"SDIJUFDUVSF 1SJPSm %FDPEFSm *NQSPWFE43 Y Y/ Y 1SFUSBJOFE 'SFF[F 5SBJOBCMF
JOJUJBMJ[FEGSPNUIF QSFUSBJOFEOFU MSE loss Perceptual loss Adversarial loss
&YQFSJNFOU4FUVQ 1SJPS %FDPEFS 43 ण ؘఠ .JNBHFUFYUQBJST $0:0ؘఠࣇ ನೣ ण
ߑध झې ण $-*1ݽ؛ 7J5- 7J5- QBSBNFUFST # . . . PQUJNJ[BUJPO TUFQT . . . . TBNQMJOHTUFQT TUFQT TUFQT TUFQT
2VBOUJUBUJWF3FTVMUT $$. $0$0 ,GSPNWBM $-*1T 7J5# '*%
2VBOUJUBUJWF3FTVMUT $$. $0$0 ,GSPNWBM $-*1T 7J5# '*%
"3BNFTI 1%IBSJXBM "/JDIPM $$IV BOE.$IFOu)JFSBSDIJDBM5FYU$POEJUJPOBM*NBHF(FOFSBUJPOXJUI$-*1-BUFOUTuBS9JWW WT GSPNVO$-*1
2VBMJUBUJWF3FTVMUT ࠂೠ ஶࣆী ೠ מ۱ ಣо
2VBMJUBUJWF3FTVMUT ࠂೠ ஶࣆী ೠ מ۱ ಣо (PSZFP DFMBEPOJOUIFTIBQFPGEBSUI WBEFS
IPMEJOHBTXPSE (PSZFP DFMBEPOJOUIFTIBQFPGEBSUI WBEFS
2VBMJUBUJWF3FTVMUT ࠂೠ ஶࣆী ೠ מ۱ ಣо (PSZFP DFMBEPOJOUIFTIBQFPGEBSUI WBEFS
IPMEJOHBTXPSE "TVQFSNBUIXJ[BSEDBU SJDIMZUFYUVSFEPJMQBJOUJOH
2VBMJUBUJWF3FTVMUT ࠂೠ ஶࣆী ೠ מ۱ ಣо "OBTUSPOBVUSJEJOHBIPSTF DIJMESFOESBXJOHTUZMF "OBTUSPOBVUSJEJOHBIPSTF
DIJMESFOESBXJOHTUZMF
2VBMJUBUJWF3FTVMUT 1IPUPSFBMJTUJDࢤࢿ оמ ৈࠗ ಣо
2VBMJUBUJWF3FTVMUT 1IPUPSFBMJTUJDࢤࢿ оמ ৈࠗ ಣо "OBTUSPOBVUSJEJOHBIPSTF DIJMESFOESBXJOHTUZMF BQIPUPPGBCBCZQVQQZXBJUJOHGPSIFSNPN
2VBMJUBUJWF3FTVMUT 1IPUPSFBMJTUJDࢤࢿ оמ ৈࠗ ಣо 1IPUPPGBZFBSPME XIJUFNBO TJMWFSIBJS OFBUCFBSE XFBSJOHBSFEHJMFU
UIJDLSJNNFEHMBTTFT
2VBMJUBUJWF3FTVMUT 1IPUPSFBMJTUJDࢤࢿ оמ ৈࠗ ಣо "OBTUSPOBVUSJEJOHBIPSTF DIJMESFOESBXJOHTUZMF BQPSUSBJUPGBOPMENPOL
2VBMJUBUJWF3FTVMUT *NBHFWBSJBUJPOоמ ৈࠗ ಣо
2VBMJUBUJWF3FTVMUT *NBHFWBSJBUJPOоמ ৈࠗ ಣо
അ ݽ؛ ѐࢶਸ ਤೠ োҳ ۽ં 0VS "QQSPBDIFT UP *NQSPWF
5XPTUBHF *NBHF (FOFSBUJPO 'SBNFXPSL
5XP4UBHF*NBHF(FOFSBUJPO'SBNFXPSL "0PSE 07JOZBMT BOE,,BWVLDVPHMVt/FVSBM%JTDSFUF3FQSFTFOUBUJPO-FBSOJOHu/FVS*14s
5XP4UBHF*NBHF(FOFSBUJPO'SBNFXPSL "0PSE 07JOZBMT BOE,,BWVLDVPHMVt/FVSBM%JTDSFUF3FQSFTFOUBUJPO-FBSOJOHu/FVS*14s
5XP4UBHF*NBHF(FOFSBUJPO'SBNFXPSL "0PSE 07JOZBMT BOE,,BWVLDVPHMVt/FVSBM%JTDSFUF3FQSFTFOUBUJPO-FBSOJOHu/FVS*14s
5XP4UBHF*NBHF(FOFSBUJPO'SBNFXPSL "0PSE 07JOZBMT BOE,,BWVLDVPHMVt/FVSBM%JTDSFUF3FQSFTFOUBUJPO-FBSOJOHu/FVS*14s 4UBHF
5XP4UBHF*NBHF(FOFSBUJPO'SBNFXPSL "0PSE 07JOZBMT BOE,,BWVLDVPHMVt/FVSBM%JTDSFUF3FQSFTFOUBUJPO-FBSOJOHu/FVS*14s 4UBHF"3PSOPO"3NPEFMJOH
അ ݽ؛ ѐࢶਸ ਤೠ োҳ ۽ં %-FF $,JN 4,JN
.$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s 5:V 4,JN $,JN %-FF BOE#)BOt-PDBMMZ)JFSBSDIJDBM"VUPSFHSFTTJWF.PEFMJOHGPS*NBHF(FOFSBUJPOt/FVS*14s %-FF $,JN 4,JN .$IP BOE8)BOt%SBGUBOE3FWJTF&GGFDUJWF*NBHF(FOFSBUJPOXJUI$POUFYUVBM325SBOTGPSNFSt/FVS*14s 327"& $713s )27"& /FVS*14s %SBGUBOE3FWJTF /FVS*14s
4FRVFODF-FOHUIBOE"3.PEFM
4FRVFODF-FOHUIBOE"3.PEFM
3FTJEVBM2VBOUJ[FE7"& 327"& %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s
3FTJEVBM2VBOUJ[FE7"& 327"& %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s
3FTJEVBM2VBOUJ[FE7"& 327"& %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s
3FTJEVBM2VBOUJ[FE7"& 327"& %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s
3FTJEVBM2VBOUJ[FE7"& 327"& %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s
3FTJEVBM2VBOUJ[FE7"& 327"& %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s $PEF3FTPMVUJPO )
Y 8 Y % $PEFCPPL4J[F S'*% 72("/ YY m QBQFS YY 327"& YY YY
3FTJEVBM2VBOUJ[FE5SBOTGPSNFS 325SBOTGPSNFS %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s
325SBOTGPSNFSز ߑध
3FTJEVBM2VBOUJ[FE5SBOTGPSNFS 325SBOTGPSNFS %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s
3FTJEVBM2VBOUJ[FE5SBOTGPSNFS 325SBOTGPSNFS %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s
)JFSBSDIJDBM2VBOUJ[FE7"& )27"& 5:V 4,JN $,JN %-FF BOE#)BOt-PDBMMZ)JFSBSDIJDBM"VUPSFHSFTTJWF.PEFMJOHGPS*NBHF(FOFSBUJPOt/FVS*14s
)JFSBSDIJDBM2VBOUJ[FE7"& )27"& 5:V 4,JN $,JN %-FF BOE#)BOt-PDBMMZ)JFSBSDIJDBM"VUPSFHSFTTJWF.PEFMJOHGPS*NBHF(FOFSBUJPOt/FVS*14s
)JFSBSDIJDBM2VBOUJ[FE7"& )27"& 5:V 4,JN $,JN %-FF BOE#)BOt-PDBMMZ)JFSBSDIJDBM"VUPSFHSFTTJWF.PEFMJOHGPS*NBHF(FOFSBUJPOt/FVS*14s
$POUFYUVBM325SBOTGPSNFS %-FF $,JN 4,JN .$IP BOE8)BOt%SBGUBOE3FWJTF&GGFDUJWF*NBHF(FOFSBUJPOXJUI$POUFYUVBM325SBOTGPSNFSt/FVS*14s
$POUFYUVBM325SBOTGPSNFS %-FF $,JN 4,JN .$IP BOE8)BOt%SBGUBOE3FWJTF&GGFDUJWF*NBHF(FOFSBUJPOXJUI$POUFYUVBM325SBOTGPSNFSt/FVS*14s
$POUFYUVBM325SBOTGPSNFS %-FF $,JN 4,JN .$IP BOE8)BOt%SBGUBOE3FWJTF&GGFDUJWF*NBHF(FOFSBUJPOXJUI$POUFYUVBM325SBOTGPSNFSt/FVS*14s
$POUFYUVBM325SBOTGPSNFS %-FF $,JN 4,JN .$IP BOE8)BOt%SBGUBOE3FWJTF&GGFDUJWF*NBHF(FOFSBUJPOXJUI$POUFYUVBM325SBOTGPSNFSt/FVS*14s
ߊܳ ݃ݶࢲ
ଵҊ ޙ +)P "+BJO BOE1"CCFFMt%FOPJTJOH%JGGVTJPO1SPCBCJMJTUJD.PEFMTu /FVS*14s "3BNFTI 1%IBSJXBM
"/JDIPM $$IV BOE.$IFOu)JFSBSDIJDBM5FYU$POEJUJPOBM*NBHF(FOFSBUJPOXJUI$-*1-BUFOUTuBS9JWW "0PSE 07JOZBMT BOE,,BWVLDVPHMVt/FVSBM%JTDSFUF3FQSFTFOUBUJPO-FBSOJOHu/FVS*14s %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s 5:V 4,JN $,JN %-FF BOE#)BOt-PDBMMZ)JFSBSDIJDBM"VUPSFHSFTTJWF.PEFMJOHGPS*NBHF(FOFSBUJPOt/FVS*14s %-FF $,JN 4,JN .$IP BOE8)BOt%SBGUBOE3FWJTF&GGFDUJWF*NBHF(FOFSBUJPOXJUI$POUFYUVBM325SBOTGPSNFSt/FVS*14s
&0%