Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
카카오브레인의 텍스트 기반 이미지 생성 기술
Search
kakao
December 09, 2022
Programming
0
430
카카오브레인의 텍스트 기반 이미지 생성 기술
#GenerativeModel
카카오브레인에서 개발한 텍스트 기반 이미지 생성 기술을 소개합니다
발표자 : sam.ksh
카카오브레인에서 생성 모델을 개발하고 있는 연구원입니다.
kakao
December 09, 2022
Tweet
Share
More Decks by kakao
See All by kakao
나의 컨텍스트를 아는 친구, Context-Aware AI Mate
kakao
0
100
카카오i를 통한 AIOT 서비스의 사례와 미래
kakao
0
88
데이터 분석과 머신러닝을 통한 유저 방문 맛집 발굴하기
kakao
0
100
최애 작품 이용권 선물해주는 ‘Helix 푸시’ 개발기
kakao
0
53
지연 시간 순삭! LLM 추론 구조와 효율적 애플리케이션 설계
kakao
0
110
문서 검토는 이제 Document AI로 한방에!
kakao
0
150
이미지까지 이해하는 Multimodal LLM의 학습 방법 밝혀내기
kakao
0
310
나만의 프로필 이미지를 만드는 Personlized T2I 모델 개발기
kakao
0
57
생성형AI를 활용한 개체명인식(NER)
kakao
0
120
Other Decks in Programming
See All in Programming
Browser and UI #2 HTML/ARIA
ken7253
2
170
VitestのIn-Source Testingが便利
taro28
8
2.4k
カウシェで Four Keys の改善を試みた理由
ike002jp
1
130
Optimizing JRuby 10
headius
0
580
音声プラットフォームのアーキテクチャ変遷から学ぶ、クラウドネイティブなバッチ処理 (20250422_CNDS2025_Batch_Architecture)
thousanda
0
410
読書シェア会 vol.4 『ダイナミックリチーミング 第2版』
kotaro666
0
110
ぽちぽち選択するだけでOSSを読めるVSCode拡張機能
ymbigo
13
6k
Dissecting and Reconstructing Ruby Syntactic Structures
ydah
4
2.1k
Storybookの情報をMCPサーバー化する
shota_tech
2
810
Flutterでllama.cppをつかってローカルLLMを試してみた
sakuraidayo
0
130
In geheimer Mission: AI Agents entwickeln
joergneumann
0
110
KANNA Android の技術的課題と取り組み
watabee
0
210
Featured
See All Featured
How To Stay Up To Date on Web Technology
chriscoyier
790
250k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
kevinliebholz
32
5.6k
The Art of Programming - Codeland 2020
erikaheidi
54
13k
How to train your dragon (web standard)
notwaldorf
91
6k
No one is an island. Learnings from fostering a developers community.
thoeni
21
3.3k
[RailsConf 2023] Rails as a piece of cake
palkan
54
5.5k
Navigating Team Friction
lara
185
15k
Building Better People: How to give real-time feedback that sticks.
wjessup
368
19k
Docker and Python
trallard
44
3.4k
Fight the Zombie Pattern Library - RWD Summit 2016
marcelosomers
233
17k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
jcasabona
32
2.3k
Code Review Best Practice
trishagee
67
18k
Transcript
$PQZSJHIU ,BLBP $PSQ"MMSJHIUTSFTFSWFE3FEJTUSJCVUJPOPSQVCMJDEJTQMBZJTOPUQFSNJUUFEXJUIPVUXSJUUFOQFSNJTTJPOGSPN,BLBP য়࠳ۨੋ ఫझ ӝ߈ ࢤࢿ ӝࣿ JG
LBLBP য়࠳ۨੋ ӣࣁള TBNLTI
য়࠳ۨੋ 5*ࢤࢿ ݽ؛ ࣗѐ അ ݽ؛ ѐࢶਸ ਤೠ োҳ ۽ં
য়࠳ۨੋ 5*ࢤࢿ ݽ؛ ࣗѐ 5PXBSET&GGJDJFOU5FYU$POEJUJPOBM%JGGVTJPO.PEFMT CZ"EWFSTBSJBM5SBJOJOH
%FOPJTJOH%JGGVTJPO1SPCBCJMJTUJD.PEFMT "QIPUPPGBUFEEZCFBSPOUIFSPBE "IJHIRVBMJUZ QJDUVSFPGBNFEJFWBMLOJHIUXJUIHPMEFOBSNPS +)P "+BJO BOE1"CCFFMt%FOPJTJOH%JGGVTJPO1SPCBCJMJTUJD.PEFMTu /FVS*14s
0WFSBMM"SDIJUFDUVSF VO$-*1 BLB%"--& ਬࢎೞѱ 1SJPSm %FDPEFSm 43 ݽٕ۽ ҳࢿغয
णפ "3BNFTI 1%IBSJXBM "/JDIPM $$IV BOE.$IFOu)JFSBSDIJDBM5FYU$POEJUJPOBM*NBHF(FOFSBUJPOXJUI$-*1-BUFOUTuBS9JWW
0WFSBMM"SDIJUFDUVSF A high quality picture of a medieval knight with
golden armor Prior Y/ Y Y CLIP (text encoder) Y/ CLIP (image feature)
0WFSBMM"SDIJUFDUVSF A high quality picture of a medieval knight with
golden armor Y/ Y Y CLIP (text encoder) Y/ CLIP (image feature) Prior
0WFSBMM"SDIJUFDUVSF A high quality picture of a medieval knight with
golden armor Y/ Y Y CLIP (text encoder) Y/ CLIP (image feature) Prior
0WFSBMM"SDIJUFDUVSF 1SJPS m %FDPEFSm 43
0WFSBMM"SDIJUFDUVSF 1SJPS m %FDPEFSm 43 $-*1UFYUGFBUVSF QPPMJOH ࠁب ನೣ
0WFSBMM"SDIJUFDUVSF 1SJPS m %FDPEFSm 43 $-*1UFYUGFBUVSF UJNF
0WFSBMM"SDIJUFDUVSF 1SJPSm %FDPEFS m 43 A high quality picture of
a medieval knight with golden armor Causal Transformer Y/ Y Y/ CLIP (text encoder) CLIP (image feature)
0WFSBMM"SDIJUFDUVSF 1SJPSm %FDPEFSm 43 Y Y/
0WFSBMM"SDIJUFDUVSF 1SJPSm %FDPEFSm *NQSPWFE43 Y Y/ Y 1SFUSBJOFE 'SFF[F 5SBJOBCMF
JOJUJBMJ[FEGSPNUIF QSFUSBJOFEOFU MSE loss Perceptual loss Adversarial loss
&YQFSJNFOU4FUVQ 1SJPS %FDPEFS 43 ण ؘఠ .JNBHFUFYUQBJST $0:0ؘఠࣇ ನೣ ण
ߑध झې ण $-*1ݽ؛ 7J5- 7J5- QBSBNFUFST # . . . PQUJNJ[BUJPO TUFQT . . . . TBNQMJOHTUFQT TUFQT TUFQT TUFQT
2VBOUJUBUJWF3FTVMUT $$. $0$0 ,GSPNWBM $-*1T 7J5# '*%
2VBOUJUBUJWF3FTVMUT $$. $0$0 ,GSPNWBM $-*1T 7J5# '*%
"3BNFTI 1%IBSJXBM "/JDIPM $$IV BOE.$IFOu)JFSBSDIJDBM5FYU$POEJUJPOBM*NBHF(FOFSBUJPOXJUI$-*1-BUFOUTuBS9JWW WT GSPNVO$-*1
2VBMJUBUJWF3FTVMUT ࠂೠ ஶࣆী ೠ מ۱ ಣо
2VBMJUBUJWF3FTVMUT ࠂೠ ஶࣆী ೠ מ۱ ಣо (PSZFP DFMBEPOJOUIFTIBQFPGEBSUI WBEFS
IPMEJOHBTXPSE (PSZFP DFMBEPOJOUIFTIBQFPGEBSUI WBEFS
2VBMJUBUJWF3FTVMUT ࠂೠ ஶࣆী ೠ מ۱ ಣо (PSZFP DFMBEPOJOUIFTIBQFPGEBSUI WBEFS
IPMEJOHBTXPSE "TVQFSNBUIXJ[BSEDBU SJDIMZUFYUVSFEPJMQBJOUJOH
2VBMJUBUJWF3FTVMUT ࠂೠ ஶࣆী ೠ מ۱ ಣо "OBTUSPOBVUSJEJOHBIPSTF DIJMESFOESBXJOHTUZMF "OBTUSPOBVUSJEJOHBIPSTF
DIJMESFOESBXJOHTUZMF
2VBMJUBUJWF3FTVMUT 1IPUPSFBMJTUJDࢤࢿ оמ ৈࠗ ಣо
2VBMJUBUJWF3FTVMUT 1IPUPSFBMJTUJDࢤࢿ оמ ৈࠗ ಣо "OBTUSPOBVUSJEJOHBIPSTF DIJMESFOESBXJOHTUZMF BQIPUPPGBCBCZQVQQZXBJUJOHGPSIFSNPN
2VBMJUBUJWF3FTVMUT 1IPUPSFBMJTUJDࢤࢿ оמ ৈࠗ ಣо 1IPUPPGBZFBSPME XIJUFNBO TJMWFSIBJS OFBUCFBSE XFBSJOHBSFEHJMFU
UIJDLSJNNFEHMBTTFT
2VBMJUBUJWF3FTVMUT 1IPUPSFBMJTUJDࢤࢿ оמ ৈࠗ ಣо "OBTUSPOBVUSJEJOHBIPSTF DIJMESFOESBXJOHTUZMF BQPSUSBJUPGBOPMENPOL
2VBMJUBUJWF3FTVMUT *NBHFWBSJBUJPOоמ ৈࠗ ಣо
2VBMJUBUJWF3FTVMUT *NBHFWBSJBUJPOоמ ৈࠗ ಣо
അ ݽ؛ ѐࢶਸ ਤೠ োҳ ۽ં 0VS "QQSPBDIFT UP *NQSPWF
5XPTUBHF *NBHF (FOFSBUJPO 'SBNFXPSL
5XP4UBHF*NBHF(FOFSBUJPO'SBNFXPSL "0PSE 07JOZBMT BOE,,BWVLDVPHMVt/FVSBM%JTDSFUF3FQSFTFOUBUJPO-FBSOJOHu/FVS*14s
5XP4UBHF*NBHF(FOFSBUJPO'SBNFXPSL "0PSE 07JOZBMT BOE,,BWVLDVPHMVt/FVSBM%JTDSFUF3FQSFTFOUBUJPO-FBSOJOHu/FVS*14s
5XP4UBHF*NBHF(FOFSBUJPO'SBNFXPSL "0PSE 07JOZBMT BOE,,BWVLDVPHMVt/FVSBM%JTDSFUF3FQSFTFOUBUJPO-FBSOJOHu/FVS*14s
5XP4UBHF*NBHF(FOFSBUJPO'SBNFXPSL "0PSE 07JOZBMT BOE,,BWVLDVPHMVt/FVSBM%JTDSFUF3FQSFTFOUBUJPO-FBSOJOHu/FVS*14s 4UBHF
5XP4UBHF*NBHF(FOFSBUJPO'SBNFXPSL "0PSE 07JOZBMT BOE,,BWVLDVPHMVt/FVSBM%JTDSFUF3FQSFTFOUBUJPO-FBSOJOHu/FVS*14s 4UBHF"3PSOPO"3NPEFMJOH
അ ݽ؛ ѐࢶਸ ਤೠ োҳ ۽ં %-FF $,JN 4,JN
.$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s 5:V 4,JN $,JN %-FF BOE#)BOt-PDBMMZ)JFSBSDIJDBM"VUPSFHSFTTJWF.PEFMJOHGPS*NBHF(FOFSBUJPOt/FVS*14s %-FF $,JN 4,JN .$IP BOE8)BOt%SBGUBOE3FWJTF&GGFDUJWF*NBHF(FOFSBUJPOXJUI$POUFYUVBM325SBOTGPSNFSt/FVS*14s 327"& $713s )27"& /FVS*14s %SBGUBOE3FWJTF /FVS*14s
4FRVFODF-FOHUIBOE"3.PEFM
4FRVFODF-FOHUIBOE"3.PEFM
3FTJEVBM2VBOUJ[FE7"& 327"& %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s
3FTJEVBM2VBOUJ[FE7"& 327"& %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s
3FTJEVBM2VBOUJ[FE7"& 327"& %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s
3FTJEVBM2VBOUJ[FE7"& 327"& %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s
3FTJEVBM2VBOUJ[FE7"& 327"& %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s
3FTJEVBM2VBOUJ[FE7"& 327"& %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s $PEF3FTPMVUJPO )
Y 8 Y % $PEFCPPL4J[F S'*% 72("/ YY m QBQFS YY 327"& YY YY
3FTJEVBM2VBOUJ[FE5SBOTGPSNFS 325SBOTGPSNFS %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s
325SBOTGPSNFSز ߑध
3FTJEVBM2VBOUJ[FE5SBOTGPSNFS 325SBOTGPSNFS %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s
3FTJEVBM2VBOUJ[FE5SBOTGPSNFS 325SBOTGPSNFS %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s
)JFSBSDIJDBM2VBOUJ[FE7"& )27"& 5:V 4,JN $,JN %-FF BOE#)BOt-PDBMMZ)JFSBSDIJDBM"VUPSFHSFTTJWF.PEFMJOHGPS*NBHF(FOFSBUJPOt/FVS*14s
)JFSBSDIJDBM2VBOUJ[FE7"& )27"& 5:V 4,JN $,JN %-FF BOE#)BOt-PDBMMZ)JFSBSDIJDBM"VUPSFHSFTTJWF.PEFMJOHGPS*NBHF(FOFSBUJPOt/FVS*14s
)JFSBSDIJDBM2VBOUJ[FE7"& )27"& 5:V 4,JN $,JN %-FF BOE#)BOt-PDBMMZ)JFSBSDIJDBM"VUPSFHSFTTJWF.PEFMJOHGPS*NBHF(FOFSBUJPOt/FVS*14s
$POUFYUVBM325SBOTGPSNFS %-FF $,JN 4,JN .$IP BOE8)BOt%SBGUBOE3FWJTF&GGFDUJWF*NBHF(FOFSBUJPOXJUI$POUFYUVBM325SBOTGPSNFSt/FVS*14s
$POUFYUVBM325SBOTGPSNFS %-FF $,JN 4,JN .$IP BOE8)BOt%SBGUBOE3FWJTF&GGFDUJWF*NBHF(FOFSBUJPOXJUI$POUFYUVBM325SBOTGPSNFSt/FVS*14s
$POUFYUVBM325SBOTGPSNFS %-FF $,JN 4,JN .$IP BOE8)BOt%SBGUBOE3FWJTF&GGFDUJWF*NBHF(FOFSBUJPOXJUI$POUFYUVBM325SBOTGPSNFSt/FVS*14s
$POUFYUVBM325SBOTGPSNFS %-FF $,JN 4,JN .$IP BOE8)BOt%SBGUBOE3FWJTF&GGFDUJWF*NBHF(FOFSBUJPOXJUI$POUFYUVBM325SBOTGPSNFSt/FVS*14s
ߊܳ ݃ݶࢲ
ଵҊ ޙ +)P "+BJO BOE1"CCFFMt%FOPJTJOH%JGGVTJPO1SPCBCJMJTUJD.PEFMTu /FVS*14s "3BNFTI 1%IBSJXBM
"/JDIPM $$IV BOE.$IFOu)JFSBSDIJDBM5FYU$POEJUJPOBM*NBHF(FOFSBUJPOXJUI$-*1-BUFOUTuBS9JWW "0PSE 07JOZBMT BOE,,BWVLDVPHMVt/FVSBM%JTDSFUF3FQSFTFOUBUJPO-FBSOJOHu/FVS*14s %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s 5:V 4,JN $,JN %-FF BOE#)BOt-PDBMMZ)JFSBSDIJDBM"VUPSFHSFTTJWF.PEFMJOHGPS*NBHF(FOFSBUJPOt/FVS*14s %-FF $,JN 4,JN .$IP BOE8)BOt%SBGUBOE3FWJTF&GGFDUJWF*NBHF(FOFSBUJPOXJUI$POUFYUVBM325SBOTGPSNFSt/FVS*14s
&0%