Upgrade to Pro — share decks privately, control downloads, hide ads and more …

카카오브레인의 텍스트 기반 이미지 생성 기술

Avatar for kakao kakao
December 09, 2022
Programming
0
440

카카오브레인의 텍스트 기반 이미지 생성 기술

#GenerativeModel

카카오브레인에서 개발한 텍스트 기반 이미지 생성 기술을 소개합니다

발표자 : sam.ksh
카카오브레인에서 생성 모델을 개발하고 있는 연구원입니다.

Avatar for kakao

kakao

December 09, 2022
Tweet

More Decks by kakao

See All by kakao
나의 컨텍스트를 아는 친구, Context-Aware AI Mate
Avatar for kakao kakao
0
140
카카오i를 통한 AIOT 서비스의 사례와 미래
Avatar for kakao kakao
0
150
데이터 분석과 머신러닝을 통한 유저 방문 맛집 발굴하기
Avatar for kakao kakao
0
150
최애 작품 이용권 선물해주는 ‘Helix 푸시’ 개발기
Avatar for kakao kakao
0
69
지연 시간 순삭! LLM 추론 구조와 효율적 애플리케이션 설계
Avatar for kakao kakao
0
170
문서 검토는 이제 Document AI로 한방에!
Avatar for kakao kakao
0
220
이미지까지 이해하는 Multimodal LLM의 학습 방법 밝혀내기
Avatar for kakao kakao
0
600
나만의 프로필 이미지를 만드는 Personlized T2I 모델 개발기
Avatar for kakao kakao
0
81
생성형AI를 활용한 개체명인식(NER)
Avatar for kakao kakao
0
210

Other Decks in Programming

See All in Programming
Register is more than clipboard
Avatar for Satoru Kitaguchi satorunooshie
1
240
Dive into Triton Internals
Avatar for Liam Jongsu Kim appleparan
0
370
三者三様 宣言的UI
Avatar for Keita Kagurazaka kkagurazaka
0
320
Kotlin 2.2が切り拓く: コンテキストパラメータで書く関数型DSLと新しい依存管理のかたち
Avatar for Kenichi SUZUKI knih
0
110
CSC305 Lecture 10
Avatar for Javier Gonzalez-Sanchez javiergs
PRO
0
330
kiroとCodexで最高のSpec駆動開発を！！数時間で web3ネイティブなミニゲームを作ってみたよ！
Avatar for Haruki Kondo mashharuki
0
1k
GitHub Copilotを使いこなせ！/mastering_github_copilot!
Avatar for Kota Kageyama kotakageyama
2
480
Webサーバーサイド言語としてのRustについて
Avatar for kaza kouyuume
1
5k
実践Claude Code：20の失敗から学ぶAIペアプログラミング
Avatar for 武田隆志 takedatakashi
18
9.3k
SODA - FACT BOOK（JP）
Avatar for SODA inc. sodainc
1
9.1k
Claude Agent SDK を使ってみよう
Avatar for Hayami Shuhei hyshu
0
1.5k
他言語経験者が Golangci-lint を最初のコーディングメンターにした話 / How Golangci-lint Became My First Coding Mentor: A Story from a Polyglot Programmer
Avatar for uMa uma31
0
490

Featured

See All Featured
ピンチをチャンスに：未来をつくるプロダクトロードマップ #pmconf2020
Avatar for Aki / @LoveIdahoBurger aki_iinuma
127
54k
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
Avatar for Irina Nazarova irinanazarova
9
1k
Reflections from 52 weeks, 52 projects
Avatar for Jefferson Lam jeffersonlam
355
21k
Context Engineering - Making Every Token Count
Avatar for Addy Osmani addyosmani
8
330
Fantastic passwords and where to find them - at NoRuKo
Avatar for Phil Nash philnash
52
3.5k
jQuery: Nuts, Bolts and Bling
Avatar for Doug Neiner dougneiner
65
7.9k
ReactJS: Keep Simple. Everything can be a component!
Avatar for Pedro Nauck pedronauck
666
130k
Thoughts on Productivity
Avatar for Jon Yablonski jonyablonski
72
4.9k
Optimizing for Happiness
Avatar for Tom Preston-Werner mojombo
379
70k
10 Git Anti Patterns You Should be Aware of
Avatar for Lemi Orhan Ergin lemiorhan
PRO
658
61k
The Art of Delivering Value - GDevCon NA Keynote
Avatar for David Neal reverentgeek
16
1.7k
Rails Girls Zürich Keynote
Avatar for Gregor Martynus gr2m
95
14k

Transcript

  1. $PQZSJHIU ,BLBP $PSQ"MMSJHIUTSFTFSWFE3FEJTUSJCVUJPOPSQVCMJDEJTQMBZJTOPUQFSNJUUFEXJUIPVUXSJUUFOQFSNJTTJPOGSPN,BLBP ஠஠য়࠳ۨੋ੄ ఫझ౟ ӝ߈ ੉޷૑ ࢤࢿ ӝࣿ JG

    LBLBP  ஠஠য়࠳ۨੋ ӣࣁള TBNLTI

  2. ஠஠য়࠳ۨੋ੄ 5*ࢤࢿ ݽ؛ ࣗѐ അ੤ ݽ؛ ѐࢶਸ ਤೠ োҳ ೐۽ં౟

  3. ஠஠য়࠳ۨੋ੄ 5*ࢤࢿ ݽ؛ ࣗѐ 5PXBSET&GGJDJFOU5FYU$POEJUJPOBM%JGGVTJPO.PEFMT CZ"EWFSTBSJBM5SBJOJOH

  4. %FOPJTJOH%JGGVTJPO1SPCBCJMJTUJD.PEFMT "QIPUPPGBUFEEZCFBSPOUIFSPBE "IJHIRVBMJUZ QJDUVSFPGBNFEJFWBMLOJHIUXJUIHPMEFOBSNPS  +)P "+BJO BOE1"CCFFMt%FOPJTJOH%JGGVTJPO1SPCBCJMJTUJD.PEFMTu /FVS*14s

  5. 0WFSBMM"SDIJUFDUVSF VO$-*1 BLB%"--&  ਬࢎೞѱ 1SJPSm %FDPEFSm 43 ݽٕ۽ ҳࢿغয

    ੓णפ׮  "3BNFTI 1%IBSJXBM "/JDIPM $$IV BOE.$IFOu)JFSBSDIJDBM5FYU$POEJUJPOBM*NBHF(FOFSBUJPOXJUI$-*1-BUFOUTuBS9JWW

  6. 0WFSBMM"SDIJUFDUVSF A high quality picture of a medieval knight with

    golden armor Prior Y/ Y Y CLIP (text encoder) Y/ CLIP (image feature)

  7. 0WFSBMM"SDIJUFDUVSF A high quality picture of a medieval knight with

    golden armor Y/ Y Y CLIP (text encoder) Y/ CLIP (image feature) Prior

  8. 0WFSBMM"SDIJUFDUVSF A high quality picture of a medieval knight with

    golden armor Y/ Y Y CLIP (text encoder) Y/ CLIP (image feature) Prior

  9. 0WFSBMM"SDIJUFDUVSF 1SJPS m %FDPEFSm 43

  10. 0WFSBMM"SDIJUFDUVSF 1SJPS m %FDPEFSm 43 $-*1UFYUGFBUVSF QPPMJOH੹ ੿ࠁب ನೣ

  11. 0WFSBMM"SDIJUFDUVSF 1SJPS m %FDPEFSm 43 $-*1UFYUGFBUVSF UJNF

  12. 0WFSBMM"SDIJUFDUVSF 1SJPSm %FDPEFS m 43 A high quality picture of

    a medieval knight with golden armor Causal Transformer Y/ Y Y/ CLIP (text encoder) CLIP (image feature)

  13. 0WFSBMM"SDIJUFDUVSF 1SJPSm %FDPEFSm 43 Y Y/

  14. 0WFSBMM"SDIJUFDUVSF 1SJPSm %FDPEFSm *NQSPWFE43 Y Y/ Y 1SFUSBJOFE 'SFF[F 5SBJOBCMF

    JOJUJBMJ[FEGSPNUIF QSFUSBJOFEOFU MSE loss Perceptual loss Adversarial loss

  15. &YQFSJNFOU4FUVQ 1SJPS %FDPEFS 43 ೟ण ؘ੉ఠ .JNBHFUFYUQBJST $0:0ؘ੉ఠࣇ ನೣ ೟ण

    ߑध झ௼ې஖ ೟ण $-*1ݽ؛ 7J5- 7J5-  QBSBNFUFST # . . . PQUJNJ[BUJPO TUFQT . . . . TBNQMJOHTUFQT TUFQT TUFQT TUFQT

  16. 2VBOUJUBUJWF3FTVMUT $$. $0$0 ,GSPNWBM $-*1T 7J5#   '*% 

    

  17. 2VBOUJUBUJWF3FTVMUT $$. $0$0 ,GSPNWBM $-*1T 7J5#   '*% 

      "3BNFTI 1%IBSJXBM "/JDIPM $$IV BOE.$IFOu)JFSBSDIJDBM5FYU$POEJUJPOBM*NBHF(FOFSBUJPOXJUI$-*1-BUFOUTuBS9JWW WT GSPNVO$-*1

  18. 2VBMJUBUJWF3FTVMUT ࠂ੟ೠ ஶࣆী ؀ೠ ؀਽ מ۱ ಣо

  19. 2VBMJUBUJWF3FTVMUT ࠂ੟ೠ ஶࣆী ؀ೠ ؀਽ מ۱ ಣо (PSZFP DFMBEPOJOUIFTIBQFPGEBSUI WBEFS

    IPMEJOHBTXPSE (PSZFP DFMBEPOJOUIFTIBQFPGEBSUI WBEFS

  20. 2VBMJUBUJWF3FTVMUT ࠂ੟ೠ ஶࣆী ؀ೠ ؀਽ מ۱ ಣо (PSZFP DFMBEPOJOUIFTIBQFPGEBSUI WBEFS

    IPMEJOHBTXPSE "TVQFSNBUIXJ[BSEDBU SJDIMZUFYUVSFEPJMQBJOUJOH

  21. 2VBMJUBUJWF3FTVMUT ࠂ੟ೠ ஶࣆী ؀ೠ ؀਽ מ۱ ಣо "OBTUSPOBVUSJEJOHBIPSTF DIJMESFOESBXJOHTUZMF "OBTUSPOBVUSJEJOHBIPSTF

    DIJMESFOESBXJOHTUZMF

  22. 2VBMJUBUJWF3FTVMUT 1IPUPSFBMJTUJDࢤࢿ оמ ৈࠗ ಣо

  23. 2VBMJUBUJWF3FTVMUT 1IPUPSFBMJTUJDࢤࢿ оמ ৈࠗ ಣо "OBTUSPOBVUSJEJOHBIPSTF DIJMESFOESBXJOHTUZMF BQIPUPPGBCBCZQVQQZXBJUJOHGPSIFSNPN

  24. 2VBMJUBUJWF3FTVMUT 1IPUPSFBMJTUJDࢤࢿ оמ ৈࠗ ಣо 1IPUPPGBZFBSPME XIJUFNBO TJMWFSIBJS OFBUCFBSE XFBSJOHBSFEHJMFU

    UIJDLSJNNFEHMBTTFT

  25. 2VBMJUBUJWF3FTVMUT 1IPUPSFBMJTUJDࢤࢿ оמ ৈࠗ ಣо "OBTUSPOBVUSJEJOHBIPSTF DIJMESFOESBXJOHTUZMF BQPSUSBJUPGBOPMENPOL

  26. 2VBMJUBUJWF3FTVMUT *NBHFWBSJBUJPOоמ ৈࠗ ಣо

  27. 2VBMJUBUJWF3FTVMUT *NBHFWBSJBUJPOоמ ৈࠗ ಣо

  28. അ੤ ݽ؛ ѐࢶਸ ਤೠ োҳ ೐۽ં౟ 0VS "QQSPBDIFT UP *NQSPWF

    5XPTUBHF *NBHF (FOFSBUJPO 'SBNFXPSL

  29. 5XP4UBHF*NBHF(FOFSBUJPO'SBNFXPSL  "0PSE 07JOZBMT BOE,,BWVLDVPHMVt/FVSBM%JTDSFUF3FQSFTFOUBUJPO-FBSOJOHu/FVS*14s

  30. 5XP4UBHF*NBHF(FOFSBUJPO'SBNFXPSL  "0PSE 07JOZBMT BOE,,BWVLDVPHMVt/FVSBM%JTDSFUF3FQSFTFOUBUJPO-FBSOJOHu/FVS*14s

  31. 5XP4UBHF*NBHF(FOFSBUJPO'SBNFXPSL  "0PSE 07JOZBMT BOE,,BWVLDVPHMVt/FVSBM%JTDSFUF3FQSFTFOUBUJPO-FBSOJOHu/FVS*14s

  32. 5XP4UBHF*NBHF(FOFSBUJPO'SBNFXPSL  "0PSE 07JOZBMT BOE,,BWVLDVPHMVt/FVSBM%JTDSFUF3FQSFTFOUBUJPO-FBSOJOHu/FVS*14s 4UBHF

  33. 5XP4UBHF*NBHF(FOFSBUJPO'SBNFXPSL  "0PSE 07JOZBMT BOE,,BWVLDVPHMVt/FVSBM%JTDSFUF3FQSFTFOUBUJPO-FBSOJOHu/FVS*14s 4UBHF"3PSOPO"3NPEFMJOH

  34. അ੤ ݽ؛ ѐࢶਸ ਤೠ োҳ ೐۽ં౟  %-FF $,JN 4,JN

    .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s  5:V 4,JN $,JN %-FF BOE#)BOt-PDBMMZ)JFSBSDIJDBM"VUPSFHSFTTJWF.PEFMJOHGPS*NBHF(FOFSBUJPOt/FVS*14s  %-FF $,JN 4,JN .$IP BOE8)BOt%SBGUBOE3FWJTF&GGFDUJWF*NBHF(FOFSBUJPOXJUI$POUFYUVBM325SBOTGPSNFSt/FVS*14s 327"& $713s )27"& /FVS*14s %SBGUBOE3FWJTF /FVS*14s

  35. 4FRVFODF-FOHUIBOE"3.PEFM

  36. 4FRVFODF-FOHUIBOE"3.PEFM

  37. 3FTJEVBM2VBOUJ[FE7"& 327"&  %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s

  38. 3FTJEVBM2VBOUJ[FE7"& 327"&  %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s

  39. 3FTJEVBM2VBOUJ[FE7"& 327"&  %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s

  40. 3FTJEVBM2VBOUJ[FE7"& 327"&  %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s

  41. 3FTJEVBM2VBOUJ[FE7"& 327"&  %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s

  42. 3FTJEVBM2VBOUJ[FE7"& 327"&  %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s $PEF3FTPMVUJPO )

    Y 8 Y % $PEFCPPL4J[F S'*% 72("/ YY   m  QBQFS YY          327"& YY    YY   

  43. 3FTJEVBM2VBOUJ[FE5SBOTGPSNFS 325SBOTGPSNFS  %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s

  44. 325SBOTGPSNFSز੘ ߑध

  45. 3FTJEVBM2VBOUJ[FE5SBOTGPSNFS 325SBOTGPSNFS  %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s

  46. 3FTJEVBM2VBOUJ[FE5SBOTGPSNFS 325SBOTGPSNFS  %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s

  47. )JFSBSDIJDBM2VBOUJ[FE7"& )27"&  5:V 4,JN $,JN %-FF BOE#)BOt-PDBMMZ)JFSBSDIJDBM"VUPSFHSFTTJWF.PEFMJOHGPS*NBHF(FOFSBUJPOt/FVS*14s

  48. )JFSBSDIJDBM2VBOUJ[FE7"& )27"&  5:V 4,JN $,JN %-FF BOE#)BOt-PDBMMZ)JFSBSDIJDBM"VUPSFHSFTTJWF.PEFMJOHGPS*NBHF(FOFSBUJPOt/FVS*14s

  49. )JFSBSDIJDBM2VBOUJ[FE7"& )27"&  5:V 4,JN $,JN %-FF BOE#)BOt-PDBMMZ)JFSBSDIJDBM"VUPSFHSFTTJWF.PEFMJOHGPS*NBHF(FOFSBUJPOt/FVS*14s

  50. $POUFYUVBM325SBOTGPSNFS  %-FF $,JN 4,JN .$IP BOE8)BOt%SBGUBOE3FWJTF&GGFDUJWF*NBHF(FOFSBUJPOXJUI$POUFYUVBM325SBOTGPSNFSt/FVS*14s

  51. $POUFYUVBM325SBOTGPSNFS  %-FF $,JN 4,JN .$IP BOE8)BOt%SBGUBOE3FWJTF&GGFDUJWF*NBHF(FOFSBUJPOXJUI$POUFYUVBM325SBOTGPSNFSt/FVS*14s

  52. $POUFYUVBM325SBOTGPSNFS  %-FF $,JN 4,JN .$IP BOE8)BOt%SBGUBOE3FWJTF&GGFDUJWF*NBHF(FOFSBUJPOXJUI$POUFYUVBM325SBOTGPSNFSt/FVS*14s

  53. $POUFYUVBM325SBOTGPSNFS  %-FF $,JN 4,JN .$IP BOE8)BOt%SBGUBOE3FWJTF&GGFDUJWF*NBHF(FOFSBUJPOXJUI$POUFYUVBM325SBOTGPSNFSt/FVS*14s

  54. ߊ಴ܳ ݃஖ݶࢲ

  55. ଵҊ ޙ೴  +)P "+BJO BOE1"CCFFMt%FOPJTJOH%JGGVTJPO1SPCBCJMJTUJD.PEFMTu /FVS*14s  "3BNFTI 1%IBSJXBM

    "/JDIPM $$IV BOE.$IFOu)JFSBSDIJDBM5FYU$POEJUJPOBM*NBHF(FOFSBUJPOXJUI$-*1-BUFOUTuBS9JWW  "0PSE 07JOZBMT BOE,,BWVLDVPHMVt/FVSBM%JTDSFUF3FQSFTFOUBUJPO-FBSOJOHu/FVS*14s  %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s  5:V 4,JN $,JN %-FF BOE#)BOt-PDBMMZ)JFSBSDIJDBM"VUPSFHSFTTJWF.PEFMJOHGPS*NBHF(FOFSBUJPOt/FVS*14s  %-FF $,JN 4,JN .$IP BOE8)BOt%SBGUBOE3FWJTF&GGFDUJWF*NBHF(FOFSBUJPOXJUI$POUFYUVBM325SBOTGPSNFSt/FVS*14s

  56. &0%