Upgrade to Pro — share decks privately, control downloads, hide ads and more …

카카오브레인의 텍스트 기반 이미지 생성 기술

kakao
December 09, 2022
Programming
0
360

카카오브레인의 텍스트 기반 이미지 생성 기술

#GenerativeModel

카카오브레인에서 개발한 텍스트 기반 이미지 생성 기술을 소개합니다

발표자 : sam.ksh
카카오브레인에서 생성 모델을 개발하고 있는 연구원입니다.

kakao

December 09, 2022
Tweet

More Decks by kakao

See All by kakao
이 세상 모든 물체를 검출할 수 있는 AI 기술을 만들 수 있을까요?
kakao
0
430
좌충우돌 애니모지 개발기
kakao
0
300
AI로 난치병을 치료할 수 있을까요?
kakao
0
230
초거대모델 학습을 위한 이미지-텍스트 데이터셋
kakao
0
490
코끼리를 GPU에 넣는 법
kakao
0
350
의료영상이 인공지능을 만났을 때: To be or Not to be
kakao
0
290
초거대 AI 기술은 헬스케어에 어떻게 활용될까?
kakao
0
340
Druid 반정형 데이터 고군분투기
kakao
0
270
WebRTC 기반 게임 리모트 플레이
kakao
0
790

Other Decks in Programming

See All in Programming
検証も兼ねて個人開発でHonoとかと向き合った話
hanetsuki
1
1k
1BRC--Nerd Sniping the Java Community
gunnarmorling
0
340
はてなにおける CSS Modules、及び CSS Modules に足りないもの / CSS Modules in Hatena, and CSS Modules missing parts
mizdra
7
930
Amazon SQSコンシューマー疎結合への旅 - 出張！ #DevelopersIO IT技術ブログの中の人が語る勉強会 #3
quiver
0
270
Ruby GitHub Packages
bkuhlmann
0
630
Let's learn code review
riofujimon
2
360
効率化に挑戦してみたらモバイル開発が少し快適になった話
ryunakayama
0
130
スクラムガイドのスプリントレトロスペクティブを改めて読みかえしてみた / Re-reading the Sprint Retrospective Section in the Scrum Guide
mackey0225
3
430
⼤規模⾔語モデルの拡張（RAG）が 終わったかも知れない件について
nearme_tech
23
15k
Netty Chicago Java User Group 2024-04-17
sullis
0
180
ADRを一年運用してみた/adr_after_a_year
hanhan1978
7
2.4k
Scalable Customer Journey Orchestration (CJO)
lewuathe
0
330

Featured

See All Featured
Atom: Resistance is Futile
akmur
259
25k
Making Projects Easy
brettharned
108
5.5k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
stephaniewalter
274
13k
GraphQLの誤解/rethinking-graphql
sonatard
50
9.2k
GraphQLとの向き合い方2022年版
quramy
32
12k
Fantastic passwords and where to find them - at NoRuKo
philnash
37
2.5k
Sharpening the Axe: The Primacy of Toolmaking
bcantrill
17
1.4k
Mobile First: as difficult as doing things right
swwweet
216
8.6k
Principles of Awesome APIs and How to Build Them.
keavy
121
16k
Music & Morning Musume
bryan
41
5.6k
Designing Dashboards & Data Visualisations in Web Apps
destraynor
226
51k
Large-scale JavaScript Application Architecture
addyosmani
504
110k

Transcript

  1. $PQZSJHIU ,BLBP $PSQ"MMSJHIUTSFTFSWFE3FEJTUSJCVUJPOPSQVCMJDEJTQMBZJTOPUQFSNJUUFEXJUIPVUXSJUUFOQFSNJTTJPOGSPN,BLBP ஠஠য়࠳ۨੋ੄ ఫझ౟ ӝ߈ ੉޷૑ ࢤࢿ ӝࣿ JG

    LBLBP  ஠஠য়࠳ۨੋ ӣࣁള TBNLTI

  2. ஠஠য়࠳ۨੋ੄ 5*ࢤࢿ ݽ؛ ࣗѐ അ੤ ݽ؛ ѐࢶਸ ਤೠ োҳ ೐۽ં౟

  3. ஠஠য়࠳ۨੋ੄ 5*ࢤࢿ ݽ؛ ࣗѐ 5PXBSET&GGJDJFOU5FYU$POEJUJPOBM%JGGVTJPO.PEFMT CZ"EWFSTBSJBM5SBJOJOH

  4. %FOPJTJOH%JGGVTJPO1SPCBCJMJTUJD.PEFMT "QIPUPPGBUFEEZCFBSPOUIFSPBE "IJHIRVBMJUZ QJDUVSFPGBNFEJFWBMLOJHIUXJUIHPMEFOBSNPS  +)P "+BJO BOE1"CCFFMt%FOPJTJOH%JGGVTJPO1SPCBCJMJTUJD.PEFMTu /FVS*14s

  5. 0WFSBMM"SDIJUFDUVSF VO$-*1 BLB%"--&  ਬࢎೞѱ 1SJPSm %FDPEFSm 43 ݽٕ۽ ҳࢿغয

    ੓णפ׮  "3BNFTI 1%IBSJXBM "/JDIPM $$IV BOE.$IFOu)JFSBSDIJDBM5FYU$POEJUJPOBM*NBHF(FOFSBUJPOXJUI$-*1-BUFOUTuBS9JWW

  6. 0WFSBMM"SDIJUFDUVSF A high quality picture of a medieval knight with

    golden armor Prior Y/ Y Y CLIP (text encoder) Y/ CLIP (image feature)

  7. 0WFSBMM"SDIJUFDUVSF A high quality picture of a medieval knight with

    golden armor Y/ Y Y CLIP (text encoder) Y/ CLIP (image feature) Prior

  8. 0WFSBMM"SDIJUFDUVSF A high quality picture of a medieval knight with

    golden armor Y/ Y Y CLIP (text encoder) Y/ CLIP (image feature) Prior

  9. 0WFSBMM"SDIJUFDUVSF 1SJPS m %FDPEFSm 43

  10. 0WFSBMM"SDIJUFDUVSF 1SJPS m %FDPEFSm 43 $-*1UFYUGFBUVSF QPPMJOH੹ ੿ࠁب ನೣ

  11. 0WFSBMM"SDIJUFDUVSF 1SJPS m %FDPEFSm 43 $-*1UFYUGFBUVSF UJNF

  12. 0WFSBMM"SDIJUFDUVSF 1SJPSm %FDPEFS m 43 A high quality picture of

    a medieval knight with golden armor Causal Transformer Y/ Y Y/ CLIP (text encoder) CLIP (image feature)

  13. 0WFSBMM"SDIJUFDUVSF 1SJPSm %FDPEFSm 43 Y Y/

  14. 0WFSBMM"SDIJUFDUVSF 1SJPSm %FDPEFSm *NQSPWFE43 Y Y/ Y 1SFUSBJOFE 'SFF[F 5SBJOBCMF

    JOJUJBMJ[FEGSPNUIF QSFUSBJOFEOFU MSE loss Perceptual loss Adversarial loss

  15. &YQFSJNFOU4FUVQ 1SJPS %FDPEFS 43 ೟ण ؘ੉ఠ .JNBHFUFYUQBJST $0:0ؘ੉ఠࣇ ನೣ ೟ण

    ߑध झ௼ې஖ ೟ण $-*1ݽ؛ 7J5- 7J5-  QBSBNFUFST # . . . PQUJNJ[BUJPO TUFQT . . . . TBNQMJOHTUFQT TUFQT TUFQT TUFQT

  16. 2VBOUJUBUJWF3FTVMUT $$. $0$0 ,GSPNWBM $-*1T 7J5#   '*% 

    

  17. 2VBOUJUBUJWF3FTVMUT $$. $0$0 ,GSPNWBM $-*1T 7J5#   '*% 

      "3BNFTI 1%IBSJXBM "/JDIPM $$IV BOE.$IFOu)JFSBSDIJDBM5FYU$POEJUJPOBM*NBHF(FOFSBUJPOXJUI$-*1-BUFOUTuBS9JWW WT GSPNVO$-*1

  18. 2VBMJUBUJWF3FTVMUT ࠂ੟ೠ ஶࣆী ؀ೠ ؀਽ מ۱ ಣо

  19. 2VBMJUBUJWF3FTVMUT ࠂ੟ೠ ஶࣆী ؀ೠ ؀਽ מ۱ ಣо (PSZFP DFMBEPOJOUIFTIBQFPGEBSUI WBEFS

    IPMEJOHBTXPSE (PSZFP DFMBEPOJOUIFTIBQFPGEBSUI WBEFS

  20. 2VBMJUBUJWF3FTVMUT ࠂ੟ೠ ஶࣆী ؀ೠ ؀਽ מ۱ ಣо (PSZFP DFMBEPOJOUIFTIBQFPGEBSUI WBEFS

    IPMEJOHBTXPSE "TVQFSNBUIXJ[BSEDBU SJDIMZUFYUVSFEPJMQBJOUJOH

  21. 2VBMJUBUJWF3FTVMUT ࠂ੟ೠ ஶࣆী ؀ೠ ؀਽ מ۱ ಣо "OBTUSPOBVUSJEJOHBIPSTF DIJMESFOESBXJOHTUZMF "OBTUSPOBVUSJEJOHBIPSTF

    DIJMESFOESBXJOHTUZMF

  22. 2VBMJUBUJWF3FTVMUT 1IPUPSFBMJTUJDࢤࢿ оמ ৈࠗ ಣо

  23. 2VBMJUBUJWF3FTVMUT 1IPUPSFBMJTUJDࢤࢿ оמ ৈࠗ ಣо "OBTUSPOBVUSJEJOHBIPSTF DIJMESFOESBXJOHTUZMF BQIPUPPGBCBCZQVQQZXBJUJOHGPSIFSNPN

  24. 2VBMJUBUJWF3FTVMUT 1IPUPSFBMJTUJDࢤࢿ оמ ৈࠗ ಣо 1IPUPPGBZFBSPME XIJUFNBO TJMWFSIBJS OFBUCFBSE XFBSJOHBSFEHJMFU

    UIJDLSJNNFEHMBTTFT

  25. 2VBMJUBUJWF3FTVMUT 1IPUPSFBMJTUJDࢤࢿ оמ ৈࠗ ಣо "OBTUSPOBVUSJEJOHBIPSTF DIJMESFOESBXJOHTUZMF BQPSUSBJUPGBOPMENPOL

  26. 2VBMJUBUJWF3FTVMUT *NBHFWBSJBUJPOоמ ৈࠗ ಣо

  27. 2VBMJUBUJWF3FTVMUT *NBHFWBSJBUJPOоמ ৈࠗ ಣо

  28. അ੤ ݽ؛ ѐࢶਸ ਤೠ োҳ ೐۽ં౟ 0VS "QQSPBDIFT UP *NQSPWF

    5XPTUBHF *NBHF (FOFSBUJPO 'SBNFXPSL

  29. 5XP4UBHF*NBHF(FOFSBUJPO'SBNFXPSL  "0PSE 07JOZBMT BOE,,BWVLDVPHMVt/FVSBM%JTDSFUF3FQSFTFOUBUJPO-FBSOJOHu/FVS*14s

  30. 5XP4UBHF*NBHF(FOFSBUJPO'SBNFXPSL  "0PSE 07JOZBMT BOE,,BWVLDVPHMVt/FVSBM%JTDSFUF3FQSFTFOUBUJPO-FBSOJOHu/FVS*14s

  31. 5XP4UBHF*NBHF(FOFSBUJPO'SBNFXPSL  "0PSE 07JOZBMT BOE,,BWVLDVPHMVt/FVSBM%JTDSFUF3FQSFTFOUBUJPO-FBSOJOHu/FVS*14s

  32. 5XP4UBHF*NBHF(FOFSBUJPO'SBNFXPSL  "0PSE 07JOZBMT BOE,,BWVLDVPHMVt/FVSBM%JTDSFUF3FQSFTFOUBUJPO-FBSOJOHu/FVS*14s 4UBHF

  33. 5XP4UBHF*NBHF(FOFSBUJPO'SBNFXPSL  "0PSE 07JOZBMT BOE,,BWVLDVPHMVt/FVSBM%JTDSFUF3FQSFTFOUBUJPO-FBSOJOHu/FVS*14s 4UBHF"3PSOPO"3NPEFMJOH

  34. അ੤ ݽ؛ ѐࢶਸ ਤೠ োҳ ೐۽ં౟  %-FF $,JN 4,JN

    .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s  5:V 4,JN $,JN %-FF BOE#)BOt-PDBMMZ)JFSBSDIJDBM"VUPSFHSFTTJWF.PEFMJOHGPS*NBHF(FOFSBUJPOt/FVS*14s  %-FF $,JN 4,JN .$IP BOE8)BOt%SBGUBOE3FWJTF&GGFDUJWF*NBHF(FOFSBUJPOXJUI$POUFYUVBM325SBOTGPSNFSt/FVS*14s 327"& $713s )27"& /FVS*14s %SBGUBOE3FWJTF /FVS*14s

  35. 4FRVFODF-FOHUIBOE"3.PEFM

  36. 4FRVFODF-FOHUIBOE"3.PEFM

  37. 3FTJEVBM2VBOUJ[FE7"& 327"&  %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s

  38. 3FTJEVBM2VBOUJ[FE7"& 327"&  %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s

  39. 3FTJEVBM2VBOUJ[FE7"& 327"&  %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s

  40. 3FTJEVBM2VBOUJ[FE7"& 327"&  %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s

  41. 3FTJEVBM2VBOUJ[FE7"& 327"&  %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s

  42. 3FTJEVBM2VBOUJ[FE7"& 327"&  %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s $PEF3FTPMVUJPO )

    Y 8 Y % $PEFCPPL4J[F S'*% 72("/ YY   m  QBQFS YY          327"& YY    YY   

  43. 3FTJEVBM2VBOUJ[FE5SBOTGPSNFS 325SBOTGPSNFS  %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s

  44. 325SBOTGPSNFSز੘ ߑध

  45. 3FTJEVBM2VBOUJ[FE5SBOTGPSNFS 325SBOTGPSNFS  %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s

  46. 3FTJEVBM2VBOUJ[FE5SBOTGPSNFS 325SBOTGPSNFS  %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s

  47. )JFSBSDIJDBM2VBOUJ[FE7"& )27"&  5:V 4,JN $,JN %-FF BOE#)BOt-PDBMMZ)JFSBSDIJDBM"VUPSFHSFTTJWF.PEFMJOHGPS*NBHF(FOFSBUJPOt/FVS*14s

  48. )JFSBSDIJDBM2VBOUJ[FE7"& )27"&  5:V 4,JN $,JN %-FF BOE#)BOt-PDBMMZ)JFSBSDIJDBM"VUPSFHSFTTJWF.PEFMJOHGPS*NBHF(FOFSBUJPOt/FVS*14s

  49. )JFSBSDIJDBM2VBOUJ[FE7"& )27"&  5:V 4,JN $,JN %-FF BOE#)BOt-PDBMMZ)JFSBSDIJDBM"VUPSFHSFTTJWF.PEFMJOHGPS*NBHF(FOFSBUJPOt/FVS*14s

  50. $POUFYUVBM325SBOTGPSNFS  %-FF $,JN 4,JN .$IP BOE8)BOt%SBGUBOE3FWJTF&GGFDUJWF*NBHF(FOFSBUJPOXJUI$POUFYUVBM325SBOTGPSNFSt/FVS*14s

  51. $POUFYUVBM325SBOTGPSNFS  %-FF $,JN 4,JN .$IP BOE8)BOt%SBGUBOE3FWJTF&GGFDUJWF*NBHF(FOFSBUJPOXJUI$POUFYUVBM325SBOTGPSNFSt/FVS*14s

  52. $POUFYUVBM325SBOTGPSNFS  %-FF $,JN 4,JN .$IP BOE8)BOt%SBGUBOE3FWJTF&GGFDUJWF*NBHF(FOFSBUJPOXJUI$POUFYUVBM325SBOTGPSNFSt/FVS*14s

  53. $POUFYUVBM325SBOTGPSNFS  %-FF $,JN 4,JN .$IP BOE8)BOt%SBGUBOE3FWJTF&GGFDUJWF*NBHF(FOFSBUJPOXJUI$POUFYUVBM325SBOTGPSNFSt/FVS*14s

  54. ߊ಴ܳ ݃஖ݶࢲ

  55. ଵҊ ޙ೴  +)P "+BJO BOE1"CCFFMt%FOPJTJOH%JGGVTJPO1SPCBCJMJTUJD.PEFMTu /FVS*14s  "3BNFTI 1%IBSJXBM

    "/JDIPM $$IV BOE.$IFOu)JFSBSDIJDBM5FYU$POEJUJPOBM*NBHF(FOFSBUJPOXJUI$-*1-BUFOUTuBS9JWW  "0PSE 07JOZBMT BOE,,BWVLDVPHMVt/FVSBM%JTDSFUF3FQSFTFOUBUJPO-FBSOJOHu/FVS*14s  %-FF $,JN 4,JN .$IP BOE8)BOt"VUPSFHSFTTJWF*NBHF(FOFSBUJPOVTJOH3FTJEVBM2VBOUJ[BUJPOt$713s  5:V 4,JN $,JN %-FF BOE#)BOt-PDBMMZ)JFSBSDIJDBM"VUPSFHSFTTJWF.PEFMJOHGPS*NBHF(FOFSBUJPOt/FVS*14s  %-FF $,JN 4,JN .$IP BOE8)BOt%SBGUBOE3FWJTF&GGFDUJWF*NBHF(FOFSBUJPOXJUI$POUFYUVBM325SBOTGPSNFSt/FVS*14s

  56. &0%