Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Synthesizing Human Images in SIGGRAPH Asia 2021

Udon
February 27, 2022

Synthesizing Human Images in SIGGRAPH Asia 2021

SIGGRAPH Asia 2021の「Synthesizing Human Images」セッションに採択された5本の論文を紹介します.

Udon

February 27, 2022
Tweet

More Decks by Udon

Other Decks in Technology

Transcript

  1. 4

  2. Barbershop ໰୊ઃఆ — GAN inversion-based hair editing 5 Face identity

    Generated image Hair color condition Hair texture condition Hair shape condition
  3. Barbershop ख๏ 7 ͷલ൒Λ” ” W+ F ͷޙ൒Λ” ” W+

    S C = (F, S) Face Hair ೖྗ ࠶ߏ੒ Swap S ֤ೖྗ৚݅
 ͷద༻ Blend ݟͨ໨ͷ࠷దԽ Face Identity Hair style
  4. 9

  5. 14

  6. 18

  7. Pose with Style ࣮ݧ — vs. StyleGAN-basedϞσϧͱͷൺֱ 22 • StylePoseGAN[Liu+

    arXiv21] • Pose with StyleͷUVϚοϓʹର͢ Δ޻෉Λ΄ͱΜͲແͨ͘͠Α͏ͳ ख๏ • UVϚοϓΛ࠷େݶར༻͢Ε͹ߴ඼࣭
  8. 23

  9. SketchHairSalon σʔληοτ࡞੒ 24 ೖྗ ൅
 soft mask ࣗಈੜ੒ खಈ •

    ൅soft mask͸Mattingख๏Ͱ ਪ࿦ • ࣗಈੜ੒Ͱ͸ฤΈࠐΈͳͲΛ දݱͰ͖ͳ͍ • खಈσʔληοτ͕ඞਢ
  10. ·ͱΊ • ਓυϝΠϯͷ໰୊Λѻ͏5ຊͷ࿦จΛ঺հ • ൅ฤू • Animatable NeRF • ·ͭ͛

    • શ਎ੜ੒ • ݻ༗ͷ໰୊ΛͲ͏ղܾ͢Δ͔ʁΛ͔ͳΓ۩ମతͳΞϓϩʔνͰղܾ͍ͯ͠Δ
 ࿦จ͕ଟ͔ͬͨ 29 Synthesizing Human Images Session