Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
Synthesizing Human Images in SIGGRAPH Asia 2021
Search
Udon
February 27, 2022
Technology
210
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
Synthesizing Human Images in SIGGRAPH Asia 2021
SIGGRAPH Asia 2021の「Synthesizing Human Images」セッションに採択された5本の論文を紹介します.
Udon
February 27, 2022
Transcript
29 slides
%BJDIJ)PSJUBൃද 4*((3"1)"TJB Synthesizing Human Images Session
୭ʁ 2
Synthesizing Human Images Session • URL: https://sa2021.siggraph.org/jp/attend/technical-papers/8/session/73 • 5ຊͷจ͕࠾ •
Barbershop • EyelashNet • Neural Actor • Pose with Style • SketchHairSalon 3
4
Barbershop ઃఆ — GAN inversion-based hair editing 5 Face identity
Generated image Hair color condition Hair texture condition Hair shape condition
• ͱإͷؒͷϒϨϯυΞʔςΟϑΝΫτΛੜͤ͡͞ͳ͍ੜ Barbershop ݁Ռ 6
Barbershop ख๏ 7 ͷલΛ” ” W+ F ͷޙΛ” ” W+
S C = (F, S) Face Hair ೖྗ ࠶ߏ Swap S ֤ೖྗ݅ ͷద༻ Blend ݟͨͷ࠷దԽ Face Identity Hair style
Barbershop ੍ݶ 8 • ᶃϚεΫ͕ͳ͍෦͋·Γ៉ྷʹ ͳΒͳ͍ • ᶄᶆϐΞεͷΑ͏ͳαϯϓϧ ແཧ •
ᶅᶇإΛःΔΑ͏ͳੜແཧ
9
EyelashNet ಈػ 10 ·ͭ͛ͷ3D࠶ߏࠔ ʢमਖ਼ʹ5࣌ؒఔඞཁʣ ·ͭ͛ͷMattingΛߦ͍ আڈ͔ͯ͠Βͷ3D࠶ߏ៉ྷʹͰ͖Δ with ·ͭ͛ w/o
·ͭ͛
EyelashNet ·ͭ͛σʔληοτ࡞ͷ 11 • ·ͭ͛άϦʔϯόοΫࡱӨͷΑ͏ͳํ๏ͰࡱӨͰ͖ͳ͍ • എܠʹͰͳ͘ɼલܠʹʢ·ͭ͛ʹܬޫృྉΛృͬͯࡱӨʣ
EyelashNet ·ͭ͛σʔληοτ࡞ͷ 12 • 2ຕͷࡱӨͷؒʹਓಈ͍ͯ͠·͏ͷͰ…ʁʁ • Optical flowͰҐஔ߹Θͤ XPҐஔ߹Θͤ XҐஔ߹Θͤ
EyelashNet ݁Ռ 13
14
Neural Actor ֓ཁ • ҙͷࢹɾ੍ޚՄೳͳϙʔζͰͷߴ࣭ͳਓؒ߹ͷͨΊͷख๏ • ϙʔζ<->ඪ४ۭؒͷมΛֶश 15
16 Neural Actor ܇࿅
NeuralActor ৽نࢹ߹࣮ݧ 17 ఆྔൺֱ ʢFID͕ۃʹྑ͍; γʔέϯεͰݟͨ࣌ʹ༏ΕΔʣ ఆੑൺֱ
18
Pose with Style ֓ཁ 19 • UVϚοϓ͕݅ͳStyleGAN2ʹΑΔશը૾ੜ ೖྗ ग़ྗ ਓੜ
Ծࢼண ೖྗ ग़ྗ
Pose with Style ܇࿅ 20 Ґஔ߹Θͤ 5BSHFUDPPSE HFOFSBUPS
Pose with Style ࣮ݧ — vs. Img-to-imgมϞσϧͱͷൺֱ 21 • ߴप៉ྷʹ
ੜ • ͷ༷ • إͷৄࡉ
Pose with Style ࣮ݧ — vs. StyleGAN-basedϞσϧͱͷൺֱ 22 • StylePoseGAN[Liu+
arXiv21] • Pose with StyleͷUVϚοϓʹର͢ ΔΛ΄ͱΜͲແͨ͘͠Α͏ͳ ख๏ • UVϚοϓΛ࠷େݶར༻͢Εߴ࣭
23
SketchHairSalon σʔληοτ࡞ 24 ೖྗ soft mask ࣗಈੜ खಈ •
soft maskMattingख๏Ͱ ਪ • ࣗಈੜͰฤΈࠐΈͳͲΛ දݱͰ͖ͳ͍ • खಈσʔληοτ͕ඞਢ
SketchHairSalon σʔληοτ࡞ 25 • ਪ࣌ʹ{ฤΈࠐΈ, ςΫενϟ}Λॻ͔ͤΔͷඇৗʹ໘͍͘͞ͷͰ…? • ύϥϝτϦοΫͳදݱؔΛఏҊ ฤΈࠐΈ ඇฤΈࠐΈ
SketchHairSalon ख๏ 26
SketchHairSalon ࣮ݧ 27
SketchHairSalon ੍ݶ 28 • Ԟߦ͖͕ඞཁͳܕݫ͍͠ • ແݶໟଋܕϑϥοτ ͳੜ • רࢴֶशαϯϓϧͱಉ͡
ੜ • Ԟߦ͖ߟྀͨ͠ੜͰղܾ(?)
·ͱΊ • ਓυϝΠϯͷΛѻ͏5ຊͷจΛհ • ฤू • Animatable NeRF • ·ͭ͛
• શੜ • ݻ༗ͷΛͲ͏ղܾ͢Δ͔ʁΛ͔ͳΓ۩ମతͳΞϓϩʔνͰղܾ͍ͯ͠Δ จ͕ଟ͔ͬͨ 29 Synthesizing Human Images Session
More Decks by Udon
See All by Udon
MIRU2024_招待講演_RALF_in_CVPR2024
udonda
1
480
[CVPR24 Oral] Retrieval-Augmented Layout Transformer for Content-Aware Layout Generation
udonda
0
430
Survey of Image Editing with GANs in SIGGRAPH'21
udonda
2
970
Network-to-Network Translation with Conditional Invertible Neural Networks
udonda
1
390
DARTS: Differentiable Architecture Search
udonda
0
190
Other Decks in Technology
See All in Technology
Go初心者のクラウドエンジニアが、デプロイを通して旨味を知っていく話
ryudai
1
230
Agent Harnessはどう作る?事例から学ぶAI Agentの設計思想
sergicalsix
0
340
AI時代における医療情報システムのセキュリティ / Security of Healthcare IT Systems in the AI Era
henryofficial
0
190
IoTのデータ保存をSREの観点で考える
grimoh
1
110
CloudTrail を推したい
kazzpapa3
1
130
アラートを見直していたら営業組織への理解にちょっとだけ繋がった話
z63d
1
210
re:Inventを楽しむために、 1日1つ「これが楽しみ」を決めよう
beli68
0
100
HTTP通信に使おうとすると実はめんどくさいfile_get_contents
maguroalternative
0
200
エンタープライズ事業未経験のデータ屋、 AI時代にN回撃沈する.pdf
ryoskdara_
0
150
SREのためのFinOps入門
muziyoshiz
3
1.6k
これからのデータエンジニアの役割について考える / Rethinking the Role of Data Engineers in the AI Era
okiyuki99
1
530
共通基盤の実装に Kotlin - Quarkus を選定した理由と採用したアーキテクチャ
nealle
1
100
Featured
See All Featured
Speed Design
sergeychernyshev
33
2.2k
The SEO identity crisis: Don't let AI make you average
varn
0
630
How to train your dragon (web standard)
notwaldorf
96
6.9k
How to optimise 3,500 product descriptions for ecommerce in one day using ChatGPT
katarinadahlin
PRO
3
3.9k
Practical Tips for Bootstrapping Information Extraction Pipelines
honnibal
25
2.2k
The Art of Programming - Codeland 2020
erikaheidi
57
14k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
35
3.9k
Data-driven link building: lessons from a $708K investment (BrightonSEO talk)
szymonslowik
1
1.4k
Agile Actions for Facilitating Distributed Teams - ADO2019
mkilby
0
340
HDC tutorial
michielstock
2
1k
A Soul's Torment
seathinner
9
3.9k
BBQ
matthewcrist
90
10k