HS-Nets: Estimating Human Body Shape from Silhouettes with Convolutional Neural Networks

Transcript

1. HS-Nets: Estimating Human Body Shape From Silhouettes With Convolutional Neural Networks Computer Graphics Laboratory Jun 29, 2017 1 White, Inc. End98
2. What’s The Point? ▸ CNN: AlexNet ▸ Optimiser : Ada delta What’s The Next? ▸ SCAPE ▸ Detailed Human Shape and Pose from Images Discussion ▸ എܠΛؾʹ͢Δඞཁ͋Δ ▸ ༸෰Λண͍ͯͨΒҙຯ͕ͳ͍ Where Is Excellent? ▸ ਫ਼౓͕ྑ͍ɺॲཧ͕ߴ଎ Verify The Effects ▸ ֤ΞϧΰϦζϜΛൺֱ ▸ ϊΠζΛ༩͑ͨ৔߹ͷ෦Ґͷޡࠩ How Is It? ▸ γϧΤοτೋ஋ը૾͔Βਓؒͷ ମܕΛଌྔ͠ɺ3Dը૾Λग़ྗ
3. ͲΜͳ΋ͷʁ How Is Itʁ ▸ γϧΤοτ(Binary Image)͔ΒCNNΛ༻͍ͯɺਓؒͷମܕΛଌྔ͢Δɻ 3DϞσϧը૾΍ɺਖ਼نԽ͞Εͯͳ͍ը૾ͷೖྗ΋ड͚ೖΕΔɻ 3
4. ઌߦݚڀͱൺ΂ͯͲ͕͍͜͢͝ʁ Where Is Excellent? ▸ ֤ମͷ෦Ґͷޡ͕ࠩখ͍͞ɺೋ஋ը૾ͷͨΊॲཧ͕ߴ଎ɻ 4
5. ٕज़΍ख๏ͷΩϞ͸Ͳ͜ʁ What’s The Point? ▸ 2Dը૾ೖྗ&ֶश͔Β3DΛग़ྗ ▸ CNN: AlexNet ▸ Activation: ReLu ▸ Optimiser : Ada delta ▸ Distance: Euclidean distance ▸ Datasets: CAESAR ▸ http://humanshape.mpi-inf.mpg.de 5
6. Ͳ͏΍ͬͯ༗ޮͩͱݕূͨ͠ʁ Verify The Effects ▸ ෳ਺ຕͷೋ஋ը૾Λೖྗͨ͠Γɺԣͷೋ஋ը૾ͷࣸਅͳͲ޲͖Λม ͑ͨΓͨࣗ͠෼ͷΞϧΰϦζϜΛൺֱݕূ ▸ ϊΠζΛ༩͑ͨ৔߹ͷ෦ҐଌఆͷޡࠩΛௐ΂ͨ 6
7. ٞ࿦͸͋Δʁ Discussion ▸ ෦Ґ͝ͱΛֶशʹ͔͚ͣʹ͜ͷఔ౓ͷޡࠩʹͳΔͷ͍͢͝ (ӕͬΆ͍ؾ΋͢Δ) ▸ ೋ஋ը૾ͷҝɺϢʔβ͕എܠΛؾʹ͢Δඞཁ͕͋Δ ▸ Ϣʔβ͕༸෰Λண͍ͯͨΒҙຯ͕ͳ͍ ▸ ඃࣸମͷࡱӨڑ཭Λ͋·Γߟ͑ͯͳ͍ؾ͕͢Δ 7
8. ࣍ʹಡΉ΂͖࿦จ͸ʁ What’s The Next? ▸ SCAPE: shape Completion and Animation of People ▸ Detailed Human Shape and Pose from Images 8