Tweet
Tweet

Slide 1

Slide 1 text

© R&D Center for Digital Nature, University of Tsukuba Interaction with Objects and Humans based on Visualized Flow using a Background- oriented Schlieren Method Shieru Suzuki1, Shun Sasaguri1, Yoichi Ochiai1,2 1DIgital Nature Group, University of Tsukuba, 2Pixie Dust Technologies, Inc. 1

Slide 2

Slide 2 text

© R&D Center for Digital Nature, University of Tsukuba 2 Background

Slide 3

Slide 3 text

© R&D Center for Digital Nature, University of Tsukuba 3 Why visualized airflow?

Slide 4

Slide 4 text

© R&D Center for Digital Nature, University of Tsukuba 4 Tactile sensation [Sodhi et al. 2013] Fog display [Alakärppä et al. 2017] Smell display [Seah et al. 2014] Temperature modulation [Han et al. 2017] Levitating spheres [Alrøe et al. 2012] HCI They are not focused on airflow visualization. Why visualized airflow?

Slide 5

Slide 5 text

© R&D Center for Digital Nature, University of Tsukuba Objective Explore the potential for interaction methods with a flow visualization method in the form of case studies 5

Slide 6

Slide 6 text

© R&D Center for Digital Nature, University of Tsukuba Methodology Case studies 1 2 Objects ⁶ Humans Visualized flow ⁶ Objects 6

Slide 7

Slide 7 text

© R&D Center for Digital Nature, University of Tsukuba 7 We use Background Oriented Schlieren as the airflow visualization method (BOS) 1. Why we use BOS? 2. What does BOS actually visualizes? 3. How to perform BOS?

Slide 8

Slide 8 text

© R&D Center for Digital Nature, University of Tsukuba Why BOS (Background-Oriented Schlieren)? 8 LDV, PIV, PTV Physical visualization • Harmful particles • Laser irradiation • Block our view • Non-uniform
 visualization Schlieren • Complex optics Kaessinger, J. C., Kors, K. C., Lum, J. S., Dillon, H. E., & Mayer, S. K. (2014, November). Utilizing Schlieren imaging to visualize heat transfer studies. In ASME International Mechanical Engineering Congress and Exposition (Vol. 46507, p. V005T05A033). American Society of Mechanical Engineers. BOS • No visual obstacle • Uniform visualization • No particles in the air • No Laser use • Simple implementation

Slide 9

Slide 9 text

© R&D Center for Digital Nature, University of Tsukuba Why BOS (Background-Oriented Schlieren)? 9 BOS • No visual obstacle • Uniform visualization • No harmful particles in the air • No Laser use • Simple implementation LDV, PIV, PTV Physical visualization • Harmful particles • Laser irradiation • Block our view • Non-uniform
 visualization Schlieren • Complex optics Kaessinger, J. C., Kors, K. C., Lum, J. S., Dillon, H. E., & Mayer, S. K. (2014, November). Utilizing Schlieren imaging to visualize heat transfer studies. In ASME International Mechanical Engineering Congress and Exposition (Vol. 46507, p. V005T05A033). American Society of Mechanical Engineers.

Slide 10

Slide 10 text

© R&D Center for Digital Nature, University of Tsukuba What is visualized with BOS? 10 Humidity Types and constituents of the gas Temperature Pressure Density Gradient

Slide 11

Slide 11 text

© R&D Center for Digital Nature, University of Tsukuba 11 What is visualized with BOS? In this study Humidity Types and constituents of the gas Temperature Pressure Density Gradient

Slide 12

Slide 12 text

© R&D Center for Digital Nature, University of Tsukuba How to Perform BOS? 12

Slide 13

Slide 13 text

© R&D Center for Digital Nature, University of Tsukuba How to Perform BOS? 13 Initial Image

Slide 14

Slide 14 text

© R&D Center for Digital Nature, University of Tsukuba How to Perform BOS? 14 Initial Image

Slide 15

Slide 15 text

© R&D Center for Digital Nature, University of Tsukuba How to Perform BOS? 15 Initial Image Each picture

Slide 16

Slide 16 text

© R&D Center for Digital Nature, University of Tsukuba How to Perform BOS? 16

Slide 17

Slide 17 text

© R&D Center for Digital Nature, University of Tsukuba How to Perform BOS? 17 Visualized Image

Slide 18

Slide 18 text

© R&D Center for Digital Nature, University of Tsukuba How to Perform BOS? 18 Background Image of Simplified BOS* * Akatsuka, J., Nagai, S.: Flow visualization by a simplified bos technique. In: 29th AIAA Applied Aerodynamics Conference. p. 3653 (2011). S-BOS

Slide 19

Slide 19 text

© R&D Center for Digital Nature, University of Tsukuba 19 Case Studies 1 2 Subtle wind Human eye Visualized flow Meaning Object Objects ⁶ Humans Visualized flow ⁶ Objects

Slide 20

Slide 20 text

© R&D Center for Digital Nature, University of Tsukuba 20 Case1: Result1 Case1: Result2 Case1: Result3 Case1: Result4 Case2: Results & Discussion Conclusion & Future Work Discussion1 Discussion2 Discussion3 Discussion4 Topics

Slide 21

Slide 21 text

© R&D Center for Digital Nature, University of Tsukuba 21 Case1 Visualize Information Human eye

Slide 22

Slide 22 text

© R&D Center for Digital Nature, University of Tsukuba 22 Affordance? “affordances define what actions are possible” “affordances are relationships between object and user” We see human bodies as objects as well. [Norman, 1988]

Slide 23

Slide 23 text

© R&D Center for Digital Nature, University of Tsukuba Case1: Set-up 23

Slide 24

Slide 24 text

© R&D Center for Digital Nature, University of Tsukuba Case1: Results & Discussions 24 Raw Processed Facial Profile Hot Cup Hot & Cold Can Paint

Slide 25

Slide 25 text

© R&D Center for Digital Nature, University of Tsukuba Case1: Results & Discussions (Facial Profile) 25 Raw Processed

Slide 26

Slide 26 text

© R&D Center for Digital Nature, University of Tsukuba Case1: Results & Discussions (Hot Cup) 26 Raw

Slide 27

Slide 27 text

© R&D Center for Digital Nature, University of Tsukuba Case1: Results & Discussions (Hot & Cold Can) 27 Raw

Slide 28

Slide 28 text

© R&D Center for Digital Nature, University of Tsukuba Case1: Results & Discussions (Paint) 28 Raw

Slide 29

Slide 29 text

© R&D Center for Digital Nature, University of Tsukuba Case1: Results & Discussions (Paint) 29 0s Time Variation of Sprayed Paper

Slide 30

Slide 30 text

© R&D Center for Digital Nature, University of Tsukuba Case1: Results & Discussions (Paint) 30 File Paper Paint

Slide 31

Slide 31 text

© R&D Center for Digital Nature, University of Tsukuba 31 Case2 Visualization Subtle wind Marionette

Slide 32

Slide 32 text

© R&D Center for Digital Nature, University of Tsukuba Case2: Set-up 32 Marionette

Slide 33

Slide 33 text

© R&D Center for Digital Nature, University of Tsukuba Case2: Results & Discussions 33

Slide 34

Slide 34 text

© R&D Center for Digital Nature, University of Tsukuba 34 Conclusion and Future Work

Slide 35

Slide 35 text

© R&D Center for Digital Nature, University of Tsukuba 35 Visualized flow based on BOS ● gives us meaningful information ● extends affordances ● The hot plume had some degree of turbulence ● The source of the surrounding fine airflow was not limited We conducted several experiments in two case studies to explore the potential for interactions based on S-BOS visualization. Conclusion Objects ⁶ Humans Visualized flow ⁶ Objects

Slide 36

Slide 36 text

© R&D Center for Digital Nature, University of Tsukuba 36 For the development of a sensing method for detecting objects’ movements, ● Stabilization of the hot air plumes ● A better experimental environment in which undesired disturbances are removed are the challenges. Raw video Processed video Future Work

Slide 37

Slide 37 text

© R&D Center for Digital Nature, University of Tsukuba 37 More detailed emotion recognition than physiological sensors Future Work

Slide 38

Slide 38 text

© R&D Center for Digital Nature, University of Tsukuba 38 Thank you. Email: [email protected]

Slide 39

Slide 39 text

© R&D Center for Digital Nature, University of Tsukuba 39 Appendix

Slide 40

Slide 40 text

© R&D Center for Digital Nature, University of Tsukuba How to Perform BOS? 40 d ~ a f grad(n) / g … α Sensitivity d: f : Focal length of the camera grad(n) : The gradient of refractive index of the medium

Slide 41

Slide 41 text

© R&D Center for Digital Nature, University of Tsukuba How to Perform BOS? 41 Background Image

Slide 42

Slide 42 text

© R&D Center for Digital Nature, University of Tsukuba How to Perform BOS? 42 Calculation [Akatsuka et al. 2011] Luminance value of the pixel at (i, j) Gradient of the luminance of the pixel at (i, j) Output image Measured image Reference image Median of the luminance values Measured image Reference image

Slide 43

Slide 43 text

© R&D Center for Digital Nature, University of Tsukuba How to Perform BOS? 43 Monitor

Slide 44

Slide 44 text

© R&D Center for Digital Nature, University of Tsukuba Case1: Results & Discussions (Hot Cup) 44 S-BOS Thermography

Slide 45

Slide 45 text

© R&D Center for Digital Nature, University of Tsukuba Case2: Set-up 45

Slide 46

Slide 46 text

© R&D Center for Digital Nature, University of Tsukuba Results & Discussions 46 d ~ a f grad(n) / g … α Sensitivity d: • f : Focal length of the camera • grad(n) : The gradient of refractive index of the medium