Unphotogenic Light - SIGGRAPH Asia 2017 (E-tech Talk by Ippei Suzuki)

This slide was presented at SIGGRAPH Asia 2017 "Emerging Technologies Talk: Magic of Light" session.
https://sa2017.siggraph.org/attendees/emerging-technologies?view=session&sid=45

Demonstration of the Unphotogenic Light: Protection from Secret Photography by Small Cameras
https://doi.org/10.1145/3132818.3132819

Unphotogenic light: high-speed projection method to prevent secret photography by small cameras
https://doi.org/10.1145/3102163.3102164

【Project page】
http://digitalnature.slis.tsukuba.ac.jp/2017/07/unphotogenic-light/

【Project movie】
https://www.youtube.com/watch?v=sCrAFTnqnkQ

【Presenter】
Ippei Suzuki (鈴木 一平)
University of Tsukuba, School of Informatics
College of Media Arts, Science and Technology
Digital Nature Group (Yoichi Ochiai)
http://1heisuzuki.tumblr.com/about

【Abstract】
We present a new method to protect projected content from secret photography using high-speed projection. In this study, we aim to realize a protectable projection method that allows people to observe content with their eyes but not record content with camera devices. To achieve this goal, we exploit the difference between the human vision system and the camera vision system. Notably, humans cannot recognize the high-speed changes of light. We were inspired by previous work that used these properties to show on-screen invisible markers. There are several studies that aim to present imperceptible on-screen markers using high-speed projection between the afterimage effect of human eyes and shutter speeds of digital cameras. From another point of view, these techniques show specific content only to the human eye while showing different content to a camera. Thus, we can project images that can be seen by human eyes whereas cameras only capture an incomplete frame. Therefore, this means the projected light is unphotogenic.

1. Unphotogenic Light High-Speed Projection Method to Prevent Secret Photography by Small Cameras Ippei Suzuki Undergraduate Student, University of Tsukuba Yoichi Ochiai Assistant Professor, University of Tsukuba Emerging Technologies Talk: Magic of Light
2. 3 Introduction Content Protection on the Screen Content Protection on the Screen = Difficult Problem
3. 4 Introduction Content Protection on the Screen Content Protection on the Screen = Difficult Problem Copy Analog/Digital Copy Guard Techniques They can take photos !
4. 5 Introduction Content Protection on the Screen Visible to Human Eyes Recordable by Cameras
5. 6 Introduction Content Protection on the Screen
6. 7 Introduction Practical Stories of the Proposed Method When you would like to protect this projected image from secret photography... Situation
7. 8 Introduction Practical Stories of the Proposed Method Solution A: Visible Watermarks or Protection Marks CONFIDENTIAL COPYRIGHT NO PHOTOS
8. CONFIDENTIAL COPYRIGHT NO PHOTOS 9 Introduction Practical Stories of the Proposed Method Solution A: Visible Watermarks or Protection Marks Bad Experience for Visitors… "
9. Security Check Area 10 Introduction Practical Stories of the Proposed Method Solution B: Confiscate Camera Devices Security Man Visitor Visitor’s Bag Confiscated Camera
10. 11 Introduction Practical Stories of the Proposed Method Solution B: Confiscate Camera Devices Visitor Security Don’t use cameras!!!
11. 12 Introduction Practical Stories of the Proposed Method Solution B: Confiscate Camera Devices Visitor’s Pocket Visitor Secret Camera e.g., Pen-Shaped Small Camera They can take photos !
12. 13 Introduction Target in This Study Our Target http://amzn.asia/etlTVOj “Google Glass” by lawrencegs (CC BY 2.0) “iPhone 7 Plus” by Kārlis Dambrāns from Latvia (CC BY 2.0) “Sony Alpha A77” by SkywalkerPL (CC BY 3.0) Not considered in ours Kinds of the camera which criminals may use (Pen-shaped camera)
13. 14 Introduction Goal Human eyes can see Cameras cannot see = Unphotogenic
14. 15 Introduction Solution < Temporal Resolution
15. 16 Related Work VRCodes [Woo et al. 2012]Detection of Imperceptible On-Screen Markers with Unsynchronized Cameras [Sampaio et al. 2015] Invisible Markers on Screen
16. 17 Method Apploach Afterimage Effect An impression of a vivid sensation retained after the stimulus has ceased
17. 18 Method Apploach
18. 19 Method Apploach Divide Image Switch in High Refresh Rate
19. 20 Method Theory and Effect of The proposed System Frame DivisionSource Image Frame Period Suitable Shutter Speed & Timings Time Projected Image Flame No. Assigned 0 1 2 3 Recorded Image Shutter Projection Period Incomplete Shutter Speed & Timings Examples
20. 21 Result Evaluation from camera vision DSLR Smartphone Variable Aperture Fixed Aperture SS 1/30, F20 SS 1/45, F2.2 SS 1/125, F10 SS 1/320, F6.3 SS 1/1000, F2.2SS 1/160, F2.2 Apple iPhone 6, with App “ProShot” by Rise Up Games LLC. All photos were taken by F/2.2, Not changeable the F-stops value. Canon EOS Kiss X4 with TAMRON B005 17-50 mm F/2.8, All photos were taken by ISO 100 Cannot change the apearture
21. 22 Method Theory and Effect of The proposed System Visitor Security Don’t use cameras!!! Combination of the human power and our system
22. 23 Result Evaluation from camera vision kvy37; Kyocera Corp. Qua phone ZE551ML; ASUSTeK Computer Inc. ZenFone 2 A500KL; ASUSTeK Computer Inc. ZenFone 5 SO-01F, Sony Corp. Xperia Z1 DSC-W110, Sony Corp. Cyber-shot CCD Image Sensor (Global Shutter) *Photos are taken with the default automatic mode.
23. 24 Application Other examples than displaying divided images EXIT $10 Theme Park Photo by Ted Murphy (CC BY 2.0) Photo by Ted Murphy (CC BY 2.0) Result Overlay onto the photos sold near the exit of the attraction
24. 25 Application Other examples than displaying divided images Museum Result Overlay onto the artworks Projector Artwork
25. 26 Discussion Limitation and Future Work Avoidance by merging multiple photos Color image Optimization the division pattern Applicability for the video contents
26. FAQ 2. Could the system show the video as projection image? 3. Could the system show the video as blurred patterns? 1. Can I use my own logo for division pattern? 4. Can the system increase the number of the division? Unphotogenic Light Please visit our booth! and let’s try to take photo by your smartphone!! — Yes in principle, under development — Difficult. Changes of the division pattern are easily perceived by people. — Yes, 2-bit image only because it should divide areas — Yes, but decrease the brightness of the screen

Transcript

1. Unphotogenic Light High-Speed Projection Method to Prevent Secret Photography by Small Cameras Ippei Suzuki Undergraduate Student, University of Tsukuba Yoichi Ochiai Assistant Professor, University of Tsukuba Emerging Technologies Talk: Magic of Light
3. 3 Introduction Content Protection on the Screen Content Protection on the Screen = Difficult Problem
4. 4 Introduction Content Protection on the Screen Content Protection on the Screen = Difficult Problem Copy Analog/Digital Copy Guard Techniques They can take photos !
5. 5 Introduction Content Protection on the Screen Visible to Human Eyes Recordable by Cameras ͑
6. 6 Introduction Content Protection on the Screen
7. 7 Introduction Practical Stories of the Proposed Method When you would like to protect this projected image from secret photography... Situation
8. 8 Introduction Practical Stories of the Proposed Method Solution A: Visible Watermarks or Protection Marks CONFIDENTIAL COPYRIGHT NO PHOTOS
9. CONFIDENTIAL COPYRIGHT NO PHOTOS 9 Introduction Practical Stories of the Proposed Method Solution A: Visible Watermarks or Protection Marks Bad Experience for Visitors… "
10. Security Check Area 10 Introduction Practical Stories of the Proposed Method Solution B: Confiscate Camera Devices Security Man Visitor Visitor’s Bag Confiscated Camera
11. 11 Introduction Practical Stories of the Proposed Method Solution B: Confiscate Camera Devices Visitor Security Don’t use cameras!!!
12. 12 Introduction Practical Stories of the Proposed Method Solution B: Confiscate Camera Devices Visitor’s Pocket Visitor Secret Camera e.g., Pen-Shaped Small Camera They can take photos !
13. 13 Introduction Target in This Study Our Target http://amzn.asia/etlTVOj “Google Glass” by lawrencegs (CC BY 2.0) “iPhone 7 Plus” by Kārlis Dambrāns from Latvia (CC BY 2.0) “Sony Alpha A77” by SkywalkerPL (CC BY 3.0) Not considered in ours Kinds of the camera which criminals may use (Pen-shaped camera)
14. 14 Introduction Goal Human eyes can see Cameras cannot see = Unphotogenic
15. 15 Introduction Solution < Temporal Resolution
16. 16 Related Work VRCodes [Woo et al. 2012] Detection of Imperceptible On-Screen Markers with Unsynchronized Cameras [Sampaio et al. 2015] Invisible Markers on Screen
17. 17 Method Apploach Afterimage Effect An impression of a vivid sensation retained after the stimulus has ceased
18. 18 Method Apploach
19. 19 Method Apploach Divide Image Switch in High Refresh Rate
20. 20 Method Theory and Effect of The proposed System Frame Division Source Image Frame Period Suitable Shutter Speed & Timings Time Projected Image Flame No. Assigned 0 1 2 3 Recorded Image Shutter Projection Period Incomplete Shutter Speed & Timings Examples
21. 21 Result Evaluation from camera vision DSLR Smartphone Variable Aperture Fixed Aperture SS 1/30, F20 SS 1/45, F2.2 SS 1/125, F10 SS 1/320, F6.3 SS 1/1000, F2.2 SS 1/160, F2.2 Apple iPhone 6, with App “ProShot” by Rise Up Games LLC. All photos were taken by F/2.2, Not changeable the F-stops value. Canon EOS Kiss X4 with TAMRON B005 17-50 mm F/2.8, All photos were taken by ISO 100 Cannot change the apearture
22. 22 Method Theory and Effect of The proposed System Visitor Security Don’t use cameras!!! Combination of the human power and our system
23. 23 Result Evaluation from camera vision kvy37; Kyocera Corp. Qua phone ZE551ML; ASUSTeK Computer Inc. ZenFone 2 A500KL; ASUSTeK Computer Inc. ZenFone 5 SO-01F, Sony Corp. Xperia Z1 DSC-W110, Sony Corp. Cyber-shot CCD Image Sensor (Global Shutter) *Photos are taken with the default automatic mode.
24. 24 Application Other examples than displaying divided images EXIT $10 Theme Park Photo by Ted Murphy (CC BY 2.0) Photo by Ted Murphy (CC BY 2.0) Result Overlay onto the photos sold near the exit of the attraction
25. 25 Application Other examples than displaying divided images Museum Result Overlay onto the artworks Projector Artwork
26. 26 Discussion Limitation and Future Work Avoidance by merging multiple photos Color image Optimization the division pattern Applicability for the video contents
28. FAQ 2. Could the system show the video as projection image? 3. Could the system show the video as blurred patterns? 1. Can I use my own logo for division pattern? 4. Can the system increase the number of the division? Unphotogenic Light Please visit our booth! and let’s try to take photo by your smartphone!! — Yes in principle, under development — Difficult. Changes of the division pattern are easily perceived by people. — Yes, 2-bit image only because it should divide areas — Yes, but decrease the brightness of the screen