Interactive Eye Aberration Correction for Holographic Near-Eye Display - Augmented Humans 2021 (Oral presentation by Kenta Yamamoto)

by Digital Nature Group

Slide 1

Slide 1 text

Interactive Eye Aberration Correction  for Holographic Near-Eye Display Kenta Yamamoto1, Ippei Suzuki1, Kosaku Namikawa1, Kaisei Sato1, Yoichi Ochiai1,2 1University of Tsukuba, Digital Nature Group 2Pixie Dust Technologies, Inc.

Slide 2

Slide 2 text

2 Overview of This Work Before Aberration Correction Aberration Correction using User Interface After Aberration Correction

Slide 3

Slide 3 text

Introduction

Slide 4

Slide 4 text

4 Distorted Image by Wave Aberration with Wave Aberration Clear Image Distorted Image Problems of Near-Eye Displays: Image Distortion, Focus Cues, 3D Image, Parallax, Occlusion, ... etc.

Slide 5

Slide 5 text

5 Cause of Wave Aberration Optical Hardware Human Eye This study

Slide 6

Slide 6 text

6 Previous Work [Maimone et al. 2017] [Takaki et al. 2018] [Kim et al. 2019, 2020] [Ours. 2021] No GUI with GUI

Slide 7

Slide 7 text

7 Previous Work [Maimone et al. 2017] [Takaki et al. 2018] [Kim et al. 2019, 2020] [Ours. 2021] No GUI with GUI

Slide 8

Slide 8 text

8 Previous Work [Maimone et al. 2017] [Takaki et al. 2018] [Kim et al. 2019, 2020] [Ours. 2021] No GUI with GUI

Slide 9

Slide 9 text

9 Previous Work [Maimone et al. 2017] [Takaki et al. 2018] [Kim et al. 2019, 2020] [Ours. 2021] No GUI with GUI

Slide 10

Slide 10 text

Proposed Method

Slide 11

Slide 11 text

11 Optical Design of Our Holographic Near-Eye Display Eyepiece is widening viewing angle

Slide 12

Slide 12 text

12 Optical Design of Our Holographic Near-Eye Display Ureal is propagated from SLM

Slide 13

Slide 13 text

13 Optical Design of Our Holographic Near-Eye Display Uobject plane propagates to SLM

Slide 14

Slide 14 text

14 Aberration Correction Formulation Eye Aberration Opposite Aberration Calculate Opposite Aberration

Slide 15

Slide 15 text

15 Aberration Correction Formulation 𝑢𝑠𝑙𝑚 = 𝑃𝑟𝑜𝑝𝑎 (𝑢𝑜𝑏𝑗𝑒𝑐𝑡 ) ∗ 𝑡(𝑥,𝑦) ∗ P𝑟𝑒𝑣 (𝑥,𝑦) propagation from uobject to uslm lens phase distribution general pupil function with opposite aberration

Slide 16

Slide 16 text

16 Aberration Correction Simulation 7FSUJDBM"TUJHNBUJTN XJUI$PNQFOTBUJPO 0CMJRVF"TUJHNBUJTN XJUIPVU$PNQFOTBUJPO 0CMJRVF"TUJHNBUJTN XJUI$PNQFOTBUJPO 7FSUJDBM"TUJHNBUJTN XJUI$PNQFOTBUJPO 0CMJRVF"TUJHNBUJTN XJUIPVU$PNQFOTBUJPO 0CMJRVF"TUJHNBUJTN XJUI$PNQFOTBUJPO uslm ureal uretina Aberration Correction Distorted Corrected Opposite Distortion

Slide 17

Slide 17 text

17 Optical Setup & Schematic Diagram AL: Aberration reproduction Lens

Slide 18

Slide 18 text

18 Display Result

Slide 19

Slide 19 text

User Interface & User Study

Slide 20

Slide 20 text

20 User Interface for Aberration Correction Oblique Astigmatism Hyperopia or Myopia Vertical or Horizontal Astigmatism Detail of User Interface User Interface with Optical Setup

Slide 21

Slide 21 text

21 Workflow of Aberration Correction B "EKVTUJOH1BSBNFUFST 1IBTF *OUFSGBDF %JTQMBZ3FTVMUT C $IFDLJOH*NBHF *OUFSGBDF Checking Displayed Image B "EKVTUJOH1BSBNFUFST 1IBTF *OUFSGBDF %JTQMBZ3FTVMUT C $IFDLJOH*NBHF

Slide 22

Slide 22 text

22 Workflow of Aberration Correction B "EKVTUJOH1BSBNFUFST 1IBTF *OUFSGBDF %JTQMBZ3FTVMUT C $IFDLJOH*NBHF *OUFSGBDF B "EKVTUJOH1BSBNFUFST 1IBTF *OUFSGBDF %JTQMBZ3FTVMUT C $IFDLJOH*NBHF *OUFSGBDF B "EKVTUJOH1BSBNFUFST 1IBTF *OUFSGBDF %JTQMBZ3FTVMUT C $IFDLJOH*NBHF Adjusting Parameters for Aberration Correction

Slide 23

Slide 23 text

23 Workflow of Aberration Correction B "EKVTUJOH1BSBNFUFST 1IBTF *OUFSGBDF %JTQMBZ3FTVMUT C $IFDLJOH*NBHF *OUFSGBDF B "EKVTUJOH1BSBNFUFST 1IBTF *OUFSGBDF %JTQMBZ3FTVMUT C $IFDLJOH*NBHF Checking Displayed Image

Slide 24

Slide 24 text

24 Workflow of Aberration Correction B "EKVTUJOH1BSBNFUFST 1IBTF *OUFSGBDF %JTQMBZ3FTVMUT C $IFDLJOH*NBHF *OUFSGBDF B "EKVTUJOH1BSBNFUFST 1IBTF *OUFSGBDF %JTQMBZ3FTVMUT C $IFDLJOH*NBHF *OUFSGBDF B "EKVTUJOH1BSBNFUFST 1IBTF *OUFSGBDF %JTQMBZ3FTVMUT C $IFDLJOH*NBHF Adjusting Parameters for Aberration Correction

Slide 25

Slide 25 text

25 Workflow of Aberration Correction B "EKVTUJOH1BSBNFUFST 1IBTF *OUFSGBDF %JTQMBZ3FTVMUT C $IFDLJOH*NBHF *OUFSGBDF Until the user can get clear image, the user repeats this cycle.

Slide 26

Slide 26 text

26 User Experiment Minimum identiﬁable gap size is measured before and after the aberration correction. 18 people participate this user experiment. Gap size

Slide 27

Slide 27 text

27 Result of User Experiment Condition 1 Condition 2 Condition 3 Condition 4 Not Improved Improved Improved Improved

Slide 28

Slide 28 text

28 Summary of Contributions Aberration Correctable Holographic Near-Eye Display User Interface for Aberration Correction Adjustment User Study