Leaked Light Field-AugmentedHuman2017

This paper introduces novel methods to add new material properties to a light field display, using computationally designed and fabricated pinholes. Most of the surface materials commonly used for LCDs are limited to smooth, transparent materials, such as glass or plastic. In conventional studies, a pinhole-based parallax barrier is employed in the design light field displays. We redefine these method to transform a non-transparent and non-smooth material, such as wood or stone, into a light field display.

1. 4mm Drilled (a) (b)
2. t dp Back lighit Pin hole Eye position d D Observer
3. (a) ( 300mm Optical sensor Mirror pinhole-display
4. (a) (b) 300mm Optical sensor Mirror pinhole-display 300mm
5. Laptop PC Target object Mirror pinhole display Depth camera Measurement (a) (b) (c) (d)

Transcript

1. -FBLFE
   -JHIU
   'JFME
   GSPN
   &WFSZEBZ
   .BUFSJBM
   
   %FTJHOJOH
   .BUFSJBM
   1SPQFSUZ
   3FNBJOFE
   -JHIUpFME
   %JTQMBZ
   ,B[VLJ
   5BLB[BXB
   ,FOUB
   4V[VLJ
   4IJOKJ
   4BLBNPUP
   
   3ZVJDIJSP
   4BTBLJ
   :PTIJLVOJ
   )BTIJNPUP
   :PJDIJ
   0DIJBJ
   6OJWFSTJUZ
   PG
   5TVLVCB
   "*4*/
   4&*,*
   $P -UE
2. *OUSPEVDUJPO  $POWFOUJPOBM
   -$%`T
   TVSGBDFT
   BSF
   MJNJUFE
   UP
   TNPPUI
   BOE
   USBOTQBSFOU
   NBUFSJBMT
   TVDI
   BT
   HMBTT
   PS
   QMBTUJD
3. *OUSPEVDUJPO  5IF
   HMBTT
   PS
   QMBTUJD
   EP
   OPU
   IBWF
   UIF
   BCJMJUZ
   UP
   FYQSFTT
   UIF
   UFYUVSF
   PG
   UIF
   TVSGBDF
   
   5IF
   EJTQMBZ
   JT
   IVSU
   UP
   UIF
   TVSSPVOEJOH
   BUNPTQIFSF
   
   UP
   PWFSDPNF
   UIJT
   EJTBEWBOUBHFʜ 8F
   QSPQPTF
   B
   EFTJHO
   NFUIPE
   GPS
   NBUFSJBMT
   JO
   PVS
   TVSSPVOEJOHT
   TVDI
   BT
   XPPE
   TUPOF
   NJSSPS
   BT
   TVSGBDF
   PG
   EJTQMBZ
   
4. *OUSPEVDUJPO  w 8F
   QSPQPTF
   B
   OFX
   GBCSJDBUJPO
   NFUIPE
   PG
   EJTQMBZ
   VTJOH
   GFNUPTFDPOE
   MBTFS
   PS
   DPNNPO
   $0
   MBTFS
   
5. *OUSPEVDUJPO  w 8F
   QSPQPTF
   B
   OFX
   GBCSJDBUJPO
   NFUIPE
   PG
   EJTQMBZ
   VTJOH
   GFNUPTFDPOE
   MBTFS
   PS
   DPNNPO
   $0
   MBTFS
   w 8F
   EFWFMPQFE
   B
   WJFXQPJOU
   TQMJU
   UZQF
   EJTQMBZ
   
6. *OUSPEVDUJPO  w 8F
   QSPQPTF
   B
   OFX
   GBCSJDBUJPO
   NFUIPE
   PG
   EJTQMBZ
   VTJOH
   GFNUPTFDPOE
   MBTFS
   PS
   DPNNPO
   $0
   MBTFS
   w 8F
   EFWFMPQFE
   B
   WJFXQPJOU
   TQMJU
   UZQF
   EJTQMBZ
   w 8F
   BVHNFOUFE
   UIF
   FYQFSJFODF
   PG
   QFPQMF
   UPVDIJOH
   EJTQMBZT
   CZ
   BEEJOH
   GVODUJPOT
   UIBU
   DPVME
   OPU
   EP
   JO
   DPOWFOUJPOBM
   EJTQMBZT
   
7. 3FMBUFE
   8PSL
   -JHIU
   'JFME
   %JTQMBZ  -BZFSFE
   %
   8FU[TUFJO
   FU
   BM
   
   &ZFHMBTTFTGSFF
   %JTQMBZ
   )VBOH
   FU
   BM
   
   
8. 3FMBUFE
   8PSL
   %JTQMBZ
   'BCSJDBUJPO
   .FUIPE  1JOMJHIU
   %JTQMBZT
   .BJNPOF
   FU
   BM
    "O
   *NNBUFSJBM
   %FQUI'VTFE
   %
   %JTQMBZ
   -FF
   FU
   BM
   
9. 1VSQPTF
   PG
   5IJT
   4UVEZ
    3FBM
   NBUFSJBM %
   SFQSFTFOUBUJPO -$%
   .POJUPS #3%'
   %JTQMBZ 1SPKFDUJPO
   NBQQJOH 0VS
   NFUIPE 8PPE
10. 1VSQPTF
    PG
    5IJT
    4UVEZ
     3FBM
    NBUFSJBM %
    SFQSFTFOUBUJPO -$%
    .POJUPS #3%'
    %JTQMBZ 1SPKFDUJPO
    NBQQJOH 0VS
    NFUIPE 8PPE
11. *NQMFNFOUBUJPO.BUFSJBM
    1SPQFSUJFT  w $0
    -BTFS
    w 'FNUPTFDPOE
    -BTFS
    w %SJMM
    NBDIJOF
12. *NQMFNFOUBUJPO.BUFSJBM
    1SPQFSUJFT  4mm Drilled (a) (b)
13. *NQMFNFOUBUJPO1SPDFTTJOH
    .FUIPE  ŸN %SJMM
    w 4J[F
    ŸNd
    w 1SFDJTJPO
    pOF
    w &EHF
    SPVHI ŸN ŸN 4UPOF -FBUIFS .JSSPS
14. *NQMFNFOUBUJPO1SPDFTTJOH
    .FUIPE  ŸN $0
    MBTFS
    w 4J[F
    ŸNd
    w 1SFDJTJPO
    QPPS
    w &EHF
    CVSO ŸN ŸN 4UPOF -FBUIFS .JSSPS
15. *NQMFNFOUBUJPO1SPDFTTJOH
    .FUIPE  ŸN 'FNUP
    TFDPOE
    MBTFS
    w 4J[F
    ŸNd
    w 1SFDJTJPO
    pOF
    w &EHF
    TNPPUI ŸN ŸN 4UPOF -FBUIFS .JSSPS
16. *NQMFNFOUBUJPO.BUFSJBM
    1SPQFSUJFT  .BUFSJBMT /VNCFS
    PG
    QJOIPMFT %JBNFUFS 1SPDFTTJOH
    NFUIPE 8PPE  
    º
     ŸN %SJMM 4UPOF  ŸN %SJMM 4ZOUIFUJD
    MFBUIFS  ŸN $0
    MBTFS (FOVJOF
    MFBUIFS   
    º
     ŸN $0
    MBTFS .JSSPS   ŸN 'FNUP
    TFDPOE
    MBTFS
17. *NQMFNFOUBUJPO%JTQMBZ
    $POpHVSBUJPO  3JHIU
    TPVSDF 1JOIPMF
    BSSBZ t dp Back lighit Pin hole Eye position d D 3BZ Observer
18. *NQMFNFOUBUJPO*NBHF
    1SPDFTTJOH  5BSHFU
    NPEFM º
    
    QJOIPMFT
    º
    QJOIPMFT
19. *NQMFNFOUBUJPO*NBHF
    1SPDFTTJOH  5BSHFU
    NPEFM º
    
    QJOIPMFT
    º
    QJOIPMFT
20. *NQMFNFOUBUJPO*NBHF
    1SPDFTTJOH  5BSHFU
    NPEFM º
    
    QJOIPMFT
    º
    QJOIPMFT
21. *NQMFNFOUBUJPO*NBHF
    1SPDFTTJOH  -PX
    SFTPMVUJPO º )JHI
    SFTPMVUJPO º
22. *NQMFNFOUBUJPO*NBHF
    1SPDFTTJOH  5BSHFU
    NPEFM -FGU
    WJFXQPJOU 5BSHFU
    NPEFM 3JHIU
    WJFXQPJOU
23. *NQMFNFOUBUJPO*NBHF
    1SPDFTTJOH  $VU
    JNBHF -FGU
    WJFXQPJOU $VU
    JNBHF 3JHIU
    WJFXQPJOU
24. *NQMFNFOUBUJPO*NBHF
    1SPDFTTJOH  *OEJDBUJPO
    JNBHF
25. *NQMFNFOUBUJPO*NBHF
    1SPDFTTJOH  3FTVMU
    JNBHF -FGU
    WJFXQPJOU 3FTVMU
    JNBHF 3JHIU
    WJFXQPJOU
26. "QQMJDBUJPOT  $POWFOUJPOBM
    .JSSPS
27. "QQMJDBUJPOT    0VS
    .FUIPE
28. "QQMJDBUJPOT 
29. "QQMJDBUJPOT 
30. %JTDVTTJPO  w #SJHIUOFTT
    w 1JYFM
    TJ[F
    PG
    CBDL
    MJHIU
    
31. %JTDVTTJPO  w #SJHIUOFTT
    #SJHIUOFTT
    ESPQ
    UP
    
    ˠ
    *U
    DBO
    VTF
    MJNJUFE
    TDFOF
    w 1JYFM
    TJ[F
    PG
    CBDL
    MJHIU
    
32. %JTDVTTJPO  w #SJHIUOFTT
    #SJHIUOFTT
    ESPQ
    UP
    
    ˠ
    *U
    DBO
    VTF
    MJNJUFE
    TDFOF
    w 1JYFM
    TJ[F
    PG
    CBDL
    MJHIU
    5IF
    3(#
    PG
    UIF
    EJTQMBZ
    BSF
    JOEJDBUFE
    TFQBSBUFMZ
    ˠ
    8F
    OFFE
    IJHIFS
    SFTPMVUJPO
    EJTQMBZ
    
33. $PODMVTJPO  w 8F
    QSPQPTF
    B
    OFX
    GBCSJDBUJPO
    NFUIPE
    PG
    EJTQMBZ
    VTJOH
    GFNUPTFDPOE
    MBTFS
    PS
    DPNNPO
    $0
    MBTFS
    w 8F
    EFWFMPQFE
    B
    WJFXQPJOU
    TQMJU
    UZQF
    EJTQMBZ
    w 8F
    BVHNFOUFE
    UIF
    FYQFSJFODF
    PG
    QFPQMF
    UPVDIJOH
    EJTQMBZT
    CZ
    BEEJOH
    GVODUJPOT
    UIBU
    DPVME
    OPU
    EP
    JO
    DPOWFOUJPOBM
    EJTQMBZT
    
34. $PODMVTJPO 
35. 3FTFBSDI
    (SPVQ  ,FOUB
    4V[VLJ
    $PBVUIPS 4IJOKJ
    4BLBNPUP
    $PBVUIPS :PJDIJ
    0DIJBJ
    1SPGFTTPS
36.  :PTIJLVOJ
    )BTIJNPUP 3ZVJDIJSP
    4BTBLJ 3FTFBSDI
    (SPVQ
37. 4QFDJBM
    UIBOLT 
38. -FBLFE
    -JHIU
    'JFME
    GSPN
    &WFSZEBZ
    .BUFSJBM
    
    %FTJHOJOH
    .BUFSJBM
    1SPQFSUZ
    3FNBJOFE
    -JHIUpFME
    %JTQMBZ
    ,B[VLJ
    5BLB[BXB
    ,FOUB
    4V[VLJ
    4IJOKJ
    4BLBNPUP
    
    3ZVJDIJSP
    4BTBLJ
    :PTIJLVOJ
    )BTIJNPUP
    :PJDIJ
    0DIJBJ
    6OJWFSTJUZ
    PG
    5TVLVCB
    "*4*/
    4&*,*
    $P -UE
39. "QQFOEJY&YQFSJNFOU  ޫྔൺ (a) ( 300mm Optical sensor Mirror pinhole-display 5IF
    FYUFOU
    UP
    XIJDI
    UIF
    MJHIU
    JOUFOTJUZ
    PG
    UIF
    CBDLMJHIU
    EFDSFBTFT
    VTJOH
    UIF
    JMMVNJOBODF
    TFOTPS
    XBT
    NFBTVSFE 5IF
    MJHIU
    GSPN
    UIF
    CBDLMJHIU
    5IF
    MJHIU
    GSPN
    UIF
    QJOIPMF
    
    UIF
    MJHIU
    BNPVOU
    SBUJP  5IF
    MJHIU
    RVBOUJUZ
    EFDSFBTFT
    CZ
    BCPVU
    
40. "QQFOEJY&YQFSJNFOU  (a) (b) 300mm Optical sensor Mirror pinhole-display 300mm 8F
    NFBTVSFE
    UIF
    WJFXJOH
    BOHMF
    QFS
    QJOIPMF
    CZ
    BDUVBMMZ
    TIPPUJOH
    XJUI
    UIF
    DBNFSB w 4IPPUJOH
    GSPN
    B
    EJTUBODF
    PG
    
    NN
    w 
    NN
    HBQ
    CFUXFFO
    QJOIPMF
    BSSBZ
    BOE
    CBDLMJHIU
    w $BNFSB
    NPWFNFOU
    EJTUBODF
    
    NN
41. "QQFOEJY"QQMJDBUJPOT  Laptop PC Target object Mirror pinhole display Depth camera Measurement (a) (b) (c) (d)
    0VS
    NFUIPE
    DBO
    SFBMJ[F
    NJSSPS
    JNBHF
    BOE
    WJEFP
    JOUFSBDUJPO
    DPSSFTQPOEJOH
    UP
    NVMUJQMF
    WJFXQPJOUT
42. "QQFOEJY1JOPIPMF
    %JBNFUFS  5P
    TFMFDU
    UIF
    QJOIPMF
    EJBNFUFS
    QBSBMMFM
    MJHIU
    XBT
    NBEF
    JODJEFOU
    PO
    B
    QJOIPMF
    PG
    EJ⒎FSFOU
    TJ[F
    UP
    NFBTVSF
    IPX
    NVDI
    MJHIU
    QBTTFE
    UISPVHI
    UIF
    QJOIPMF
    XBT
    EJTUVSCFE
43. "QQFOEJY1JOPIPMF
    %JBNFUFS