Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Gaze-Based Self-Confidence Estimation on Multiple-Choice Questions and Its Feedback - Asian CHI Symposium 2020

Gaze-Based Self-Confidence Estimation on Multiple-Choice Questions and Its Feedback - Asian CHI Symposium 2020

Slides used at the Asian CHI Symposium 2020 and modified a bit after the talk.

6978ccb697cda698fcfe588c9127d415?s=128

Shoya Ishimaru

April 25, 2020
Tweet

More Decks by Shoya Ishimaru

Other Decks in Research

Transcript

  1. (B[F#BTFE4FMG$POpEFODF&TUJNBUJPOPO
 .VMUJQMF$IPJDF2VFTUJPOTBOE*UT'FFECBDL 4IPZB*TIJNBSV 5BLBOPSJ.BSVJDIJ ,PJDIJ,JTFBOE"OESFBT%FOHFM  (FSNBO3FTFBSDI$FOUFSGPS"SUJpDJBM*OUFMMJHFODF %',* 
 

    (SBEVBUF4DIPPMPG&OHJOFFSJOH 0TBLB1SFGFDUVSF6OJWFSTJUZ
  2. .PUJWBUJPO*NQSPWJOHUIF1FSGPSNBODFPGB-FBSOFS 

  3. .PUJWBUJPO*NQSPWJOHUIF1FSGPSNBODFPGB-FBSOFS  -FDUVSFUFYUCPPL

  4. .PUJWBUJPO*NQSPWJOHUIF1FSGPSNBODFPGB-FBSOFS  -FDUVSFUFYUCPPL 2VFTUJPOT UFTU

  5. .PUJWBUJPO*NQSPWJOHUIF1FSGPSNBODFPGB-FBSOFS  -FDUVSFUFYUCPPL 2VFTUJPOT UFTU 3FWJFX

  6. .PUJWBUJPO*NQSPWJOHUIF1FSGPSNBODFPGB-FBSOFS  -FDUVSFUFYUCPPL 2VFTUJPOT UFTU 3FWJFX

  7. .PUJWBUJPO*NQSPWJOHUIF1FSGPSNBODFPGB-FBSOFS  -FDUVSFUFYUCPPL 2VFTUJPOT UFTU 3FWJFX

  8. .PUJWBUJPO*NQSPWJOHUIF1FSGPSNBODFPGB-FBSOFS  -FDUVSFUFYUCPPL 2VFTUJPOT UFTU 3FWJFX

  9. .PUJWBUJPO*NQSPWJOHUIF1FSGPSNBODFPGB-FBSOFS  -FDUVSFUFYUCPPL 2VFTUJPOT UFTU 3FWJFX 8IJDIRVFTUJPOTIPVMECFSFWJFXFEDBSFGVMMZ  QSJPSJUZ MFBLBHF

  10.  ,FZ*EFB$POpEFODF"XBSF-FBSOJOH"TTJTUBOU

  11.  ,FZ*EFB$POpEFODF"XBSF-FBSOJOH"TTJTUBOU $PSSFDU *ODPSSFDU

  12.  ,FZ*EFB$POpEFODF"XBSF-FBSOJOH"TTJTUBOU $PSSFDU *ODPSSFDU $POpEFOU 6ODPOpEFOU

  13.  ,FZ*EFB$POpEFODF"XBSF-FBSOJOH"TTJTUBOU $PSSFDU *ODPSSFDU $POpEFOU 6ODPOpEFOU

  14.  ,FZ*EFB$POpEFODF"XBSF-FBSOJOH"TTJTUBOU $PSSFDU *ODPSSFDU $POpEFOU 6ODPOpEFOU 

  15.  ,FZ*EFB$POpEFODF"XBSF-FBSOJOH"TTJTUBOU $PSSFDU *ODPSSFDU $POpEFOU 6ODPOpEFOU  

  16.  ,FZ*EFB$POpEFODF"XBSF-FBSOJOH"TTJTUBOU $PSSFDU *ODPSSFDU $POpEFOU 6ODPOpEFOU   

  17.  ,FZ*EFB$POpEFODF"XBSF-FBSOJOH"TTJTUBOU $PSSFDU *ODPSSFDU $POpEFOU 6ODPOpEFOU    .VMUJQMF$IPJDF2VFTUJPO

  18. (B[F#BTFE4FMG$POpEFODF&TUJNBUJPO 

  19. (B[F#BTFE4FMG$POpEFODF&TUJNBUJPO 

  20. (B[F#BTFE4FMG$POpEFODF&TUJNBUJPO  %FDJTJPOXJUIDPOpEFODF

  21. (B[F#BTFE4FMG$POpEFODF&TUJNBUJPO  %FDJTJPOXJUIDPOpEFODF %FDJTJPOXJUIPVUDPOpEFODF

  22. (B[F#BTFE4FMG$POpEFODF&TUJNBUJPO  • IBTCFFOPSJHJOBMMZQSPQPTFECZ:BNBEBFUBM %FDJTJPOXJUIDPOpEFODF %FDJTJPOXJUIPVUDPOpEFODF <>,:BNBEB ,,JTF BOE0"VHFSFBV&TUJNBUJPOPGDPOpEFODFCBTFEPOFZFHB[FBOBQQMJDBUJPOUPNVMUJQMFDIPJDFRVFTUJPOT*O1SPD6CJ$PNQ"EKVODUQQr

  23. (B[F#BTFE4FMG$POpEFODF&TUJNBUJPO  • IBTCFFOPSJHJOBMMZQSPQPTFECZ:BNBEBFUBM • 8FJNQMFNFOUUIJTJEFBBTBXPSLJOHTZTUFNBOE
 FWBMVBUFIPXNVDIEPFTJUJNQSPWFMFBSOJOHQFSGPSNBODFT %FDJTJPOXJUIDPOpEFODF %FDJTJPOXJUIPVUDPOpEFODF <>,:BNBEB

    ,,JTF BOE0"VHFSFBV&TUJNBUJPOPGDPOpEFODFCBTFEPOFZFHB[FBOBQQMJDBUJPOUPNVMUJQMFDIPJDFRVFTUJPOT*O1SPD6CJ$PNQ"EKVODUQQr
  24. 3FTFBSDI)ZQPUIFTFT 

  25. • 3)2VFTUJPOTBOTXFSFEDPSSFDUMZXJUIPVUDPOpEFODFUFOEUPCF GPSHPUUFODPNQBSFEUPLOPXMFEHFXJUIDPOpEFODF 3FTFBSDI)ZQPUIFTFT 

  26. • 3)2VFTUJPOTBOTXFSFEDPSSFDUMZXJUIPVUDPOpEFODFUFOEUPCF GPSHPUUFODPNQBSFEUPLOPXMFEHFXJUIDPOpEFODF • 3)2VFTUJPOTBOTXFSFEJODPSSFDUMZXJUIDPOpEFODFUFOEUPCF NJTUBLFOBHBJODPNQBSFEUPXSPOHLOPXMFEHFXJUIPVUDPOpEFODF 3FTFBSDI)ZQPUIFTFT 

  27. • 3)2VFTUJPOTBOTXFSFEDPSSFDUMZXJUIPVUDPOpEFODFUFOEUPCF GPSHPUUFODPNQBSFEUPLOPXMFEHFXJUIDPOpEFODF • 3)2VFTUJPOTBOTXFSFEJODPSSFDUMZXJUIDPOpEFODFUFOEUPCF NJTUBLFOBHBJODPNQBSFEUPXSPOHLOPXMFEHFXJUIPVUDPOpEFODF • 3)&TUJNBUJOHTFMGDPOpEFODFGSPNMFBSOJOHCFIBWJPSTBOEHJWJOH GFFECBDL FH

    BEEJOHRVFTUJPOTUPBSFWJFXMJTU IJHIMJHIUJOHUIFN XIJMFSFWJFXJOH BWPJETTVDITDFOBSJPT 3FTFBSDI)ZQPUIFTFT 
  28. %FNP

  29. %FNP

  30. 4ZTUFN0WFSWJFX 

  31. 4ZTUFN0WFSWJFX  1SFQSPDFTTJOH
 pYBUJPOTBDDBEFEFUFDUJPO

  32. 4ZTUFN0WFSWJFX  1SFQSPDFTTJOH
 pYBUJPOTBDDBEFEFUFDUJPO 'FBUVSFDBMDVMBUJPO

  33. 4ZTUFN0WFSWJFX  1SFQSPDFTTJOH
 pYBUJPOTBDDBEFEFUFDUJPO 'FBUVSFDBMDVMBUJPO 8FVUJMJ[FUIFGPMMPXJOHpWFFGGFDUJWFGFBUVSFTTFMFDUFECZ'PSXBSETUFQXJTFGFBUVSFTFMFDUJPO
 GTVNPGpYBUJPOEVSBUJPOTPO$IPJDFT GWBSJBODFPGYDPPSEJOBUFPGpYBUJPOT
 GUIFOVNCFSPGTBDDBEFTCFUXFFODIPJDFBSFBT GTVNPGTBDDBEFEVSBUJPOT

    GSFBEJOHUJNF
  34. 4ZTUFN0WFSWJFX  • #JOBSZDMBTTJpDBUJPO • 4VQQPSU7FDUPS .BDIJOF 47.  •

    3#'LFSOFM 
 $ Ѝ 1SFQSPDFTTJOH
 pYBUJPOTBDDBEFEFUFDUJPO 'FBUVSFDBMDVMBUJPO $MBTTJpDBUJPO 8FVUJMJ[FUIFGPMMPXJOHpWFFGGFDUJWFGFBUVSFTTFMFDUFECZ'PSXBSETUFQXJTFGFBUVSFTFMFDUJPO
 GTVNPGpYBUJPOEVSBUJPOTPO$IPJDFT GWBSJBODFPGYDPPSEJOBUFPGpYBUJPOT
 GUIFOVNCFSPGTBDDBEFTCFUXFFODIPJDFBSFBT GTVNPGTBDDBEFEVSBUJPOT GSFBEJOHUJNF
  35. &YQFSJNFOUBM%FTJHO 

  36. &YQFSJNFOUBM%FTJHO  • 1BSUJDJQBOUT BHF

  37. &YQFSJNFOUBM%FTJHO  • 1BSUJDJQBOUT BHF • &ZFUSBDLFS5PCJJ$)[

  38. &YQFSJNFOUBM%FTJHO  • 1BSUJDJQBOUT BHF • &ZFUSBDLFS5PCJJ$)[ • 2VFTUJPOT&OHMJTIHSBNNBS

  39. &YQFSJNFOUBM%FTJHO  • 1BSUJDJQBOUT BHF • &ZFUSBDLFS5PCJJ$)[ • 2VFTUJPOT&OHMJTIHSBNNBS •

    1SPDFEVSFT
  40. &YQFSJNFOUBM%FTJHO  • 1BSUJDJQBOUT BHF • &ZFUSBDLFS5PCJJ$)[ • 2VFTUJPOT&OHMJTIHSBNNBS •

    1SPDFEVSFT • 5IFTUEBZ5SJBMBOEQSFUFTU
  41. &YQFSJNFOUBM%FTJHO  • 1BSUJDJQBOUT BHF • &ZFUSBDLFS5PCJJ$)[ • 2VFTUJPOT&OHMJTIHSBNNBS •

    1SPDFEVSFT • 5IFTUEBZ5SJBMBOEQSFUFTU • 5IFSEEBZ3FWJFX *ODPSSFDU DPSSFDUXJUIPVUDPOpEFODF
  42. &YQFSJNFOUBM%FTJHO  • 1BSUJDJQBOUT BHF • &ZFUSBDLFS5PCJJ$)[ • 2VFTUJPOT&OHMJTIHSBNNBS •

    1SPDFEVSFT • 5IFTUEBZ5SJBMBOEQSFUFTU • 5IFSEEBZ3FWJFX *ODPSSFDU DPSSFDUXJUIPVUDPOpEFODF • 5IFUIEBZ1PTUUFTU
  43. &YQFSJNFOUBM%FTJHO  • 1BSUJDJQBOUT BHF • &ZFUSBDLFS5PCJJ$)[ • 2VFTUJPOT&OHMJTIHSBNNBS •

    1SPDFEVSFT • 5IFTUEBZ5SJBMBOEQSFUFTU • 5IFSEEBZ3FWJFX *ODPSSFDU DPSSFDUXJUIPVUDPOpEFODF • 5IFUIEBZ1PTUUFTU • 5IFDMBTTJpFSXBTQSFMJNJOBSZCVJMUXJUIBOPUIFSQBSUJDJQBOUT
  44.  %JWJOH"OTXFSTJOUP&YQFSJNFOUBMBOE$POUSPM(SPVQT (1) corr. w/ conf. 53.5% (2a) corr. w/o

    conf. 5.6% (2b) corr. w/o conf. > feedback 5.1% (3) incorr. w/o conf. 5.1% (4a) incor. w/ conf. 16.5% (4b) incorr. w/ conf. > feedback 14.1% %BUBDPSSFDUFEBUUIFQSFUFTU
  45.  %JWJOH"OTXFSTJOUP&YQFSJNFOUBMBOE$POUSPM(SPVQT (1) corr. w/ conf. 53.5% (2a) corr. w/o

    conf. 5.6% (2b) corr. w/o conf. > feedback 5.1% (3) incorr. w/o conf. 5.1% (4a) incor. w/ conf. 16.5% (4b) incorr. w/ conf. > feedback 14.1% PGDPSSFDUBOTXFST
 XJUIPVUDPOpEFODFXFSF
 JODMVEFEJOUIFSFWJFX %BUBDPSSFDUFEBUUIFQSFUFTU
  46.  %JWJOH"OTXFSTJOUP&YQFSJNFOUBMBOE$POUSPM(SPVQT (1) corr. w/ conf. 53.5% (2a) corr. w/o

    conf. 5.6% (2b) corr. w/o conf. > feedback 5.1% (3) incorr. w/o conf. 5.1% (4a) incor. w/ conf. 16.5% (4b) incorr. w/ conf. > feedback 14.1% PGDPSSFDUBOTXFST
 XJUIPVUDPOpEFODFXFSF
 JODMVEFEJOUIFSFWJFX PGJODPSSFDUBOTXFST
 XJUIDPOpEFODFXFSF
 IJHIMJHIUFEBUUIFSFWJFX %BUBDPSSFDUFEBUUIFQSFUFTU
  47. &YQFSJNFOUBM3FTVMUT    B C    

          DPSSXDPOG B DPSSXPDPOG C DPSSXPDPOGGFFECBDL   B C           JODPSSXPDPOG B JODPSXDPOG C JODPSSXDPOGGFFECBDL 5IFNFBOPGDPSSFDUBOTXFSSBUFT
 BNPOHQBSUJDJQBOUTBUUIFQPTUUFTU
  48. &YQFSJNFOUBM3FTVMUT    B C    

          DPSSXDPOG B DPSSXPDPOG C DPSSXPDPOGGFFECBDL   B C           JODPSSXPDPOG B JODPSXDPOG C JODPSSXDPOGGFFECBDL • 5IFSBUJPPG B DPSSFDUBOTXFSTXJUIPVU DPOpEFODFXBTESPQQFEDPNQBSFEUP  BOTXFSTXJUIDPOpEFODF Q  5IFNFBOPGDPSSFDUBOTXFSSBUFT
 BNPOHQBSUJDJQBOUTBUUIFQPTUUFTU
  49. &YQFSJNFOUBM3FTVMUT    B C    

          DPSSXDPOG B DPSSXPDPOG C DPSSXPDPOGGFFECBDL   B C           JODPSSXPDPOG B JODPSXDPOG C JODPSSXDPOGGFFECBDL • 5IFSBUJPPG B DPSSFDUBOTXFSTXJUIPVU DPOpEFODFXBTESPQQFEDPNQBSFEUP  BOTXFSTXJUIDPOpEFODF Q  • "OTXFSTXJUIPVUDPOpEFODFUFOEUPCF GPSHPUUFOJOUIFOFBSGVUVSF 5IFNFBOPGDPSSFDUBOTXFSSBUFT
 BNPOHQBSUJDJQBOUTBUUIFQPTUUFTU
  50. &YQFSJNFOUBM3FTVMUT    B C    

          DPSSXDPOG B DPSSXPDPOG C DPSSXPDPOGGFFECBDL   B C           JODPSSXPDPOG B JODPSXDPOG C JODPSSXDPOGGFFECBDL • 5IFSBUJPPG B DPSSFDUBOTXFSTXJUIPVU DPOpEFODFXBTESPQQFEDPNQBSFEUP  BOTXFSTXJUIDPOpEFODF Q  • "OTXFSTXJUIPVUDPOpEFODFUFOEUPCF GPSHPUUFOJOUIFOFBSGVUVSF • 5IFQFSGPSNBODFPG C IJHIMJHIUFEBT JODPSSFDUXJUIDPOpEFODFXBTIJHIFS UIBO B XPIJHIMJHIU Q 5IFNFBOPGDPSSFDUBOTXFSSBUFT
 BNPOHQBSUJDJQBOUTBUUIFQPTUUFTU
  51. &YQFSJNFOUBM3FTVMUT    B C    

          DPSSXDPOG B DPSSXPDPOG C DPSSXPDPOGGFFECBDL   B C           JODPSSXPDPOG B JODPSXDPOG C JODPSSXDPOGGFFECBDL • 5IFSBUJPPG B DPSSFDUBOTXFSTXJUIPVU DPOpEFODFXBTESPQQFEDPNQBSFEUP  BOTXFSTXJUIDPOpEFODF Q  • "OTXFSTXJUIPVUDPOpEFODFUFOEUPCF GPSHPUUFOJOUIFOFBSGVUVSF • 5IFQFSGPSNBODFPG C IJHIMJHIUFEBT JODPSSFDUXJUIDPOpEFODFXBTIJHIFS UIBO B XPIJHIMJHIU Q • 'FFECBDLTVDDFFEFEUPJNQSPWFUIF NFBODPSSFDUBOTXFSSBUF 5IFNFBOPGDPSSFDUBOTXFSSBUFT
 BNPOHQBSUJDJQBOUTBUUIFQPTUUFTU
  52. • 3)2VFTUJPOTBOTXFSFEDPSSFDUMZXJUIPVUDPOpEFODFUFOEUPCF GPSHPUUFODPNQBSFEUPLOPXMFEHFXJUIDPOpEFODF • 5SVF FWBMVBUFECZUIFDPNQBSJTPOCFUXFFOBOEB  • 3)2VFTUJPOTBOTXFSFEJODPSSFDUMZXJUIDPOpEFODFUFOEUPCF NJTUBLFOBHBJODPNQBSFEUPXSPOHLOPXMFEHFXJUIPVUDPOpEFODF

    • /PUBMXBZTUSVF FWBMVBUFECZUIFDPNQBSJTPOCFUXFFOBOEB  • 3)&TUJNBUJOHTFMGDPOpEFODFGSPNMFBSOJOHCFIBWJPSTBOEHJWJOH GFFECBDL FH BEEJOHRVFTUJPOTUPBSFWJFXMJTU IJHIMJHIUJOHUIFN XIJMFSFWJFXJOH BWPJETTVDITDFOBSJPT • 5SVF FWBMVBUFECZUIFDPNQBSJTPOCFUXFFOBBOEC "OTXFSTUPUIF3FTFBSDI)ZQPUIFTFT    B C           DPSSXDPOG B DPSSXPDPOG C DPSSXPDPOGGFFECBDL   B C           JODPSSXPDPOG B JODPSXDPOG C JODPSSXDPOGGFFECBDL
  53. $PODMVTJPOBOE'VUVSF8PSL 

  54. • 8FIBWFEFNPOTUSBUFE$POpEFODF"XBSF-FBSOJOH"TTJTUBOU 
 XIJDINFBTVSFTUIFTFMGDPOpEFODFPGMFBSOFSTGSPNUIFJSFZF NPWFNFOUTBOEOBWJHBUFTUIFNUPSFWJFXDSJUJDBMRVFTUJPOT $PODMVTJPOBOE'VUVSF8PSL 

  55. • 8FIBWFEFNPOTUSBUFE$POpEFODF"XBSF-FBSOJOH"TTJTUBOU 
 XIJDINFBTVSFTUIFTFMGDPOpEFODFPGMFBSOFSTGSPNUIFJSFZF NPWFNFOUTBOEOBWJHBUFTUIFNUPSFWJFXDSJUJDBMRVFTUJPOT • $PSSFDUBOTXFSSBUFTPGRVFTUJPOTXFSFJODSFBTFECZBOE
 CZHJWJOHGFFECBDLBCPVUDPSSFDUBOTXFSTXJUIPVUDPOpEFODF
 BOEJODPSSFDUBOTXFSTXJUIDPOpEFODF SFTQFDUJWFMZ

    $PODMVTJPOBOE'VUVSF8PSL 
  56. • 8FIBWFEFNPOTUSBUFE$POpEFODF"XBSF-FBSOJOH"TTJTUBOU 
 XIJDINFBTVSFTUIFTFMGDPOpEFODFPGMFBSOFSTGSPNUIFJSFZF NPWFNFOUTBOEOBWJHBUFTUIFNUPSFWJFXDSJUJDBMRVFTUJPOT • $PSSFDUBOTXFSSBUFTPGRVFTUJPOTXFSFJODSFBTFECZBOE
 CZHJWJOHGFFECBDLBCPVUDPSSFDUBOTXFSTXJUIPVUDPOpEFODF
 BOEJODPSSFDUBOTXFSTXJUIDPOpEFODF SFTQFDUJWFMZ

    • 'VUVSFXPSL $PODMVTJPOBOE'VUVSF8PSL 
  57. • 8FIBWFEFNPOTUSBUFE$POpEFODF"XBSF-FBSOJOH"TTJTUBOU 
 XIJDINFBTVSFTUIFTFMGDPOpEFODFPGMFBSOFSTGSPNUIFJSFZF NPWFNFOUTBOEOBWJHBUFTUIFNUPSFWJFXDSJUJDBMRVFTUJPOT • $PSSFDUBOTXFSSBUFTPGRVFTUJPOTXFSFJODSFBTFECZBOE
 CZHJWJOHGFFECBDLBCPVUDPSSFDUBOTXFSTXJUIPVUDPOpEFODF
 BOEJODPSSFDUBOTXFSTXJUIDPOpEFODF SFTQFDUJWFMZ

    • 'VUVSFXPSL • %FTJHOJOHCFUUFSGFFECBDL $PODMVTJPOBOE'VUVSF8PSL 
  58. • 8FIBWFEFNPOTUSBUFE$POpEFODF"XBSF-FBSOJOH"TTJTUBOU 
 XIJDINFBTVSFTUIFTFMGDPOpEFODFPGMFBSOFSTGSPNUIFJSFZF NPWFNFOUTBOEOBWJHBUFTUIFNUPSFWJFXDSJUJDBMRVFTUJPOT • $PSSFDUBOTXFSSBUFTPGRVFTUJPOTXFSFJODSFBTFECZBOE
 CZHJWJOHGFFECBDLBCPVUDPSSFDUBOTXFSTXJUIPVUDPOpEFODF
 BOEJODPSSFDUBOTXFSTXJUIDPOpEFODF SFTQFDUJWFMZ

    • 'VUVSFXPSL • %FTJHOJOHCFUUFSGFFECBDL • "QQMZJOHUPEJGGFSFOURVFTUJPOGPSNBUT $PODMVTJPOBOE'VUVSF8PSL 
  59. • 8FIBWFEFNPOTUSBUFE$POpEFODF"XBSF-FBSOJOH"TTJTUBOU 
 XIJDINFBTVSFTUIFTFMGDPOpEFODFPGMFBSOFSTGSPNUIFJSFZF NPWFNFOUTBOEOBWJHBUFTUIFNUPSFWJFXDSJUJDBMRVFTUJPOT • $PSSFDUBOTXFSSBUFTPGRVFTUJPOTXFSFJODSFBTFECZBOE
 CZHJWJOHGFFECBDLBCPVUDPSSFDUBOTXFSTXJUIPVUDPOpEFODF
 BOEJODPSSFDUBOTXFSTXJUIDPOpEFODF SFTQFDUJWFMZ

    • 'VUVSFXPSL • %FTJHOJOHCFUUFSGFFECBDL • "QQMZJOHUPEJGGFSFOURVFTUJPOGPSNBUT $PODMVTJPOBOE'VUVSF8PSL