Gaze-Based Self-Confidence Estimation on Multiple-Choice Questions and Its Feedback - Asian CHI Symposium 2020

(B[F#BTFE4FMG$POpEFODF&TUJNBUJPOPO  .VMUJQMF$IPJDF2VFTUJPOTBOE*UT'FFECBDL 4IPZB*TIJNBSV 5BLBOPSJ.BSVJDIJ ,PJDIJ,JTFBOE"OESFBT%FOHFM (FSNBO3FTFBSDI$FOUFSGPS"SUJpDJBM*OUFMMJHFODF %',*  
(SBEVBUF4DIPPMPG&OHJOFFSJOH 0TBLB1SFGFDUVSF6OJWFSTJUZ

.PUJWBUJPO*NQSPWJOHUIF1FSGPSNBODFPGB-FBSOFS

.PUJWBUJPO*NQSPWJOHUIF1FSGPSNBODFPGB-FBSOFS -FDUVSFUFYUCPPL

.PUJWBUJPO*NQSPWJOHUIF1FSGPSNBODFPGB-FBSOFS -FDUVSFUFYUCPPL 2VFTUJPOT UFTU

.PUJWBUJPO*NQSPWJOHUIF1FSGPSNBODFPGB-FBSOFS -FDUVSFUFYUCPPL 2VFTUJPOT UFTU 3FWJFX

.PUJWBUJPO*NQSPWJOHUIF1FSGPSNBODFPGB-FBSOFS -FDUVSFUFYUCPPL 2VFTUJPOT UFTU 3FWJFX 8IJDIRVFTUJPOTIPVMECFSFWJFXFEDBSFGVMMZ QSJPSJUZ MFBLBHF

,FZ*EFB$POpEFODF"XBSF-FBSOJOH"TTJTUBOU

,FZ*EFB$POpEFODF"XBSF-FBSOJOH"TTJTUBOU $PSSFDU *ODPSSFDU

,FZ*EFB$POpEFODF"XBSF-FBSOJOH"TTJTUBOU $PSSFDU *ODPSSFDU $POpEFOU 6ODPOpEFOU

,FZ*EFB$POpEFODF"XBSF-FBSOJOH"TTJTUBOU $PSSFDU *ODPSSFDU $POpEFOU 6ODPOpEFOU .VMUJQMF$IPJDF2VFTUJPO

(B[F#BTFE4FMG$POpEFODF&TUJNBUJPO

(B[F#BTFE4FMG$POpEFODF&TUJNBUJPO %FDJTJPOXJUIDPOpEFODF

(B[F#BTFE4FMG$POpEFODF&TUJNBUJPO %FDJTJPOXJUIDPOpEFODF %FDJTJPOXJUIPVUDPOpEFODF

(B[F#BTFE4FMG$POpEFODF&TUJNBUJPO • IBTCFFOPSJHJOBMMZQSPQPTFECZ:BNBEBFUBM %FDJTJPOXJUIDPOpEFODF %FDJTJPOXJUIPVUDPOpEFODF <>,:BNBEB ,,JTF BOE0"VHFSFBV&TUJNBUJPOPGDPOpEFODFCBTFEPOFZFHB[FBOBQQMJDBUJPOUPNVMUJQMFDIPJDFRVFTUJPOT*O1SPD6CJ$PNQ"EKVODUQQr

(B[F#BTFE4FMG$POpEFODF&TUJNBUJPO • IBTCFFOPSJHJOBMMZQSPQPTFECZ:BNBEBFUBM • 8FJNQMFNFOUUIJTJEFBBTBXPSLJOHTZTUFNBOE  FWBMVBUFIPXNVDIEPFTJUJNQSPWFMFBSOJOHQFSGPSNBODFT %FDJTJPOXJUIDPOpEFODF %FDJTJPOXJUIPVUDPOpEFODF <>,:BNBEB
,,JTF BOE0"VHFSFBV&TUJNBUJPOPGDPOpEFODFCBTFEPOFZFHB[FBOBQQMJDBUJPOUPNVMUJQMFDIPJDFRVFTUJPOT*O1SPD6CJ$PNQ"EKVODUQQr

3FTFBSDI)ZQPUIFTFT

• 3)2VFTUJPOTBOTXFSFEDPSSFDUMZXJUIPVUDPOpEFODFUFOEUPCF GPSHPUUFODPNQBSFEUPLOPXMFEHFXJUIDPOpEFODF 3FTFBSDI)ZQPUIFTFT

• 3)2VFTUJPOTBOTXFSFEDPSSFDUMZXJUIPVUDPOpEFODFUFOEUPCF GPSHPUUFODPNQBSFEUPLOPXMFEHFXJUIDPOpEFODF • 3)2VFTUJPOTBOTXFSFEJODPSSFDUMZXJUIDPOpEFODFUFOEUPCF NJTUBLFOBHBJODPNQBSFEUPXSPOHLOPXMFEHFXJUIPVUDPOpEFODF 3FTFBSDI)ZQPUIFTFT

• 3)2VFTUJPOTBOTXFSFEDPSSFDUMZXJUIPVUDPOpEFODFUFOEUPCF GPSHPUUFODPNQBSFEUPLOPXMFEHFXJUIDPOpEFODF • 3)2VFTUJPOTBOTXFSFEJODPSSFDUMZXJUIDPOpEFODFUFOEUPCF NJTUBLFOBHBJODPNQBSFEUPXSPOHLOPXMFEHFXJUIPVUDPOpEFODF • 3)&TUJNBUJOHTFMGDPOpEFODFGSPNMFBSOJOHCFIBWJPSTBOEHJWJOH GFFECBDL FH
BEEJOHRVFTUJPOTUPBSFWJFXMJTU IJHIMJHIUJOHUIFN XIJMFSFWJFXJOH BWPJETTVDITDFOBSJPT 3FTFBSDI)ZQPUIFTFT

4ZTUFN0WFSWJFX

4ZTUFN0WFSWJFX 1SFQSPDFTTJOH  pYBUJPOTBDDBEFEFUFDUJPO

4ZTUFN0WFSWJFX 1SFQSPDFTTJOH  pYBUJPOTBDDBEFEFUFDUJPO 'FBUVSFDBMDVMBUJPO

4ZTUFN0WFSWJFX 1SFQSPDFTTJOH  pYBUJPOTBDDBEFEFUFDUJPO 'FBUVSFDBMDVMBUJPO 8FVUJMJ[FUIFGPMMPXJOHpWFFGGFDUJWFGFBUVSFTTFMFDUFECZ'PSXBSETUFQXJTFGFBUVSFTFMFDUJPO  GTVNPGpYBUJPOEVSBUJPOTPO$IPJDFT GWBSJBODFPGYDPPSEJOBUFPGpYBUJPOT  GUIFOVNCFSPGTBDDBEFTCFUXFFODIPJDFBSFBT GTVNPGTBDDBEFEVSBUJPOT
GSFBEJOHUJNF

4ZTUFN0WFSWJFX • #JOBSZDMBTTJpDBUJPO • 4VQQPSU7FDUPS .BDIJOF 47. •
3#'LFSOFM   $ Ѝ 1SFQSPDFTTJOH  pYBUJPOTBDDBEFEFUFDUJPO 'FBUVSFDBMDVMBUJPO $MBTTJpDBUJPO 8FVUJMJ[FUIFGPMMPXJOHpWFFGGFDUJWFGFBUVSFTTFMFDUFECZ'PSXBSETUFQXJTFGFBUVSFTFMFDUJPO  GTVNPGpYBUJPOEVSBUJPOTPO$IPJDFT GWBSJBODFPGYDPPSEJOBUFPGpYBUJPOT  GUIFOVNCFSPGTBDDBEFTCFUXFFODIPJDFBSFBT GTVNPGTBDDBEFEVSBUJPOT GSFBEJOHUJNF

&YQFSJNFOUBM%FTJHO

&YQFSJNFOUBM%FTJHO • 1BSUJDJQBOUT BHF

&YQFSJNFOUBM%FTJHO • 1BSUJDJQBOUT BHF • &ZFUSBDLFS5PCJJ$)[

&YQFSJNFOUBM%FTJHO • 1BSUJDJQBOUT BHF • &ZFUSBDLFS5PCJJ$)[ • 2VFTUJPOT&OHMJTIHSBNNBS

&YQFSJNFOUBM%FTJHO • 1BSUJDJQBOUT BHF • &ZFUSBDLFS5PCJJ$)[ • 2VFTUJPOT&OHMJTIHSBNNBS •
1SPDFEVSFT

1SPDFEVSFT • 5IFTUEBZ5SJBMBOEQSFUFTU

1SPDFEVSFT • 5IFTUEBZ5SJBMBOEQSFUFTU • 5IFSEEBZ3FWJFX *ODPSSFDU DPSSFDUXJUIPVUDPOpEFODF

1SPDFEVSFT • 5IFTUEBZ5SJBMBOEQSFUFTU • 5IFSEEBZ3FWJFX *ODPSSFDU DPSSFDUXJUIPVUDPOpEFODF • 5IFUIEBZ1PTUUFTU

1SPDFEVSFT • 5IFTUEBZ5SJBMBOEQSFUFTU • 5IFSEEBZ3FWJFX *ODPSSFDU DPSSFDUXJUIPVUDPOpEFODF • 5IFUIEBZ1PTUUFTU • 5IFDMBTTJpFSXBTQSFMJNJOBSZCVJMUXJUIBOPUIFSQBSUJDJQBOUT

%JWJOH"OTXFSTJOUP&YQFSJNFOUBMBOE$POUSPM(SPVQT (1) corr. w/ conf. 53.5% (2a) corr. w/o
conf. 5.6% (2b) corr. w/o conf. > feedback 5.1% (3) incorr. w/o conf. 5.1% (4a) incor. w/ conf. 16.5% (4b) incorr. w/ conf. > feedback 14.1% %BUBDPSSFDUFEBUUIFQSFUFTU

conf. 5.6% (2b) corr. w/o conf. > feedback 5.1% (3) incorr. w/o conf. 5.1% (4a) incor. w/ conf. 16.5% (4b) incorr. w/ conf. > feedback 14.1% PGDPSSFDUBOTXFST  XJUIPVUDPOpEFODFXFSF  JODMVEFEJOUIFSFWJFX %BUBDPSSFDUFEBUUIFQSFUFTU

conf. 5.6% (2b) corr. w/o conf. > feedback 5.1% (3) incorr. w/o conf. 5.1% (4a) incor. w/ conf. 16.5% (4b) incorr. w/ conf. > feedback 14.1% PGDPSSFDUBOTXFST  XJUIPVUDPOpEFODFXFSF  JODMVEFEJOUIFSFWJFX PGJODPSSFDUBOTXFST  XJUIDPOpEFODFXFSF  IJHIMJHIUFEBUUIFSFWJFX %BUBDPSSFDUFEBUUIFQSFUFTU

&YQFSJNFOUBM3FTVMUT B C
DPSSXDPOG B DPSSXPDPOG C DPSSXPDPOGGFFECBDL B C JODPSSXPDPOG B JODPSXDPOG C JODPSSXDPOGGFFECBDL 5IFNFBOPGDPSSFDUBOTXFSSBUFT  BNPOHQBSUJDJQBOUTBUUIFQPTUUFTU

DPSSXDPOG B DPSSXPDPOG C DPSSXPDPOGGFFECBDL B C JODPSSXPDPOG B JODPSXDPOG C JODPSSXDPOGGFFECBDL • 5IFSBUJPPG B DPSSFDUBOTXFSTXJUIPVU DPOpEFODFXBTESPQQFEDPNQBSFEUP BOTXFSTXJUIDPOpEFODF Q 5IFNFBOPGDPSSFDUBOTXFSSBUFT  BNPOHQBSUJDJQBOUTBUUIFQPTUUFTU

DPSSXDPOG B DPSSXPDPOG C DPSSXPDPOGGFFECBDL B C JODPSSXPDPOG B JODPSXDPOG C JODPSSXDPOGGFFECBDL • 5IFSBUJPPG B DPSSFDUBOTXFSTXJUIPVU DPOpEFODFXBTESPQQFEDPNQBSFEUP BOTXFSTXJUIDPOpEFODF Q • "OTXFSTXJUIPVUDPOpEFODFUFOEUPCF GPSHPUUFOJOUIFOFBSGVUVSF 5IFNFBOPGDPSSFDUBOTXFSSBUFT  BNPOHQBSUJDJQBOUTBUUIFQPTUUFTU

DPSSXDPOG B DPSSXPDPOG C DPSSXPDPOGGFFECBDL B C JODPSSXPDPOG B JODPSXDPOG C JODPSSXDPOGGFFECBDL • 5IFSBUJPPG B DPSSFDUBOTXFSTXJUIPVU DPOpEFODFXBTESPQQFEDPNQBSFEUP BOTXFSTXJUIDPOpEFODF Q • "OTXFSTXJUIPVUDPOpEFODFUFOEUPCF GPSHPUUFOJOUIFOFBSGVUVSF • 5IFQFSGPSNBODFPG C IJHIMJHIUFEBT JODPSSFDUXJUIDPOpEFODFXBTIJHIFS UIBO B XPIJHIMJHIU Q 5IFNFBOPGDPSSFDUBOTXFSSBUFT  BNPOHQBSUJDJQBOUTBUUIFQPTUUFTU

DPSSXDPOG B DPSSXPDPOG C DPSSXPDPOGGFFECBDL B C JODPSSXPDPOG B JODPSXDPOG C JODPSSXDPOGGFFECBDL • 5IFSBUJPPG B DPSSFDUBOTXFSTXJUIPVU DPOpEFODFXBTESPQQFEDPNQBSFEUP BOTXFSTXJUIDPOpEFODF Q • "OTXFSTXJUIPVUDPOpEFODFUFOEUPCF GPSHPUUFOJOUIFOFBSGVUVSF • 5IFQFSGPSNBODFPG C IJHIMJHIUFEBT JODPSSFDUXJUIDPOpEFODFXBTIJHIFS UIBO B XPIJHIMJHIU Q • 'FFECBDLTVDDFFEFEUPJNQSPWFUIF NFBODPSSFDUBOTXFSSBUF 5IFNFBOPGDPSSFDUBOTXFSSBUFT  BNPOHQBSUJDJQBOUTBUUIFQPTUUFTU

• 3)2VFTUJPOTBOTXFSFEDPSSFDUMZXJUIPVUDPOpEFODFUFOEUPCF GPSHPUUFODPNQBSFEUPLOPXMFEHFXJUIDPOpEFODF • 5SVF FWBMVBUFECZUIFDPNQBSJTPOCFUXFFOBOEB • 3)2VFTUJPOTBOTXFSFEJODPSSFDUMZXJUIDPOpEFODFUFOEUPCF NJTUBLFOBHBJODPNQBSFEUPXSPOHLOPXMFEHFXJUIPVUDPOpEFODF
• /PUBMXBZTUSVF FWBMVBUFECZUIFDPNQBSJTPOCFUXFFOBOEB • 3)&TUJNBUJOHTFMGDPOpEFODFGSPNMFBSOJOHCFIBWJPSTBOEHJWJOH GFFECBDL FH BEEJOHRVFTUJPOTUPBSFWJFXMJTU IJHIMJHIUJOHUIFN XIJMFSFWJFXJOH BWPJETTVDITDFOBSJPT • 5SVF FWBMVBUFECZUIFDPNQBSJTPOCFUXFFOBBOEC "OTXFSTUPUIF3FTFBSDI)ZQPUIFTFT B C DPSSXDPOG B DPSSXPDPOG C DPSSXPDPOGGFFECBDL B C JODPSSXPDPOG B JODPSXDPOG C JODPSSXDPOGGFFECBDL

$PODMVTJPOBOE'VUVSF8PSL

• 8FIBWFEFNPOTUSBUFE$POpEFODF"XBSF-FBSOJOH"TTJTUBOU   XIJDINFBTVSFTUIFTFMGDPOpEFODFPGMFBSOFSTGSPNUIFJSFZF NPWFNFOUTBOEOBWJHBUFTUIFNUPSFWJFXDSJUJDBMRVFTUJPOT $PODMVTJPOBOE'VUVSF8PSL

• 8FIBWFEFNPOTUSBUFE$POpEFODF"XBSF-FBSOJOH"TTJTUBOU   XIJDINFBTVSFTUIFTFMGDPOpEFODFPGMFBSOFSTGSPNUIFJSFZF NPWFNFOUTBOEOBWJHBUFTUIFNUPSFWJFXDSJUJDBMRVFTUJPOT • $PSSFDUBOTXFSSBUFTPGRVFTUJPOTXFSFJODSFBTFECZBOE  CZHJWJOHGFFECBDLBCPVUDPSSFDUBOTXFSTXJUIPVUDPOpEFODF  BOEJODPSSFDUBOTXFSTXJUIDPOpEFODF SFTQFDUJWFMZ
$PODMVTJPOBOE'VUVSF8PSL

• 'VUVSFXPSL $PODMVTJPOBOE'VUVSF8PSL

• 'VUVSFXPSL • %FTJHOJOHCFUUFSGFFECBDL $PODMVTJPOBOE'VUVSF8PSL

• 'VUVSFXPSL • %FTJHOJOHCFUUFSGFFECBDL • "QQMZJOHUPEJGGFSFOURVFTUJPOGPSNBUT $PODMVTJPOBOE'VUVSF8PSL

Gaze-Based Self-Confidence Estimation on Multip...

Gaze-Based Self-Confidence Estimation on Multiple-Choice Questions and Its Feedback - Asian CHI Symposium 2020

More Decks by Shoya Ishimaru

Other Decks in Research

Featured

Transcript