[Human-AI Decision Making勉強会] 意思決定 with AIは個人vsグループで変わるの？

2023/12/20 Human-AI Decision Makingの発表資料
Are Explanations Helpful? A Comparative Study of the Effects of Explanations in AI-Assisted Decision-Making
CHI2023

Transcript

1. ҙࢥܾఆ with AI͸ݸਓvsάϧʔϓͰมΘΔͷʁ ౦ژେֶ അ৔ݚڀࣨ D2 ༶໌఩ 2023/12/20 Human-AI Decision making ษڧձ Are Two Heads Beter Than One in AI-Assisted Decision Making? Comparing the Behavior and Performance of Groups and Individuals in Human-AI Collaborative Recidivism Risk Assessment Chun-Wei Chiang, Zhuoran Lu, Zhuoyan Li and Ming Yin CHI 2023 https://dl.acm.org/doi/10.1145/3544548.3581015
2. ࿦จ֓ཁ w"*ͷࢧԉ͕͋ΔҙࢥܾఆΛߦ͏࣌ɺݸਓ୯ಠͱάϧʔϓʹΑΔҙࢥܾఆͰ͸ɺ
   ɹύϑΥʔϚϯε΍ϓϩηεʹҧ͍͕͋Δͷ͔Λௐࠪ
   w"*ͱਓؒʹΑΔҙࢥܾఆݚڀͷطଘݚڀΛ౿·͑ͯͭͷ؍఺͔Β
   ɹݸਓͱάϧʔϓͷධՁΛ͓͜ͳ͏ɻ
   wάϧʔϓ͸ݸਓͱൺ΂ͯ
   w"*ͷਖ਼͠͞ʹ͔͔ΘΒͣɺ"*ʹґଘ͢Δ܏޲͕͋Δ
   wެฏੑج४ʹΑͬͯ͸ެฏͳ൑அΛಋ͚Δ
   wؒҧͬͨ"*ͷ൑அΛࣗ৴Λ࣋ͬͯڋ൱͢ΔɹͳͲͷҧ͍͕͋ͬͨ 3
3. എܠɿ༷ʑͳ෼໺Ͱ"*ͷҙࢥܾఆࢧԉ 4 աڈσʔλ͔Β ൑அͨ͠Α ΞυόΠε ΞυόΠε ΞυόΠε
4. എܠɿػց͕ΞυόΠεɺਓ͕ؒ࠷ऴܾఆ 5 ΞυόΠε ͜ͷ൑அͷํ͕
 ͍͍ͱࢥ͏ ΞυόΠεΛݩʹ࠷ऴ൑அΛͲ͏͢Δ͔ܾΊΔ
5. എܠɿ5XP
   IFBET
   BSF
   CFUUFS
   UIBO
   POF 6 ຊݚڀͷର৅ طଘݚڀͷର৅ άϧʔϓɺݸਓͷҙࢥܾఆ with AI ͰԿ͔ҧ͍͕͋Δͷ͔ʁ
6. എܠɿ5XP
   IFBET
   BSF
   CFUUFS
   UIBO
   POF 7 ຊݚڀͷର৅ طଘݚڀͷର৅ άϧʔϓɺݸਓͷҙࢥܾఆ with AI ͰԿ͔ҧ͍͕͋Δͷ͔ʁ
7. ४උɿͭͷ؍఺ʹ஫໨͢Δ 8 1. Decision Accuracy 3. Decision Confidence 5. Fairness 2. Reliance on AI 4. Understanding of AI 6. Accountability
8. ४උɿ
   %FDJTJPO
   "DDVSBDZ 9 ؒҧͬͨAIʹ௼ΒΕͯؒҧ͏͜ͱʹ஫ҙ… [1,2] ਓؒͷҙࢥܾఆʹ͓͚Δਫ਼౓޲্Λ໨ࢦ͢
9. ४උɿ
   3FMJBODF
   PO
   "* 10 ໡໨తʹAIΛ৴པ →Over reliance Algorithm appreciation[4,5] AIΛ৴པ͠ͳ͍ →Under reliance Algorithm aversion[3] AIͷΞυόΠε͕࠷ऴ൑அʹͲΕ͘Β͍ӨڹΛड͚Δ͔ʁ
10. ४උɿ
    %FDJTJPO
    $POpEFODF 11 AIʹର͢ΔConfidence → AIͷೳྗΛͲΕ͚ͩ৴͍ͯ͡Δ͔ ࣗ෼ʹର͢ΔConfidence → ࣗ෼ͷೳྗΛͲΕ͚ͩ৴͍ͯ͡Δ͔ ৴པ౓߹͍͕ద੾ͳར༻ʹӨڹΛ༩͑Δ[6]
11. ४උɿ
    6OEFSTUBOEJOH
    PG
    "* 12 ٬؍తɿ AIͷ༧ଌΛߟ͑ͤͯ͞ AIΛཧղͰ͖͔ͨΛධՁ AIͷ൑அΛ׬ᘳʹ ཧղͰ͖ͨͧ!! ओ؍తɿ ͲΕ͘Β͍ཧղͰ͖͔ͨΛճ౴ͤ͞Δ ৴པͱར༻Λଅͨ͢ΊʹAIͷৼΔ෣͍Λཧղ͍ͤͨ͞[7]
12. ४උɿ
    'BJSOFTT 13 Ӊ஦ਓ͸μϝ ਓؒ͸͍͍Α ಛఆͷଐੑʹରͯ͠ෆ౰ͳ൑அΛ͠ͳ͍Α͏ʹ͢Δ[8] P(Y ∣ A = 0) = P(Y ∣ A = 1) Y͸༧ଌ஋ɺA͸ੑผ΍ਓछͳͲͷଐੑɻଐੑ͝ͱͷ༧ଌൺ཰͕ಉ͡Ͱ͋Δ͜ͱ͕ެฏ
13. ४උɿ
    "DDPVOUBCJMJUZ 14 ͜ͷܾఆ ୭͕੹೚࣋ͭͷʁ άϧʔϓ಺ͷܾఆͰ੹೚͕ͩΕʹ͋Δ͔ௐࠪͨ͠΋ͷ͸গͳ͍
14. ࠶ܝɿͭͷ؍఺ʹ஫໨͢Δ 15 1. Decision Accuracy 3. Decision Confidence 5. Fairness 2. Reliance on AI 4. Understanding of AI 6. Accountabilidy
15. ࣮ݧλεΫɿ೥ޙͷ࠶൜ϦεΫΛ༧ଌ બ୒ཧ༝ɿ
    
    ܐࣄ࢘๏ʹ͓͚Δूஂҙࢥܾఆ͕࣮ࡍʹ͋Δ
    
    ܐࣄ࢘๏ʹ"*Λ׆༻͢Δͷ͕ҰൠతʹͳΓͭͭ͋Δ
    
    ͜ͷ൑அ͸ಛʹެฏੑ͕໰୊ʹͳ͍ͬͯΔ 16
16. ࣮ݧɿશମతྲྀΕ 17 ੹೚ׂ߹Λࣗݾਃࠂ ࿅श໰୊ʹ͓͚Δ
 ϑΟʔυόοΫ
17. ࣮ݧɿݸਓ
    PS
    άϧʔϓʹΑΔҙࢥܾఆ 18 άϧʔϓઃఆɹɹ ݸਓઃఆɹɹɹ 3ਓ1άϧʔϓ AIͷΞυόΠεΛݟ ͨͱ࿩͠߹ͬͯ࠷ऴ ճ౴Λܾఆ AIͷΞυόΠεΛݟ ͨޙʹ࠷ऴܾఆ
18. ࣮ݧɿఆྔධՁํ๏ɹͦͷ̍ w%FDJTJPO
    "DDVSBDZɿݸਓPSάϧʔϓͷ࠷ऴܾఆͷਫ਼౓ΛධՁ
    w3FMJBODF
    PO
    "*ɿ࠷ऴܾఆͱ"*ͷ൑அͷҰக౓߹͍ͰධՁ
    ɹɹɹɹɹɹɹɹɹ0WFSSFMJBODF
    ˠ
    "*͕ؒҧ͍ͬͯΔதͰҰக͍ͯ͠Δ൑அ
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    
    6OEFSSFMJBODF
    ˠ
    "*͕ਖ਼͍͠தͰ൑அ͕ޡ͍ͬͯΔ΋ͷ
    w%FDJTJPO
    $POpEFODFɿλεΫऴྃޙͷΞϯέʔτͰࣗݾਃࠂ 19
19. ࣮ݧɿఆྔධՁํ๏ɹͦͷ w6OEFSTUBOEJOHT
    PG
    "*ɿ
    wΞϯέʔτͰॏཁಛ௃ྔΛऩूɻϞσϧͷॏཁಛ௃ྔͱͷ૬ؔΛܭଌ
    w'BJSOFTT
    JO
    EFDJTJPO
    NBLJOHɿ
    wෳ਺ͷެฏੑධՁࢦඪΛ༻͍ͯଌఆ͢Δɻ
    w"DDPVOUBCJMJUZɿ
    wλεΫऴྃޙʹ࣮ݧࢀՃऀʹʮ୭͕੹೚Λ͍࣋ͬͯΔ͔ʯΛࣗݾਃࠂͰऩू 20
20. ࣮ݧ݁Ռɿ%FDJTJPO
    "DDVSBDZ 21 άϧʔϓઃఆ ݸਓઃఆ ਫ਼౓   ༗ҙࠩͳ͠ ຊ൪λεΫͰͷਫ਼౓ wਫ਼౓ͷ਺஋తʹ͸άϧʔϓͷํ͕ݸਓΑΓ΋ਫ਼౓͕ߴ͍ɻͨͩ͠༗ҙࠩ͸ͳ͍
21. ࣮ݧ݁Ռɿ3FMJBODF
    PO
    "* wάϧʔϓͷ΄͏͕"*ͷܾఆʹґଘ͍ͯ͠Δʢಉ͡ʹ͢Δʣ܏޲͕͋Δ
    w0WFSSFMJBODF
    6OEFSSFMBJBOEFͷ྆ํͷಛ௃Λ֬ೝ
    wˠ"*ͷਖ਼͠͞ʹ͔͔ΘΒͣɺ"*Ϟσϧʹґଘ͍ͯ͠Δɻ 22
22. ࣮ݧ݁Ռɿ%FDJTJPO
    $POpEFODF wݸਓ͸൑அ͕ޡ͍ͬͯΔ࣌ʹࣗ৴Λࣦ͏܏޲͕͋Δ
    wάϧʔϓͷํ͸"*ʹैΘͳ͍࣌΋ࣗ৴Λ࣋ͬͯैΘͳ͍ͱ͍ͯ͠Δ 23 AIʹಉҙ͢Δ AIʹಉҙ͠ͳ͍ શମ
23. ࣮ݧ݁Ռɿ6OEFSTUBOEJOH
    PO
    "* wάϧʔϓઃఆͱݸਓઃఆͰ"*ͷཧղ౓ʹ͕ࠩͳ͍
    wʢͳΜͳΒཧղͰ͖͍ͯͳ͍ͷͰ͸ʁʣ 24 άϧʔϓઃఆ ݸਓઃఆ ϐΞιϯ܎਺   ༗ҙࠩͳ͠ ຊ൪λεΫͰͷཧղ౓
24. ࣮ݧ݁Ռɿ%FDJTJPO
    .BLJOH
    'BJSOFTT wશମతʹ͸άϧʔϓͷํ͕ެฏͳ൑அΛ΋ͨΒ͍ͯ͠Δɻͨͩ͠༗ҙࠩ͸ͳ͠
    w ʹؔͯ͠ͷΈάϧʔϓͱݸਓͰ༗ҙ͕ࠩΈΒΕͨ ΔAcc 25 ूஂެฏੑ ूஂެฏੑ ूஂެฏੑ ूஂެฏੑ ݸผެฏੑ શͯ0ʹ͍ۙ΄Ͳެฏ
25. ࣮ݧ݁Ռɿ"DDPVOUBCJMJUZ w࠷ऴܾఆ͕ਖ਼͍࣌͠͸ɺࣗ෼ͨͪʹ੹೚ΛׂΓ౰͍ͯͯΔ
    w࠷ऴܾఆ͕ؒҧ͏࣌ɺ"*ʹ੹೚ΛׂΓ౰ͯΔ܏޲͸ݸਓͱάϧʔϓͰ͕ࠩͳ͍ 26 ਓؒʹର͢Δ੹೚౓߹͍ AIʹର͢Δ੹೚౓߹͍
26. ࣮ݧ݁Ռɿఆྔ݁Ռͷ·ͱΊ 27 1. Decision Accuracy ݸਓͱάϧʔϓͰେࠩͳ͍ 2. Reliance on AI άϧʔϓ͸AIʹґଘ͕ͪ͠ 3. Reliance on AI άϧʔϓ͸ࣗ৴Λ࣋ͬͯ AIΛڋ൱͢Δ 4. Understanding on AI ݸਓͱάϧʔϓͰେࠩͳ͍ 5. Fairness ͋Δج४Ͱ͸άϧʔϓ͸ެฏʹ 6. Accountability ࠷ऴ൑அ͕ؒҧ͏ͱ͖ ݸਓ΋άϧʔϓ΋܏޲͸ಉ͡
27. ఆੑධՁɿάϧʔϓ͸"*ΛͲ͏ར༻͢Δ͔ 
    "*ͷ൑அΛج४఺ͱͯ͠༻͍Δ
    w"*ͷ൑அΛΞϯΧʔͱͯٞ͠࿦ΛਐΊΔ
    
    "*ͷ൑அΛ్தͰৼΓฦΔ
    w"*ͷ൑அΛਖ਼౰Խɺվળ
    w"*ͷ൑அͰࣗ෼ͷҙݟΛཪ෇͚Δ
    
    ൑அͷλΠϒϨʔΧ
    wٞ࿦͕፰߅ͨ࣌͠ʹར༻ɻ"*ʹڧ͍൓ର͕͋Δ࣌͸"*͸ڋ൱͞ΕΔ 28
28. ٞ࿦ɿ"*ʹґଘ͢Δ܏޲ "*ͳ͠ͷύΠϩοτݚڀͱൺֱ
    w"*ͳ͠Ͱಉ༷ͷλεΫΛߦͬͨ࣌ɺਫ਼౓Ͱ͋Γɺճ౴ʹࣗ৴͕ͳ͍
    w·ͨάϧʔϓͷٞ࿦Ͱ΋ҙݟͷ৯͍ҧ͍͕໨ཱͬͨ
    wˠ
    "*ʹґଘ͢Δ܏޲͸͜ͷΑ͏ͳಛ௃͔Βͩͱߟ͑ΒΕΔ 29
29. ٞ࿦ɿެฏੑʹ͍ͭͯ wެฏੑج४ͷઃఆʹΑͬͯ͸ɺݸਓΑΓ΋άϧʔϓͷํ͕ެฏʹͳͬͨ
    wطଘݚڀͰ͸ɺݸਓͱൺ΂ɺάϧʔϓͷҙࢥܾఆ͕ެฏʹͳΔ܏޲͕ใࠂ
    w৺ཧֶ෼໺ͰऔΓ্͛ΒΕ͓ΓɺάϧʔϓͰ࿩͠߹͏ϓϩηε͕େࣄ
    wάϧʔϓ಺ͷೝ஌ଟ༷ੑ͕ߴ͍άϧʔϓͷํ͕ެฏͳ൑அʹͳΓ͕ͪ 30
30. ·ͱΊ w"*Λར༻ͨ͠ݸਓͱάϧʔϓͷҙࢥܾఆʹ͓͚Δҧ͍ʹ͍ͭͯௐࠪ
    wάϧʔϓ͸ݸਓͱൺ΂ͯ
    w"*ͷਖ਼͠͞ʹ͔͔ΘΒͣɺ"*ʹґଘ͢Δ܏޲͕͋Δ
    wެฏੑج४ʹΑͬͯ͸ެฏͳ൑அΛಋ͚Δ
    wؒҧͬͨ"*ͷ൑அΛࣗ৴Λ࣋ͬͯڋ൱͢ΔɹͳͲͷҧ͍͕͋ͬͨ
    w·ͨάϧʔϓͰ"*ΛͲͷΑ͏ʹར༻͢Δ͔؍࡯Ͱ͖ͨ 31
31. ࢀߟจݙ <>$IVO8FJ
    $IJBOH
    BOE
    .JOH
    :JO
    
    :PV`E
    CFUUFS
    TUPQ
    6OEFSTUBOEJOH
    IVNBO
    SFMJBODF
    PO
    NBDIJOF
    MFBSOJOH
    NPEFMT
    VOEFS
    DPWBSJBUF
    TIJGU
    <>#FO
    (SFFO
    BOE
    :JMJOH
    $IFO
    
    5IF
    QSJODJQMFT
    BOE
    MJNJUT
    PG
    BMHPSJUINJOUIFMPPQ
    EFDJTJPO
    NBLJOH
    <>+FOOJGFS
    .
    -PHH
    +VMJB
    "
    .JOTPO
    BOE
    %PO
    "
    .PPSF
    
    "MHPSJUIN
    BQQSFDJBUJPO
    1FPQMF
    QSFGFS
    BMHPSJUINJD
    UP
    IVNBO
    KVEHNFOU
    
    <>#FSLFMFZ
    +
    %JFUWPSTU
    +PTFQI
    1
    4JNNPOT
    BOE
    $BEF
    .BTTFZ
    
    "MHPSJUIN
    BWFSTJPO
    QFPQMF
    FSSPOFPVTMZ
    BWPJE
    BMHPSJUINT
    BGUFS
    TFFJOH
    UIFN
    FSS
    <>:PDIBOBO
    &
    #JHNBO
    BOE
    ,VSU
    (SBZ
    
    1FPQMF
    BSF
    BWFSTF
    UP
    NBDIJOFT
    NBLJOH
    NPSBM
    EFDJTJPOT
    <>-FBI
    $IPOH
    (VBOHMV
    ;IBOH
    ,PTB
    (PVDIFS-BNCFSU
    ,FOOFUI
    ,PUPWTLZ
    BOE
    +POBUIBO
    $BHBO
    
    )VNBO
    DPOGEFODF
    JO
    BSUJGDJBM
    JOUFMMJHFODF
    BOE
    JO
    UIFNTFMWFT
    5IF
    FWPMVUJPO
    BOE
    JNQBDU
    PG
    DPOGEFODF
    PO
    BEPQUJPO
    PG
    "*
    BEWJDF
    <>
    7JWJBO
    -BJ
    )BO
    -JV
    BOE
    $IFOIBP
    5BO
    
    
    8IZ
    JT`
    $IJDBHP`EFDFQUJWF 
    5PXBSET
    #VJMEJOH
    .PEFM%SJWFO
    5VUPSJBMT
    GPS
    )VNBOT
    <>
    +VMJB
    "OHXJO
    +FG
    -BSTPO
    4VSZB
    .BUUV
    BOE
    -BVSFO
    ,JSDIOFS
    
    .BDIJOF
    #JBT
    1SP1VCMJDB
    32