BMI 研究はなぜ同じ失敗を繰り返すのか（日本BMI研究会, 2021.11.5）

2021年の日本BMI研究会で発表したスライドの一部を公開します

Transcript

1. BMI ݚڀ͸ͳͥಉࣦ͡ഊΛ܁Γฦ͢ͷ͔
   ژ౎େֶ ৘ใֶݚڀՊ
   ATR೴৘ใݚڀॴ
   ਆ୩೭߁
   http://kamitani-lab.ist.i.kyoto-u.ac.jp
   @ykamit
   

   View Slide

2. NHK͓͸Α͏೔ຊ, 2006.5.25
   ͡ΌΜ͚ΜσϞʢ2006ʣ
   

   View Slide

3. Kamitani and Tong (2005)
   

   View Slide

4. σίʔσΟϯάͷʮ௒ղ૾ʯ
   (Boynton, 2005; Rojer and Schwartz, 1990)
   Information from subvoxel representation via random bias of voxel
   sampling due to irregular columnar and/or vasculature structure
   (Kamitani and Tong, 2005)
   (See also: Op de Beeck, 2009; Kamitani & Sawahata, 2009; Gardner, 2009; Shmuel
   et al. 2009; Kriegeskorte et al 2009; Mannion et al., 2009; Swisher et al. 2010;
   Freeman et al. 2011; Clifford et al., 2011; Chaimow et al 2011)
   

   View Slide

5. 2003: CRESTʮߴྸ೴ͷֶशೳྗͱՄ઼ੑͷBMI๏ʹΑΔղ໌ʯʢᓎҪ๕༤ʣ
   2003-2004:ʢਆ୩ʣϓϦϯετϯ଺ࡏதɺ೴σίʔσΟϯά։ൃ
   2004.10.1: ʢਆ୩ʣATRೖॴ
   2005:ɹKamitani and Tong (2005ʣग़൛
   2006: ɹɹɹ
   • NICT, Symposium on Brain Communication Technology (Wolpaw, ࡕେ೴֎Պ)
   • ͡ΌΜ͚ΜσϞʢATR, Honda HRIʣ
   • CREST γϯϙδ΢Ϝʮ೴ͱػցΛͭͳ͙ʔϒϨΠϯ-ϚγϯɾΠϯλʔϑΣʔ
   εͷՄೳੑʯʢNicolelis, Fetzʣ
   • ೴Λ׆͔͢ݚڀձ
   2007: G-TeCใࠂॻɹʮϒϨΠϯɾϚγϯɾΠϯλϑΣʔεʯʢถࠃʣ
   2008: จ෦Պֶলɾ೴ՊֶݚڀઓུਪਐϓϩάϥϜʢ೴ϓϩʣ՝୊AʮϒϨΠϯɾϚ
   γϯɾΠϯλʔϑΣʔεʢBMIʣͷ։ൃʯ
   2010: ͖͕͚͞ʮ೴৘ใͷղಡͱ੍ޚʯ(ݚڀ૯ׅɿ ઒ਓ ޫஉ)
   ͦͷޙͷࠃϓϩɿ೴ϓϩୈೋظɺ૯຿লɺImPactɺNEDOɺ Ϝʔϯγϣοτ…
   ೔ຊͷBMIݚڀͷ͋ΏΈ
   

   View Slide

6. χϡʔϩΠϝʔδϯάɿ
   • GLM/SPMʢܹࢗ→൓Ԡਤࣜɺ৺ཧ౷ܭɺِཅੑɺूஂฏۉ…ʣ͔Βͷ։์
   • ࣗ༝ͳϞσϦϯάɺ਺ཧՊֶɾAI΁ͷ઀ଓ
   • આ໌͔Β༧ଌ΁
   • BMIͷςετϕου
   ਆܦίʔυɿ
   • αϧ͔Βώτ΁
   • ػցֶशʢ≠ ౷ܭʣͰେن໛࣮σʔλΛղੳ
   • ʮχϡʔϩϯʢεύΠΫʣυΫτϦϯʯΛ௒͑ͯʢϙϐϡϨʔγϣϯɺηϯ
   αʔۭؒʣ
   • ʮݸମʢ೴ʣʹͱͬͯͷίʔυʯ͔Βʮୈࡾऀʹͱͬͯͷίʔυʯ΁
   K & T (2005) /͡ΌΜ͚ΜσϞͷޭࡑ
   

   View Slide

7. χϡʔϩΠϝʔδϯάɿ
   • GLM/SPMʢܹࢗ→൓Ԡਤࣜɺ৺ཧ౷ܭɺِཅੑɺूஂฏۉ…ʣ͔Βͷ։์
   • ࣗ༝ͳϞσϦϯάɺ਺ཧՊֶɾAI΁ͷ઀ଓ
   • આ໌͔Β༧ଌ΁
   • BMIͷςετϕου
   ਆܦίʔυɿ
   • αϧ͔Βώτ΁
   • ػցֶशʢ≠ ౷ܭʣͰେن໛࣮σʔλΛղੳ
   • ʮχϡʔϩϯʢεύΠΫʣυΫτϦϯʯΛ௒͑ͯʢϙϐϡϨʔγϣϯɺηϯ
   αʔۭؒʣ
   • ʮݸମʢ೴ʣʹͱͬͯͷίʔυʯ͔Βʮୈࡾऀʹͱͬͯͷίʔυʯ΁
   K & T (2005) /͡ΌΜ͚ΜσϞͷޭࡑ
   ࡑ
   ಈ෺࣮ݧෆཁ࿦
   ඇ৵ऻ೴ܭଌ΁ͷա౓ͳظ଴
   ࠃϓϩʹ޲͖ͷςʔϚͱͯ͠ཞ༻
   ૉਓड͚Λૂͬͨূڌͷ๡͍͠ݚڀ
   େຊӦൃදతϓϨεϦϦʔε
   ݚڀऀͷηʔϧεϚϯԽ
   ʮԠ༻೴ՊֶϏδωεʯ͕೿ੜ
   

   View Slide

8. ࡕେ೴֎ՊͱͷECoG-BMIͷڞಉݚڀ
   (Yanagisawa, Kamitani, et al.,
   Neuroimage 2009, Annals of
   Neurology 2011, Nature
   Communications 2016, among others)
   

   View Slide

9. View Slide

10. https://www.gofundme.com/f/visitingjapanbraincomputerinterface
    ʮBMI͸ͳͯ͘΋ੜ׆ʹࠔΒͳ͍ʯ
    

    View Slide

11. BMIΛ࠶ఆٛ͢Δ
    • BMI=৵ऻܕɺBCI=ඇ৵ऻ ← ੲͷۀք੗Έ෼͚࿦ཧ
    • Neuroprosthetics (Schwartz, Shenoy) ← ࢒ଘػೳΛ௒͑ΒΕΔ͔
    • ೴–೴௨৴ (Rao, Nicolelis) ← ݱঢ়ɺத਎͸ۃΊͯ͠ΐ΅͍…
    ͦ΋ͦ΋ɺ
    • ʮػցʯʮܭଌɾܹࢗ๏ʯʮػೳ୅ସʯ͸ຊ࣭ʁ
    ʮBMIʹ೴ͱػցͷΠϯλʔϑΣʔεʯͰ͸
    ೴ςΫϊϩδʔͷՄೳੑΛे෼ଊ͑ΒΕͳ͍ͷͰ͸?
    

    View Slide

12. ೴͸ԿͷͨΊʹ͋Δʁ
    

    View Slide

13. ʮϗϠ͸ؠ৔ʹఆணͯ͠ӭ͙ඞཁ͕ͳ͘ͳΔͱࣗ෼ͷ೴ΛফԽ͠
    ͯ͠·͏ɻςχϡΞΛͱͬͨେֶڭतͱಉ͡Α͏ʹʯ
    ʮࢥߟ΍ײ৘ͷͨΊͰ͸ͳ͘ӡಈ੍ޚͷͨΊʹ೴͕ਐԽͨ͠ʯ
    

    View Slide

14. (Brooks, 1986) (Pfeifer and Sheier, 2001)
    ೴͸਎ମͷ͓·͚ʁ
    

    View Slide

15. ਎ମ
    ʢӡಈɾײ֮ث׭ʣ
    ೴
    ࢹࡉ๔ɿ~150ສ
    ࠎ֨ےɿ~600
    χϡʔϩϯɿ860ԯ
    ʢେ೴ɺ160ԯʣ
    ൽ࣭੸਷࿏ɿ~100ສ
    ࢹਆܦɿ~100ສ
    ਎ମͷ͓·͚ͱݴ͏ʹ͸೴͸େ͖͗͢Δ
    

    View Slide

16. Jang et al., Retino-Cortical Mapping Ratio Predicts Columnar and Salt-and-Pepper
    Organization in Mammalian Visual Cortex. Cell Reports 30, 3270-3279.e3 (2020).
    

    View Slide

17. ੈք
    ೴
    ਎ମ
    ಺ଁ
    ਎ମ͸ʮϘτϧωοΫʯ
    3Dγʔϯ →̎D໢ບ૾ → 3DΠϝʔδ
    ׽ࣈ ← ͔ͳ ← ࢦӡಈʢϩʔϚࣈʣ ← ͔ͳ ← ׽ࣈ
    ɹɹɹɹݴޠ ← ൃ੠ӡಈ ← ࢥߟɾΠϝʔδ
    

    View Slide

18. ੈք
    ೴
    ਎ମ
    ೴σίʔσΟϯά
    = ਎ମΛհͣ͞೴ͷݴ༿Λੈքͷݴ༿ʹ຋༁
    

    View Slide

19. ੈք
    ೴
    ਎ମ
    BMI
    = ೴ͱੈքΛϦΞϧλΠϜʹͭͳ͙ɺ਎ମҎ֎ͷ
    νϟϯωϧΛ։͘
    BMI
    

    View Slide

20. ਂ૚Πϝʔδ࠶ߏ੒
    ʢShen, Horikawa, Majima, Kamitani, bioRxiv 2017ʣ
    

    View Slide

21. 3FDPO1SPDFTT@QBJS@HPE$PM@T(%("/SFMVHFO@BMM@GQT
    

    View Slide

22. Imagined Reconstruction
    Imagery
    

    View Slide

23. (Horikawa, Kamitani, CCN 2019)
    Attention
    

    View Slide

24. Patient A Patient B
    Image: Ryohei Fukuma, Osaka University
    Lateral view, right
    hemisphere
    Lateral view,
    left hemisphere
    ECoG͔Βͷࢹ֮૾࠶ߏ੒
    ʢ༄୔CRESTʣ
    

    View Slide

25. Subject 1
    ʮ೴ίʔυม׵ثʯ
    Subject 2
    Train inter-subject
    prediction model
    (Yamada, Miyawaki, Kamitani, PRNI 2011, Neuroimage 2015)
    

    View Slide

26. (Ho, Horikawa,
    Majima, Kamitani,
    in preparation)
    ݸਓؒਂ૚Πϝʔδ࠶ߏ੒
    

    View Slide

27. (Ho, Horikawa,
    Majima, Kamitani,
    in preparation)
    

    View Slide

28. ੈք ೴
    ݪࢠ΍෼ࢠ
    ࣗવͷ֊૚ߏ଄
    ۙ઀࡞༻
    χϡʔϩϯͱεύΠΫ
    ωοτϫʔΫ
    ہॴɾԕִίωΫγϣϯ
    ೴͸ಠಛͳ࢓ํͰੈքΛίʔυ͍ͯ͠Δ
    ೴಺ੈքϞσϧΛ֎ࡏԽɾڞ༗͢ΔςΫϊϩδʔͱͯ͠
    ʮBMIʯΛ࠶ఆٛɿʮχϡʔϩόʔεʯ
    

    View Slide

29. ࠷ޙʹ
    • ࣦഊ͔ΒֶΜͰ৽͍͠ΞϓϩʔνΛ໛ࡧ͠Α͏
    • ʮૉਓड͚͢Δݚڀʯ΄Ͳݻ͍ΤϏσϯε͕ඞཁ
    • ೴ςΫϊϩδʔͷՄೳੑΛݟۃΊΑ͏ʢݚڀऀͷએ఻จ۟Λਅ
    ʹड͚ͯ͸μϝʣ
    

    View Slide