Tweet
Tweet

Slide 1

Slide 1 text

BMI ݚڀ͸ͳͥಉࣦ͡ഊΛ܁Γฦ͢ͷ͔ ژ౎େֶ ৘ใֶݚڀՊ ATR೴৘ใݚڀॴ ਆ୩೭߁ http://kamitani-lab.ist.i.kyoto-u.ac.jp @ykamit

Slide 2

Slide 2 text

NHK͓͸Α͏೔ຊ, 2006.5.25 ͡ΌΜ͚ΜσϞʢ2006ʣ

Slide 3

Slide 3 text

Kamitani and Tong (2005)

Slide 4

Slide 4 text

σίʔσΟϯάͷʮ௒ղ૾ʯ (Boynton, 2005; Rojer and Schwartz, 1990) Information from subvoxel representation via random bias of voxel sampling due to irregular columnar and/or vasculature structure (Kamitani and Tong, 2005) (See also: Op de Beeck, 2009; Kamitani & Sawahata, 2009; Gardner, 2009; Shmuel et al. 2009; Kriegeskorte et al 2009; Mannion et al., 2009; Swisher et al. 2010; Freeman et al. 2011; Clifford et al., 2011; Chaimow et al 2011)

Slide 5

Slide 5 text

2003: CRESTʮߴྸ೴ͷֶशೳྗͱՄ઼ੑͷBMI๏ʹΑΔղ໌ʯʢᓎҪ๕༤ʣ 2003-2004:ʢਆ୩ʣϓϦϯετϯ଺ࡏதɺ೴σίʔσΟϯά։ൃ 2004.10.1: ʢਆ୩ʣATRೖॴ 2005:ɹKamitani and Tong (2005ʣग़൛ 2006: ɹɹɹ • NICT, Symposium on Brain Communication Technology (Wolpaw, ࡕେ೴֎Պ) • ͡ΌΜ͚ΜσϞʢATR, Honda HRIʣ • CREST γϯϙδ΢Ϝʮ೴ͱػցΛͭͳ͙ʔϒϨΠϯ-ϚγϯɾΠϯλʔϑΣʔ εͷՄೳੑʯʢNicolelis, Fetzʣ • ೴Λ׆͔͢ݚڀձ 2007: G-TeCใࠂॻɹʮϒϨΠϯɾϚγϯɾΠϯλϑΣʔεʯʢถࠃʣ 2008: จ෦Պֶলɾ೴ՊֶݚڀઓུਪਐϓϩάϥϜʢ೴ϓϩʣ՝୊AʮϒϨΠϯɾϚ γϯɾΠϯλʔϑΣʔεʢBMIʣͷ։ൃʯ 2010: ͖͕͚͞ʮ೴৘ใͷղಡͱ੍ޚʯ(ݚڀ૯ׅɿ ઒ਓ ޫஉ) ͦͷޙͷࠃϓϩɿ೴ϓϩୈೋظɺ૯຿লɺImPactɺNEDOɺ Ϝʔϯγϣοτ… ೔ຊͷBMIݚڀͷ͋ΏΈ

Slide 6

Slide 6 text

χϡʔϩΠϝʔδϯάɿ • GLM/SPMʢܹࢗ→൓Ԡਤࣜɺ৺ཧ౷ܭɺِཅੑɺूஂฏۉ…ʣ͔Βͷ։์ • ࣗ༝ͳϞσϦϯάɺ਺ཧՊֶɾAI΁ͷ઀ଓ • આ໌͔Β༧ଌ΁ • BMIͷςετϕου ਆܦίʔυɿ • αϧ͔Βώτ΁ • ػցֶशʢ≠ ౷ܭʣͰେن໛࣮σʔλΛղੳ • ʮχϡʔϩϯʢεύΠΫʣυΫτϦϯʯΛ௒͑ͯʢϙϐϡϨʔγϣϯɺηϯ αʔۭؒʣ • ʮݸମʢ೴ʣʹͱͬͯͷίʔυʯ͔Βʮୈࡾऀʹͱͬͯͷίʔυʯ΁ K & T (2005) /͡ΌΜ͚ΜσϞͷޭࡑ

Slide 7

Slide 7 text

χϡʔϩΠϝʔδϯάɿ • GLM/SPMʢܹࢗ→൓Ԡਤࣜɺ৺ཧ౷ܭɺِཅੑɺूஂฏۉ…ʣ͔Βͷ։์ • ࣗ༝ͳϞσϦϯάɺ਺ཧՊֶɾAI΁ͷ઀ଓ • આ໌͔Β༧ଌ΁ • BMIͷςετϕου ਆܦίʔυɿ • αϧ͔Βώτ΁ • ػցֶशʢ≠ ౷ܭʣͰେن໛࣮σʔλΛղੳ • ʮχϡʔϩϯʢεύΠΫʣυΫτϦϯʯΛ௒͑ͯʢϙϐϡϨʔγϣϯɺηϯ αʔۭؒʣ • ʮݸମʢ೴ʣʹͱͬͯͷίʔυʯ͔Βʮୈࡾऀʹͱͬͯͷίʔυʯ΁ K & T (2005) /͡ΌΜ͚ΜσϞͷޭࡑ ࡑ ಈ෺࣮ݧෆཁ࿦ ඇ৵ऻ೴ܭଌ΁ͷա౓ͳظ଴ ࠃϓϩʹ޲͖ͷςʔϚͱͯ͠ཞ༻ ૉਓड͚Λૂͬͨূڌͷ๡͍͠ݚڀ େຊӦൃදతϓϨεϦϦʔε ݚڀऀͷηʔϧεϚϯԽ ʮԠ༻೴ՊֶϏδωεʯ͕೿ੜ

Slide 8

Slide 8 text

ࡕେ೴֎ՊͱͷECoG-BMIͷڞಉݚڀ (Yanagisawa, Kamitani, et al., Neuroimage 2009, Annals of Neurology 2011, Nature Communications 2016, among others)

Slide 9

Slide 9 text

No content

Slide 10

Slide 10 text

https://www.gofundme.com/f/visitingjapanbraincomputerinterface ʮBMI͸ͳͯ͘΋ੜ׆ʹࠔΒͳ͍ʯ

Slide 11

Slide 11 text

BMIΛ࠶ఆٛ͢Δ • BMI=৵ऻܕɺBCI=ඇ৵ऻ ← ੲͷۀք੗Έ෼͚࿦ཧ • Neuroprosthetics (Schwartz, Shenoy) ← ࢒ଘػೳΛ௒͑ΒΕΔ͔ • ೴–೴௨৴ (Rao, Nicolelis) ← ݱঢ়ɺத਎͸ۃΊͯ͠ΐ΅͍… ͦ΋ͦ΋ɺ • ʮػցʯʮܭଌɾܹࢗ๏ʯʮػೳ୅ସʯ͸ຊ࣭ʁ ʮBMIʹ೴ͱػցͷΠϯλʔϑΣʔεʯͰ͸ ೴ςΫϊϩδʔͷՄೳੑΛे෼ଊ͑ΒΕͳ͍ͷͰ͸?

Slide 12

Slide 12 text

೴͸ԿͷͨΊʹ͋Δʁ

Slide 13

Slide 13 text

ʮϗϠ͸ؠ৔ʹఆணͯ͠ӭ͙ඞཁ͕ͳ͘ͳΔͱࣗ෼ͷ೴ΛফԽ͠ ͯ͠·͏ɻςχϡΞΛͱͬͨେֶڭतͱಉ͡Α͏ʹʯ ʮࢥߟ΍ײ৘ͷͨΊͰ͸ͳ͘ӡಈ੍ޚͷͨΊʹ೴͕ਐԽͨ͠ʯ

Slide 14

Slide 14 text

(Brooks, 1986) (Pfeifer and Sheier, 2001) ೴͸਎ମͷ͓·͚ʁ

Slide 15

Slide 15 text

਎ମ ʢӡಈɾײ֮ث׭ʣ ೴ ࢹࡉ๔ɿ~150ສ ࠎ֨ےɿ~600 χϡʔϩϯɿ860ԯ ʢେ೴ɺ160ԯʣ ൽ࣭੸਷࿏ɿ~100ສ ࢹਆܦɿ~100ສ ਎ମͷ͓·͚ͱݴ͏ʹ͸೴͸େ͖͗͢Δ

Slide 16

Slide 16 text

Jang et al., Retino-Cortical Mapping Ratio Predicts Columnar and Salt-and-Pepper Organization in Mammalian Visual Cortex. Cell Reports 30, 3270-3279.e3 (2020).

Slide 17

Slide 17 text

ੈք ೴ ਎ମ ಺ଁ ਎ମ͸ʮϘτϧωοΫʯ 3Dγʔϯ →̎D໢ບ૾ → 3DΠϝʔδ ׽ࣈ ← ͔ͳ ← ࢦӡಈʢϩʔϚࣈʣ ← ͔ͳ ← ׽ࣈ ɹɹɹɹݴޠ ← ൃ੠ӡಈ ← ࢥߟɾΠϝʔδ

Slide 18

Slide 18 text

ੈք ೴ ਎ମ ೴σίʔσΟϯά = ਎ମΛհͣ͞೴ͷݴ༿Λੈքͷݴ༿ʹ຋༁

Slide 19

Slide 19 text

ੈք ೴ ਎ମ BMI = ೴ͱੈքΛϦΞϧλΠϜʹͭͳ͙ɺ਎ମҎ֎ͷ νϟϯωϧΛ։͘ BMI

Slide 20

Slide 20 text

ਂ૚Πϝʔδ࠶ߏ੒ ʢShen, Horikawa, Majima, Kamitani, bioRxiv 2017ʣ

Slide 21

Slide 21 text

3FDPO1SPDFTT@QBJS@HPE$PM@T(%("/SFMVHFO@BMM@GQT

Slide 22

Slide 22 text

Imagined Reconstruction Imagery

Slide 23

Slide 23 text

(Horikawa, Kamitani, CCN 2019) Attention

Slide 24

Slide 24 text

Patient A Patient B Image: Ryohei Fukuma, Osaka University Lateral view, right hemisphere Lateral view, left hemisphere ECoG͔Βͷࢹ֮૾࠶ߏ੒ ʢ༄୔CRESTʣ

Slide 25

Slide 25 text

Subject 1 ʮ೴ίʔυม׵ثʯ Subject 2 Train inter-subject prediction model (Yamada, Miyawaki, Kamitani, PRNI 2011, Neuroimage 2015)

Slide 26

Slide 26 text

(Ho, Horikawa, Majima, Kamitani, in preparation) ݸਓؒਂ૚Πϝʔδ࠶ߏ੒

Slide 27

Slide 27 text

(Ho, Horikawa, Majima, Kamitani, in preparation)

Slide 28

Slide 28 text

ੈք ೴ ݪࢠ΍෼ࢠ ࣗવͷ֊૚ߏ଄ ۙ઀࡞༻ χϡʔϩϯͱεύΠΫ ωοτϫʔΫ ہॴɾԕִίωΫγϣϯ ೴͸ಠಛͳ࢓ํͰੈքΛίʔυ͍ͯ͠Δ ೴಺ੈքϞσϧΛ֎ࡏԽɾڞ༗͢ΔςΫϊϩδʔͱͯ͠ ʮBMIʯΛ࠶ఆٛɿʮχϡʔϩόʔεʯ

Slide 29

Slide 29 text

࠷ޙʹ • ࣦഊ͔ΒֶΜͰ৽͍͠ΞϓϩʔνΛ໛ࡧ͠Α͏ • ʮૉਓड͚͢Δݚڀʯ΄Ͳݻ͍ΤϏσϯε͕ඞཁ • ೴ςΫϊϩδʔͷՄೳੑΛݟۃΊΑ͏ʢݚڀऀͷએ఻จ۟Λਅ ʹड͚ͯ͸μϝʣ