注意機構を用いた言語創発ゲーム

Slide 1

Slide 1 text

஫ҙػߏΛ༻͍ͨ ݴޠ૑ൃήʔϜ ཥ ྇פɹ্ా ྄ɹJason Naradowsky ౦ژେֶ

Slide 2

Slide 2 text

ࢦࣔήʔϜͱ͸ʁ - ίϛϡχέʔγϣϯ͔Βࢦࣔͷଆ໘͚ͩΛऔΓग़ͨ͠ήʔϜɻ - ૑ൃίϛϡχέʔγϣϯͷݚڀͰΑ͘࢖ΘΕΔɻ ࢦࣔήʔϜ (referential game)

Slide 3

Slide 3 text

ࢦࣔήʔϜ (referential game) Speaker 3 14 2 25 ໨ඪΦϒδΣΫτ Listener ΦϒδΣΫτީิू߹

Slide 4

Slide 4 text

ࢦࣔήʔϜ (referential game) Speaker 3 14 2 25 Listener ໨ඪΦϒδΣΫτ ΦϒδΣΫτީิू߹ ᶃ Speaker ͕ ໨ඪΦϒδΣΫτΛݟͯ ϝοηʔδΛੜ੒

Slide 5

Slide 5 text

ࢦࣔήʔϜ (referential game) Speaker 3 14 2 25 Listener ໨ඪΦϒδΣΫτ ΦϒδΣΫτީิू߹ ᶄ Listener ͕ϝοηʔδΛݟͯ ΦϒδΣΫτީิू߹͔Β ໨ඪΦϒδΣΫτΛ༧ଌ͢Δ

Slide 6

Slide 6 text

ࢦࣔήʔϜ (referential game) Speaker 3 14 2 25 ໨ඪΦϒδΣΫτ Listener ΦϒδΣΫτީิू߹ ᶅ Listener ͷ༧ଌͱ ໨ඪΦϒδΣΫτ͕Ұக͍ͯ͠Ε͹ ใु͕༩͑ΒΕΔɻ

Slide 7

Slide 7 text

ࢦࣔήʔϜͷΤʔδΣϯτʹ஫ҙػߏΛ࣮૷͢Δ ຊݚڀͰ΍ͬͨ͜ͱ Speaker Listener

Slide 8

Slide 8 text

ͳͥ஫ҙػߏ͔ʁ - ૑ൃݴޠͷߏ੒ੑ্͕͕Δ͸ͣ - ૑ൃݴޠͷղऍੑ্͕͕Δ͸ͣ ຊݚڀͰ΍ͬͨ͜ͱ

Slide 9

Slide 9 text

ͳͥ஫ҙػߏ͔ʁ - ૑ൃݴޠͷߏ੒ੑ্͕͕Δ͸ͣ - ૑ൃݴޠͷղऍੑ্͕͕Δ͸ͣ ຊݚڀͰ΍ͬͨ͜ͱ

Slide 10

Slide 10 text

ߏ੒ੑͱ͸ɿશମ͕෦෼ͷ૯࿨͔ΒͳΔ͜ͱ ஫ҙػߏ͸૑ൃݴޠͷߏ੒ੑΛ্͛Δʁ ߏ੒ੑ ߴ🔺 ߏ੒ੑ ௿🔻 5 3 2 3 2 1 6 4

Slide 11

Slide 11 text

஫ҙػߏ͸૑ൃݴޠͷߏ੒ੑΛ্͛Δʁ 5 Speaker ஫ҙػߏ͸୯ޠͱΦϒδΣΫτͷ෦෼ͷ݁ͼ͖ͭ Λֶश͢Δͷʹ໾ཱͪͦ͏

Slide 12

Slide 12 text

ͳͥ஫ҙػߏ͔ʁ - ૑ൃݴޠͷߏ੒ੑ্͕͕Δ͸ͣ - ૑ൃݴޠͷղऍੑ্͕͕Δ͸ͣ ຊݚڀͰ΍ͬͨ͜ͱ

Slide 13

Slide 13 text

஫ҙػߏ͸૑ൃݴޠͷղऍੑΛ্͛Δʁ 5 Speaker ͜ͷ୯ޠ͸͜ͷҙຯͳͷͩͱΘ͔Δ

Slide 14

Slide 14 text

࣮ݧઃఆɿࢦࣔήʔϜ Speaker 3 14 2 25 ໨ඪΦϒδΣΫτ Listener ΦϒδΣΫτީิू߹ Fashion MNIST Λ༻͍ͨࢦࣔήʔϜ ʢεχʔΧʔͱϓϧΦʔόʔʣ

Slide 15

Slide 15 text

࣮ݧઃఆɿࢦࣔήʔϜ Speaker 3 14 2 25 ໨ඪΦϒδΣΫτ Listener ΦϒδΣΫτީิू߹ Fashion MNIST Λ༻͍ͨࢦࣔήʔϜ ʢεχʔΧʔͱϓϧΦʔόʔʣ

Slide 16

Slide 16 text

FashionMNIST - 10 छྨͷΞΠςϜͷը૾ΛؚΉσʔληοτ ࣮ݧઃఆɿࢦࣔήʔϜ

Slide 17

Slide 17 text

FashionMNIST - 10 छྨͷΞΠςϜͷը૾ΛؚΉσʔληοτ ࣮ݧઃఆɿࢦࣔήʔϜ ̎छྨͷΞΠςϜΛબΜͰ ̍ͭͷΦϒδΣΫτΛ࡞Δ

Slide 18

Slide 18 text

࣮ݧઃఆɿࢦࣔήʔϜ FashionMNIST Λ༻͍ͨࢦࣔήʔϜ - FashionMNIST த͔Βը૾Λαϯϓϧͯ͠ଟ༷ͳΦϒδΣΫ τΛ࡞੒ɻ - ಉ͡छྨͷΞΠςϜؚ͕·Ε͍ͯΕ͹ಉ͡ΦϒδΣΫτͰ͋Δ ͱΈͳ͢ɻ - ΦϒδΣΫτͷछྨ਺͸ - ܇࿅ηοτʹ30छྨɺධՁηοτʹ15छྨ࢖༻ 10 C2 = 45

Slide 19

Slide 19 text

࣮ݧઃఆɿࢦࣔήʔϜ ਓؒʹ͍ۙݴޠΛֶश͢ΔͨΊʹ ಉ͡छྨͷҟͳΔΦϒδΣΫτΛ Speaker ͱ Listener ʹݟͤΔ ໨ඪΦϒδΣΫτ ΦϒδΣΫτީิू߹

Slide 20

Slide 20 text

஫ҙػߏͳ͠ͷ Speaker ஫ҙػߏ͋Γͷ Speaker ࣮ݧઃఆɿϞσϧ ஫ҙػߏͳ͠ͷ Listner ஫ҙػߏ͋Γͷ Listener × ͦΕͧΕͷ૊Έ߹ΘͤͰ࣮ݧ ͞ΒʹΤʔδΣϯτΛ࣮૷͢ΔωοτϫʔΫͱͯ͠ LSTM ͱ Transformer ͦΕͧΕͰ࣮ݧ

Slide 21

Slide 21 text

࣮ݧઃఆɿϞσϧ ϕʔεϥΠϯɾΤʔδΣϯτ otgt o1 %FDPEFS &ODPEFS m1 m2 m3 ϝοηʔδΦϒδΣΫτ ߹கείΞ m0 m1 m2 m1 m2 m3 Speaker Listener - ஫ҙػߏͳ͠ - ΦϒδΣΫτ͸୯ҰͷϕΫτϧͰදݱ͞ΕΔ

Slide 22

Slide 22 text

࣮ݧઃఆɿϞσϧ ஫ҙػߏ͋ΓΤʔδΣϯτ otgt o1 %FDPEFS &ODPEFS m1 m2 m3 "UUFOUJPO "UUFOUJPO m0 m1 m2 m1 m2 m3 Speaker Listener ϝοηʔδΦϒδΣΫτ ߹கείΞ - ஫ҙػߏ͋Γ - ΦϒδΣΫτ͸ෳ਺ͷϕΫτϧͰදݱ͞ΕΔ

Slide 23

Slide 23 text

஫ҙػߏ͋Γ/ͳ͠ΤʔδΣϯτͷൺֱ - ஫ҙػߏ͋Γͩͱߏ੒ੑͷई౓ (TopSim) ͕޲্͢Δ ஫ҙػߏ͋ΓΤʔδΣϯτͷݴޠͷௐࠪ ࣮ݧͨ͜͠ͱ

Slide 24

Slide 24 text

஫ҙػߏ͋Γ/ͳ͠ΤʔδΣϯτͷൺֱ ܇࿅ηοτͷਖ਼ղ཰ ධՁηοτͷਖ਼ղ཰ TopSimʢߏ੒ੑͷई౓ʣ - ஫ҙػߏ͕͋Δํ͕ਖ਼ղ཰͕ߴ͘ͳΔ܏޲ʹ͋Δ - ஫ҙػߏ͕͋Δํ͕ɺTopSim ͕ߴ͘ͳΔ܏޲ʹ͋Δ

Slide 25

Slide 25 text

஫ҙػߏ͋ΓΤʔδΣϯτͷ ஫ҙػߏͷՄࢹԽ Speaker Listener Speaker Listener Speaker Listener ੒ޭͨ͠ύλʔϯ ੒ޭͨ͠ύλʔϯ ࣦഊͨ͠ύλʔϯ

Slide 26

Slide 26 text

஫ҙػߏ͋ΓΤʔδΣϯτͷ ૑ൃͨ͠ݴޠͷγϯϘϧͱΦϒδΣΫτͷରԠ Speaker Listener

Slide 27

Slide 27 text

஫ҙػߏ͋ΓΤʔδΣϯτͷ ૑ൃͨ͠ݴޠͷγϯϘϧͱΦϒδΣΫτͷରԠ Speaker Listener ্ணܥͷΦϒδΣΫτ ۺܥͷΦϒδΣΫτ

Slide 28

Slide 28 text

஫ҙػߏ͋ΓSpeaker ͱ Listener ͷ ஫ҙൣғͷͣΕͱਖ਼ղ཰ͷؔ܎ ͣΕ͕গͳ͍΄Ͳਖ਼ղ͠΍͍͢܏޲

Slide 29

Slide 29 text

΍ͬͨ͜ͱ - ࢦࣔήʔϜͷΤʔδΣϯτʹ஫ҙػߏΛ͚ͭΔ   - FashionMNIST ͷը૾Λ࢖ͬͨࢦࣔήʔϜͰ࣮ݧ ෼͔ͬͨ͜ͱ - ஫ҙػߏ͕͋Δͱߏ੒ੑ͕ߴ͍ݴޠ͕૑ൃ͠΍͍͢ - ஫ҙػߏΛ࣋ͬͨΤʔδΣϯτ͸ղऍੑͷ͋ΔݴޠΛ૑ൃͤ͞ΒΕΔ ·ͱΊ

Slide 30

Slide 30 text

࣮͸΋͏ͪΐͬͱࣗવͰෳࡶͳը૾Λ࢖ͬͨࢦࣔήʔϜͰ΋ ͏·͍ͬͯ͘΄͔͕ͬͨ͠ɺֶश͕೉͔ͬͨ͠ - ෳࡶͳը૾ͩͱղऍෆೳͳ஫ҙͷύλʔϯ͔͠؍࡯͞Εͣ ➡︎ ஫ҙػߏ͕ਓؒͷΑ͏ͳબ޷ੑΛ͍࣋ͬͯͳ͍͔Βʁ ਓؒͷ࣋ͭೝ஌ػೳͱݴޠͷੑ࣭ͷؔ࿈ͳͲ͕ௐ΂ΒΕΔͱ ָͦ͠͏ʁ ࠓޙͷൃల