注意機構を用いた言語創発ゲーム

2023 JSAI オーガナイズドセッション
言語とコミュニケーションの創発 ～記号創発システムから共創的言語進化まで～

Transcript

1. ஫ҙػߏΛ༻͍ͨ ݴޠ૑ൃήʔϜ ཥ ྇פɹ্ా ྄ɹJason Naradowsky ౦ژେֶ
2. ࢦࣔήʔϜͱ͸ʁ - ίϛϡχέʔγϣϯ͔Βࢦࣔͷଆ໘͚ͩΛऔΓग़ͨ͠ήʔϜɻ - ૑ൃίϛϡχέʔγϣϯͷݚڀͰΑ͘࢖ΘΕΔɻ ࢦࣔήʔϜ (referential game)
3. ࢦࣔήʔϜ (referential game) Speaker 3 14 2 25 ໨ඪΦϒδΣΫτ Listener ΦϒδΣΫτީิू߹
4. ࢦࣔήʔϜ (referential game) Speaker 3 14 2 25 Listener ໨ඪΦϒδΣΫτ ΦϒδΣΫτީิू߹ ᶃ Speaker ͕ ໨ඪΦϒδΣΫτΛݟͯ ϝοηʔδΛੜ੒
5. ࢦࣔήʔϜ (referential game) Speaker 3 14 2 25 Listener ໨ඪΦϒδΣΫτ ΦϒδΣΫτީิू߹ ᶄ Listener ͕ϝοηʔδΛݟͯ ΦϒδΣΫτީิू߹͔Β ໨ඪΦϒδΣΫτΛ༧ଌ͢Δ
6. ࢦࣔήʔϜ (referential game) Speaker 3 14 2 25 ໨ඪΦϒδΣΫτ Listener ΦϒδΣΫτީิू߹ ᶅ Listener ͷ༧ଌͱ ໨ඪΦϒδΣΫτ͕Ұக͍ͯ͠Ε͹ ใु͕༩͑ΒΕΔɻ
7. ࢦࣔήʔϜͷΤʔδΣϯτʹ஫ҙػߏΛ࣮૷͢Δ ຊݚڀͰ΍ͬͨ͜ͱ Speaker Listener
8. ͳͥ஫ҙػߏ͔ʁ - ૑ൃݴޠͷߏ੒ੑ্͕͕Δ͸ͣ - ૑ൃݴޠͷղऍੑ্͕͕Δ͸ͣ ຊݚڀͰ΍ͬͨ͜ͱ
9. ͳͥ஫ҙػߏ͔ʁ - ૑ൃݴޠͷߏ੒ੑ্͕͕Δ͸ͣ - ૑ൃݴޠͷղऍੑ্͕͕Δ͸ͣ ຊݚڀͰ΍ͬͨ͜ͱ
10. ߏ੒ੑͱ͸ɿશମ͕෦෼ͷ૯࿨͔ΒͳΔ͜ͱ ஫ҙػߏ͸૑ൃݴޠͷߏ੒ੑΛ্͛Δʁ ߏ੒ੑ ߴ🔺 ߏ੒ੑ ௿🔻 5 3 2 3 2 1 6 4
11. ஫ҙػߏ͸૑ൃݴޠͷߏ੒ੑΛ্͛Δʁ 5 Speaker ஫ҙػߏ͸୯ޠͱΦϒδΣΫτͷ෦෼ͷ݁ͼ͖ͭ Λֶश͢Δͷʹ໾ཱͪͦ͏
12. ͳͥ஫ҙػߏ͔ʁ - ૑ൃݴޠͷߏ੒ੑ্͕͕Δ͸ͣ - ૑ൃݴޠͷղऍੑ্͕͕Δ͸ͣ ຊݚڀͰ΍ͬͨ͜ͱ
13. ஫ҙػߏ͸૑ൃݴޠͷղऍੑΛ্͛Δʁ 5 Speaker ͜ͷ୯ޠ͸͜ͷҙຯͳͷͩͱΘ͔Δ
14. ࣮ݧઃఆɿࢦࣔήʔϜ Speaker 3 14 2 25 ໨ඪΦϒδΣΫτ Listener ΦϒδΣΫτީิू߹ Fashion MNIST Λ༻͍ͨࢦࣔήʔϜ ʢεχʔΧʔͱϓϧΦʔόʔʣ
15. ࣮ݧઃఆɿࢦࣔήʔϜ Speaker 3 14 2 25 ໨ඪΦϒδΣΫτ Listener ΦϒδΣΫτީิू߹ Fashion MNIST Λ༻͍ͨࢦࣔήʔϜ ʢεχʔΧʔͱϓϧΦʔόʔʣ
16. FashionMNIST - 10 छྨͷΞΠςϜͷը૾ΛؚΉσʔληοτ ࣮ݧઃఆɿࢦࣔήʔϜ
17. FashionMNIST - 10 छྨͷΞΠςϜͷը૾ΛؚΉσʔληοτ ࣮ݧઃఆɿࢦࣔήʔϜ ̎छྨͷΞΠςϜΛબΜͰ ̍ͭͷΦϒδΣΫτΛ࡞Δ
18. ࣮ݧઃఆɿࢦࣔήʔϜ FashionMNIST Λ༻͍ͨࢦࣔήʔϜ - FashionMNIST த͔Βը૾Λαϯϓϧͯ͠ଟ༷ͳΦϒδΣΫ τΛ࡞੒ɻ - ಉ͡छྨͷΞΠςϜؚ͕·Ε͍ͯΕ͹ಉ͡ΦϒδΣΫτͰ͋Δ ͱΈͳ͢ɻ - ΦϒδΣΫτͷछྨ਺͸ - ܇࿅ηοτʹ30छྨɺධՁηοτʹ15छྨ࢖༻ 10 C2 = 45
19. ࣮ݧઃఆɿࢦࣔήʔϜ ਓؒʹ͍ۙݴޠΛֶश͢ΔͨΊʹ ಉ͡छྨͷҟͳΔΦϒδΣΫτΛ Speaker ͱ Listener ʹݟͤΔ ໨ඪΦϒδΣΫτ ΦϒδΣΫτީิू߹
20. ஫ҙػߏͳ͠ͷ Speaker ஫ҙػߏ͋Γͷ Speaker ࣮ݧઃఆɿϞσϧ ஫ҙػߏͳ͠ͷ Listner ஫ҙػߏ͋Γͷ Listener × ͦΕͧΕͷ૊Έ߹ΘͤͰ࣮ݧ ͞ΒʹΤʔδΣϯτΛ࣮૷͢ΔωοτϫʔΫͱͯ͠ LSTM ͱ Transformer ͦΕͧΕͰ࣮ݧ
21. ࣮ݧઃఆɿϞσϧ ϕʔεϥΠϯɾΤʔδΣϯτ otgt o1 %FDPEFS &ODPEFS m1 m2 m3 ϝοηʔδΦϒδΣΫτ
    ߹கείΞ m0 m1 m2 m1 m2 m3 Speaker Listener - ஫ҙػߏͳ͠ - ΦϒδΣΫτ͸୯ҰͷϕΫτϧͰදݱ͞ΕΔ
22. ࣮ݧઃఆɿϞσϧ ஫ҙػߏ͋ΓΤʔδΣϯτ otgt o1 %FDPEFS &ODPEFS m1 m2 m3 "UUFOUJPO "UUFOUJPO m0 m1 m2 m1 m2 m3 Speaker Listener ϝοηʔδΦϒδΣΫτ
    ߹கείΞ - ஫ҙػߏ͋Γ - ΦϒδΣΫτ͸ෳ਺ͷϕΫτϧͰදݱ͞ΕΔ
23. ஫ҙػߏ͋Γ/ͳ͠ΤʔδΣϯτͷൺֱ - ஫ҙػߏ͋Γͩͱߏ੒ੑͷई౓ (TopSim) ͕޲্͢Δ ஫ҙػߏ͋ΓΤʔδΣϯτͷݴޠͷௐࠪ ࣮ݧͨ͜͠ͱ
24. ஫ҙػߏ͋Γ/ͳ͠ΤʔδΣϯτͷൺֱ ܇࿅ηοτͷਖ਼ղ཰ ධՁηοτͷਖ਼ղ཰ TopSimʢߏ੒ੑͷई౓ʣ - ஫ҙػߏ͕͋Δํ͕ਖ਼ղ཰͕ߴ͘ͳΔ܏޲ʹ͋Δ - ஫ҙػߏ͕͋Δํ͕ɺTopSim ͕ߴ͘ͳΔ܏޲ʹ͋Δ
25. ஫ҙػߏ͋ΓΤʔδΣϯτͷ ஫ҙػߏͷՄࢹԽ Speaker Listener Speaker Listener Speaker Listener ੒ޭͨ͠ύλʔϯ ੒ޭͨ͠ύλʔϯ ࣦഊͨ͠ύλʔϯ
26. ஫ҙػߏ͋ΓΤʔδΣϯτͷ ૑ൃͨ͠ݴޠͷγϯϘϧͱΦϒδΣΫτͷରԠ Speaker Listener
27. ஫ҙػߏ͋ΓΤʔδΣϯτͷ ૑ൃͨ͠ݴޠͷγϯϘϧͱΦϒδΣΫτͷରԠ Speaker Listener ্ணܥͷΦϒδΣΫτ ۺܥͷΦϒδΣΫτ
28. ஫ҙػߏ͋ΓSpeaker ͱ Listener ͷ ஫ҙൣғͷͣΕͱਖ਼ղ཰ͷؔ܎ ͣΕ͕গͳ͍΄Ͳਖ਼ղ͠΍͍͢܏޲
29. ΍ͬͨ͜ͱ - ࢦࣔήʔϜͷΤʔδΣϯτʹ஫ҙػߏΛ͚ͭΔ 
 - FashionMNIST ͷը૾Λ࢖ͬͨࢦࣔήʔϜͰ࣮ݧ ෼͔ͬͨ͜ͱ - ஫ҙػߏ͕͋Δͱߏ੒ੑ͕ߴ͍ݴޠ͕૑ൃ͠΍͍͢ - ஫ҙػߏΛ࣋ͬͨΤʔδΣϯτ͸ղऍੑͷ͋ΔݴޠΛ૑ൃͤ͞ΒΕΔ ·ͱΊ
30. ࣮͸΋͏ͪΐͬͱࣗવͰෳࡶͳը૾Λ࢖ͬͨࢦࣔήʔϜͰ΋ ͏·͍ͬͯ͘΄͔͕ͬͨ͠ɺֶश͕೉͔ͬͨ͠ - ෳࡶͳը૾ͩͱղऍෆೳͳ஫ҙͷύλʔϯ͔͠؍࡯͞Εͣ ➡︎ ஫ҙػߏ͕ਓؒͷΑ͏ͳબ޷ੑΛ͍࣋ͬͯͳ͍͔Βʁ ਓؒͷ࣋ͭೝ஌ػೳͱݴޠͷੑ࣭ͷؔ࿈ͳͲ͕ௐ΂ΒΕΔͱ ָͦ͠͏ʁ ࠓޙͷൃల