Upgrade to Pro — share decks privately, control downloads, hide ads and more …

注意機構を用いた言語創発ゲーム

Ryokan RI
August 19, 2023

 注意機構を用いた言語創発ゲーム

2023 JSAI オーガナイズドセッション
言語とコミュニケーションの創発 ~記号創発システムから共創的言語進化まで~

Ryokan RI

August 19, 2023
Tweet

More Decks by Ryokan RI

Other Decks in Research

Transcript

  1. ஫ҙػߏΛ༻͍ͨ


    ݴޠ૑ൃήʔϜ
    ཥ ྇פɹ্ా ྄ɹJason Naradowsky


    ౦ژେֶ

    View full-size slide

  2. ࢦࣔήʔϜͱ͸ʁ


    - ίϛϡχέʔγϣϯ͔Βࢦࣔͷଆ໘͚ͩΛऔΓग़ͨ͠ήʔϜɻ


    - ૑ൃίϛϡχέʔγϣϯͷݚڀͰΑ͘࢖ΘΕΔɻ
    ࢦࣔήʔϜ


    (referential game)

    View full-size slide

  3. ࢦࣔήʔϜ


    (referential game)
    Speaker
    3 14 2 25
    ໨ඪΦϒδΣΫτ
    Listener
    ΦϒδΣΫτީิू߹

    View full-size slide

  4. ࢦࣔήʔϜ


    (referential game)
    Speaker
    3 14 2 25
    Listener
    ໨ඪΦϒδΣΫτ ΦϒδΣΫτީิू߹
    ᶃ Speaker ͕ ໨ඪΦϒδΣΫτΛݟͯ


    ϝοηʔδΛੜ੒

    View full-size slide

  5. ࢦࣔήʔϜ


    (referential game)
    Speaker
    3 14 2 25
    Listener
    ໨ඪΦϒδΣΫτ ΦϒδΣΫτީิू߹
    ᶄ Listener ͕ϝοηʔδΛݟͯ


    ΦϒδΣΫτީิू߹͔Β


    ໨ඪΦϒδΣΫτΛ༧ଌ͢Δ

    View full-size slide

  6. ࢦࣔήʔϜ


    (referential game)
    Speaker
    3 14 2 25
    ໨ඪΦϒδΣΫτ
    Listener
    ΦϒδΣΫτީิू߹
    ᶅ Listener ͷ༧ଌͱ


    ໨ඪΦϒδΣΫτ͕Ұக͍ͯ͠Ε͹


    ใु͕༩͑ΒΕΔɻ

    View full-size slide

  7. ࢦࣔήʔϜͷΤʔδΣϯτʹ஫ҙػߏΛ࣮૷͢Δ
    ຊݚڀͰ΍ͬͨ͜ͱ
    Speaker Listener

    View full-size slide

  8. ͳͥ஫ҙػߏ͔ʁ


    - ૑ൃݴޠͷߏ੒ੑ্͕͕Δ͸ͣ


    - ૑ൃݴޠͷղऍੑ্͕͕Δ͸ͣ
    ຊݚڀͰ΍ͬͨ͜ͱ

    View full-size slide

  9. ͳͥ஫ҙػߏ͔ʁ


    - ૑ൃݴޠͷߏ੒ੑ্͕͕Δ͸ͣ


    - ૑ൃݴޠͷղऍੑ্͕͕Δ͸ͣ
    ຊݚڀͰ΍ͬͨ͜ͱ

    View full-size slide

  10. ߏ੒ੑͱ͸ɿશମ͕෦෼ͷ૯࿨͔ΒͳΔ͜ͱ
    ஫ҙػߏ͸૑ൃݴޠͷߏ੒ੑΛ্͛Δʁ
    ߏ੒ੑ ߴ🔺 ߏ੒ੑ ௿🔻
    5
    3
    2
    3
    2
    1
    6
    4

    View full-size slide

  11. ஫ҙػߏ͸૑ൃݴޠͷߏ੒ੑΛ্͛Δʁ
    5
    Speaker
    ஫ҙػߏ͸୯ޠͱΦϒδΣΫτͷ෦෼ͷ݁ͼ͖ͭ
    Λֶश͢Δͷʹ໾ཱͪͦ͏

    View full-size slide

  12. ͳͥ஫ҙػߏ͔ʁ


    - ૑ൃݴޠͷߏ੒ੑ্͕͕Δ͸ͣ


    - ૑ൃݴޠͷղऍੑ্͕͕Δ͸ͣ
    ຊݚڀͰ΍ͬͨ͜ͱ

    View full-size slide

  13. ஫ҙػߏ͸૑ൃݴޠͷղऍੑΛ্͛Δʁ
    5
    Speaker
    ͜ͷ୯ޠ͸͜ͷҙຯͳͷͩͱΘ͔Δ

    View full-size slide

  14. ࣮ݧઃఆɿࢦࣔήʔϜ
    Speaker
    3 14 2 25
    ໨ඪΦϒδΣΫτ
    Listener
    ΦϒδΣΫτީิू߹
    Fashion MNIST Λ༻͍ͨࢦࣔήʔϜ
    ʢεχʔΧʔͱϓϧΦʔόʔʣ

    View full-size slide

  15. ࣮ݧઃఆɿࢦࣔήʔϜ
    Speaker
    3 14 2 25
    ໨ඪΦϒδΣΫτ
    Listener
    ΦϒδΣΫτީิू߹
    Fashion MNIST Λ༻͍ͨࢦࣔήʔϜ
    ʢεχʔΧʔͱϓϧΦʔόʔʣ

    View full-size slide

  16. FashionMNIST


    - 10 छྨͷΞΠςϜͷը૾ΛؚΉσʔληοτ
    ࣮ݧઃఆɿࢦࣔήʔϜ

    View full-size slide

  17. FashionMNIST


    - 10 छྨͷΞΠςϜͷը૾ΛؚΉσʔληοτ
    ࣮ݧઃఆɿࢦࣔήʔϜ
    ̎छྨͷΞΠςϜΛબΜͰ


    ̍ͭͷΦϒδΣΫτΛ࡞Δ

    View full-size slide

  18. ࣮ݧઃఆɿࢦࣔήʔϜ
    FashionMNIST Λ༻͍ͨࢦࣔήʔϜ


    - FashionMNIST த͔Βը૾Λαϯϓϧͯ͠ଟ༷ͳΦϒδΣΫ
    τΛ࡞੒ɻ


    - ಉ͡छྨͷΞΠςϜؚ͕·Ε͍ͯΕ͹ಉ͡ΦϒδΣΫτͰ͋Δ
    ͱΈͳ͢ɻ


    - ΦϒδΣΫτͷछྨ਺͸


    - ܇࿅ηοτʹ30छྨɺධՁηοτʹ15छྨ࢖༻
    10
    C2
    = 45

    View full-size slide

  19. ࣮ݧઃఆɿࢦࣔήʔϜ
    ਓؒʹ͍ۙݴޠΛֶश͢ΔͨΊʹ


    ಉ͡छྨͷҟͳΔΦϒδΣΫτΛ Speaker
    ͱ Listener ʹݟͤΔ
    ໨ඪΦϒδΣΫτ ΦϒδΣΫτީิू߹

    View full-size slide

  20. ஫ҙػߏͳ͠ͷ Speaker


    ஫ҙػߏ͋Γͷ Speaker
    ࣮ݧઃఆɿϞσϧ
    ஫ҙػߏͳ͠ͷ Listner


    ஫ҙػߏ͋Γͷ Listener
    ×
    ͦΕͧΕͷ૊Έ߹ΘͤͰ࣮ݧ
    ͞ΒʹΤʔδΣϯτΛ࣮૷͢ΔωοτϫʔΫͱͯ͠


    LSTM ͱ Transformer ͦΕͧΕͰ࣮ݧ

    View full-size slide

  21. ࣮ݧઃఆɿϞσϧ


    ϕʔεϥΠϯɾΤʔδΣϯτ
    otgt o1
    %FDPEFS
    &ODPEFS
    m1
    m2
    m3
    ϝοηʔδΦϒδΣΫτ
    ߹கείΞ
    m0
    m1
    m2
    m1
    m2
    m3
    Speaker Listener
    - ஫ҙػߏͳ͠


    - ΦϒδΣΫτ͸୯ҰͷϕΫτϧͰදݱ͞ΕΔ

    View full-size slide

  22. ࣮ݧઃఆɿϞσϧ


    ஫ҙػߏ͋ΓΤʔδΣϯτ
    otgt o1
    %FDPEFS
    &ODPEFS
    m1
    m2
    m3
    "UUFOUJPO
    "UUFOUJPO
    m0
    m1
    m2
    m1
    m2
    m3
    Speaker Listener
    ϝοηʔδΦϒδΣΫτ
    ߹கείΞ
    - ஫ҙػߏ͋Γ


    - ΦϒδΣΫτ͸ෳ਺ͷϕΫτϧͰදݱ͞ΕΔ

    View full-size slide

  23. ஫ҙػߏ͋Γ/ͳ͠ΤʔδΣϯτͷൺֱ


    - ஫ҙػߏ͋Γͩͱߏ੒ੑͷई౓ (TopSim) ͕޲্͢Δ


    ஫ҙػߏ͋ΓΤʔδΣϯτͷݴޠͷௐࠪ
    ࣮ݧͨ͜͠ͱ

    View full-size slide

  24. ஫ҙػߏ͋Γ/ͳ͠ΤʔδΣϯτͷൺֱ
    ܇࿅ηοτͷਖ਼ղ཰ ධՁηοτͷਖ਼ղ཰ TopSimʢߏ੒ੑͷई౓ʣ
    - ஫ҙػߏ͕͋Δํ͕ਖ਼ղ཰͕ߴ͘ͳΔ܏޲ʹ͋Δ


    - ஫ҙػߏ͕͋Δํ͕ɺTopSim ͕ߴ͘ͳΔ܏޲ʹ͋Δ

    View full-size slide

  25. ஫ҙػߏ͋ΓΤʔδΣϯτͷ


    ஫ҙػߏͷՄࢹԽ
    Speaker Listener Speaker Listener Speaker Listener
    ੒ޭͨ͠ύλʔϯ ੒ޭͨ͠ύλʔϯ ࣦഊͨ͠ύλʔϯ

    View full-size slide

  26. ஫ҙػߏ͋ΓΤʔδΣϯτͷ


    ૑ൃͨ͠ݴޠͷγϯϘϧͱΦϒδΣΫτͷରԠ
    Speaker Listener

    View full-size slide

  27. ஫ҙػߏ͋ΓΤʔδΣϯτͷ


    ૑ൃͨ͠ݴޠͷγϯϘϧͱΦϒδΣΫτͷରԠ
    Speaker Listener
    ্ணܥͷΦϒδΣΫτ
    ۺܥͷΦϒδΣΫτ

    View full-size slide

  28. ஫ҙػߏ͋ΓSpeaker ͱ Listener ͷ


    ஫ҙൣғͷͣΕͱਖ਼ղ཰ͷؔ܎
    ͣΕ͕গͳ͍΄Ͳਖ਼ղ͠΍͍͢܏޲

    View full-size slide

  29. ΍ͬͨ͜ͱ


    - ࢦࣔήʔϜͷΤʔδΣϯτʹ஫ҙػߏΛ͚ͭΔ

    - FashionMNIST ͷը૾Λ࢖ͬͨࢦࣔήʔϜͰ࣮ݧ


    ෼͔ͬͨ͜ͱ


    - ஫ҙػߏ͕͋Δͱߏ੒ੑ͕ߴ͍ݴޠ͕૑ൃ͠΍͍͢


    - ஫ҙػߏΛ࣋ͬͨΤʔδΣϯτ͸ղऍੑͷ͋ΔݴޠΛ૑ൃͤ͞ΒΕΔ


    ·ͱΊ

    View full-size slide

  30. ࣮͸΋͏ͪΐͬͱࣗવͰෳࡶͳը૾Λ࢖ͬͨࢦࣔήʔϜͰ΋
    ͏·͍ͬͯ͘΄͔͕ͬͨ͠ɺֶश͕೉͔ͬͨ͠


    - ෳࡶͳը૾ͩͱղऍෆೳͳ஫ҙͷύλʔϯ͔͠؍࡯͞Εͣ


    ➡︎
    ஫ҙػߏ͕ਓؒͷΑ͏ͳબ޷ੑΛ͍࣋ͬͯͳ͍͔Βʁ


    ਓؒͷ࣋ͭೝ஌ػೳͱݴޠͷੑ࣭ͷؔ࿈ͳͲ͕ௐ΂ΒΕΔͱ
    ָͦ͠͏ʁ
    ࠓޙͷൃల

    View full-size slide