Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Reinforcement learning in PyGame

Reinforcement learning in PyGame

Presentation for PyData 21 on reinforcement learning in the PyGame framework

DanielSlater

March 01, 2016

Transcript

8 slides
  1. What is reinforcement learning? • Agents are run within an

    environment. • As they take actions they receive feedback • They aim to maximize good feedback and minimize bad feedback • Computer games are a great way to train reinforcement learning agents. we know we can learn games from just a sequence of images, so computer agents should be able to do the same thing (given enough computational power, time and the right algorithms).
  2. Deep learning in reinforcement learning • Google deepmind recently published

    a set of papers which have the best performance for reinforcement learning on a number of atari games such as Pong • They use a deep convolutional architecture to turn a 192x160 image into a much smaller representation of the state of the game A technique called Q-learning is then used to learn the best actions from those states
  3. • http://www.arcadelearningenvironment.org/ • Framework for running agents against atari 2600

    games • Lots of atari roms now supported • Used in many top research papers on reinforcement learning Arcade learning environment (ALE)
  4. PyGame • http://pygame.org/ • Most popular python games framework •

    1000’s of games, all free, all open source • All written in Python
  5. Everything being in python is great • Its easy to

    make modifications to the game, such as removing a menu screen We can grab values from within the game to use for reinforcement ◦ In Pong we can get reinforcement from the scores ◦ In Tetris we can get +ve reinforcement by intercepting the removeCompleteLines function ◦ In a platform game we can grab the player's x position to encourage exploration
  6. PyGamePlayer • https://github.com/DanielSlater/PyGamePlayer • Allows running of PyGame games with

    zero touches • Handles intercepting screen buffer and key presses • Fixes the game frame rates

More Decks by DanielSlater

Other Decks in Technology