Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Playing Pacman with Monte Carlo Tree Search

Sponsored · Ship Features Fearlessly Turn features on and off without deploys. Used by thousands of Ruby developers. →

Playing Pacman with Monte Carlo Tree Search

Writing algorithms for Artificial Intelligence is a lot of fun. You end up teaching your software how to move and learn in the environment and how to take actions to survive to obstacles and threats. But this is still software. How do you know your AI is not dumb as doorknobs? How do you test something that thinks and decides in its own terms? How can you be sure it is following your inputs in a strategic way?

Daniele Polencic

July 06, 2017

Transcript

123 slides
  1. ! "

  2. 2 1

  3. 2 1

  4. 2 1 3 2 1 3 2 1 3 2

    1 3 2 1 3 2 1 3
  5. 2 1 3 2 1 3 2 1 3 2

    1 3 2 1 3 2 1 3
  6. 2 1 3 2 1 3 2 1 3 2

    1 3 2 1 3 2 1 3
  7. 2 1 3 2 1 3 2 1 3 2

    1 3 2 1 3 2 1 3
  8. 2 1 3 2 1 3 2 1 3 2

    1 3 2 1 3 2 1 3
  9. 2 1 3 2 1 3 2 1 3 2

    1 3 2 1 3 2 1 3
  10. 2 1 3 2 1 3 2 1 3 2

    1 3 2 1 3 2 1 3
  11. 2 1 3 2 1 3 2 1 3 2

    1 3 2 1 3 2 1 3
  12. 2 1 3 2 1 3 2 1 3 2

    1 3 2 1 3 2 1 3
  13. 2 1 3 2 1 3 2 1 3 2

    1 3 2 1 3 2 1 3
  14. 2 1 3 2 1 3 2 1 3 2

    1 3 2 1 3 2 1 3
  15. 2 1 3 2 1 3 2 1 3 2

    1 3 2 1 3 2 1 3
  16. 2 1 3 2 1 3 2 1 3 2

    1 3 2 1 3 2 1 3
  17. 2 1 3 2 1 3 2 1 3 2

    1 3 2 1 3 2 1 3
  18. 2 1

  19. 2 1

  20. 2 1 3 2 1 3 2 1 3 2

    1 3 2 1 3 2 1 3
  21. 2 1 3 2 1 3 2 1 3 2

    1 3 2 1 3 2 1 3
  22. 2 1 3 2 1 3 2 1 3 2

    1 3 2 1 3 2 1 3
  23. 2 1 3 2 1 3 2 1 3 2

    1 3 2 1 3 2 1 3
  24. 2 1

  25. 2 1 3 2 1 3 2 1 3 2

    1 3 2 1 3 2 1 3
  26. 2 1

  27. 0 0 1 0 0 1 0 0 2 0

    0 1 0 0 1 0 0 1 0 0 1 0 0 1 0 0 1
  28. 0 0 4 0 0 4 0 0 8 0

    0 1 0 0 1 0 0 1 0 0 1 0 0 1 0 0 1
  29. 2 1 3 2 1 3 2 1 3 2

    1 3 2 1 3 2 1 3 0 0 4 0 0 4 0 0 8 0 0 1 0 0 1 0 0 1 0 0 1 0 0 1 0 0 1
  30. 0 0 4 0 0 4 0 0 8 0

    0 1 0 0 1 0 0 1 0 0 1 0 0 1 0 0 1 0 0 1 0 0 1 1 0 1 0 0 1 0 1 1 1 0 1 0 0 1 0 0 1 1 0 1 0 1 1 0 0 1 0 0 1 0 0 1 0 1 1 0 0 1 0 0 1 0 0 1 0 0 1
  31. 0 0 4 0 0 4 0 0 8 0

    0 1 0 0 1 0 0 1 0 0 1 0 0 1 0 0 1 0 0 1 0 0 1 1 0 1 0 0 1 0 1 1 1 0 1 0 0 1 0 0 1 1 0 1 0 1 1 0 0 1 0 0 1 0 0 1 0 1 1 0 0 1 0 0 1 0 0 1 0 0 1
  32. 3 1 12 0 2 12 3 3 24 1

    0 4 1 1 4 1 0 4 0 1 4 0 1 4 0 0 4 0 0 1 0 0 1 1 0 1 0 0 1 0 1 1 1 0 1 0 0 1 0 0 1 1 0 1 0 1 1 0 0 1 0 0 1 0 0 1 0 1 1 0 0 1 0 0 1 0 0 1 0 0 1
  33. 3 1 12 0 2 12 3 3 24 1

    0 4 1 1 4 1 0 4 0 1 4 0 1 4 0 0 4 0 0 1 0 0 1 1 0 1 0 0 1 0 1 1 1 0 1 0 0 1 0 0 1 1 0 1 0 1 1 0 0 1 0 0 1 0 0 1 0 1 1 0 0 1 0 0 1 0 0 1 0 0 1
  34. 3 1 12 0 2 12 3 3 24 1

    0 4 1 1 4 1 0 4 0 1 4 0 1 4 0 0 4 0 0 1 0 0 1 1 0 1 0 0 1 0 1 1 1 0 1 0 0 1 0 0 1 1 0 1 0 1 1 0 0 1 0 0 1 0 0 1 0 1 1 0 0 1 0 0 1 0 0 1 0 0 1
  35. 3 1 12 0 2 12 3 3 24 1

    0 4 1 1 4 1 0 4 0 1 4 0 1 4 0 0 4 0 0 1 0 0 1 1 0 1 0 0 1 0 1 1 1 0 1 0 0 1 0 0 1 1 0 1 0 1 1 0 0 1 0 0 1 0 0 1 0 1 1 0 0 1 0 0 1 0 0 1 0 0 1
  36. 3 1 12 0 2 12 3 3 24 1

    0 4 0 0 1 0 0 1 1 0 1 0 0 1 0 1 1 1 0 1 0 0 1 0 0 1 1 0 1 0 1 1 0 0 1 0 0 1 0 0 1 0 1 1 0 0 1 0 0 1 0 0 1 0 0 1 1 1 4 1 0 4 0 1 4 0 1 4 0 0 4
  37. 3 1 12 0 2 12 3 3 24 1

    0 4 0 0 1 0 0 1 1 0 1 0 0 1 0 1 1 1 0 1 0 0 1 0 0 1 1 0 1 0 1 1 0 0 1 0 0 1 0 0 1 0 1 1 0 0 1 0 0 1 0 0 1 0 0 1 1 1 4 1 0 4 0 1 4 0 1 4 0 0 4
  38. 3 1 12 0 2 12 3 3 24 1

    0 4 0 0 1 0 0 1 1 0 1 0 0 1 0 1 1 1 0 1 0 0 1 0 0 1 1 0 1 0 1 1 0 0 1 0 0 1 0 0 1 0 1 1 0 0 1 0 0 1 0 0 1 0 0 1 1 1 4 1 0 4 0 1 4 0 1 4 0 0 4
  39. 3 1 12 0 2 12 3 3 24 1

    0 4 0 0 1 0 0 1 1 0 1 0 0 1 0 1 1 1 0 1 0 0 1 0 0 1 1 0 1 0 1 1 0 0 1 0 0 1 0 0 1 0 1 1 0 0 1 0 0 1 0 0 1 0 0 1 1 1 4 1 0 4 0 1 4 0 1 4 0 0 4
  40. 3 1 12 0 2 12 3 3 24 1

    0 4 0 0 1 0 0 1 1 0 1 0 0 1 0 1 1 1 0 1 0 0 1 0 0 1 1 0 1 0 1 1 0 0 1 0 0 1 0 0 1 0 1 1 0 0 1 0 0 1 0 0 1 0 0 1 1 1 4 1 0 4 0 1 4 0 1 4 0 0 4
  41. 3 1 12 0 2 12 3 3 24 1

    0 4 0 0 1 0 0 1 1 0 1 0 0 1 0 1 1 1 0 1 0 0 1 0 0 1 1 0 1 0 1 1 0 0 1 0 0 1 0 0 1 0 1 1 0 0 1 0 0 1 0 0 1 0 0 1 1 1 4 1 0 4 0 1 4 0 1 4 0 0 4
  42. 0 2 12 0 1 1 0 0 1 0

    0 1 0 0 1 0 1 1 0 0 1 0 0 1 0 0 1 0 0 1 0 1 4 0 1 4 0 0 4
  43. const message = { type: PACMAN_MOVES, direction: 'left' }; const

    state = { pacman: {x: 1, y: 0}, red: {x: 0, y: 2} };

More Decks by Daniele Polencic

Other Decks in Technology