WTM19 - I built a robot to cheat at Pokémon!! by Sophie Déziel

It requires a lot of work to be lazy. This was proven once again when a friend of mine wanted to automate a very long and repetitive task in a video game. Turns out, the open-source world has everything that we needed to build a robot that can catch some Shiny Pokémon in Let's Go Pikachu!

https://youtu.be/r9usR8J1lD0

Transcript

1. I built a robot to I built a robot to cheat at Pokémon!! cheat at Pokémon!! 1
2. Sophie Déziel Sophie Déziel Rails dev @ Acquisio Twitch Streamer @sophiedeziel 2
3. Guiz de Pessemier Guiz de Pessemier Co-founder of Outerminds Youtuber Twitch Streamer @jeuserieux 3
6. Automation to the Automation to the rescue!! rescue!! 6
7. Two challenges Two challenges Controlling the game Have input to make decisions 7
8. Servo-motors Servo-motors Cheap Easy to find You can position the arm precisely Easy to control Does not require to destroy a controller Slow 8
9. Webcam Webcam Easy to position close to the screen Lots of Open-Source Software to control them Plug and Play (most of the time) We can use a single pixel to make a decision 9
10. We can go forward We can go forward Make it autonomous and easy to share with Raspberry Pi We need to make it: Reliable Precise Configurable 10
11. Make it reliable Make it reliable Unsupervised Perfect timing Must not move 11
12. Arduino Arduino 12
13. "Computer vision" "Computer vision" Easy to setup Not so hard to code 13
14. Having an interface Having an interface Control remotely Edit settings easily Visualise the webcam 14
15. Putting it all together Putting it all together 15
16. The working prototype! The working prototype! 16
17. Ooops! Ooops! 17
18. Unplanned features Unplanned features Controls improvements Easy updates Two people working on the same robot Communication features (SMS and Tweets) 18
19. And now? And now? 19
20. Want to build it? Want to build it? So cool! So cool! github.com/sophiedeziel/robo-catcher 20
21. You can modify it: You can modify it: Add Lights and lasers Remove the Arduino and use the RP GPIO Improve the interface Adapt the codebase for another game 21
22. OS Hardware OS Hardware Raspberry Pi Arduino OSS OSS Raspbian Motion Firmata Ruby Rails RMagick Nginx 22
23. Thank you so much Thank you so much Question? Question? 23