Domo Arigato, Mr. Roboto: Machine Learning with Ruby

Transcript

1. 1.

   Dōmo arigatō, Mr. Roboto: Machine Learning with Ruby # Eric

   Weinstein # RubyConf 2016 # Cincinnati, Ohio # 10 November 2016
2. 2.

   for Joshua

3. 3.

   Part 0: Hello!

4. 4.

   About Me eric_weinstein = { employer: 'Hulu', github: 'ericqweinstein', twitter:

   'ericqweinstein', website: 'ericweinste.in' } 30% off with RUBYCONF30!
5. 5.

   Agenda • What is machine learning? • What is supervised

   learning? • What’s a neural network? • Machine learning with Ruby and the MNIST dataset
6. 6.

   Part 1: Machine Learning

7. 7.

   None
8. 8.

   What’s machine learning?

9. 9.

   In a word:

10. 10.

    Generalization

11. 11.

    What’s Supervised Learning? Classification or regression, generalizing from labeled data

    to unlabeled data
12. 12.

    Features && Labels • Raw pixel features (vectors of intensities)

    • Digit (0..9)
13. 13.

    Features && Labels • Raw pixel features (vectors of intensities)

    • Digit (0..9)
14. 14.

    Image credit: https://www.tensorflow.org/versions/r0.9/tutorials/mnist/ beginners/index.html

15. 15.

    What’s a neural network?

16. 16.

    Image credit: https://github.com/cdipaolo/goml/tree/master/perceptron

17. 17.

    Image credit: https://en.wikipedia.org/wiki/Artificial_neural_network

18. 18.

    Part 2: The MNIST Dataset

19. 19.

    Our Data • Images of handwritten digits, size-normalized and centered

    • Training: 60,000 examples, test: 10,000 • http://yann.lecun.com/exdb/mnist/
20. 20.

    Image credit: https://www.researchgate.net/

21. 21.

    How’d We Do? • Correct: 9328 / 10_000 • Incorrect:

    672 / 10_000 • Overall: 93.28% accuracy
22. 22.

    Developing the App

23. 23.

    Front End submit() { fetch('/submit', { method: 'POST', body: this.state.canvas.toDataURL('image/png')

    }).then(response => { return response.json(); }).then(j => { this.setState({ prediction: j.prediction }); }); }
24. 24.

    Front End render() { return( <div> <EditableCanvas canvas={this.state.canvas} ctx={this.state.ctx} ref='editableCanvas'

    /> <Prediction number={this.state.prediction} /> <div> <Button onClick={this.submit} value='Submit' /> <Button onClick={this.clear} value='Clear' /> </div> </div> ); }
25. 25.

    Back End train = RubyFann::TrainData.new(inputs: features, desired_outputs: labels) fann =

    RubyFann::Standard.new(num_inputs: 576, hidden_neurons: [300], num_outputs: 10) fann.train_on_data(train, 1000, 10, 0.01)
26. 26.

    STOP #demotime

27. 27.

    Summary • Machine learning is generalization • Supervised learning is

    labeled data -> unlabeled data • Neural networks are awesome • You can do all this with Ruby!
28. 28.

    Takeaways (TL;DPA) • We can do machine learning with Ruby

    • Contribute to tools like Ruby FANN (github.com/tangledpath/ruby-fann) and sciruby (http://sciruby.com/) • Check it out: http://ruby-mnist.herokuapp.com/ • PRs welcome! github.com/ericqweinstein/ruby- mnist
29. 29.

    Thank You!

30. 30.

    Questions? eric_weinstein = { employer: 'Hulu', github: 'ericqweinstein', twitter: 'ericqweinstein',

    website: 'ericweinste.in' } 30% off with RUBYCONF30!