Slide 1

Slide 1 text

Intro to ML for Android developers November 2016

Slide 2

Slide 2 text

2010s : emergence of Machine Learning 1999 : neural networks used for handwritten digits recognition

Slide 3

Slide 3 text

2010s : emergence of Machine Learning 1999 : neural networks used for handwritten digits recognition 2012 : @Google, 16k processors, 10M Youtube videos, 1 week

Slide 4

Slide 4 text

2010s : emergence of Machine Learning 1999 : neural networks used for handwritten digits recognition 2012 : @Google, 16k processors, 10M Youtube videos, 1 week Able to find cats

Slide 5

Slide 5 text

2010s : emergence of Machine Learning ● Self-driving cars ● Human interaction : ○ Handwriting ○ Speech ○ Natural language ● OCR ● Image recognition ● Information retrieval ● Artificial personal assistants ● Recommendations systems ● Drones ● Game playing ● ...

Slide 6

Slide 6 text

Machine Learning

Slide 7

Slide 7 text

Explaining Machine Learning Machine learning is the idea that there are generic algorithms that can tell you something interesting about a set of data without you having to write any custom code specific to the problem. Instead of writing code, you feed data to the generic algorithm and it builds its own logic based on the data.

Slide 8

Slide 8 text

Explaining Machine Learning Different categories : ● Supervised learning ○ continous answer : regression ex : estimate a price, a volume, ... ○ discrete answer : classification ex : spam detection, cancerous tumors ● Unsupervised learning ● Reinforced learning continuous environment and constant feedback, learns by itself

Slide 9

Slide 9 text

Unsupervised learning

Slide 10

Slide 10 text

Linear regression

Slide 11

Slide 11 text

Intuitions from linear regression ● algorithm is generic, results depends on data ● system is both the algorithm and the data ● starts with a hypothesis about how we can represent the data (for linear regression : a straight line) ● only as good as your data ● can deal poorly with outliers ● lots of calculation to learn, but very fast to apply (can run on mobile)

Slide 12

Slide 12 text

Tensorflow Playground

Slide 13

Slide 13 text

Deep learning

Slide 14

Slide 14 text

State of the art : Google

Slide 15

Slide 15 text

No content

Slide 16

Slide 16 text

SyntaxNet and Parsey McParseface

Slide 17

Slide 17 text

TensorFlow ML framework Opensourced in 2016 New standard

Slide 18

Slide 18 text

Implications for mobile

Slide 19

Slide 19 text

No content

Slide 20

Slide 20 text

Interactions between mobile and ML ● Mobile as a source of data

Slide 21

Slide 21 text

Assistant API d.android.com/training/articles/assistant.html

Slide 22

Slide 22 text

Interactions between mobile and ML ● Mobile as a source of data ● Mobile as UI ○ still need UI to access services (even AI services) ○ bots are not for everyone : alternative UI for “power users” ● ML to enrich mobile apps (offline ML)

Slide 23

Slide 23 text

ML offline

Slide 24

Slide 24 text

Applications of NLP at Quora - automatic grammar correction - question quality - duplicate question detection - related question suggestion - topic biography quality (= qualifications of writer) - topic labeler (from “science” to narrow topics like “tennis Courts in Mountain View”) - search - answer summaries - automatic answers wiki - hate speech/harassment detection - spam detection - question edit quality

Slide 25

Slide 25 text

Questions? November 2016

Slide 26

Slide 26 text

No content

Slide 27

Slide 27 text

Overfitting Need to split the data into : - training set (60%) - cross-validation set (20%) - evaluation set (20%)

Slide 28

Slide 28 text

SyntaxNet and Parsey McParseface Parsey McParseface can correctly read: ● The old man the boat. ● While the man hunted the deer ran into the woods. ● While Anna dressed the baby played in the crib. ● Buffalo buffalo Buffalo buffalo buffalo buffalo Buffalo buffalo. It makes mistakes on: ● I convinced her children are noisy. ● The coach smiled at the player tossed the frisbee. ● The cotton clothes are made up of grows in Mississippi. ● James while John had had had had had had had had had had had a better effect on the teacher