2017 - A Gentle Introduction to Text Classification with Deep Learning

Slide 1

Slide 1 text

A Gentle Introduction to Text Classiﬁcation with Deep Learning Brian Spiering http://bit.ly/deep-text

Slide 2

Slide 2 text

No content

Slide 3

Slide 3 text

Agenda 1. A Gentle Intro to Text Classiﬁcation and Deep Learning (20 Minutes) 2. Demo #1: Learn to classify movie reviews (15 Minutes) 3. Demo #2: Learn to categorize news articles (7.5 Minutes) 4. Questions & Answers (until )

Slide 4

Slide 4 text

Let's start with foundation: Language

Slide 5

Slide 5 text

More importantly, humans use language to: - Think - Dream - Plan - …

Slide 6

Slide 6 text

No content

Slide 7

Slide 7 text

Text, digitized language, is the one of the dominant forms of communication on the Internet and within organizations

Slide 8

Slide 8 text

The Internet is just a training set for Deep Learning AI

Slide 9

Slide 9 text

Language is hard

Slide 10

Slide 10 text

Building complex, useful things with computers is hard

Slide 11

Slide 11 text

No content

Slide 12

Slide 12 text

No content

Slide 13

Slide 13 text

Deep Learning isn't magic, it is just very good at ﬁnding patterns

Slide 14

Slide 14 text

Why is Deep Learning taking over Machine Learning?

Slide 15

Slide 15 text

Neural Networks: Graphs with edges and nodes

Slide 16

Slide 16 text

A Single Node

Slide 17

Slide 17 text

Deep Learning: >1 hidden layers

Slide 18

Slide 18 text

Classiﬁcation: Discrete Value Prediction

Slide 19

Slide 19 text

Text Classiﬁcation: Predict category for a group of words

Slide 20

Slide 20 text

Neural Network: Given words, weight them to put into categories

Slide 21

Slide 21 text

Demo #1: Learn to classify movie reviews

Slide 22

Slide 22 text

Demo #2: Learn to categorize news articles

Slide 23

Slide 23 text

Summary 1. Text data is everywhere. 2. Deep Learning ❤ lots of data and has the ability to make sense of it. 3. Keras is approachable way to build Deep Learning systems. 4. Given this start, please continue learning!

Slide 24

Slide 24 text

Further Study

Slide 25

Slide 25 text

fast.ai by Jeremy Howard and Rachel Thomas

Slide 26

Slide 26 text

Deep Learning Specialization from Coursera by Andrew Ng

Slide 27

Slide 27 text

No content

Slide 28

Slide 28 text

CS224d: Deep Learning for Natural Language Processing from Stanford • Course homepage -A complete survey of the ﬁeld with videos, lecture slides, and sample student projects • Course notes - Probably the best "book" on DL for NLP • Course Lectures

Slide 1

Slide 1 text

Slide 2

Slide 2 text

Slide 3

Slide 3 text

Slide 4

Slide 4 text

Slide 5

Slide 5 text

Slide 6

Slide 6 text

Slide 7

Slide 7 text

Slide 8

Slide 8 text

Slide 9

Slide 9 text

Slide 10

Slide 10 text

Slide 11

Slide 11 text

Slide 12

Slide 12 text

Slide 13

Slide 13 text

Slide 14

Slide 14 text

Slide 15

Slide 15 text

Slide 16

Slide 16 text

Slide 17

Slide 17 text

Slide 18

Slide 18 text

Slide 19

Slide 19 text

Slide 20

Slide 20 text

Slide 21

Slide 21 text

Slide 22

Slide 22 text

Slide 23

Slide 23 text

Slide 24

Slide 24 text

Slide 25

Slide 25 text

Slide 26

Slide 26 text

Slide 27

Slide 27 text

Slide 28

Slide 28 text

Slide 29

Slide 29 text

Slide 30

Slide 30 text

Slide 31

Slide 31 text