Deep Learning and Natural Language Processing with Spark

Slide 1

Slide 1 text

Deep Learning and Natural Language Processing with Spark Melanie Warrick | Skymind | @nyghtowl Andy Petrella | Data Fellas | @noootsab

Slide 2

Slide 2 text

@nyghtowl Machine Learning

Slide 3

Slide 3 text

No content

Slide 4

Slide 4 text

@nyghtowl

Slide 5

Slide 5 text

@nyghtowl

Slide 6

Slide 6 text

Natural Language Processing @nyghtowl ● Question Answer ● Image Captioning ● Topic Modeling/Sentiment Analysis ● Language | Machine Translation ● Text Generation NLP is hard

Slide 7

Slide 7 text

@nyghtowl Artificial Neural Nets Input | X Output | y Hidden

Slide 8

Slide 8 text

@nyghtowl Recurrent Neural Net

Slide 9

Slide 9 text

@nyghtowl Long short-term Memory (LSTM)

Slide 10

Slide 10 text

@nyghtowl Sequence to Sequence

Slide 11

Slide 11 text

@nyghtowl Example: Word2Vec Word embeddings represent context King – Man + Woman ~ Queen

Slide 12

Slide 12 text

@nyghtowl Example: Image Captioning

Slide 13

Slide 13 text

@nyghtowl Sequence to Sequence

Slide 14

Slide 14 text

@nyghtowl Sentiment Analysis Reviews “Best part of the movie is the end credits” “It should have been a great movie…” Sentiment

Slide 15

Slide 15 text

@nyghtowl Hadoop Spark AWS Skymind ND4J DeepLearning4J Native & JavaCPP & OpenMP & Cuda 7.5 Canova Data Neural Nets Linear Algebra LIBND4J C Backend

Slide 16

Slide 16 text

@nyghtowl Data Fellas - Spark-Notebook only Scala based notebook that is - scalable and enables interactive work on Spark, Akka, Cassandra, & Kafka - plotting interactive plots in any Scala type - Data Fellas enables data-driven business, bringing productivity to data science in enterprise

Slide 17

Slide 17 text

@nyghtowl Research References RNNs ● DL4J Overview: ○ RNN & LSTM Overview: http://deeplearning4j.org/recurrentnetwork ○ Using RNNs: http://deeplearning4j.org/usingrnns.html ● Karpathy: https://karpathy.github.io/2015/05/21/rnn-effectiveness/ ● Intro: http://www.wildml.com/2015/09/recurrent-neural-networks-tutorial-part-1-introduction-to-rnns/ Github Repos ● Spark Notebook: https://github.com/andypetrella/spark-notebook ● DL4J Examples: https://github.com/deeplearning4j/dl4j-0.4-examples ● DL4J Spark Examples: https://github.com/deeplearning4j/dl4j-spark-cdh5-examples General ML Projects (referenced in presentation) ● AlphaGo: http://i.dailymail.co.uk/i/pix/2016/03/09/09/320583D500000578-3483569- Google_has_confirmed_its_AlphaGo_computer_has_taken_the_first_vi-a-11_1457516282972.jpg ● Switzerland SAR: http://www.forensicmag.com/article/2016/02/autonomous-drones-fly-search-and-rescue-operations ● VIV: http://www.dailytech.com/ExSiri+CEO+Poaches+Apple+to+Create+Viv+The+Global+Brain/article36387.htm

Slide 18

Slide 18 text

@nyghtowl Image References ● http://www.dailytech. com/ExSiri+CEO+Poaches+Apple+to+Create+Viv+The+Global+Brain/article36387.htm ● http://3.bp.blogspot.com/- mMPT3tgVWaQ/U5qVs64HbRI/AAAAAAAAJCM/lEE4OiJmRSY/s1600/thumb-down-smiley.png ● http://4.bp.blogspot.com/-pUoO5oOuzOc/VcomU6qKT4I/AAAAAAAAAsg/TonkgL1iEjE/s1600/Screen% 2BShot%2B2015-08-11%2Bat%2B9.43.21%2BAM.png ● http://www.ucreative.com/inspiration/interesting-patterns-and-fractals-from-nature/ ● http://i.telegraph.co.uk/multimedia/archive/02122/WILLIAM-SHAKESPEAR_2122089b.jpg ● https://karpathy.github.io/2015/05/21/rnn-effectiveness/ ● https://pbs.twimg.com/media/CJm9HmfVEAEXU0c.jpg:large ● http://www.wildml.com/2015/09/recurrent-neural-networks-tutorial-part-1-introduction-to-rnns/ ● http://i.dailymail.co.uk/i/pix/2016/03/09/09/320583D500000578-3483569- Google_has_confirmed_its_AlphaGo_computer_has_taken_the_first_vi-a-11_1457516282972.jpg ● http://www.forensicmag.com/article/2016/02/autonomous-drones-fly-search-and-rescue-operations ● Susan Eraly

Slide 19

Slide 19 text

@nyghtowl Deep Learning and Natural Language Processing with Spark Andy Petrella | Data Fellas | @noootsab Melanie Warrick | Skymind | @nyghtowl