Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Deep Learning and Natural Language Processing w...
Search
Melanie Warrick
June 17, 2016
Technology
1
450
Deep Learning and Natural Language Processing with Spark - Berlin
Melanie Warrick
June 17, 2016
Tweet
Share
More Decks by Melanie Warrick
See All by Melanie Warrick
PyCon.ru RL Talk Resources
nyghtowl
0
87
Career Path Advice
nyghtowl
0
190
AI & Enterprise
nyghtowl
0
280
Artificial Intelligence
nyghtowl
2
760
Reinforcement Learning
nyghtowl
2
440
Machine Learning
nyghtowl
0
320
Machine Learning Resources
nyghtowl
0
86
What is AI? - Jerusalem
nyghtowl
0
230
Computer Vision Deep Learning with DL4J
nyghtowl
0
530
Other Decks in Technology
See All in Technology
ドメインと向き合う - 旅行予約編
hidenorigoto
4
540
MLOpsの「あるある」課題の解決と、そのためのライブラリgokart
mski_iksm
1
160
令和最新版 Perlコーディングガイド
anatofuz
4
3.2k
それでもやっぱり ExpressRoute が好き!
skmkzyk
0
160
C# 13 / .NET 9 の新機能 (RC 1 時点)
nenonaninu
1
1.2k
山手線一周のパフォーマンス改善
suzukahr
0
120
O'Reilly Superstream: Building a RAG App to Chat with Your Data
pamelafox
0
110
LINEヤフー新卒採用 コーディングテスト解説 アルゴリズム問題編
lycorp_recruit_jp
0
13k
入門 バックアップ
ryuichi1208
18
6.4k
軽いノリで"自動化"に取り組んではいけないという話
tetsuyaooooo
1
410
Webセキュリティのあるきかた
akiym
20
7.9k
トークナイザー入門
payanotty
2
890
Featured
See All Featured
How GitHub (no longer) Works
holman
311
140k
Raft: Consensus for Rubyists
vanstee
136
6.6k
Principles of Awesome APIs and How to Build Them.
keavy
126
17k
Docker and Python
trallard
40
3k
4 Signs Your Business is Dying
shpigford
180
21k
RailsConf 2023
tenderlove
28
840
Optimizing for Happiness
mojombo
375
69k
Reflections from 52 weeks, 52 projects
jeffersonlam
346
20k
How STYLIGHT went responsive
nonsquared
94
5.1k
The Straight Up "How To Draw Better" Workshop
denniskardys
231
130k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
eileencodes
131
32k
Intergalactic Javascript Robots from Outer Space
tanoku
268
27k
Transcript
Deep Learning and Natural Language Processing with Spark Melanie Warrick
| Skymind | @nyghtowl Andy Petrella | Data Fellas | @noootsab
@nyghtowl Machine Learning
None
@nyghtowl
@nyghtowl
Natural Language Processing @nyghtowl • Question Answer • Image Captioning
• Topic Modeling/Sentiment Analysis • Language | Machine Translation • Text Generation NLP is hard
@nyghtowl Artificial Neural Nets Output | y Hidden Loss Function
Output k j X M kj W y Run until error stops improving = converge Input | X
@nyghtowl Recurrent Neural Net
@nyghtowl Long short-term Memory (LSTM)
@nyghtowl Sequence to Sequence
@nyghtowl Example: Word2Vec Word embeddings represent context King – Man
+ Woman ~ Queen
@nyghtowl Example: Image Captioning
@nyghtowl Sequence to Sequence
@nyghtowl Sentiment Analysis Reviews “Best part of the movie is
the end credits” “It should have been a great movie…” Sentiment
@nyghtowl Hadoop Spark AWS Skymind ND4J DeepLearning4J Native & JavaCPP
& OpenMP & Cuda 7.5 Canova Data Neural Nets Linear Algebra LIBND4J C Backend
@nyghtowl Data Fellas - Spark-Notebook only Scala based notebook that
is - scalable and enables interactive work on Spark, Akka, Cassandra, & Kafka - plotting interactive plots in any Scala type - Data Fellas enables data-driven business, bringing productivity to data science in enterprise
@nyghtowl Cluster Juju bundle including: • DL4J • Mesos •
Spark • Spark Notebook
@nyghtowl Blog Making deep learning accessible on Openstack
@nyghtowl Research References RNNs • DL4J Overview: ◦ RNN &
LSTM Overview: http://deeplearning4j.org/recurrentnetwork ◦ Using RNNs: http://deeplearning4j.org/usingrnns.html • Karpathy: https://karpathy.github.io/2015/05/21/rnn-effectiveness/ • Intro: http://www.wildml.com/2015/09/recurrent-neural-networks-tutorial-part-1-introduction-to-rnns/ Github Repos • Spark Notebook: https://github.com/andypetrella/spark-notebook • DL4J Examples: https://github.com/deeplearning4j/dl4j-0.4-examples • DL4J Spark Examples: https://github.com/deeplearning4j/dl4j-spark-cdh5-examples General ML Projects (referenced in presentation) • AlphaGo: http://i.dailymail.co.uk/i/pix/2016/03/09/09/320583D500000578-3483569- Google_has_confirmed_its_AlphaGo_computer_has_taken_the_first_vi-a-11_1457516282972.jpg • Switzerland SAR: http://www.forensicmag.com/article/2016/02/autonomous-drones-fly-search-and-rescue-operations • VIV: http://www.dailytech.com/ExSiri+CEO+Poaches+Apple+to+Create+Viv+The+Global+Brain/article36387.htm
@nyghtowl Image References • http://www.dailytech. com/ExSiri+CEO+Poaches+Apple+to+Create+Viv+The+Global+Brain/article36387.htm • http://3.bp.blogspot.com/- mMPT3tgVWaQ/U5qVs64HbRI/AAAAAAAAJCM/lEE4OiJmRSY/s1600/thumb-down-smiley.png •
http://4.bp.blogspot.com/-pUoO5oOuzOc/VcomU6qKT4I/AAAAAAAAAsg/TonkgL1iEjE/s1600/Screen% 2BShot%2B2015-08-11%2Bat%2B9.43.21%2BAM.png • http://www.ucreative.com/inspiration/interesting-patterns-and-fractals-from-nature/ • http://i.telegraph.co.uk/multimedia/archive/02122/WILLIAM-SHAKESPEAR_2122089b.jpg • https://karpathy.github.io/2015/05/21/rnn-effectiveness/ • https://pbs.twimg.com/media/CJm9HmfVEAEXU0c.jpg:large • http://www.wildml.com/2015/09/recurrent-neural-networks-tutorial-part-1-introduction-to-rnns/ • http://i.dailymail.co.uk/i/pix/2016/03/09/09/320583D500000578-3483569- Google_has_confirmed_its_AlphaGo_computer_has_taken_the_first_vi-a-11_1457516282972.jpg • http://www.forensicmag.com/article/2016/02/autonomous-drones-fly-search-and-rescue-operations • Susan Eraly
@nyghtowl Deep Learning and Natural Language Processing with Spark Andy
Petrella | Data Fellas | @noootsab Melanie Warrick | Skymind | @nyghtowl