Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Deep Learning and Natural Language Processing w...
Search
Melanie Warrick
June 17, 2016
Technology
1
450
Deep Learning and Natural Language Processing with Spark - Berlin
Melanie Warrick
June 17, 2016
Tweet
Share
More Decks by Melanie Warrick
See All by Melanie Warrick
PyCon.ru RL Talk Resources
nyghtowl
0
93
Career Path Advice
nyghtowl
0
200
AI & Enterprise
nyghtowl
0
310
Artificial Intelligence
nyghtowl
2
770
Reinforcement Learning
nyghtowl
2
470
Machine Learning
nyghtowl
0
330
Machine Learning Resources
nyghtowl
0
88
What is AI? - Jerusalem
nyghtowl
0
260
Computer Vision Deep Learning with DL4J
nyghtowl
0
540
Other Decks in Technology
See All in Technology
グループポリシー再確認
murachiakira
0
110
RubyKaigi 2025でプロポーザルが初めて採択されるまでにやったこと
yuuu
1
130
クラウド脆弱性の傾向とShisho Cloudの活用
rvirus0817
0
120
Github Copilot Chatは本日よりケ◯ロ軍曹でありま〜〜〜すッ!!!(たぶん)
yu_yukk_y
1
130
DIってなんだか難しい? 依存という概念を「使う・使われる」 という言葉で整理しよう
akinoriakatsuka
1
700
eBPF-based Process Lifecycle Monitoring
yukinakanaka
1
160
SpannerとAurora DSQLの同時実行制御の違いに想いを馳せる
masakikato5
0
310
AI の活用における課題と現状、今後の期待
asei
4
330
単一の深層学習モデルによる不確実性の定量化の紹介 ~その予測結果正しいですか?~
ftakahashi
PRO
3
490
職種に名前が付く、ということ/The fact that a job title has a name
bitkey
0
120
AIが変えるソフトウェア開発__未来のアジャイルチームとは__.pdf
buchirei
0
330
移行できそうでやりきれなかった 10年超えのシステムを葬るための戦略 / phper-kaigi-2025-ryu
carta_engineering
0
660
Featured
See All Featured
KATA
mclloyd
29
14k
How GitHub (no longer) Works
holman
314
140k
What’s in a name? Adding method to the madness
productmarketing
PRO
22
3.4k
Embracing the Ebb and Flow
colly
84
4.6k
The Art of Programming - Codeland 2020
erikaheidi
53
13k
YesSQL, Process and Tooling at Scale
rocio
172
14k
Faster Mobile Websites
deanohume
306
31k
Designing Experiences People Love
moore
140
23k
Build The Right Thing And Hit Your Dates
maggiecrowley
34
2.6k
Why Our Code Smells
bkeepers
PRO
336
57k
Code Reviewing Like a Champion
maltzj
521
39k
A designer walks into a library…
pauljervisheath
205
24k
Transcript
Deep Learning and Natural Language Processing with Spark Melanie Warrick
| Skymind | @nyghtowl Andy Petrella | Data Fellas | @noootsab
@nyghtowl Machine Learning
None
@nyghtowl
@nyghtowl
Natural Language Processing @nyghtowl • Question Answer • Image Captioning
• Topic Modeling/Sentiment Analysis • Language | Machine Translation • Text Generation NLP is hard
@nyghtowl Artificial Neural Nets Output | y Hidden Loss Function
Output k j X M kj W y Run until error stops improving = converge Input | X
@nyghtowl Recurrent Neural Net
@nyghtowl Long short-term Memory (LSTM)
@nyghtowl Sequence to Sequence
@nyghtowl Example: Word2Vec Word embeddings represent context King – Man
+ Woman ~ Queen
@nyghtowl Example: Image Captioning
@nyghtowl Sequence to Sequence
@nyghtowl Sentiment Analysis Reviews “Best part of the movie is
the end credits” “It should have been a great movie…” Sentiment
@nyghtowl Hadoop Spark AWS Skymind ND4J DeepLearning4J Native & JavaCPP
& OpenMP & Cuda 7.5 Canova Data Neural Nets Linear Algebra LIBND4J C Backend
@nyghtowl Data Fellas - Spark-Notebook only Scala based notebook that
is - scalable and enables interactive work on Spark, Akka, Cassandra, & Kafka - plotting interactive plots in any Scala type - Data Fellas enables data-driven business, bringing productivity to data science in enterprise
@nyghtowl Cluster Juju bundle including: • DL4J • Mesos •
Spark • Spark Notebook
@nyghtowl Blog Making deep learning accessible on Openstack
@nyghtowl Research References RNNs • DL4J Overview: ◦ RNN &
LSTM Overview: http://deeplearning4j.org/recurrentnetwork ◦ Using RNNs: http://deeplearning4j.org/usingrnns.html • Karpathy: https://karpathy.github.io/2015/05/21/rnn-effectiveness/ • Intro: http://www.wildml.com/2015/09/recurrent-neural-networks-tutorial-part-1-introduction-to-rnns/ Github Repos • Spark Notebook: https://github.com/andypetrella/spark-notebook • DL4J Examples: https://github.com/deeplearning4j/dl4j-0.4-examples • DL4J Spark Examples: https://github.com/deeplearning4j/dl4j-spark-cdh5-examples General ML Projects (referenced in presentation) • AlphaGo: http://i.dailymail.co.uk/i/pix/2016/03/09/09/320583D500000578-3483569- Google_has_confirmed_its_AlphaGo_computer_has_taken_the_first_vi-a-11_1457516282972.jpg • Switzerland SAR: http://www.forensicmag.com/article/2016/02/autonomous-drones-fly-search-and-rescue-operations • VIV: http://www.dailytech.com/ExSiri+CEO+Poaches+Apple+to+Create+Viv+The+Global+Brain/article36387.htm
@nyghtowl Image References • http://www.dailytech. com/ExSiri+CEO+Poaches+Apple+to+Create+Viv+The+Global+Brain/article36387.htm • http://3.bp.blogspot.com/- mMPT3tgVWaQ/U5qVs64HbRI/AAAAAAAAJCM/lEE4OiJmRSY/s1600/thumb-down-smiley.png •
http://4.bp.blogspot.com/-pUoO5oOuzOc/VcomU6qKT4I/AAAAAAAAAsg/TonkgL1iEjE/s1600/Screen% 2BShot%2B2015-08-11%2Bat%2B9.43.21%2BAM.png • http://www.ucreative.com/inspiration/interesting-patterns-and-fractals-from-nature/ • http://i.telegraph.co.uk/multimedia/archive/02122/WILLIAM-SHAKESPEAR_2122089b.jpg • https://karpathy.github.io/2015/05/21/rnn-effectiveness/ • https://pbs.twimg.com/media/CJm9HmfVEAEXU0c.jpg:large • http://www.wildml.com/2015/09/recurrent-neural-networks-tutorial-part-1-introduction-to-rnns/ • http://i.dailymail.co.uk/i/pix/2016/03/09/09/320583D500000578-3483569- Google_has_confirmed_its_AlphaGo_computer_has_taken_the_first_vi-a-11_1457516282972.jpg • http://www.forensicmag.com/article/2016/02/autonomous-drones-fly-search-and-rescue-operations • Susan Eraly
@nyghtowl Deep Learning and Natural Language Processing with Spark Andy
Petrella | Data Fellas | @noootsab Melanie Warrick | Skymind | @nyghtowl