Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Deep Learning and Natural Language Processing w...
Search
Melanie Warrick
June 17, 2016
Technology
1
460
Deep Learning and Natural Language Processing with Spark - Berlin
Melanie Warrick
June 17, 2016
Tweet
Share
More Decks by Melanie Warrick
See All by Melanie Warrick
PyCon.ru RL Talk Resources
nyghtowl
0
98
Career Path Advice
nyghtowl
0
230
AI & Enterprise
nyghtowl
0
340
Artificial Intelligence
nyghtowl
2
790
Reinforcement Learning
nyghtowl
2
510
Machine Learning
nyghtowl
0
350
Machine Learning Resources
nyghtowl
0
110
What is AI? - Jerusalem
nyghtowl
0
280
Computer Vision Deep Learning with DL4J
nyghtowl
0
580
Other Decks in Technology
See All in Technology
「Verify with Wallet API」を アプリに導入するために
hinakko
1
240
AIが書いたコードをAIが検証する!自律的なモバイルアプリ開発の実現
henteko
1
340
生成AIとM5Stack / M5 Japan Tour 2025 Autumn 東京
you
PRO
0
220
GA technologiesでのAI-Readyの取り組み@DataOps Night
yuto16
0
270
ユニットテストに対する考え方の変遷 / Everyone should watch his live coding
mdstoy
0
130
M5製品で作るポン置きセルラー対応カメラ
sayacom
0
150
Goにおける 生成AIによるコード生成の ベンチマーク評価入門
daisuketakeda
2
100
OpenAI gpt-oss ファインチューニング入門
kmotohas
2
990
関係性が駆動するアジャイル──GPTに人格を与えたら、対話を通してふりかえりを習慣化できた話
mhlyc
0
130
KMP の Swift export
kokihirokawa
0
330
SOC2取得の全体像
shonansurvivors
1
390
pprof vs runtime/trace (FlightRecorder)
task4233
0
170
Featured
See All Featured
Fireside Chat
paigeccino
40
3.7k
Optimising Largest Contentful Paint
csswizardry
37
3.4k
Thoughts on Productivity
jonyablonski
70
4.9k
Making the Leap to Tech Lead
cromwellryan
135
9.5k
Intergalactic Javascript Robots from Outer Space
tanoku
273
27k
Facilitating Awesome Meetings
lara
56
6.6k
The Success of Rails: Ensuring Growth for the Next 100 Years
eileencodes
46
7.6k
Producing Creativity
orderedlist
PRO
347
40k
ピンチをチャンスに:未来をつくるプロダクトロードマップ #pmconf2020
aki_iinuma
127
53k
Music & Morning Musume
bryan
46
6.8k
No one is an island. Learnings from fostering a developers community.
thoeni
21
3.5k
Fight the Zombie Pattern Library - RWD Summit 2016
marcelosomers
234
17k
Transcript
Deep Learning and Natural Language Processing with Spark Melanie Warrick
| Skymind | @nyghtowl Andy Petrella | Data Fellas | @noootsab
@nyghtowl Machine Learning
None
@nyghtowl
@nyghtowl
Natural Language Processing @nyghtowl • Question Answer • Image Captioning
• Topic Modeling/Sentiment Analysis • Language | Machine Translation • Text Generation NLP is hard
@nyghtowl Artificial Neural Nets Output | y Hidden Loss Function
Output k j X M kj W y Run until error stops improving = converge Input | X
@nyghtowl Recurrent Neural Net
@nyghtowl Long short-term Memory (LSTM)
@nyghtowl Sequence to Sequence
@nyghtowl Example: Word2Vec Word embeddings represent context King – Man
+ Woman ~ Queen
@nyghtowl Example: Image Captioning
@nyghtowl Sequence to Sequence
@nyghtowl Sentiment Analysis Reviews “Best part of the movie is
the end credits” “It should have been a great movie…” Sentiment
@nyghtowl Hadoop Spark AWS Skymind ND4J DeepLearning4J Native & JavaCPP
& OpenMP & Cuda 7.5 Canova Data Neural Nets Linear Algebra LIBND4J C Backend
@nyghtowl Data Fellas - Spark-Notebook only Scala based notebook that
is - scalable and enables interactive work on Spark, Akka, Cassandra, & Kafka - plotting interactive plots in any Scala type - Data Fellas enables data-driven business, bringing productivity to data science in enterprise
@nyghtowl Cluster Juju bundle including: • DL4J • Mesos •
Spark • Spark Notebook
@nyghtowl Blog Making deep learning accessible on Openstack
@nyghtowl Research References RNNs • DL4J Overview: ◦ RNN &
LSTM Overview: http://deeplearning4j.org/recurrentnetwork ◦ Using RNNs: http://deeplearning4j.org/usingrnns.html • Karpathy: https://karpathy.github.io/2015/05/21/rnn-effectiveness/ • Intro: http://www.wildml.com/2015/09/recurrent-neural-networks-tutorial-part-1-introduction-to-rnns/ Github Repos • Spark Notebook: https://github.com/andypetrella/spark-notebook • DL4J Examples: https://github.com/deeplearning4j/dl4j-0.4-examples • DL4J Spark Examples: https://github.com/deeplearning4j/dl4j-spark-cdh5-examples General ML Projects (referenced in presentation) • AlphaGo: http://i.dailymail.co.uk/i/pix/2016/03/09/09/320583D500000578-3483569- Google_has_confirmed_its_AlphaGo_computer_has_taken_the_first_vi-a-11_1457516282972.jpg • Switzerland SAR: http://www.forensicmag.com/article/2016/02/autonomous-drones-fly-search-and-rescue-operations • VIV: http://www.dailytech.com/ExSiri+CEO+Poaches+Apple+to+Create+Viv+The+Global+Brain/article36387.htm
@nyghtowl Image References • http://www.dailytech. com/ExSiri+CEO+Poaches+Apple+to+Create+Viv+The+Global+Brain/article36387.htm • http://3.bp.blogspot.com/- mMPT3tgVWaQ/U5qVs64HbRI/AAAAAAAAJCM/lEE4OiJmRSY/s1600/thumb-down-smiley.png •
http://4.bp.blogspot.com/-pUoO5oOuzOc/VcomU6qKT4I/AAAAAAAAAsg/TonkgL1iEjE/s1600/Screen% 2BShot%2B2015-08-11%2Bat%2B9.43.21%2BAM.png • http://www.ucreative.com/inspiration/interesting-patterns-and-fractals-from-nature/ • http://i.telegraph.co.uk/multimedia/archive/02122/WILLIAM-SHAKESPEAR_2122089b.jpg • https://karpathy.github.io/2015/05/21/rnn-effectiveness/ • https://pbs.twimg.com/media/CJm9HmfVEAEXU0c.jpg:large • http://www.wildml.com/2015/09/recurrent-neural-networks-tutorial-part-1-introduction-to-rnns/ • http://i.dailymail.co.uk/i/pix/2016/03/09/09/320583D500000578-3483569- Google_has_confirmed_its_AlphaGo_computer_has_taken_the_first_vi-a-11_1457516282972.jpg • http://www.forensicmag.com/article/2016/02/autonomous-drones-fly-search-and-rescue-operations • Susan Eraly
@nyghtowl Deep Learning and Natural Language Processing with Spark Andy
Petrella | Data Fellas | @noootsab Melanie Warrick | Skymind | @nyghtowl