Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Deep Learning and Natural Language Processing with Spark - Berlin
Search
Melanie Warrick
June 17, 2016
Technology
1
450
Deep Learning and Natural Language Processing with Spark - Berlin
Melanie Warrick
June 17, 2016
Tweet
Share
More Decks by Melanie Warrick
See All by Melanie Warrick
PyCon.ru RL Talk Resources
nyghtowl
0
72
Career Path Advice
nyghtowl
0
170
AI & Enterprise
nyghtowl
0
270
Artificial Intelligence
nyghtowl
2
750
Reinforcement Learning
nyghtowl
2
430
Machine Learning
nyghtowl
0
300
Machine Learning Resources
nyghtowl
0
82
What is AI? - Jerusalem
nyghtowl
0
220
Computer Vision Deep Learning with DL4J
nyghtowl
0
510
Other Decks in Technology
See All in Technology
継続的な改善 x ⾮連続的な進化
sansantech
PRO
3
150
プラットフォームってつくることより計測することが重要なんじゃないかという話 / Platform Engineering Meetup #8
taishin
1
350
どうするコスト最適化のトレードオフ
tetsuyaooooo
1
500
開発パフォーマンスを最大化するための開発体制
ham0215
2
290
エンジニア候補者向け資料2024.04.24.pdf
macloud
0
3.3k
Compose Compiler Metricsを使った実践的なコードレビュー
tomorrowkey
1
220
AWSに詳しくない人でも始められるコスト最適化ガイド
yuhta28
0
170
ChatGPT for IT Service Management (IT Pro)
dahatake
7
1.5k
プロトタイピングによる不確実性の低減 / Reducing Uncertainty through Prototyping
ohbarye
5
380
本当のAWS基礎
toru_kubota
0
500
コードを書く隙間を見つけて生きていく技術/Findy 思考の現在地
fujiwara3
27
5.9k
エンジニアのキャリアをちょっと楽しくする3本の軸/Three Pillars to Make an Engineer's Career More Enjoyable
kwappa
0
2.6k
Featured
See All Featured
Designing Dashboards & Data Visualisations in Web Apps
destraynor
226
51k
Reflections from 52 weeks, 52 projects
jeffersonlam
345
19k
Building Applications with DynamoDB
mza
88
5.6k
Why Our Code Smells
bkeepers
PRO
331
56k
Thoughts on Productivity
jonyablonski
58
3.8k
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
eileencodes
2
1.3k
What the flash - Photography Introduction
edds
64
11k
Rebuilding a faster, lazier Slack
samanthasiow
73
8.2k
We Have a Design System, Now What?
morganepeng
43
6.7k
Mobile First: as difficult as doing things right
swwweet
216
8.6k
5 minutes of I Can Smell Your CMS
philhawksworth
199
19k
Side Projects
sachag
451
41k
Transcript
Deep Learning and Natural Language Processing with Spark Melanie Warrick
| Skymind | @nyghtowl Andy Petrella | Data Fellas | @noootsab
@nyghtowl Machine Learning
None
@nyghtowl
@nyghtowl
Natural Language Processing @nyghtowl • Question Answer • Image Captioning
• Topic Modeling/Sentiment Analysis • Language | Machine Translation • Text Generation NLP is hard
@nyghtowl Artificial Neural Nets Output | y Hidden Loss Function
Output k j X M kj W y Run until error stops improving = converge Input | X
@nyghtowl Recurrent Neural Net
@nyghtowl Long short-term Memory (LSTM)
@nyghtowl Sequence to Sequence
@nyghtowl Example: Word2Vec Word embeddings represent context King – Man
+ Woman ~ Queen
@nyghtowl Example: Image Captioning
@nyghtowl Sequence to Sequence
@nyghtowl Sentiment Analysis Reviews “Best part of the movie is
the end credits” “It should have been a great movie…” Sentiment
@nyghtowl Hadoop Spark AWS Skymind ND4J DeepLearning4J Native & JavaCPP
& OpenMP & Cuda 7.5 Canova Data Neural Nets Linear Algebra LIBND4J C Backend
@nyghtowl Data Fellas - Spark-Notebook only Scala based notebook that
is - scalable and enables interactive work on Spark, Akka, Cassandra, & Kafka - plotting interactive plots in any Scala type - Data Fellas enables data-driven business, bringing productivity to data science in enterprise
@nyghtowl Cluster Juju bundle including: • DL4J • Mesos •
Spark • Spark Notebook
@nyghtowl Blog Making deep learning accessible on Openstack
@nyghtowl Research References RNNs • DL4J Overview: ◦ RNN &
LSTM Overview: http://deeplearning4j.org/recurrentnetwork ◦ Using RNNs: http://deeplearning4j.org/usingrnns.html • Karpathy: https://karpathy.github.io/2015/05/21/rnn-effectiveness/ • Intro: http://www.wildml.com/2015/09/recurrent-neural-networks-tutorial-part-1-introduction-to-rnns/ Github Repos • Spark Notebook: https://github.com/andypetrella/spark-notebook • DL4J Examples: https://github.com/deeplearning4j/dl4j-0.4-examples • DL4J Spark Examples: https://github.com/deeplearning4j/dl4j-spark-cdh5-examples General ML Projects (referenced in presentation) • AlphaGo: http://i.dailymail.co.uk/i/pix/2016/03/09/09/320583D500000578-3483569- Google_has_confirmed_its_AlphaGo_computer_has_taken_the_first_vi-a-11_1457516282972.jpg • Switzerland SAR: http://www.forensicmag.com/article/2016/02/autonomous-drones-fly-search-and-rescue-operations • VIV: http://www.dailytech.com/ExSiri+CEO+Poaches+Apple+to+Create+Viv+The+Global+Brain/article36387.htm
@nyghtowl Image References • http://www.dailytech. com/ExSiri+CEO+Poaches+Apple+to+Create+Viv+The+Global+Brain/article36387.htm • http://3.bp.blogspot.com/- mMPT3tgVWaQ/U5qVs64HbRI/AAAAAAAAJCM/lEE4OiJmRSY/s1600/thumb-down-smiley.png •
http://4.bp.blogspot.com/-pUoO5oOuzOc/VcomU6qKT4I/AAAAAAAAAsg/TonkgL1iEjE/s1600/Screen% 2BShot%2B2015-08-11%2Bat%2B9.43.21%2BAM.png • http://www.ucreative.com/inspiration/interesting-patterns-and-fractals-from-nature/ • http://i.telegraph.co.uk/multimedia/archive/02122/WILLIAM-SHAKESPEAR_2122089b.jpg • https://karpathy.github.io/2015/05/21/rnn-effectiveness/ • https://pbs.twimg.com/media/CJm9HmfVEAEXU0c.jpg:large • http://www.wildml.com/2015/09/recurrent-neural-networks-tutorial-part-1-introduction-to-rnns/ • http://i.dailymail.co.uk/i/pix/2016/03/09/09/320583D500000578-3483569- Google_has_confirmed_its_AlphaGo_computer_has_taken_the_first_vi-a-11_1457516282972.jpg • http://www.forensicmag.com/article/2016/02/autonomous-drones-fly-search-and-rescue-operations • Susan Eraly
@nyghtowl Deep Learning and Natural Language Processing with Spark Andy
Petrella | Data Fellas | @noootsab Melanie Warrick | Skymind | @nyghtowl