Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Deep Learning and Natural Language Processing w...
Search
Melanie Warrick
June 17, 2016
Technology
1
460
Deep Learning and Natural Language Processing with Spark - Berlin
Melanie Warrick
June 17, 2016
Tweet
Share
More Decks by Melanie Warrick
See All by Melanie Warrick
PyCon.ru RL Talk Resources
nyghtowl
0
97
Career Path Advice
nyghtowl
0
220
AI & Enterprise
nyghtowl
0
340
Artificial Intelligence
nyghtowl
2
780
Reinforcement Learning
nyghtowl
2
500
Machine Learning
nyghtowl
0
350
Machine Learning Resources
nyghtowl
0
100
What is AI? - Jerusalem
nyghtowl
0
270
Computer Vision Deep Learning with DL4J
nyghtowl
0
570
Other Decks in Technology
See All in Technology
開発 × 生成AI × コミュニケーション:GENDAの開発現場で感じたコミュニケーションの変化 / GENDA Tech Talk #1
genda
0
280
S3 Glacier のデータを Athena からクエリしようとしたらどうなるのか/try-to-query-s3-glacier-from-athena
emiki
0
230
Strands Agents & Bedrock AgentCoreを1分でおさらい
minorun365
PRO
8
370
JAWS AI/ML #30 AI コーディング IDE "Kiro" を触ってみよう
inariku
3
390
【OptimizationNight】数理最適化のラストワンマイルとしてのUIUX
brainpadpr
2
510
JAWS-UG のイベントで使うハンズオンシナリオを Amazon Q Developer for CLI で作ってみた話
kazzpapa3
0
110
ロールが細分化された組織でSREと協働するインフラエンジニアは何をするか? / SRE Lounge #18
kossykinto
0
230
Autonomous Database Serverless 技術詳細 / adb-s_technical_detail_jp
oracle4engineer
PRO
18
52k
夏休みWebアプリパフォーマンス相談室/web-app-performance-on-radio
hachi_eiji
0
250
Serverless Meetup #21
yoshidashingo
1
130
データモデリング通り #2オンライン勉強会 ~方法論の話をしよう~
datayokocho
0
180
専門分化が進む分業下でもユーザーが本当に欲しかったものを追求するプロダクトマネジメント/Focus on real user needs despite deep specialization and division of labor
moriyuya
2
1.4k
Featured
See All Featured
ReactJS: Keep Simple. Everything can be a component!
pedronauck
667
120k
The Invisible Side of Design
smashingmag
301
51k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
47
9.6k
Java REST API Framework Comparison - PWX 2021
mraible
33
8.8k
Put a Button on it: Removing Barriers to Going Fast.
kastner
60
4k
Designing Dashboards & Data Visualisations in Web Apps
destraynor
231
53k
A Tale of Four Properties
chriscoyier
160
23k
Principles of Awesome APIs and How to Build Them.
keavy
126
17k
Building a Modern Day E-commerce SEO Strategy
aleyda
43
7.4k
Adopting Sorbet at Scale
ufuk
77
9.5k
Building an army of robots
kneath
306
45k
Distributed Sagas: A Protocol for Coordinating Microservices
caitiem20
333
22k
Transcript
Deep Learning and Natural Language Processing with Spark Melanie Warrick
| Skymind | @nyghtowl Andy Petrella | Data Fellas | @noootsab
@nyghtowl Machine Learning
None
@nyghtowl
@nyghtowl
Natural Language Processing @nyghtowl • Question Answer • Image Captioning
• Topic Modeling/Sentiment Analysis • Language | Machine Translation • Text Generation NLP is hard
@nyghtowl Artificial Neural Nets Output | y Hidden Loss Function
Output k j X M kj W y Run until error stops improving = converge Input | X
@nyghtowl Recurrent Neural Net
@nyghtowl Long short-term Memory (LSTM)
@nyghtowl Sequence to Sequence
@nyghtowl Example: Word2Vec Word embeddings represent context King – Man
+ Woman ~ Queen
@nyghtowl Example: Image Captioning
@nyghtowl Sequence to Sequence
@nyghtowl Sentiment Analysis Reviews “Best part of the movie is
the end credits” “It should have been a great movie…” Sentiment
@nyghtowl Hadoop Spark AWS Skymind ND4J DeepLearning4J Native & JavaCPP
& OpenMP & Cuda 7.5 Canova Data Neural Nets Linear Algebra LIBND4J C Backend
@nyghtowl Data Fellas - Spark-Notebook only Scala based notebook that
is - scalable and enables interactive work on Spark, Akka, Cassandra, & Kafka - plotting interactive plots in any Scala type - Data Fellas enables data-driven business, bringing productivity to data science in enterprise
@nyghtowl Cluster Juju bundle including: • DL4J • Mesos •
Spark • Spark Notebook
@nyghtowl Blog Making deep learning accessible on Openstack
@nyghtowl Research References RNNs • DL4J Overview: ◦ RNN &
LSTM Overview: http://deeplearning4j.org/recurrentnetwork ◦ Using RNNs: http://deeplearning4j.org/usingrnns.html • Karpathy: https://karpathy.github.io/2015/05/21/rnn-effectiveness/ • Intro: http://www.wildml.com/2015/09/recurrent-neural-networks-tutorial-part-1-introduction-to-rnns/ Github Repos • Spark Notebook: https://github.com/andypetrella/spark-notebook • DL4J Examples: https://github.com/deeplearning4j/dl4j-0.4-examples • DL4J Spark Examples: https://github.com/deeplearning4j/dl4j-spark-cdh5-examples General ML Projects (referenced in presentation) • AlphaGo: http://i.dailymail.co.uk/i/pix/2016/03/09/09/320583D500000578-3483569- Google_has_confirmed_its_AlphaGo_computer_has_taken_the_first_vi-a-11_1457516282972.jpg • Switzerland SAR: http://www.forensicmag.com/article/2016/02/autonomous-drones-fly-search-and-rescue-operations • VIV: http://www.dailytech.com/ExSiri+CEO+Poaches+Apple+to+Create+Viv+The+Global+Brain/article36387.htm
@nyghtowl Image References • http://www.dailytech. com/ExSiri+CEO+Poaches+Apple+to+Create+Viv+The+Global+Brain/article36387.htm • http://3.bp.blogspot.com/- mMPT3tgVWaQ/U5qVs64HbRI/AAAAAAAAJCM/lEE4OiJmRSY/s1600/thumb-down-smiley.png •
http://4.bp.blogspot.com/-pUoO5oOuzOc/VcomU6qKT4I/AAAAAAAAAsg/TonkgL1iEjE/s1600/Screen% 2BShot%2B2015-08-11%2Bat%2B9.43.21%2BAM.png • http://www.ucreative.com/inspiration/interesting-patterns-and-fractals-from-nature/ • http://i.telegraph.co.uk/multimedia/archive/02122/WILLIAM-SHAKESPEAR_2122089b.jpg • https://karpathy.github.io/2015/05/21/rnn-effectiveness/ • https://pbs.twimg.com/media/CJm9HmfVEAEXU0c.jpg:large • http://www.wildml.com/2015/09/recurrent-neural-networks-tutorial-part-1-introduction-to-rnns/ • http://i.dailymail.co.uk/i/pix/2016/03/09/09/320583D500000578-3483569- Google_has_confirmed_its_AlphaGo_computer_has_taken_the_first_vi-a-11_1457516282972.jpg • http://www.forensicmag.com/article/2016/02/autonomous-drones-fly-search-and-rescue-operations • Susan Eraly
@nyghtowl Deep Learning and Natural Language Processing with Spark Andy
Petrella | Data Fellas | @noootsab Melanie Warrick | Skymind | @nyghtowl