Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Speaker Deck
PRO
Sign in
Sign up
for free
Theano: let's build a net
ktisha
July 03, 2016
Programming
0
270
Theano: let's build a net
ktisha
July 03, 2016
Tweet
Share
More Decks by ktisha
See All by ktisha
ktisha
0
310
Other Decks in Programming
See All in Programming
deepflow
9
3.6k
mackee
0
670
andpad
4
290
meemeelab
0
310
mizzsugar
1
220
shiz
1
110
gernotstarke
0
390
kilometer
4
500
mihyaeru21
0
370
tkow
1
130
korosuke613
2
270
ryokbt
2
310
Featured
See All Featured
erikaheidi
14
4.3k
andyhume
63
3.7k
chriscoyier
683
180k
akmur
252
19k
jnunemaker
PRO
40
4.6k
destraynor
146
19k
matthewcrist
73
7.5k
tanoku
86
8.6k
keithpitt
401
20k
sachag
267
17k
trallard
14
720
brettharned
93
3k
Transcript
Theano: let’s build a net Ekaterina Tuzova
Motivation
MNIST dataset X — images (60000, 784) Y — labels
(60000, ) Goal: train a model to look at images and predict what digits they are.
K nearest neighbors
K nearest neighbors ~95 % accuracy
Feature engineering
Machine Learning
Machine Learning
Variable in Computer Science A piece of informations stored somewhere
in memory with a name made up by a programmer.
Variable in Mathematics Indeterminate quantity that can be manipulated using
arithmetic operations, or using calculus and so on.
Theano
What is Theano? A library for efficiently handling mathematical expressions
involving tensors.
What is tensor? Multi-dimensional array.
What is Theano? A mathematical symbolic expression compiler.
Quick How-To - Define symbolic expression - Compile a function
that can compute numeric values using those expressions - Execute that function on data
Example model GoogLeNet, 2014 ~99.6% accuracy
Logistic regression Probabilistic, linear classifier.
Simple model
Preparation
Load MNIST
Define model
Theano shared variable Shared between different functions and function calls.
Build model
Train model
Train model ~93% accuracy
Simple model
Improve model
Improve model
Improve model
Train model ~98.5% accuracy
Thank you. @ktisha