Upgrade to Pro — share decks privately, control downloads, hide ads and more …

ML Session n°4

2696500a913e29a26f38115f8ea56f71?s=47 Adrien Couque
April 05, 2017
Technology
0
12

ML Session n°4

2696500a913e29a26f38115f8ea56f71?s=128

Adrien Couque

April 05, 2017
Tweet

More Decks by Adrien Couque

See All by Adrien Couque
2696500a913e29a26f38115f8ea56f71?s=48 acq
0
8
2696500a913e29a26f38115f8ea56f71?s=48 acq
0
32
2696500a913e29a26f38115f8ea56f71?s=48 acq
0
9
2696500a913e29a26f38115f8ea56f71?s=48 acq
0
10
2696500a913e29a26f38115f8ea56f71?s=48 acq
0
8
2696500a913e29a26f38115f8ea56f71?s=48 acq
0
11
2696500a913e29a26f38115f8ea56f71?s=48 acq
1
9
2696500a913e29a26f38115f8ea56f71?s=48 acq
0
5
2696500a913e29a26f38115f8ea56f71?s=48 acq
0
140

Other Decks in Technology

See All in Technology
9df0566fad9c9ca3bf669917848878fe?s=48 i35_267
0
270
3f848c0c0b9a6603894e157da93e4655?s=48 sadayoshitada0919
1
480
1c6ef01647528e574184bbffa96df1cd?s=48 keiya01
20
7.9k
40301c0affdf359eaca771713e22b71a?s=48 harshbothra
1
160
3c635ac67557f954b04d37a24254f436?s=48 becolomochi
0
160
E97091ac0d2c69ce9f9e8a8d0a2ea066?s=48 torisoup
0
310
8a7e83d2e447783ab6d824f553429a09?s=48 stakaya
14
8.4k
5df7b3418b4b5528ddfe514d73008883?s=48 tsugimot
0
140
69b93af68320a590f607c296e8edff73?s=48 k1low
1
500
11d5350db3f389d0f5749b91ee11a916?s=48 indigo13love
2
520
86e4f6731e81df0591bd9cb66ddbd347?s=48 sugimomoto
1
380
3499a1d71fa70b8ee44816ca9e7329fe?s=48 bells17
0
610

Featured

See All Featured
E14f55d3f939977cecbf51b64ff6f861?s=48 keithpitt
401
20k
A60068bce2e73de3a37ca9d2dbe36092?s=48 bryan
100
11k
766b9746b59e6f09e280cd33cf4ed419?s=48 skipperchong
7
670
20bfe76b3d6105641f879fe45cfc9272?s=48 bkeepers
408
57k
4262b9cfacfb6b2c77f23e1d0310cd3e?s=48 myddelton
109
11k
39488f9d172ab92fd352f2cd7b73258d?s=48 mza
80
4.1k
8081b26e05bb4354f7d65ffc34cbbd67?s=48 chriscoyier
684
180k
06f8b41980eb4c577fa40c41d5030c19?s=48 keathley
18
650
7c8469ee8c9e594c65c59b919626c08d?s=48 scottboms
251
11k
433acaea1012b25d97ae66da9b998dad?s=48 malarkey
119
16k
25c7c18223fb42a4c6ae1c8db6f50f9b?s=48 mojombo
358
62k
2f5463832ccb768ccb4a1ca3607c27ef?s=48 jacobian
255
20k

Transcript

  1. ML: regularization and neural networks March 2017

  2. Recap

  3. Recap: linear regression

  4. Recap: polynomial regression

  5. Recap: gradient descent

  6. Regularization

  7. Normalization Goal : have all features be equivalent (in size)

    Rescaling : Standardization :

  8. Regularization : goal

  9. Regularization Before : Now : Forces values to stay low

  10. Neural networks

  11. Demo: Tensorflow Playground

  12. Biological neuron

  13. Artificial neuron: Perceptron

  14. Teaching a neuron

  15. Artifical neuron : activation function

  16. Most common activation functions Identity Sigmoid Tanh ReLU

  17. Teaching a neuron

  18. Demo: simple network, but the hard way (92%)

  19. Demo: simple network, but the hard way (92%)

  20. Artificial neuron -> Artificial neural network

  21. Artificial neuron -> Artificial neural network

  22. Teaching a neural net

  23. Demo: Tensorflow Playground

  24. Demo: layered network, still the hard way (97%)

  25. Questions? March 2017