Dreams, Drugs & ConvNets Piotr Migdał, PhD deepsense.io / freelancer http://p.migdal.pl/ 2 Mar 2017, Studenckie Koło Naukowe Neurobiologii UW

No content

No content

Deep Learning progress • image recognition, neural style, word analogies, per-char translations, playing ATARI games, Go, [no idea what’s next] • fast-paced (more than my quantum physics PhD):
 6 month ago a breakthrough, now a baseline • (no questions about Singularity please!)

Artificial neural networks • Multidimensional arrays • Simple matrix operations (add, multiply) • Floats (not spikes) • Simple activation functions (sigmoid, ReLU) • Cost function and back-propagation • A lot of weights (e.g. 100M)

Many layers https://research.facebook.com/publications/deepface-closing-the-gap-to-human-level-performance-in-face-verification/

Convolutions http://setosa.io/ev/image-kernels/

Patterns activating channels https://blog.keras.io/how-convolutional-neural-networks-see-the-world.html

Big questions • creating general AI or sentient beings • transferring our minds (mind uploading) “I mean, if we're able to save even just a small piece of ourselves, why wouldn't we do that?” - SOMA https://www.youtube.com/watch?v=BZTfi1jv-EE

Flesh vs machines:
 practical questions • Cross-inspiration: • Machine Learning to Human Cognition • Human Cognition to Machine Learning • Common abstractions • Learning in general • Hierarchical signal processing

NSFW, 18+, etc

http://www.techrepublic.com/article/why-microsofts-tay-ai-bot-went-wrong/ Tay.AI (+ 4chan)

The biggest lie of every
 parent, pet owner
 and neural network trainer: “I’ve never shown it that, it must have learned it by itself!”

Stereotypes http://p.migdal.pl/2017/01/06/king-man-woman-queen-why.html

If you’ve never had a trip… https://youtu.be/cPKq7JuQDvg?t=256

If you’ve never had a trip… https://youtu.be/z7_U6y8kJaY?t=72

Deep dreams: forcing ConvNet
 to see things https://research.googleblog.com/2015/06/inceptionism-going-deeper-into-neural.html

• What should I use:
 THC, LSD, DMT? • A good GPU! http://alexgrey.com/shop/st-al.html

Grocery trip https://www.youtube.com/watch?v=DgPaCWJL7XI

Forcing networks to see things https://research.googleblog.com/2015/06/inceptionism-going-deeper-into-neural.html

Neural style transfer also video: https://www.youtube.com/watch?v=Khuj4ASldmU

With own photos to play with https://deepart.io/ or https://prisma-ai.com/

What is sexual? http://blog.clarifai.com/what-convolutional-neural-networks-see-at-when-they-see-nudity/#.WLhGmRIrLLh

What is sensual? http://blog.clarifai.com/what-convolutional-neural-networks-see-at-when-they-see-nudity/#.WLhGmRIrLLh

And this? (yes, ConvNet is also fooled)

Sketch to picture http://affinelayer.com/pixsrv/

Sketch to picture: let’s get rogue! http://affinelayer.com/pixsrv/

https://raw.githubusercontent.com/Newmu/dcgan_code/master/images/faces_arithmetic_collage.png https://github.com/255BITS/HyperGAN Picture analogies

https://open_nsfw.gitlab.io/ Image generation

Learning what is important • Object consistency • Toddler needs to learn, so do ConvNets http://blogs.scientificamerican.com/illusion-chasers/what-little-babies-see-that-you-no-longer-can/

Uncertainty and learning http://www.nature.com/articles/ncomms11609

Retrain your own network:
 McCollough effect http://www.michaelbach.de/ot/col-McCollough/

Trypophobia
 (don’t google it!) visit here instead: https://en.wikipedia.org/wiki/Trypophobia

Trypophobia detector https://github.com/grzegorz225/trypophobia-detector (a 5-day workshop was enough for 88% accuracy!)

And if you
 don’t want to code… http://www.sciencemag.org/news/2015/11/pigeons-spot-cancer-well-human-experts https://www.youtube.com/watch?v=flzGjnJLyS0

Questions? • If you want to learn: • http://lumiverse.io/series/neural-networks-demystified • https://gist.github.com/stared/7de2908b9bcba01c39ee3c591875a23c • http://www.deeplearningbook.org/ • Keras (on top of TensorFlow) in Jupyter Notebook • https://medium.com/@mateuszsieniawski/keras-with-gpu-on-amazon-ec2-a-step-by- step-instruction-4f90364e49ac#.4i1norivh • https://www.erowid.org/ http://p.migdal.pl/ + I do like emails: pmigdal@gmail.com