Docker and Deep Learning 

Summary What is Docker? What is Deep Learning? How can I use Deep Learning today? 

Outline ● What is Docker? ○ run code in containers ○ isolated virtual environment ○ automate setup for repeatability ● What is Deep Learning? ○ example functions and applications ● How does Deep Learning work? ○ take in lots of example input - output pairs ○ learn a function, there are many techniques ● How can I use Deep Learning today? ○ Demo 

What is Docker? 

In their own words 

Docker containers are Linux in a box 

Why? Example: Run lots of identical web servers 

Why? Example: Run lots of machine learning 

Why? Example: Run research code locally then run the same thing on Google Cloud Engine 

The applications in the box are up to you 

How? Containers use host server resources Docker runs application code inside containers The Docker daemon (within the illustrated Container Engine) controls how containers can access resources of the host like disk to store programs or data and CPU to execute code 

How? Resource Isolation Think of a container like a box inside of which you can run any flavor of the Linux operating system The Docker daemon controls access to host resources like restricting how containers can access networking functions to send and receive traffic Namespaces prevent process interference 

Vagrant vs Docker 

Docker saves space 

Docker saves time* Compared to virtual machines, containers ● startup faster ● use only resources needed at that time ● support direct hardware access *Overall performance depends on the application 

Docker saves you time Building a Docker container that you can run anywhere saves you time setting up servers Using one that someone on your team (or out on the world wide web) already built and published can save you a lot of time and effort 

First make a Dockerfile Specify a base image like your favorite Linux OS Write & install code then build the container and next run the application That makes one Dockerfile which describes how to run some application(s) in a container 

Test and publish your container You can run containers on your own laptop after installing the Docker Engine for your OS Then push it to a registry Later pull the container image file down to any host server running Docker to run anywhere 

Make a docker-compose file Write a docker-compose file which can pick multiple containers to run on one host server For example we can start up an in-memory network cache as well as a web server 

Make a Docker Swarm service Write a Docker Swarm service which can run containers automatically on many Docker host servers provisioned using Docker Machine For example we can deploy a web server application to many server nodes in some cloud 

Reuse setup to run on the cloud 

What gets run on Docker? 

What is Deep Learning? 

What is Deep Learning? 

Deep Neural Network Training and Inference 

Example Function : Digit Classification a training dataset with lots of labeled examples presented individually handwritten digits to integers 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 ... 

Train Handwritten Digit Classification Model 

Digit Classification Model Inference given new input, infer what digit we are seeing image of digit to predicted integer 3 

What else can Deep Learning do? ○ Object Recognition ○ Image Captioning ○ Obstacle Detection ○ Speech Recognition ○ Scene Recognition ○ Reinforcement Learning ○ … etc. 

Example Function: Object Recognition image pixels to semantic object labels and bounding boxes 

Example Function: Image Captioning image pixels to semantic object labels bounding boxes and image caption 

Example: Obstacle Detection Online learning to iteratively refine the function model NVidia Jetson TK1 GPU on a drone 

Example: Speech Recognition mic recorded sound to words The training examples should be in the same language, otherwise there might not be a good match This is a fine day today. 

Example: Scene Segmentation Fidler et al. Scene Tutorial Reconstruction, Localization, Semantics in RGB-D CVPR'15 Depth camera video data stream to segmented 3D map 

Example: Coordinated Reinforcement Learning RL sharing knowledge between many learning systems to grasp and pick up objects Behaviors that successfully pick up objects are rewarded and performed more often, this is positive reinforcement Levine et al. Learning Hand-Eye Coordination for Robotic Grasping with Deep Learning and Large-Scale Data Collection 2016 

Example: Learning Robot Motion Strategy Motor dynamics are known, robot learns movements to pick up and move objects Wong and Takahashi et al. Self-Supervised Deep Visuomotor Learning from Motor Unit Feedback 2016 

Example: AlphaGo Training policy network suggests the best next move trained on a large history of games value network predicts probability of winning given some position, trained similarly 

Example: AlphaGo Inference trained networks are used to search tree of possible futures for the game 

How does Deep Learning work? 

Training a function from input data 

Supervised Training with Backpropagation 0 0 0 0 0 0 8 0 0 0 0 0 0 0 0 1 1 1 1 1 2 1 7 1 1 1 1 1 1 ... 

Supervised Training Sees a Misclassification 2 ≠ 1 

Supervised Training Corrected Prediction 1 = 1 

Deep Learning likes matrices Wu et al. Enabling Ubiquitous Visual Intelligence Through Deep Learning Baidu 2015 

Deep Learning does not like the unexpected 

Training takes a lot of input data 

Training produces a model - large and slow 

Training and Inference 

Evaluate learned model to perform inference 

Inference might require lots of hardware NVidia Titan X graphics card 

Inference might be lightweight Compressed models can preserve accuracy and run on mobile platforms NVidia Jetson TK1 GPU on a drone 

How can I use Deep Learning today? 

How can we get started? For supervised learning such as classification and object detection ○ Pick a framework ○ Utilize pre-trained models -or- ○ Record/download data to train our own models ○ Make evaluations of the model on new data 

Popular frameworks ● Tensorflow ● Caffe ● Theano ● Torch ● MXNet ● Matlab Deep Learning ● and more 

Download pre-trained network models 

Or train your own rental GPU instances This will be in the demo 

Summary What is Docker? ● virtualized containers for isolated and repeatable code execution What is Deep Learning? ● deep neural network function approximation driven by big data How can I use Deep Learning today? ● demo time 

Thanks 

Special Thanks Cornell Center for Advanced Computing Adrian Sampson and the Cornell Computer Systems Lab Reading Group for Deep Learning Hardware Song Han from Stanford University 

References ● Docker Overview ● Edureka What is Docker ● Vagrant Vs Docker by Jonathan Chase ● Docker vs VMs Christopher Tozzi ● https://stanford.edu/~songhan/ ● https://www.dropbox.com/s/p7lvelt0aihrwtl/FPGA%2717%20tutorial%20Song%20Han.pdf?dl=0 ● https://arxiv.org/abs/1602.07360 ● https://www.slideshare.net/embeddedvision/enabling-ubiquitous-visual-intelligence-through-deep-le arning-a-keynote-presentation-from-baidu ● Fidler et al. Scene Tutorial Reconstruction, Localization, Semantics in RGB-D CVPR'15 ● A 'Brief' History of Game AI Up To AlphaGo, Andrey Kurenkov ● Zhang et al Efficient and Accurate Approximations of Nonlinear Convolutional Networks CVPR’15 ● http://www.neurala.com 

References cont. ● https://www.slideshare.net/xavigiro/deep-learning-for-computer-vision-imagenet-challenge-upc-2016 ● https://pdollar.wordpress.com/2015/01/21/image-captioning/ ● https://github.com/BVLC/caffe/wiki/Model-Zoo ● https://github.com/tensorflow/models ● http://deeplearning.net/tutorial/gettingstarted.html ● http://deeplearning.net/tutorial/gettingstarted.html#early-stopping ● https://arxiv.org/abs/1603.02199 ● https://arxiv.org/abs/1501.02530 ● https://en.wikipedia.org/wiki/Backpropagation ● Goodfellow et al. 2016 http://www.deeplearningbook.org/ ● Where's the Bear Elias et al. https://www.cs.ucsb.edu/sites/cs.ucsb.edu/files/docs/reports/tr.pdf 

Image and Figure References Testing Docker for Mac by Dave Kerr Edureka What is Docker InfoWorld Containers 101 Swarm Goes Stable by Docker Inc Docker community ecosystem Docker Compose Example by Racquel Pau Continuous Delivery with Docker by Julia Mateo See Song Han FPGA '17 Tutorial in References above See listed References for selected figures ImageNet Wikimedia Commons Flickr ResearchGate Zhang et al. ResearchGate Abedini et al. Nextxen Jetsonhacks Robohub VGG in Tensorflow by Davi Frossard RSIP Vision 

Author Bennett Wineholt Center for Advanced Computing Cornell University Scientific Software Club at Cornell 04/17/2017 

Demo Time