Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Computer Vision Deep Learning with DL4J

Computer Vision Deep Learning with DL4J

Melanie Warrick

June 05, 2016
Tweet

More Decks by Melanie Warrick

Other Decks in Technology

Transcript

  1. Melanie Warrick | Skymind | @nyghtowl Computer Vision Deep Learning

    with DL4J
  2. @nyghtowl Machine Learning

  3. None
  4. @nyghtowl

  5. @nyghtowl

  6. @nyghtowl Artificial Neural Nets Input Output Hidden Run until error

    stops improving = converge Loss Function
  7. @nyghtowl Computer Vision Who is it? Pixels Edges Object Parts

    Object Models Layer 2 Layer 3 Layer 4 Input
  8. @nyghtowl Example: Image Captioning

  9. Example: Image Generation

  10. @nyghtowl Convolutional Neural Net

  11. @nyghtowl Hadoop Spark AWS Skymind ND4J DeepLearning4J Native & JavaCPP

    & OpenMP & Cuda 7.5 Canova Data Neural Nets Linear Algebra LIBND4J C Backend
  12. @nyghtowl Research References • DL4J CNN Examples: https://github.com/deeplearning4j/ComputerVision-examples • DL4J

    Examples: https://github.com/deeplearning4j/dl4j-0.4-examples • CS231Convolution Neural Nets for Visual Recognition: https://cs231n.github.io/ • Tiny ImageNet Classification with CNN: http://cs231n.stanford.edu/reports/leonyao_final.pdf • AlexNet: http://papers.nips.cc/paper/4824-imagenet-classification-with-deep-convolutional-neural- networks.pdf & https://github.com/BVLC/caffe/blob/master/models/bvlc_alexnet/train_val.prototxt • Neural Networks and Deep Learning: http://neuralnetworksanddeeplearning.com/chap3.html • Neuarl Networks: http://nbviewer.jupyter. org/github/masinoa/machine_learning/blob/master/04_Neural_Networks.ipynb • Visual Information Theory: https://colah.github.io/posts/2015-09-Visual-Information/ • Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift: http: //jmlr.org/proceedings/papers/v37/ioffe15.pdf • Deep Learning Book: http://www.deeplearningbook.org/ • Neural Networks for Machine Learning: https://www.coursera.org/course/neuralnets
  13. @nyghtowl Image References • U.S. Fish and Wildlife Service (animal

    sample dataset): http://digitalmedia.fws.gov/cdm/ • http://www.dailytech. com/ExSiri+CEO+Poaches+Apple+to+Create+Viv+The+Global+Brain/article36387.htm • http://3.bp.blogspot.com/- mMPT3tgVWaQ/U5qVs64HbRI/AAAAAAAAJCM/lEE4OiJmRSY/s1600/thumb-down-smiley.png • http://4.bp.blogspot.com/-pUoO5oOuzOc/VcomU6qKT4I/AAAAAAAAAsg/TonkgL1iEjE/s1600/Screen% 2BShot%2B2015-08-11%2Bat%2B9.43.21%2BAM.png • http://www.ucreative.com/inspiration/interesting-patterns-and-fractals-from-nature/ • http://i.telegraph.co.uk/multimedia/archive/02122/WILLIAM-SHAKESPEAR_2122089b.jpg • https://karpathy.github.io/2015/05/21/rnn-effectiveness/ • https://pbs.twimg.com/media/CJm9HmfVEAEXU0c.jpg:large • http://www.wildml.com/2015/09/recurrent-neural-networks-tutorial-part-1-introduction-to-rnns/ • http://i.dailymail.co.uk/i/pix/2016/03/09/09/320583D500000578-3483569- Google_has_confirmed_its_AlphaGo_computer_has_taken_the_first_vi-a-11_1457516282972.jpg • http://www.forensicmag.com/article/2016/02/autonomous-drones-fly-search-and-rescue-operations
  14. @nyghtowl Computer Vision DL with DL4J Melanie Warrick skymind.io @nyghtowl

    gitter.im/deeplearning4j