Slide 1

Slide 1 text

The modern Python AI stack: an overview of TensorFlow Dražen Lučanin

Slide 2

Slide 2 text

AI: The Next Big Thing™ ● Communication was the Internet’s killer app – web apps storing data to DBs ruled ● My view… AI will be the next killer app – Faster & cheaper GPU hardware – Lots of R&D around machine learning – Cool applications ● Self-driving cars ● Good speech recognition ● Automating repetitive manual tasks ● “The secret sauce”

Slide 3

Slide 3 text

Getting into AI ● …probably a good idea ● Applying AI != researching AI ● Modern AI frameworks – Torch (Facebook) – Theano (academy) – TensorFlow (Google)

Slide 4

Slide 4 text

TensorFlow (TF) ● Great AI framework built in Google – Easy for developers and researchers – Production-ready ● MapReduce – White paper only – Hadoop became the standard ● TF open sourced to became the standard ● Model marketplace

Slide 5

Slide 5 text

TF Overview ● DataFlow programming language ● describe a graph of interacting operations that run entirely outside Python – Graph – Session

Slide 6

Slide 6 text

TF API ● Low-level API (for researchers) ● High-level API (GTD) ● Example

Slide 7

Slide 7 text

Performance ● CPU (C++ implementation – pretty efficient) ● GPU – even faster! ● JIT compiler – Speed things up by adding a single line of code – Experimental ● XLA compiler – Ahead-of time compilation – Run on embedded devices (phones, IoT)

Slide 8

Slide 8 text

TensorBoard

Slide 9

Slide 9 text

Deployment ● Google Cloud & AWS offer VMs with GPUs ● FloydHub – Heroku for AI – https://www.floydhub.com/

Slide 10

Slide 10 text

Learning ● Easy riding – https://changelog.com/podcast/219 – TF Dev Summit ‘17 videos – https://events.withgoogle.com/tensorflow-dev-summit/ ● Docs & tutorial – https://www.tensorflow.org/get_started/get_started – https://medium.freecodecamp.com/big-picture-machine-learning-classifying-text- with-neural-networks-and-tensorflow-d94036ac2274 ● Goood free books – ESL – http://statweb.stanford.edu/~tibs/ElemStatLearn/ – Michael Nielsen – http://neuralnetworksanddeeplearning.com/ ● Research – http://distill.pub/

Slide 11

Slide 11 text

Thanks! ● Dražen Lučanin ● @metakermit ● Building apps with a kick! https://punkrockdev.com/