Slide 1

Slide 1 text

Open Source Deep Learning for Developers — Bradley Holt Program Manager, Developer Advocacy Center for Open-Source Data & AI Technologies ↳ (CODAIT) @BradleyHolt

Slide 2

Slide 2 text

It’s a hybrid world Enterprises want the ability to span traditional IT, private and public clouds. Containers are strategic Enterprises need agility to meet the demands of their clients and their markets. Innovation is the path forward Mission critical projects need industry leading middleware and data. IBM and Red Hat Share Three Common Beliefs 2 © 2019 IBM Corporation IBM and Red Hat – Partners for 20 years For over 20 years IBM and Red Hat have collaborated with the open source community to drive innovation and power businesses around the world.

Slide 3

Slide 3 text

Artificial Intelligence Center for Open-Source Data & AI Technologies (CODAIT) / May 8, 2019 / © 2019 IBM Corporation @BradleyHolt

Slide 4

Slide 4 text

↳ General AI Metal Skull With Terminator Eye by L.C. Nøttaasen, on Flickr (CC BY-SA 2.0).

Slide 5

Slide 5 text

↳ Broad AI -[ electrIc b88Gal88 ]- by JD Hancock, on Flickr (CC BY 2.0).

Slide 6

Slide 6 text

↳ Narrow AI Danbo on the Lookout by IQRemix, on Flickr (CC BY-SA 2.0).

Slide 7

Slide 7 text

Approaches to Artificial Intelligence Center for Open-Source Data & AI Technologies (CODAIT) / May 8, 2019 / © 2019 IBM Corporation Machine Learning (ML) • Predictive analytics • Data mining • Anomaly detection • Email filtering Deep Learning • Image or audio classification • Facial recognition • Object recognition • Image caption generation • Natural language processing @BradleyHolt

Slide 8

Slide 8 text

https://github.com/CODAIT/magicat

Slide 9

Slide 9 text

23895621638_535be71dee_k.jpg 37038669284_899d7784a9_k.jpg 37489697170_31d05aa027_k.jpg 37699459356_24fd526a5e_k.jpg 37699976806_5ce694be36_k.jpg Animal photos by Susanne Nilsson, on Flickr (CC BY-SA 2.0).

Slide 10

Slide 10 text

Scan Directory with magicat $ magicat . --contains sheep Scanning directory '~/tfjs-demos/magicat' for sheep... Sheep found in: 37038669284_899d7784a9_k.jpg 37489697170_31d05aa027_k.jpg @BradleyHolt

Slide 11

Slide 11 text

Save Image Segment with magicat $ magicat 37699976806_5ce694be36_k.jpg --save horse The image '37699976806_5ce694be36_k.jpg' contains the following segments: background, horse. saved 37699976806_5ce694be36_k-horse.png Animal photos by Susanne Nilsson, on Flickr (CC BY-SA 2.0).

Slide 12

Slide 12 text

↳ Deep Learning Code Patterns @BradleyHolt

Slide 13

Slide 13 text

Software Programming Center for Open-Source Data & AI Technologies (CODAIT) / May 8, 2019 / © 2019 IBM Corporation Untitled by Marcin Wichary, on Flickr (CC BY 2.0).

Slide 14

Slide 14 text

Center for Open-Source Data & AI Technologies (CODAIT) / May 8, 2019 / © 2019 IBM Corporation 01011001001011000001 10101101010100100110 00010110101010011100 10101010110101010100 10001001011101000101 Software Program Business Logic @BradleyHolt

Slide 15

Slide 15 text

Center for Open-Source Data & AI Technologies (CODAIT) / May 8, 2019 / © 2019 IBM Corporation 01011001001011000001 10101101010100100110 00010110101010011100 10101010110101010100 10001001011101000101 Software Program Input Program Execution Output @BradleyHolt

Slide 16

Slide 16 text

Deep Learning & ML vs. Software Programming Center for Open-Source Data & AI Technologies (CODAIT) / May 8, 2019 / © 2019 IBM Corporation Deep Learning & ML • Training • High-quality examples (i.e., training data) • Approximation of a correct function Software Programming • Programming • Set of direct instructions • Precisely-defined function @BradleyHolt

Slide 17

Slide 17 text

Center for Open-Source Data & AI Technologies (CODAIT) / May 8, 2019 / © 2019 IBM Corporation Input Layer Hidden Layers Output Layer @BradleyHolt

Slide 18

Slide 18 text

Fashion-MNIST dataset by Zalando Research, on GitHub (MIT License). Backpropagation Labeled Training Data Coat Sneaker T-shirt Sneaker Pullover Output Errors Pullover Coat Coat Sneaker T-shirt ❌ ❌ ❌

Slide 19

Slide 19 text

Fashion-MNIST dataset by Zalando Research, on GitHub (MIT License). Input Output Sneaker Neural Network Inferencing

Slide 20

Slide 20 text

Center for Open-Source Data & AI Technologies (CODAIT) / May 8, 2019 / © 2019 IBM Corporation @BradleyHolt

Slide 21

Slide 21 text

@BradleyHolt

Slide 22

Slide 22 text

Applying Deep Learning Center for Open-Source Data & AI Technologies (CODAIT) / May 8, 2019 / © 2019 IBM Corporation Data Science Expertise Computing Resources High-Quality Training Data Model Deployment Time Model Integration Inferencing Code And more… @BradleyHolt

Slide 23

Slide 23 text

Model Asset Exchange Classify Generate Recognize Center for Open-Source Data & AI Technologies (CODAIT) / May 8, 2019 / © 2019 IBM Corporation @BradleyHolt

Slide 24

Slide 24 text

Microservice Center for Open-Source Data & AI Technologies (CODAIT) / May 8, 2019 / © 2019 IBM Corporation Choose deployable model Deep Learning asset from the Model Asset Exchange (MAX) Deploy Swagger specification Inference endpoint Metadata endpoint Input preprocessing, model execution, and output post-processing Deploy model Use model @BradleyHolt

Slide 25

Slide 25 text

AI Lifecycle Center for Open-Source Data & AI Technologies (CODAIT) / May 8, 2019 / © 2019 IBM Corporation Deploy & Run Operate & Manage Prepare, Build & Train @BradleyHolt

Slide 26

Slide 26 text

Preparing, Building, and Training AI Models Center for Open-Source Data & AI Technologies (CODAIT) / May 8, 2019 / © 2019 IBM Corporation Model Asset Exchange (MAX) @BradleyHolt

Slide 27

Slide 27 text

Deploying and Running AI Models Center for Open-Source Data & AI Technologies (CODAIT) / May 8, 2019 / © 2019 IBM Corporation ONNX.js Model Asset Exchange (MAX) @BradleyHolt

Slide 28

Slide 28 text

Operating and Managing AI Systems Fabric for Deep Learning (FfDL) Train and deploy deep learning models on Kubernetes using TensorFlow, Caffe2, PyTorch, and other frameworks AI Fairness 360 (AIF360) Comprehensive set of fairness metrics for machine learning models, explanations for these metrics, and algorithms to mitigate bias in models Adversarial Robustness Toolbox (ART) Python library for adversarial attacks and defenses for neural networks with multiple framework support @BradleyHolt

Slide 29

Slide 29 text

IBM Data & AI Portfolio Center for Open-Source Data & AI Technologies (CODAIT) / May 8, 2019 / © 2019 IBM Corporation The Ladder to AI Pre-built Use Cases Watson Applications Multicloud Data & AI Platform IBM Cloud Platform for Data Hybrid Data Management Db2 Family Data Governance & Integration InfoSphere Family Open Source meets a multicloud, working as ONE Watson Machine Learning Watson Knowledge Catalog Watson Studio Watson OpenScale Prepare Build Manage Run @BradleyHolt

Slide 30

Slide 30 text

Watson Data Science Platform Center for Open-Source Data & AI Technologies (CODAIT) / May 8, 2019 / © 2019 IBM Corporation Build and Deploy Upon Open Source Frameworks Watson Studio A universal runtime to embed, share and optimize AI models Design, build and train AI models, with visual modeling & generation Watson Machine Learning Watson OpenScale Operate and scaling AI value & usage with trust & transparency Unify on a Multicloud Data & AI Platform Watson Knowledge Catalog Data Discovery Data Preparation Policy-based Catalogs Visual Design Develop & Train Automation (AutoAI) Deploy & Manage Model-ops Retraining Optimize Outcomes Explainability & Lineage Automated Evolution Unified catalog to data users find, curate, categorize and share data Prep Build Run Manage @BradleyHolt

Slide 31

Slide 31 text

What will you build with deep learning? Dynamic Earth - Continental Shelf by NASA Goddard Space Flight Center, on Flickr (CC BY 2.0).

Slide 32

Slide 32 text

Resources: Machine Learning Libraries • TensorFlow https://www.tensorflow.org/ • Train your first neural network: basic classification | TensorFlow https://www.tensorflow.org/tutorials/keras/basic_classification • Keras https://keras.io/ • PyTorch https://pytorch.org/ • Caffe2 https://caffe2.ai/ @BradleyHolt

Slide 33

Slide 33 text

Resources: IBM Developer • IBM Developer https://developer.ibm.com/ • IBM Cloud https://ibm.biz/Bd2NAr • Center for Open-Source Data & AI Technologies (CODAIT) http://codait.org/ • IBM Developer Model Asset Exchange (MAX) https://developer.ibm.com/exchanges/models/ • magicat https://github.com/CODAIT/magicat @BradleyHolt

Slide 34

Slide 34 text

Resources: Preparing, Building, and Training AI Models • Project Jupyter https://jupyter.org/ • IBM Developer Model Asset Exchange (MAX) https://developer.ibm.com/exchanges/models/ • IBM Watson Knowledge Catalog https://www.ibm.com/cloud/watson-knowledge-catalog • IBM Watson Studio https://www.ibm.com/cloud/watson-studio @BradleyHolt

Slide 35

Slide 35 text

Resources: Deploying and Running AI Models • Data Mining Group (PMML & PFA) http://dmg.org/ • ONNX https://onnx.ai/ • ONNX.js https://github.com/Microsoft/onnxjs • TensorFlow.js https://js.tensorflow.org/ • TensorFlow Lite https://www.tensorflow.org/lite • Core ML https://developer.apple.com/machine-learning/ • IBM Watson Machine Learning https://www.ibm.com/cloud/machine-learning @BradleyHolt

Slide 36

Slide 36 text

Resources: Operating and Managing AI Systems • Fabric for Deep Learning (FfDL) https://github.com/IBM/FfDL • AI Fairness 360 (AIF360) https://github.com/IBM/AIF360 • Adversarial Robustness Toolbox (ART) https://github.com/IBM/adversarial-robustness-toolbox • IBM Watson OpenScale https://www.ibm.com/cloud/watson-openscale @BradleyHolt

Slide 37

Slide 37 text

Thank you. Center for Open-Source Data & AI Technologies (CODAIT) / May 8, 2019 / © 2019 IBM Corporation Bradley Holt Program Manager, Developer Advocacy Center for Open-Source Data & AI Technologies (CODAIT) — ibm.com @BradleyHolt

Slide 38

Slide 38 text

Center for Open-Source Data & AI Technologies (CODAIT) / May 8, 2019 / © 2019 IBM Corporation