Slide 1

Slide 1 text

Azure AutoML LEARNING THE LEARNING

Slide 2

Slide 2 text

Agenda ML – Overview Azure Machine Learning What is Automated ML? Build a ML Model using Automated ML Demo

Slide 3

Slide 3 text

Hello !! I’m Siva Working as Architect in CEI #Cloud #Mobile #IoT Solutions ksivamuthu ksivamuthu

Slide 4

Slide 4 text

Machine Learning … Everywhere … ML Overview

Slide 5

Slide 5 text

Artificial Intelligence Science of getting machines to do the things what they do in movies. (Mimic human behavior) Machine Learning Subset of AI - The science of getting computers to act without being explicitly programmed. Deep Learning Subset of ML - Learning based on deep neural network.

Slide 6

Slide 6 text

Machine Learning Using known data, develop a model to predict unknown data

Slide 7

Slide 7 text

Machine learns the same way human do.

Slide 8

Slide 8 text

Let’s do an exercise on human learning to understand machine learning. @ksivamuthu

Slide 9

Slide 9 text

Virzeth https://medium.com/@yakubova92/machine-learning-vs-human-learning-f3f204c8b27d @ksivamuthu

Slide 10

Slide 10 text

Virzeth

Slide 11

Slide 11 text

Virzeth or Not ? @ksivamuthu

Slide 12

Slide 12 text

Types of Machine Learning Supervised Learning Reinforcement Learning Train an algorithm to perform classification and regression with labelled data set. Unsupervised Learning Train an algorithm to find clusters and associations in an unlabeled data set. Train an agent to take certain actions in an environment without a data set.

Slide 13

Slide 13 text

Energy Auto Finance Entertainment Media Manufacturing / Agriculture Retail

Slide 14

Slide 14 text

ML Workflow Gathering Data Preparing Data Choosing a model Training Evaluation Hyper parameter tuning Prediction

Slide 15

Slide 15 text

Data preprocessing ML Model Design Tune model parameters Evaluate Deploy Update What preprocessing techniques should I use? What modeling techniques? Which architecture? Which set of hyperparameters? How do I know my model’s performance? How can I improve my dataset? Which metrics are most important? What infrastructure to use to serve my model at scale? How to meet latency goals? ML Workflow

Slide 16

Slide 16 text

Azure Machine Learning Service

Slide 17

Slide 17 text

Sophisticated pretrained models To simplify solution development Azure Databricks Machine Learning VMs Popular frameworks To build advanced deep learning solutions TensorFlow Keras Pytorch Onnx Azure Machine Learning Language Speech … Azure Search Vision On-premises Cloud Edge Productive services To empower data science and development teams Powerful infrastructure To accelerate deep learning Flexible deployment To deploy and manage models on intelligent cloud and edge Machine Learning on Azure Cognitive Services

Slide 18

Slide 18 text

No content

Slide 19

Slide 19 text

Creating ML Workspace

Slide 20

Slide 20 text

Azure ML Workspace Resources

Slide 21

Slide 21 text

ML EXPERIMENTS DATASTORE COMPUTE MODELS IMAGES DEPLOYMENTS

Slide 22

Slide 22 text

No content

Slide 23

Slide 23 text

Automated ML

Slide 24

Slide 24 text

No content

Slide 25

Slide 25 text

• Based on Microsoft Research • Brain trained with several million experiments • Collaborative filtering and Bayesian optimization • Privacy preserving: No need to “see” the data Automated ML – How it works

Slide 26

Slide 26 text

Build a ML Model using AutoML

Slide 27

Slide 27 text

Type of machine learning problem you are solving …

Slide 28

Slide 28 text

Categories of supervised learning supported CLASSIFICATION REGRESSION FORECASTING

Slide 29

Slide 29 text

No content

Slide 30

Slide 30 text

No content

Slide 31

Slide 31 text

Data preparation & Compute Target • Source and format of training data • Data can be read into Numpy arrays or a Pandas data frame • Configure split options for selecting training and validation data • You can specify separate training and validation datasets. • Configure compute target

Slide 32

Slide 32 text

Configure your experiment settings automl_classifier = AutoMLConfig( task='classification’, primary_metric='AUC_weighted’, max_time_sec=12000, iterations=50, X=X, y=y, n_cross_validations=2 )

Slide 33

Slide 33 text

Primary Metric Classification Regression Time Series Forecasting accuracy spearman_correlation spearman_correlation AUC_weighted normalized_root_mean_squared _error normalized_root_mean_squared _error average_precision_score_weighte d r2_score r2_score norm_macro_recall normalized_mean_absolute_err or normalized_mean_absolute_err or precision_score_weighted

Slide 34

Slide 34 text

Run Experiment run = experiment.submit(automl_config)

Slide 35

Slide 35 text

Exit Criteria No Criteria Number of iterations / Iteration Timeout Minutes Exit after a length of time / Experiment Timeout Minute. Exit after a score has been reached – Experiment Exit Score

Slide 36

Slide 36 text

MODEL CREATION TIME – FROM DAYS TO HOURS ROBUST BENCHMARKING PROCESS FOR ML PROJECTS ENABLE DOMAIN EXPERTS TO LEVERAGE ML

Slide 37

Slide 37 text

Automated ML in Power BI

Slide 38

Slide 38 text

No content

Slide 39

Slide 39 text

Reference • Azure - https://azure.microsoft.com/en- us/services/machine-learning-service/ • Microsoft Machine Learning Blog - https://azure.microsoft.com/en-us/blog/tag/azure- machine-learning/ • Azure ML documentation - https://docs.microsoft.com/en-us/azure/machine- learning/ • Slides - https://speakerdeck.com/ksivamuthu/azure- automl-learning-the-learning

Slide 40

Slide 40 text

Thank You !! Follow me on social medias ksivamuthu ksivamuthu