Introduction to Oracle Machine Learning - AskTOM Office Hours

In this first Office Hours session for Oracle Machine Learning, Mark Hornick provides an introduction to the Oracle Machine Learning (OML) family of products, both on-premises and on the Oracle Cloud. Learn about the key component technologies and features available today, and that are coming soon. See how the key attributes of automation, scalability, and production readiness enable enterprises to increase productivity, achieve enterprise goals faster, and innovate more.

Oracle Machine Learning consists of complementary components supporting scalable machine learning algorithms for in-database and big data environments (including Cloud and on-premises), notebook technology, SQL, Python and R APIs, and Hadoop/Spark environments.

Transcript

1. With Mark Hornick, Senior Director, Product Management, Data Science and Machine Learning @MarkHornick Marcos Arancibia, Product Mgr. Data Science and Big Data @MarcosArancibia oracle.com/big-data/oml Oracle Machine Learning Office Hours Introduction to Oracle Machine Learning Copyright © 2019, Oracle and/or its affiliates. All rights reserved
2. Today’s Session: Introduction to Oracle Machine Learning • Learn about Oracle Machine Learning and its key component technologies and features available today, and that are coming soon. • See how the key attributes of automation, scalability, and production readiness enable enterprises to increase productivity, achieve enterprise goals faster, and innovate more • Oracle Machine Learning consists of complementary components supporting scalable machine learning algorithms for in-database and big data environments (including Cloud and on-premises), notebook technology, SQL, Python and R APIs, and Hadoop/Spark environments Copyright © 2019, Oracle and/or its affiliates. All rights reserved
3. Next Sessions to look for: December 11th, 2019: Oracle Machine Learning Hours, 9AM US Pacific Oracle's Comprehensive Machine Learning Platform plus OML Updates Wes Prichard, Senior Director Industry Solutions Architecture Mark Hornick, Senior Director, Product Management, Data Science and Machine Learning December 12th, 2019: Database Cloud Service Office Hours, 10AM US Pacific Using Machine Learning Results with APEX Tammy Bednar, Senior Director of Product Management, Database Cloud Services Charlie Berger, Sr. Dir. Product Mgt., Machine Learning, AI and Cognitive Analytics David Peake, Senior Principal Product Manager - Application Express Copyright © 2019, Oracle and/or its affiliates. All rights reserved
4. Oracle Machine Learning Overview and Roadmap Mark Hornick Senior Director, Product Management Data Science and Machine Learning Copyright © 2019 Oracle and/or its affiliates. Oracle Machine Learning Office Hours
5. The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, timing, and pricing of any features or functionality described for Oracle’s products may change and remains at the sole discretion of Oracle Corporation. Safe Harbor Copyright © 2019 Oracle and/or its affiliates.
6. Oracle Machine Learning Key Attributes Copyright © 2019 Oracle and/or its affiliates. Automated Get better results faster with less effort – even non-expert users Scalable Handle big data volumes using parallel, distributed algorithms – no data movement Production-ready Deploy and update data science solutions faster with integrated ML platform Increase productivity, Achieve enterprise goals, Innovate More
7. d Oracle Machine Learning OML Microservices* Supporting Oracle Applications Image, Text, Scoring, Deployment, Model Management * Coming soon OML4SQL Oracle Advanced Analytics SQL API OML4Py* Python API OML4R Oracle R Enterprise R API OML Notebooks with Apache Zeppelin on Autonomous Database OML4Spark Oracle R Advanced Analytics for Hadoop Oracle Data Miner Oracle SQL Developer extension Copyright © 2019 Oracle and/or its affiliates.
8. Data Scientists Business and Data Analysts DBA and IT Professionals Application / Dashboard Developers Executives OML empowers Enterprise Users Oracle Machine Learning Copyright © 2019 Oracle and/or its affiliates.
9. Data Scientists •Popular data science languages: Python, R, SQL •Augment with 3rd party packages •Scalability and performance •Automation-enhanced productivity •Greater enterprise collaboration •Integrate and analyze data across the enterprise Oracle Machine Learning Data Scientists Business and Data Analysts DBA and IT Professionals Application / Dashboard Developers Executives Copyright © 2019 Oracle and/or its affiliates.
10. Business and Data Analysts •Expand analytical tool set with ML •Enable non-ML experts with AutoML •Leverage domain knowledge for better results •Collaborate with Data Scientists and IT Oracle Machine Learning Data Scientists Business and Data Analysts DBA and IT Professionals Application / Dashboard Developers Executives Copyright © 2019 Oracle and/or its affiliates.
11. DBA and IT Professionals Oracle Machine Learning Data Scientists Business and Data Analysts DBA and IT Professionals Application / Dashboard Developers Executives •Even greater value from Oracle investment •Support scalability and performance •Simpler, streamlined infrastructure •Maintain data security, backup, recovery •Use SQL, expand to Python and R •Leverage Database and Big Data sources Copyright © 2019 Oracle and/or its affiliates.
12. Application and Dashboard Developers •Realize intelligent solutions faster through Oracle stack integration •Easily uptake data scientists’ R, Python, SQL scripts and rapidly deploy solutions •Embed ML in applications and dashboards using, e.g., SQL and REST APIs Data Scientists Business and Data Analysts DBA and IT Professionals Application / Dashboard Developers Executives Oracle Machine Learning Copyright © 2019 Oracle and/or its affiliates.
13. Executives •Benefit from world-class data management technology and support •Democratize ML across the enterprise to enable better data-driven decisions •Deploy solutions faster to realize ROI Data Scientists Business and Data Analysts DBA and IT Professionals Application / Dashboard Developers Executives Oracle Machine Learning Copyright © 2019 Oracle and/or its affiliates.
14. Cross-Platform Machine Learning Multiple user interfaces and APIs Deployed in cloud and on-premises From database to entire data management ecosystem Oracle Cloud SQL OML4R OML4Py REST OML4SQL SQL Developer Popular R IDEs Popular Python IDEs OML Notebooks User Interfaces, e.g. APIs Cloud or On-premises Reach broader Data Sources Oracle Object Storage Big Data Service (HDFS) NoSQL Databases Kafka Streams Amazon S3 Azure Blob Storage Oracle Database Data Lake OML4Spark Oracle Big Data SQL Copyright © 2019 Oracle and/or its affiliates. OCI Data Science OAC
15. CLASSIFICATION Naïve Bayes Logistic Regression (GLM) Decision Tree Random Forest Neural Network Support Vector Machine (SVM) Explicit Semantic Analysis CLUSTERING Hierarchical K-Means Hierarchical O-Cluster Expectation Maximization (EM) ANOMALY DETECTION One-Class SVM TIME SERIES Forecasting - Exponential Smoothing Includes popular models e.g. Holt-Winters with trends, seasonality, irregularity, missing data REGRESSION Linear Model Generalized Linear Model (GLM) Support Vector Machine (SVM) Stepwise Linear regression Neural Network LASSO ATTRIBUTE IMPORTANCE Minimum Description Length Principal Component Analysis (PCA) Unsupervised Pair-wise KL Div CUR decomposition for row & AI ASSOCIATION RULES A priori/ market basket PREDICTIVE QUERIES Predict, cluster, detect, features SQL ANALYTICS SQL Windows SQL Patterns SQL Aggregates FEATURE EXTRACTION Principal Comp Analysis (PCA) Non-negative Matrix Factorization Singular Value Decomposition (SVD) Explicit Semantic Analysis (ESA) TEXT MINING SUPPORT Algorithms support text columns Tokenization and theme extraction Explicit Semantic Analysis (ESA) for document similarity STATISTICAL FUNCTIONS Basic statistics: min, max, median, stdev, t-test, F-test, Pearson’s, Chi-Sq, ANOVA, etc. R AND PYTHON PACKAGES Third-party R and Python Packages through Embedded Execution Spark MLlib algorithm integration Oracle Machine Learning Algorithms and Analytics Copyright © 2019 Oracle and/or its affiliates.
16. Oracle Machine Learning Notebooks Collaborative UI Based on Apache Zeppelin Supports data scientists, data analysts, application developers, DBAs Easy sharing of notebooks and templates Permissions, versioning, and execution scheduling Included with Autonomous Database Automatically provisioned, managed, backed up In-database SQL algorithms and analytics functions Explore and prepare, build and evaluate models, score data, deploy solutions Soon to be augmented with Python and R Autonomous Database as a Data Science Platform Copyright © 2019 Oracle and/or its affiliates.
17. Oracle Machine Learning for SQL In-database, parallel, distributed algorithms ML models as first class database objects Export / import models across databases Batch and real-time scoring Explanatory predictive details Leverage ML across Oracle stack Empower SQL users with immediate access to ML in Oracle Database and Oracle Autonomous Database SQL Interfaces SQL*Plus SQLDeveloper … Oracle Autonomous Database OML Notebooks Oracle Database with OML Copyright © 2019 Oracle and/or its affiliates.
18. OML4SQL: Model Build and Real-time Prediction BEGIN DBMS_DATA_MINING.CREATE_MODEL( model_name => 'BUY_INSUR1', mining_function => dbms_data_mining.classification, data_table_name => 'CUST_INSUR_LTV', case_id_column_name => 'CUST_ID', target_column_name => 'BUY_INSURANCE', settings_table_name => 'CUST_INSUR_LTV_SET'); END; Simple SQL Syntax—Classification Model SELECT prediction_probability(BUY_INSUR1, 'Yes' USING 3500 as bank_funds, 825 as checking_amount, 400 as credit_balance, 22 as age, 'Married' as marital_status, 93 as MONEY_MONTLY_OVERDRAWN, 1 as house_ownership) FROM dual; Model build (PL/SQL) Real-time scoring (SQL query) Copyright © 2019 Oracle and/or its affiliates.
19. Oracle Data Miner User Interface SQL Developer Extension for Oracle Database Automates typical data science steps Easy to use drag-and- drop interface Analytical workflows quickly defined and shared Wide range of algorithms and data transformations Generate SQL code for immediate deployment Create analytical workflows – supports “Citizen Data Scientists” Copyright © 2019 Oracle and/or its affiliates.
20. Traditional Analytics and Data Source Interaction Access latency Paradigm shift: R/Python Æ Data Access Language Æ R/Python Memory limitation – data size, in-memory processing Single threaded Issues for backup, recovery, security Ad hoc production deployment Deployment Ad hoc cron job Data Source Flat Files extract / export read export load Data source connectivity packages Read/Write files using built-in tool capabilities ? Copyright © 2019 Oracle and/or its affiliates.
21. Oracle Machine Learning for R and Python Empower data scientists Oracle Database as HPC environment In-database parallel and distributed machine learning algorithms Manage scripts and objects in Oracle Database Integrate results into applications and dashboards Leverage open source 3rd party packages Key functional areas: Transparency Layer ML Algorithms Embedded Execution OML4Py automated machine learning Components of Oracle Database – R today, Python coming soon Both coming soon to Oracle Autonomous Database Database Server Machine Client SQL Interfaces SQL*Plus SQLDeveloper OML4Py OML4R Copyright © 2019 Oracle and/or its affiliates.
22. Transparency Layer Leverages proxy objects for database data: oml.DataFrame # Create table from Pandas DataFrame data DATA = oml.create(data, table = 'BOSTON') # Get proxy object to DB table boston DATA = oml.sync(table = 'BOSTON') Uses familiar Python syntax to manipulate database data Overloads Python functions translating functionality to SQL In-database performance – indexes, query optimization, parallelism, partitioning DATA.shape DATA.head() DATA.describe() DATA.std() DATA.skew() TRAIN, TEST = DATA.split() TRAIN.shape TEST.shape Copyright © 2019 Oracle and/or its affiliates.
23. In-database modeling using Support Vector Machine Parallel, Distributed Algorithms User tables Oracle Database from oml import svm # create proxy object ONTIME_S = oml.sync(table='ONTIME_S') # define model object settings = {'svms_outlier_rate' : 0.01} svm_mod = svm('anomaly_detection', svms_kernel_function = 'dbms_data_mining.svms_linear', **settings) # build anomaly detection model svm_mod = svm_mod.fit(x=ONTIME_S, y=None) # view model object svm_mod OML4Py Python Client Copyright © 2019 Oracle and/or its affiliates.
24. Embedded Execution User tables pyq*eval () interface extproc Oracle Database extproc # user-defined function using sklearn def build_lm(dat): from sklearn import linear_model lm = linear_model.LinearRegression() X = dat[['PETAL_WIDTH']] y = dat[['PETAL_LENGTH']] lm.fit(X, y) return lm # select column(s) for partitioning data index = oml.DataFrame(IRIS['SPECIES']) # invoke function in parallel on IRIS table mods = oml.group_apply(IRIS, index, func=build_lm, parallel=2) mods.pull().items() OML4Py Python Engine OML4Py Python Engine OML4Py Python Client Example of parallel execution for partitioned data flow using third party package Copyright © 2019 Oracle and/or its affiliates.
25. AutoML – new with OML4Py Auto Feature Selection – Reduce # of features by identifying most predictive – Improve performance and accuracy Increase data scientist productivity – reduce overall compute time Auto Model Selection Much faster than exhaustive search Auto Feature Selection >50% reduction in features AutoTune Significant score improvement ML Model Auto Model Selection – Identify in-database algorithm that achieves highest model quality – Find best model faster than with exhaustive search Auto Tune Hyperparameters – Significantly improve model accuracy – Avoid manual or exhaustive search techniques Copyright © 2019 Oracle and/or its affiliates. Enables non-expert users to leverage Machine Learning Data Table
26. Reduce # features by identifying most relevant Improve performance and accuracy Auto Feature Selection: examples OpenML dataset 40996 with 56K rows, 784 columns 0.5 0.55 0.6 0.65 0.7 0.75 0.8 0.85 0.9 0.95 1 784 309 Accuracy Prediction Accuracy +18% 60% reduction 1.3X time reduction to build SVM Gaussian model Copyright © 2019 Oracle and/or its affiliates.
27. Oracle Machine Learning for Spark (OML4Spark) supported by Oracle R Advanced Analytics for Hadoop
28. Oracle Machine Learning for Spark Leverage Spark 2 environment for powerful data preparation and machine learning Use data across range of Data Lake sources Achieve scalability and performance using full Hadoop cluster Parallel and distributed ML algorithms from native and Spark MLlib implementations R Language API Component to Oracle Big Data Connectors Java API HDFS | Hive | Spark DF | Impala | JDBC Sources BDA BDS DIY OML4Spark R Client Copyright © 2019 Oracle and/or its affiliates.
29. Oracle Machine Learning for Spark Transparency layer Proxy objects reference data from file system, HDFS, Hive, Impala, Spark DataFrame and JDBC sources Overloaded R functions translate functionality to native language, e.g., HiveQL for HIVE and Impala Users manipulate data via standard R syntax Parallel, distributed machine learning algorithms Scalability and performance leveraging full Hadoop cluster Spark-based custom LM, GLM, NN, K-Means plus Spark MLlib Use expressive R Formula specification Compute framework with custom R mappers/reducers Data-parallel and task-parallel execution Allows for open source CRAN packages run on Cluster Nodes R Language API Component to Oracle Big Data Connectors Copyright © 2019 Oracle and/or its affiliates. Java API HDFS | Hive | Spark DF | Impala | JDBC Sources BDA BDS DIY OML4Spark R Client
30. OML4Spark Performance Logistic Regression (GLM) Data fits in memory Up to 7x faster than Spark MLlib Data cannot fit memory Able to solve a 10B row model Benchmark environment ORAAH 2.8.0 Big Data Appliance X7-2 6 Nodes, 256GB of RAM per Node Formula: cancelled ~ distance + origin + dest + as.factor(month) + as.factor(year) + as.factor(dayofmonth) + as.factor(dayofweek) + as.factor(flightnum) 1 10 100 1,000 10,000 100K 1M 10M 100M 1B 10B Execution Time (seconds) Dataset Size (# rows) OML4Spark vs. Spark MLlib for GLM Logistic Regression OML4Spark MLlib Copyright © 2019 Oracle and/or its affiliates.
31. HCM Cloud Workforce Predictions CRM Sales Cloud Sales Prediction Retail GBU Customer Insights, Customer Segmentation Adaptive Intelligent Applications for Manufacturing Configure, Price, Quote Cloud Content and Experience Unstructured Data Analytics Integration Cloud Digital Process Automation Industry Data Models Communications, SNA, Utilities, Airlines, Retail, … EBS Spend Classification Organize spend into logical categories EBS Depot Repair Optimize speed, cost, quality of product repair, reuse, recycling Identity Management Adaptive Access Management FSGBU Analytical Applications Infrastructure Applications integrating OML Copyright © 2019 Oracle and/or its affiliates.
32. Oracle Integration Cloud (OIC) Digital Process Automation Help business users make better decisions by using recommendations from ML models Increase automation of human-centric approval workflows Used by Oracle SaaS process-centric apps PaaS service that exposes OML features Build models in ADB Deploy via OML Microservices Oracle Content and Experience (OCE) Improve Content Discoverability Search, organize content, reduce duplication Find relevant images/docs during content creation Automatic tagging and classification of images, videos, text Visual search Cloud-based content hub to drive omni-channel content management and accelerate experience delivery Leverages OML cognitive microservices Application platforms using OML Microservices Copyright © 2019 Oracle and/or its affiliates.
33. Oracle Machine Learning Roadmap Expanding Oracle’s investment in machine learning
34. Roadmap: OML Microservices Model Management Services Building and deploying OML models Model Monitoring of accuracy and prediction/predictor drift Model repository Store, version, compare ML models Cognitive Services Feature Extraction, Image and Text User-defined scripts deployment Python and R user-defined functions invoked via REST API REST APIs for application integration Currently available to internal Oracle Applications teams – GA coming soon Copyright © 2019 Oracle and/or its affiliates.
35. Sample of Microservices APIs Copyright © 2019 Oracle and/or its affiliates. Model Repository REST Model Deploy REST Cognitive Image REST Cognitive Text REST Model Management GET /models GET /{model name} GET /{model name}/{version} POST /{model name} POST /{model name}/{version} DELETE /{model name}/{version} Model Deployment GET /models GET /{uri} GET /{uri}/api POST /{uri} POST /{uri}/score DELETE /{uri} Cognitive Image POST /imageClassification POST /nsfw POST /objectDetection POST /faceDetection POST /imageSimilarity POST /faceSimilarity Cognitive Text POST /ner POST /topics POST /keywords POST /sentiment POST /summary POST /similarity
36. Roadmap: Algorithms for Database 20c eXtreme Gradient Boosting Trees (XGBoost) Classification, regression, ranking, survival analysis Highly popular and powerful algorithm MSET-SPRT Anomaly detection for sensors, IoT data sources “Multivariate State Estimation Technique” A non-linear, non-parametric anomaly detection ML technique Based on Oracle Labs algorithm Frequently requested algorithms Copyright © 2019 Oracle and/or its affiliates.
37. Roadmap: Expand Autonomous Database with Python and R OML Notebooks add support for Python and R Python and R scripts managed in-database Invoke from OML Notebooks, and REST or SQL APIs Deploy into SQL and Web applications easily Scalable Python and R execution Transparency layer-enabled database functionality In-database machine learning algorithms AutoML functionality via OML4Py OML4Py integrated with OCI Data Science Autonomous Database as a Data Science Platform DATA SCIENTISTS SQL Clients REST Applications $ SQL Copyright © 2019 Oracle and/or its affiliates.
38. Roadmap: OML AutoML User Interface Automate production and deployment of ML models Enhance Data Scientist productivity, user-experience Enable non-expert users to leverage ML Unify model deployment and monitoring Support model management Features Minimal user input: data, target Model leaderboard Model deployment in applications via REST endpoint Model monitoring: accuracy, prediction/predictor drift Cognitive features for processing image and text “Code-free” user interface supporting automated end-to-end machine learning Sample screen mock-up Copyright © 2019 Oracle and/or its affiliates.
39. Roadmap: OML4R and OML4Py Expose additional OML4SQL algorithms to Python and R Support for recent R and Python releases Enable Oracle Database standard integrated installation, patching, upgrade/downgrade Expand support for open source languages and ecosystems Copyright © 2019 Oracle and/or its affiliates.
40. Roadmap: OML4Spark Support advanced machine learning activities on Big Data Model management and cognitive image and text processing Model deployment and monitoring on Big Data (including Database models) Cloud-oriented packaging (containers, REST APIs) Enable OML4Py and OML4R for uniform experience across platforms Algorithms Neural Network gradient descent enhancements avoid over-fitting New native Support Vector Machine with linear and non-linear kernels New native k-Means and k-Mode clustering algorithms New cloud-based architecture with powerful Spark analytics Copyright © 2019 Oracle and/or its affiliates.
41. Enabling OML on GPUs Enable GPUs for in-database algorithms Replace MKL with cuBLAS Leverage GPUs for user-defined R and Python functions Include 3rd party packages leveraging GPUs, e.g., Tensorflow, Keras Support state-of-the-art ML processing, e.g., deep learning Augment OML Microservices for GPU processing – key for images Copyright © 2019 Oracle and/or its affiliates.
42. Oracle Machine Learning Key Attributes Copyright © 2019 Oracle and/or its affiliates. Automated Scalable Production-ready Increase productivity, Achieve enterprise goals, Innovate More
43. For more information… https://www.oracle.com/goto/machinelearning Copyright © 2019 Oracle and/or its affiliates.
44. Thank You Mark Hornick | mark.hornick@oracle.com Senior Director, Product Management Data Science and Machine Learning