Oracle Analytics Cloud – From Cloud Entry to Data Engineering to Data Science

Everybody has read about all the usual buzzwords endlessly. Yet how do these translate into what’s actually available in the products and how are they really being used? Let’s cut away the marketing nonsense and the empty buzzwords and GO to the cloud, DO data engineering and DO Machine Learning.

Transcript

1. www.dimensionality.ch @Nephentur freenode | obihackers slide 1 Oracle Analytics Cloud From Cloud Entry to Data Engineering to Data Science
2. www.dimensionality.ch @Nephentur freenode | obihackers slide 2 • Oracle ACE Director Business Analytics • Oracle Analytics since 2001 • Speaker at OpenWorld, KScope, User Groups and open-source conferences • Blogger on Analytics, DWH, Data Science http://dimensionality.ch • Telegram/IRC #obihackers moderator • ODC and OCCC community advocate • Trainer for Oracle University since 2006 Christian Berg
3. www.dimensionality.ch @Nephentur freenode | obihackers slide 3 Gianni Ceresa • Managing Director of DATAlysis GmbH (Switzerland) • Working with BI and EPM tools for more than 10 years • Oracle ACE • Blogger on gianniceresa.com • Full-time IRC / Telegram #obihackers resident • ODC (ex OTN) forums addict • Technology geek (or just geek in general)
4. 3 Membership Tiers • Oracle ACE Director • Oracle ACE • Oracle ACE Associate bit.ly/OracleACEProgram 500+ Technical Experts Helping Peers Globally Connect: Nominate yourself or someone you know: acenomination.oracle.com @oracleace Facebook.com/oracleaces oracle-ace_ww@oracle.com
5. www.dimensionality.ch @Nephentur freenode | obihackers slide 5 Oracle Analytics Cloud Overview
6. www.dimensionality.ch @Nephentur freenode | obihackers slide 6 Oracle Analytics Cloud Oracle’s complete suite of Platform Services (PaaS) for unified analytics in the cloud • Delivered entirely in the cloud: ‣ No infrastructure footprint ‣ Immediate scale up or down ‣ Simplified licensing • Several options to suit your needs: ‣ Oracle or customer managed ‣ 3 funcational editions
7. www.dimensionality.ch @Nephentur freenode | obihackers slide 7 Functionalities OAC supports every type of analytics workload • Classic enterprise BI: ‣ Analysis & dashboarding ‣ Published reporting ‣ Enterprise Performance Management • Modern departmental/personal discovery: ‣ Extended data mashup & modelling ‣ Data preparation, exploration & visualization ‣ Data science & machine learning
8. www.dimensionality.ch @Nephentur freenode | obihackers slide 8 • Similar User Experience to OBIEE 12c – Centrally maintained & governed – Semantic model remains key • Interactive Dashboards – Ideal for KPI measurement & monitoring – Guided navigation paths • BI Publisher – Highly formatted, burst outputs • Action Framework – Navigation actions – Scheduled agents Classic Enterprise Analytics
9. www.dimensionality.ch @Nephentur freenode | obihackers slide 9 • Data Preparation – Acquire data from multiple connections – Apply enrichments data prior to analysis – Define repeatable preparation flows • Data Visualization – Create visual insights rapidly – Construct narrated storyboards – Share findings • Machine Learning – Build & train ML models – Apply model to new data sets Modern Data Discovery and Data Science
10. www.dimensionality.ch @Nephentur freenode | obihackers slide 10 • Mobile Web & BI Mobile App – All DV projects will auto-render on mobile devices – The heritage mobile app supports all OAC content • Synopsis Mobile App – Automatic Excel/CSV ingestion & analysis – Extending to all DV supported sources • Day by Day – Included within Enterprise Edition – Search driven analytics – Voice recognition allows you to verablise questions – Embedded learning enables a tailored experience Mobile Capabilities
11. www.dimensionality.ch @Nephentur freenode | obihackers slide 11 Editions, Licenses and Shapes
12. www.dimensionality.ch @Nephentur freenode | obihackers slide 12 Service Options (pre 2019) Analytics Cloud Analytics Cloud Autonomous Analytics Cloud Autonomous Analytics Cloud Services managed by Oracle: Backup & Recovery Service Monitoring Patching & Upgrades Test & Production instances Based on Oracle Cloud Infrastructure (OCI) Services managed by You: Based on Oracle Cloud Infrastructure Classic Database apart and stand-alone Storage Container apart and stand-alone Patching done by you Full control down to the OS of the VM
13. www.dimensionality.ch @Nephentur freenode | obihackers slide 13 Service Options 2019++ Analytics Cloud Analytics Cloud Autonomous Analytics Cloud Autonomous Analytics Cloud Services managed by Oracle: Services managed by You: Analytics Cloud Classic (OACC) Analytics Cloud (OAC)
14. www.dimensionality.ch @Nephentur freenode | obihackers slide 14 OAC Cloud dashboard Analytics Cloud Classic (OACC) Analytics Cloud (OAC)
15. www.dimensionality.ch @Nephentur freenode | obihackers slide 15 Analytics Cloud (Ex Autonomous) • All managed by Oracle, so… – No “OBIEE-style” customizations – Possible to change few parameters (more expected to be added) – No access to logs except runtime logs – At the moment no Usage Tracking – Feels like proper «serverless» – Focus on consume and use rather than administer and manage.
16. www.dimensionality.ch @Nephentur freenode | obihackers slide 16 Three Edition Options Enterprise Edition Data Lake Edition Standard Edition Data Discovery Data Preparation What-If Planning Big Data Storage Data Transformation via Apache Spark Data Lake Connectivity Enterprise Analysis & Dashboarding Published Reporting Day by Day
17. www.dimensionality.ch @Nephentur freenode | obihackers slide 17 Two Purchasing Options Monthly Flex Monthly Flex Pay As You Go Pay As You Go Based on Universal Credits model No minimum tenure Payments made in arrears Based on consumption Suitable for: Rapid Prototyping Testing & Sampling Elastic Scalable Based on Universal Credits model 12 month minimum tenure Payments made in advance Unused credits are forfeited Suitable for: Predictable, production workloads Long running platforms
18. www.dimensionality.ch @Nephentur freenode | obihackers slide 18 Several Shape Options • OAC instances are provisioned in Oracle Compute Units (OCPU’s) shapes to satisfy different requirements • The shape can be altered after service creation – Scale up or down based on immediate need
19. www.dimensionality.ch @Nephentur freenode | obihackers slide 19 Shape implications Excel mafia
20. www.dimensionality.ch @Nephentur freenode | obihackers slide 20 Bring Your Own License (BYOL) • For existing, on-premises Oracle clients • Mapping rules apply – Roughly 1 Processor license = 2 OCPUs • Maintained through your annual support contract • Simplifies decision to move to the cloud: – Reduces an entry barrier to the cloud – Reduces the operating cost of using the cloud • Converted licenses are significantly cheaper!
21. www.dimensionality.ch @Nephentur freenode | obihackers slide 21 Oracle Universal Credit Pricing * As presented on https://cloud.oracle.com/en_US/ucpricing as at 08/10/2018
22. www.dimensionality.ch @Nephentur freenode | obihackers slide 22 Architectural options
23. www.dimensionality.ch @Nephentur freenode | obihackers slide 23 Pure Oracle Cloud • Simplest integration architecture: – Data held in Oracle Database Cloud Service (DBCS) – ETL via Oracle Data Integration Platform Cloud (DIPC) • Data acquisition from Cloud Applications: – BI Cloud Connector – Goldengate – OAC’s new Data Replication features • Data acquisition from on-premises applications: – Data Sync – APEX Data Loader – SQL Developer tools – Data Pump
24. www.dimensionality.ch @Nephentur freenode | obihackers slide 24 Hybrid on-premises and cloud • Database remains on-premises • Data access via Remote Data Connector – Runs on dedicated application server (WLS/Tomcat) – Secure connectivity via public/private SSL key – Supports Oracle, DB2, Teradata, SQL Server • Beware performance challenges – Potential latency due to network bandwidth – Check network capacity and test carefully
25. www.dimensionality.ch @Nephentur freenode | obihackers slide 25 Multi-Cloud • Commonly adopted cloud strategy – Spread investment across different clouds/vendors – Mix private and public cloud workloads – Use anything you have • Data Sets have a broad support for connectivity – Relational, Big Data, semi-structured & proprietary • Data Model supports fewer options (via RDC) – Oracle, DB2, Teradata, SQL Server • Data flows allow for «in-OAC ETL»
26. www.dimensionality.ch @Nephentur freenode | obihackers slide 26 Creating your instance
27. www.dimensionality.ch @Nephentur freenode | obihackers slide 27 Provisioning Example - OAC
28. www.dimensionality.ch @Nephentur freenode | obihackers slide 28
29. www.dimensionality.ch @Nephentur freenode | obihackers slide 29 Provisioning Example – OAC Choose Edition Choose Feature Set
30. www.dimensionality.ch @Nephentur freenode | obihackers slide 30 Provisioning Example - OAC
31. www.dimensionality.ch @Nephentur freenode | obihackers slide 31 Provisioning Example - OAC
32. www.dimensionality.ch @Nephentur freenode | obihackers slide 32 Provisioning Example - OAC
33. www.dimensionality.ch @Nephentur freenode | obihackers slide 33 Migrating to the cloud
34. www.dimensionality.ch @Nephentur freenode | obihackers slide 34 • Migrating to OAC is relatively straight-forward • Multiple starting points supported On-premises to cloud From BICS From BICS Create BAR File * Upload Based on Oracle Cloud Infrastructure Classic 11g 11g Run the Migration Tool Deploy Import Bundle to OAC Minimum OBIEE 11.1.1.7 12c 12c Create 12c BAR file Upload Snapshot to OAC or Manually upload Data Model Archive/Unarchive Web Catalog
35. www.dimensionality.ch @Nephentur freenode | obihackers slide 35 OAC-based utilities
36. www.dimensionality.ch @Nephentur freenode | obihackers slide 36 Managing your instance (aka “There still is administration”)
37. www.dimensionality.ch @Nephentur freenode | obihackers slide 37 • I know I said less management • Just because “cloud” doesn’t mean “no admin” • Enterprise aspects often forgotten in quick-win tools – Security – Lifecycle management – Migrations – etc Using OAC in the Enterprise
38. www.dimensionality.ch @Nephentur freenode | obihackers slide 38 Starting / stopping • Currently only possible via SR for OAC • Full control for OACC • Planned for near future release • Currently OAC keeps running
39. www.dimensionality.ch @Nephentur freenode | obihackers slide 39 Environment migration – Snapshots Custom select types of object to include in Snapshot Custom select types of object to include in Snapshot Snapshot includes everything or select custom content Snapshot includes everything or select custom content
40. www.dimensionality.ch @Nephentur freenode | obihackers slide 40 Replace Snapshot content only Replace Snapshot content only Replace everything Replace everything Replace select objects Replace select objects Environment restore
41. www.dimensionality.ch @Nephentur freenode | obihackers slide 41 Launch System Settings from Console Edit parameters values for your system and restart services Launch System Settings from Console Edit parameters values for your system and restart services Configurable system settings
42. www.dimensionality.ch @Nephentur freenode | obihackers slide 42 Catalog manager as part of OAC client install allows to connect in online mode to OAC services and generate reports Catalog manager as part of OAC client install allows to connect in online mode to OAC services and generate reports The URL should be of the following format for actual OCI pods: https://<hostname>:443/analytics-ws The URL should be of the following format for actual OCI pods: https://<hostname>:443/analytics-ws Development tools – Catalog Manager
43. www.dimensionality.ch @Nephentur freenode | obihackers slide 43 Development tools – Administration
44. www.dimensionality.ch @Nephentur freenode | obihackers slide 44 50 + available DSS REST API Calls in OAC 50 + available DSS REST API Calls in OAC …/datasetsvc/public/swagger.json Data engineering – DSS APIs
45. www.dimensionality.ch @Nephentur freenode | obihackers slide 45 Feature highlights
46. www.dimensionality.ch @Nephentur freenode | obihackers slide 46 Realtime visualization • “clever” charts – data-based, adaptive chart types • Extensible visualization palettes – Library of Oracle and 3rd party • Analytical functions at a button click • Visual grammar – Logical flow – Build like you express your need
47. www.dimensionality.ch @Nephentur freenode | obihackers slide 47 Realtime visualization
48. www.dimensionality.ch @Nephentur freenode | obihackers slide 48 Oracle Analytics library • “free beer” • Continuously updated • Everyone can submit https://www.oracle.com/solutions/business-analytics/data-visualization/library-overview.html
49. www.dimensionality.ch @Nephentur freenode | obihackers slide 49 Oracle Analytics Library
50. www.dimensionality.ch @Nephentur freenode | obihackers slide 50 Talk to your data – “Ask” • Natural language voice search – Metadata – Content – User-uploaded data • Auto-generates visualizations • Multi-platform – Browser, Desktop, Mobile, Alexa,… • Will be extended to Insights (advanced analytics)
51. www.dimensionality.ch @Nephentur freenode | obihackers slide 51 Talk to your data – “Ask”
52. www.dimensionality.ch @Nephentur freenode | obihackers slide 52 Embedded Advanced Analytics
53. www.dimensionality.ch @Nephentur freenode | obihackers slide 53 Augmented data engineering Identify Sensitive Data Knowledge Matching Predictive Algorithms Formatting Suggestions • Automatic suggestions • Data profiling • Pattern profiling • Data-flows become intelligent • See the result of all changes
54. www.dimensionality.ch @Nephentur freenode | obihackers slide 54 Augmented data engineering
55. www.dimensionality.ch @Nephentur freenode | obihackers slide 55 What’s New, What’s Hot
56. www.dimensionality.ch @Nephentur freenode | obihackers slide 56 A. Data Preparation 1. Recommendations – Transformations & Enrichments 2. Data Preparation Scripts B. Data Flows & Data Sources 3. Incremental Processing 4. Parameterized Sources & Output 5. Dataflow Branching Node 6. Function Shipping Calculations to BDC 7. Output Data Set Aggregation Control 8. Dataflow Status Inspector 9. Data Replication (New Sources & Targets) 10.Local Subject Area Data Set 11.Multiple ADWC Connections C. Data Visualizations 12.New Visualizations : Grid Heatmap, Correlation Matrix, Picto Charts, 100% Stacked Bar, Area 13.Maps - Multiple Data Layers 14.Maps - Dynamic Heatmap 15.Maps – Google & Baidu base maps 16.Tool Tip Grammar Support 17.Experience Enhancements • Value as % for Treemap & Sunburst • Auto Save • Zoom to Value range for Axis • Copy Data to Clipboard 18.Publish Event Action to External Portal D. Other 19.Data Set Replace 20.Explain Enhancements 21.Object Inspectors Consistency 22.Data Sets Permission-ing 23.Console Menu Reorganized 24.User Profile 25.Tabless Navigation 26.Data Set Storage Management 27.Search/Ask Improvements 28.Day by Day Improvements D. BI Publisher 29.BIP Improvements E. Essbase 30.Essbase Improvements OAC 18.3.3 aka 4.3
57. www.dimensionality.ch @Nephentur freenode | obihackers slide 57 A.Admin 1.Pod to Pod migration of selective objects 2.Configure System Settings & Restart services 3.Catalog Manager 4.DSS/Data Prep Public Rest APIs 5.Quick Start Templates B.Data Sources & Data Viz 6.Autonomous Transaction Processing & UX changes to ADW connection 7.Suppress row on/off, show duplicates D.BI Publisher 8. Bar File inclusion 9. Essbase POV Parameter Support D. Essbase 12.Essbase RDC connector 13.Oracle Autonomous Database support 14.Calc Tuple Support 15.Auto generate aggregate views 16.New Gallery templates 17.Start/stop ability from PSM UI for Oracle Managed 18.Smart View support for Ancestor On Top 19.Outline Support for Alias Tables in Web UI 20.Cube Designer - Formula Editor members tree 21.New Gallery Templates 22.… OAC 19.1.1 aka 5.1
58. www.dimensionality.ch @Nephentur freenode | obihackers slide 58 Just try it
59. www.dimensionality.ch @Nephentur freenode | obihackers slide 59 GDPR Graphs Analytics OAC Cloud Visualization Security Data Science Self-service