Analytics Architecture Road-map & Digital Transformation

In this digital age, companies are trying to transform themselves to transform their businesses so that they can engage their customers digitally. This brings up new opportunities and challenges for age-old businesses since they have to serve both their traditional customers as well as the new customers. More challenges are to nudge the customers to transition to the new engagement process to create an omnichannel experience. The opportunities are: you have better control over customer information; if you handle this carefully, you can personalize the customer experience; creating new business opportunities and increasing customer loyalty.

This abstract talks about step by step ways to create new capabilities, that will create a top-notch data-driven organization.

Transcript

1. Analytics Architecture Roadmap & Digital Transformation Dinesh Pillai
2. What is Digital Transformation?
4. Why Analytics Strategy Is Important To Digital Transformation? Make decisions more accurately Leverage new types of data: Social Media, IOT, Click Stream, Telemetry etc. Closing feedback loops and re-align decisions Democratize data analytics Monotonize Data Operational optimization and cost reduction Personalize customer experience
6. Why?
8. Factors to consider
20. Approach - Choices: BUILD USING PUBLIC CLOUD PAAS SYSTEMS BUY SINGLE ANALYTICS PLATFORM AS SAAS BUY MULTIPLE BEST IN CLASS SAAS AND INTEGRATE USING CLOUD BASED PAAS BUILD/BUY SOME COMPONENTS AND OUTSOURCE SOME
21. Transaction Layer Raw Data Layer Processing Layer Knowledge Layer Presentation Layer Data Catalog Reports & Dashboards Mobile Call Center ETL Master Data- Customer 360 Other Data relevant to Enterprise Real Time/Near Real Time Processing Batch Processing Storage Machine Learning Adhoc Analytics Telemetry OLTP Social Clickstream Data Governance Data Lake ELT Curated and Aggregated Data -Customer Segmentation Affinity Scores Enterprise DW
22. Road map • Identify transaction data sources • Setup Raw Data Layer • Create governance around raw data layer • Procure Data Pipeline tool • Ingest transaction data to raw data layer • Setup processing layer- Batch • Setup ad-hoc analytics capability • Move all personalization logic to processing layer-batch Phase 1 - Crawl •Setup Customer 360 UI and database •Setup Data Ingestion to C360 database •Create APIs/integration for CRUD operations in C360 •Setup segmentation logic •Setup integration to presentation layer systems Phase 2 – Walk •Setup processing layer (Real time) •Setup Machine Learning Platform •Create Machine Learning models •Setup Dashboards and reports •Setup bitmap indexes for scalable segmentation Phase 3 – Run
23. Capabilities & Business Goals • Capability: Data Lake • Capability: Data Analytics Platform • Capability: Data Pipeline • Capability: Adhoc Analytics • Personalization logic in new data platform • Off-load processes from Data Warehouse Phase 1 - Crawl •Capability: C360 System •Capability: Highly available database storing personalized info •Can store many millions of records •Segmentation logic in new data platform •Personalized experience in Web and Mobile Apps •More EDW offloads (Data and Process) Phase 2 – Walk •Capability: Near real time processing •Capability: Customer dashboards and real-time reporting •Capability: Machine learning •Capability: Highly scalable segmentation •Near real-time personalized experience •Faster response to customer behavior changes •Faster response to market •Automated personalized response to users •More EDW offload (Data and Process) Phase 3 – Run
24. Skills/Technology • Data Lake storage • Messaging pipeline • Hosting Platform • Programming languages • Kubernetes, Docker • Data Science Phase 1 - Crawl •Wide column db: •Web app development for C360 UI •API development for C360 •Personalization Phase 2 – Walk •Machine Learning: Tensorflow/SparkML •Dashboarding frameworks •Reporting: Hue, SQL, Excel, PDF •BitMap Index: Pilosa Phase 3 – Run
26. Credits: • Cloudera • SAP Analytics • Mainline Information Systems • Third Nature, Inc