Controlling Your Data

Transcript

1. Society of Actuaries Annual Meeting and Exhibit New York, 14 November 2005 30 PD – Controlling Your Data Technologies (and what makes them successful) Kevin Pledge President and CEO Insight Decision Solutions
2. Society of Actuaries Annual Meeting and Exhibit New York, 14 November 2005 Kevin Pledge – kpledge@insightdecision.com 30 PD – Controlling Your Data Technology Requirements  Deliver “good” data  Verifiable data  Single Version of Truth  Data standards  Handle large volumes of data  Move data efficiently  Manage multiple sources of data  Security / Access to data  Testing data  Verifiable process Requirements Strategies Insurance Data ETL Insurance Challenges Success Factors Summary Further Information
3. Society of Actuaries Annual Meeting and Exhibit New York, 14 November 2005 Kevin Pledge – kpledge@insightdecision.com 30 PD – Controlling Your Data Data Management Strategies  Consolidation  Federation  Propagation  Semantic Systems – the future? Extract, Transform and Load (ETL) Enterprise Content Management (ECM) Centralized Data Enterprise Application Integration (EAI) Real-Time ETL (RT-ETL) Enterprise Data Replication (EDR) Distributed Data Enterprise Information Integration (EII) Virtual Business View Requirements Strategies Insurance Data ETL Insurance Challenges Success Factors Summary Further Information
4. Society of Actuaries Annual Meeting and Exhibit New York, 14 November 2005 Kevin Pledge – kpledge@insightdecision.com 30 PD – Controlling Your Data Extract, Transform and Load (ETL) Enterprise Content Management (ECM) Centralized Data Consolidation Strengths  Performance  Transformations  Scalability  Security  Control  Off-line Weaknesses  Not real time Requirements Strategies Insurance Data ETL Insurance Challenges Success Factors Summary Further Information
5. Society of Actuaries Annual Meeting and Exhibit New York, 14 November 2005 Kevin Pledge – kpledge@insightdecision.com 30 PD – Controlling Your Data Strengths  Real-time Weaknesses  Low volume  Data quality  Data consistency  Performance impact Federation Enterprise Information Integration (EII) Virtual Business View Requirements Strategies Insurance Data ETL Insurance Challenges Success Factors Summary Further Information
6. Society of Actuaries Annual Meeting and Exhibit New York, 14 November 2005 Kevin Pledge – kpledge@insightdecision.com 30 PD – Controlling Your Data Strengths  Can be real-time Weaknesses  Performance Enterprise Application Integration (EAI) Real-Time ETL (RT-ETL) Enterprise Data Replication (EDR) Distributed Data Propagation Requirements Strategies Insurance Data ETL Insurance Challenges Success Factors Summary Further Information
7. Society of Actuaries Annual Meeting and Exhibit New York, 14 November 2005 Kevin Pledge – kpledge@insightdecision.com 30 PD – Controlling Your Data Insurance Data  Multiple source systems  Real time not critical  Complex business rules  Relationships over time  Multiple granularities  Consolidation (ETL) Requirements Strategies Insurance Data ETL Insurance Challenges Success Factors Summary Further Information
8. Society of Actuaries Annual Meeting and Exhibit New York, 14 November 2005 Kevin Pledge – kpledge@insightdecision.com 30 PD – Controlling Your Data ETL Products  Informatica  Microsoft Integration Services  IBM Information Integrator  Oracle ETL  SAS Data Integration & ETL  Cognos DecisionStream  Data Junction  Data Mirror  Kalido  Certive The products referenced do not represent a definitive list, nor it is intended to be a recommendation or endorsement of any particular product. Requirements Strategies Insurance Data ETL Insurance Challenges Success Factors Summary Further Information
9. Society of Actuaries Annual Meeting and Exhibit New York, 14 November 2005 Kevin Pledge – kpledge@insightdecision.com 30 PD – Controlling Your Data What does ETL look like? Requirements Strategies Insurance Data ETL Insurance Challenges Success Factors Summary Further Information
10. Society of Actuaries Annual Meeting and Exhibit New York, 14 November 2005 Kevin Pledge – kpledge@insightdecision.com 30 PD – Controlling Your Data Data Consolidation – ETL  ETL manages data flows  Transforms data  Metadata  Technical metadata  Business metadata  No ‘silver bullet’ solutions  Niche vendors or DB vendor?  Market consolidation Requirements Strategies Insurance Data ETL Insurance Challenges Success Factors Summary Further Information
11. Society of Actuaries Annual Meeting and Exhibit New York, 14 November 2005 Kevin Pledge – kpledge@insightdecision.com 30 PD – Controlling Your Data Typical Insurance Data Challenges  Unstructured data, e.g. spreadsheets  Functional silos  Multiple heavily modified administration systems  Legacy data  Complex business rules So what makes ETL successful? Requirements Strategies Insurance Data ETL Insurance Challenges Success Factors Summary Further Information
12. Society of Actuaries Annual Meeting and Exhibit New York, 14 November 2005 Kevin Pledge – kpledge@insightdecision.com 30 PD – Controlling Your Data Success or Failure Success  Target data model  Business involvement  Embed ongoing audit checks  Don’t rely solely on these checks Failure  Target data model  Focus on technology  Belief in SVT Requirements Strategies Insurance Data ETL Insurance Challenges Success Factors Summary Further Information
13. Society of Actuaries Annual Meeting and Exhibit New York, 14 November 2005 Kevin Pledge – kpledge@insightdecision.com 30 PD – Controlling Your Data In Summary  ETL may help consolidate data, but not ‘silver bullet’ solution  Solution only as good as data model  Data management is not a technology solution Requirements Strategies Insurance Data ETL Insurance Challenges Success Factors Summary Further Information
14. Society of Actuaries Annual Meeting and Exhibit New York, 14 November 2005 Kevin Pledge – kpledge@insightdecision.com 30 PD – Controlling Your Data Further Information  kpledge@insightdecision.com  www.insightdecision.com Requirements Strategies Insurance Data ETL Insurance Challenges Success Factors Summary Further Information