analytical report a life and health Insurance company should produce? How does your company produce that kind of analysis? Frequency? Reconciliation efforts? Slicing and dicing? Suppose you want to use data in a report that resides in different systems? Finding the Truth IT Puzzle BI History BI Key Ideas Applications
DW Many P&C clients Includes Earned Premium computation Is closed system Users can’t write reports Very Limited use A limited success Finding the Truth IT Puzzle BI History BI Key Ideas Applications
perspective, not a tool perspective Cleanses, stores and manages data Presents results for reporting and analysis Includes applications specific to insurance for enhanced analysis Should deal with status changes Has the end user in mind Most DW’s start as Marketing projects Most are unsuccessful Finding the Truth IT Puzzle BI History BI Key Ideas Applications
data Different calculations of the same item by different departments (e.g. unearned premium) Multiple departments producing reports that don’t agree requiring reconciliation Finding the Truth IT Puzzle BI History BI Key Ideas Applications
or limited by time Most of our metrics are around dates, status and events à Underwriting and issue process à Inforce à Claim à Exit Need a multistate temporal query tool that simultaneously queries around dates, durations, and events, Finding the Truth IT Puzzle BI History BI Key Ideas Applications
to a new bias à Rerun again, and again, and again à A diarrhea of reports Better approach à Pivot table query à Run it through specialized cubes à A repository of reports Finding the Truth IT Puzzle BI History BI Key Ideas Applications
done with our DW that we couldn’t have done with out it.” à It just would have been harder. à It just would have taken longer. à The opportunity cost can be fatal. How long do you want to wait to cut off a losing product? Finding the Truth IT Puzzle BI History BI Key Ideas Applications
à Closed Licensing fees Implementation Opportunity Costs Benefit Justification Finding the Truth IT Puzzle BI History BI Key Ideas Applications
Legacy system data à Single data source Clearly defined information and processes (Sarbanes-Oxley) Multiple areas working with the same view of the business Functional information and analysis Getting at the Truth Finding the Truth IT Puzzle BI History BI Key Ideas Applications
most information wins." - John D. Rockefeller Information should be: à Accurate à Consistent à Relevant à Timely How can you plan for this? Finding the Truth IT Puzzle BI History BI Key Ideas Applications
issued? Are premiums paid to date on a policy? Which agent sold the policy? What is the current policy value? Analytic What factors affect underwriting time? How did each product line (or product) contribute to profit last quarter? Which factors contribute to profit? Who are the most successful agents? Who asks what? Finding the Truth IT Puzzle BI History BI Key Ideas Applications
systems à Current, changing data DW/BI supports à Summarized queries à Consistent, heterogeneous data à Voluminous, historical, stable data Operating Operating Business Business Managing Managing Business Business Operational Processing vs. BI Finding the Truth IT Puzzle BI History BI Key Ideas Applications
addressed by a Business Intelligence (BI) system “a data infrastructure specifically designed for query, analysis and reporting” Includes: à Data cleansing à Data Storage à Application à Reporting Tools A relatively new category of system Finding the Truth IT Puzzle BI History BI Key Ideas Applications
IBM Mainstream DW books published First mainstream Pivot application: Excel 95 OLAP Defined by Dr Codd Large DB vendors release products MDX Finding the Truth IT Puzzle BI History BI Key Ideas Applications
data Consistent data Perform analysis quickly Analysis that was never possible previously Savings in time and resources Finding the Truth IT Puzzle BI History BI Key Ideas Applications
à Data Acquisition à Complete Metadata Contributing Factors à Business Sponsor Commitment à Senior Business Sponsorship à Alignment to Business Finding the Truth IT Puzzle BI History BI Key Ideas Applications
31% Somewhat successful: 25% Not very successful 7% Not sure yet 15% Does not apply 5% Finding the Truth IT Puzzle BI History BI Key Ideas Applications
but no plan 46% Have plan, but have not yet implemented 21% Have plan, and started to implement 16% Have implemented metadata 3% Finding the Truth IT Puzzle BI History BI Key Ideas Applications
director of IT) 13% Top corporate executive (CEO, CFO, COO) 35% Business unit leader (e.g., head of unit or division) 32% None 1% Executive council or committee 4% Other 1% IT program or project manager 5% Functional unit leader (e.g., head of sales) 9% Finding the Truth IT Puzzle BI History BI Key Ideas Applications
projects class themselves as successful à Only 3% have successfully implemented metadata Contributing Factors à Business Sponsor Commitment 52% à Senior Business Sponsorship 35% à Alignment to Business 28% Finding the Truth IT Puzzle BI History BI Key Ideas Applications
standard, intuitive framework that allows for high-performance access The measurement data is organized in a single table with a multipart key, called the fact table, and a set of smaller tables called dimension tables RI constraints in-place between the fact table and the dimension tables The other non-FK fields in the fact table are numeric, additive measures, e.g., sales $, counts, etc. Dimensions are generally descriptive, text fields So commonly used that many RDBMS have a specialized join technique called a “star” join which optimizes access Finding the Truth IT Puzzle BI History BI Key Ideas Dimensional Modeling Applications
a single dimension table Snowflake = normalized (FK constraint) tables Structures are always one-to-many up the hierarchy – they can be regular, ragged or parent- child, but always one-to-many à Facilitates rollups; drill down, etc. Finding the Truth IT Puzzle BI History BI Key Ideas Dimensional Modeling Applications
Report Quarter Report Month Report Date Company Id (PK) Company Statutory Company Company Attributes Issue Location (PK) State or Province Sales Area Country Issue Location Policy Id (PK) Product Cell Id (FK) Agent Id (FK) Report Date (FK) Company Id (FK) Issue Location (FK) Status (FK) Gender Issue Age Premium Reserve Benefit Amount Policy Fact Table Agent Id (PK) Name Address Gender Manager Region Agent Attributes Product Cell Id (PK) Product Product Description Product Type Benefit Type Premium Type Insurance Event Product Group Product Line Product Cell Attributes Status (PK) Status Group Status Finding the Truth IT Puzzle BI History BI Key Ideas Dimensional Modeling Applications
What are the advantages and disadvantages of this over the original star schema? Finding the Truth IT Puzzle BI History BI Key Ideas Dimensional Modeling Applications
is static or unchanging Benefits à Efficient Storage of data à Intuitive query building Finding the Truth IT Puzzle BI History BI Key Ideas Dimensional Modeling Applications
(PK) Report Year Band Report Year Report Quarter Report Month Report Date Company Id (PK) Company Statutory Company Company Attributes Issue Location (PK) State or Province Sales Area Country Issue Location Policy Id (PK) Product Cell Id (FK) Agent Id (FK) Report Date (FK) Company Id (FK) Issue Location (FK) Status (FK) Gender Issue Age Premium Reserve Benefit Amount Policy Fact Table Agent Id (PK) Name Address Gender Manager Region Agent Attributes Product Cell Id (PK) Product Product Description Product Type Benefit Type Premium Type Insurance Event Product Group Product Line Product Cell Attributes Status (PK) Status Group Status 1) Select Premium 2) Where report date = 2004-12 and Status = ‘Active’ Finding the Truth IT Puzzle BI History BI Key Ideas Dimensional Modeling Applications
Sample Schema select sum(f.Premium) as Premium from PolicyFactTable f join Status t on t.Status=f.Status Join ReportDate d on d.ReportDate = f.ReportDate where t.Status = 'Active' and d.ReportDate = '2004-12‘ Actual Schema select sum(f.AnnlzdPremium) as Premium from iwfAllPolDynamics f join PolDynamicsType t on t.PolDynamicsTypeKey=f.PolDynamicsTypeKey Join ReportDateMth d on d.ReportDateMthKey = f.ReportDateMthKey where t.PolDynamicsType = 'Active' and d.ReportDateMth = '2004-12' Finding the Truth IT Puzzle BI History BI Key Ideas Dimensional Modeling Applications
Syntax select p.Product, count(*) from PolicyFactTable f join Status t on t.Status=f.Status Join ReportDate d on d.ReportDate = f.ReportDate join ProductCellAttributes p on p.ProductCellID = f.ProductCellID where t.Status = 'Active' and d.ReportDate = '2004-12' Group by p.Product Order by p.Product Finding the Truth IT Puzzle BI History BI Key Ideas Dimensional Modeling Applications
allows reporting and query tools to make assumptions around à How data is presented, grouped, and navigated (i.e., slice ‘n pivot) à Browse dimensions (and hierarchies) independent of numeric data à Users are not locked into one data access route – drilldown and pivot Well-understood semantics for high-performance, i.e. aggregation Finding the Truth IT Puzzle BI History BI Key Ideas Dimensional Modeling Applications
dimensions West East South North Geography Q2 Q1 Q3 Q4 Time Life Health Annuity Seg Funds Product Finding the Truth IT Puzzle BI History BI Key Ideas Multidim’l Analysis Applications
Key Feature: Aggregations Policy Policy All LOB Type Product Policy ID Facts Facts … $1,003 135672 563601 $6,732 451236 563601 $4,567 135123 345623 Reserves Policy ID custID Highest Level Aggregation Highest Level Aggregation $145,212,301 All All Reserves Product Customer Intermediate Aggregation Intermediate Aggregation … $57,931,945 WOL678 US $23,914,730 IT452 Can Reserves Product Type CountryCode Subtotals at a certain level from every dimension Finding the Truth IT Puzzle BI History BI Key Ideas Multidim’l Analysis Applications
navigator (or very sophisticated query tools) Run-time query engine selects nearest aggregations Optimizing queries SQL MDX Query language Analyze which aggs best support query pattern Wizards (for simple design process)? Designing aggregations Materialized view with GROUP BY clauses Intrinsic to DB Aggregation Relational Multidimensional Finding the Truth IT Puzzle BI History BI Key Ideas Multidim’l Analysis Applications
Transform, Load Moving data from production systems to DW Checking data integrity Assigning surrogate key values Collecting data from disparate systems Reorganizing data Finding the Truth IT Puzzle BI History BI Key Ideas Data Management Applications
issue à Rewriting history versus maintaining history à Temporal dimensions solve this à Restatements à Do not to alter facts à What if you have to re-do a month of data? à Data lineage à Where does this number come from? Data cleansing Data standardization à Across various source systems à Surrogate keys help here too Finding the Truth IT Puzzle BI History BI Key Ideas Data Management Applications
in the DW Must manage multiple technologies at scale! Insurance is one of the most complex applications ⇒ Watch out retail applications are different from insurance Complex calculations (“wide queries”) à Experience studies are simple example Very large dimensions CrossJoins on large dims à Age and duration, for example Finding the Truth IT Puzzle BI History BI Key Ideas Scale Applications
price ‘sweet spot’ Not just storage à Load time à Query processing Key is in the design à Storage vs processing Finding the Truth IT Puzzle BI History BI Key Ideas Scale Applications
Mortality Premium Persistency Transition à Incidence/Termination Finding the Truth IT Puzzle BI History BI Key Ideas Applications Experience Studies
Dividend setting Assumption setting for management projections, Embedded Value, other reserves Improve performance Finding the Truth IT Puzzle BI History BI Key Ideas Applications Experience Studies
Life Year à Calendar Year à Policy Year Study Period Exposure Type à Initial à Central Dependent vs. Independent Rates Finding the Truth IT Puzzle BI History BI Key Ideas Applications Experience Studies
studies à Lapse vs Sales Persistency Be automatically notified of adverse experience the moment it occurs? Have the ability to produce new studies in 5 seconds? Slice and dice experience studies Tie results to financial impacts and demographic changes? Finding the Truth IT Puzzle BI History BI Key Ideas Applications Experience Studies
Warehouse Spreadsheets / Access Computational systems Integrated or Extract provider Finding the Truth IT Puzzle BI History BI Key Ideas Applications Experience Studies
exit dates and exposure à Based on current view of data Census Approach à Traditional approach for handling aggregate data Multi-state Approach à Based on true history of data Finding the Truth IT Puzzle BI History BI Key Ideas Applications Experience Studies
date, study dates and exit dates Group by age, duration and risk factors Pros à Intuitive Cons à Inflexible over time à Computationally intensive à Uses current attributes Finding the Truth IT Puzzle BI History BI Key Ideas Applications Experience Studies
Data intensive (data warehouse) Ultimate flexibility – true data, slice and dice Simplest calculation Population validation Finding the Truth IT Puzzle BI History BI Key Ideas Applications Experience Studies
Approach: Approx exposure at that time Multi-state: Exact exposure either way + ability to study Finding the Truth IT Puzzle BI History BI Key Ideas Applications Experience Studies
Census Approach: Calculate exposure depending on study Multi-state: Single exposure filtered based on event Finding the Truth IT Puzzle BI History BI Key Ideas Applications Experience Studies
demographics 9 9 Flexible time period 9 9 Precise exposure calculation Multi-state Census Direct Finding the Truth IT Puzzle BI History BI Key Ideas Applications Experience Studies
data Regression line fitting Data Mining à Cluster algorithms to define grouping à Predictive algorithms to manage experience Source of Earnings à Contingency sources should be consistent with experience Finding the Truth IT Puzzle BI History BI Key Ideas Applications Experience Studies
assumptions Can be based on statutory, GAAP or management reserves EBS is a management tool Related to experience studies and pricing profit signature Finding the Truth IT Puzzle BI History BI Key Ideas Applications Source of Earnings
à Uses projected actual Actual Business Actual Business Transaction File SOE Calcs Finding the Truth IT Puzzle BI History BI Key Ideas Applications Source of Earnings
Actual Events Data Warehouse Actual Experience Reserve Calcs SOE Analysis and Reporting Constantly Update Data Analysis of actual experience (not reserve model) BI approach explains actual earnings Finding the Truth IT Puzzle BI History BI Key Ideas Applications Source of Earnings
level, with a substantial degree of approximations. Approximations may not be understood Static – prevents analysis by product, sales office or demographic Different approaches by line of business Generally not divisible over time Finding the Truth IT Puzzle BI History BI Key Ideas Applications Source of Earnings
in later periods Illustrated with simple example à Mortality as expected à Withdrawals 50% of expected for 1st three quarters Expected values in Q4 based on artificial population Finding the Truth IT Puzzle BI History BI Key Ideas Applications Source of Earnings
98,000 100,000 102,000 Start Q1 Q2 Q3 Q4 expected actual Understatement of Inforce Finding the Truth IT Puzzle BI History BI Key Ideas Applications Source of Earnings
Q1 Q2 Q3 Q4 Actual Expected Mortality appears to be worse than expected due to calculation being based expected inforce Finding the Truth IT Puzzle BI History BI Key Ideas Applications Source of Earnings
month of issue Monthly sources accumulated using Fund return Flexible over time à yearly results are easily accumulated from quarterly results. Simple formula Reduces compounding and interaction Contingency sources are based on the immediate impact of the event Gives immediate impact of sales After the month of issue, policies are included in the “in-force” analysis of variations. Finding the Truth IT Puzzle BI History BI Key Ideas Applications Source of Earnings
Less accurate à May show business plan numbers Changing à More meaningful for decisions à Explains earnings! Finding the Truth IT Puzzle BI History BI Key Ideas Applications Source of Earnings
reserves and earnings allows: à Knowledge discovery with regard to profitability and performance by product, sales office or client segment à Can lead to successful management action Makes SOE a management tool Finding the Truth IT Puzzle BI History BI Key Ideas Applications Source of Earnings
X Total Earnings X X X Sales Impact X X X Basis Change X X X Contingency … X X X Transaction … X X X Investment Total Expected Experience Finding the Truth IT Puzzle BI History BI Key Ideas Applications Source of Earnings
including à Gross or net premium valuation à Statutory, GAAP, Management, Embedded Value Variations by line of business due to contingencies May vary components depending on application, but always consistent No approximations Finding the Truth IT Puzzle BI History BI Key Ideas Applications Source of Earnings
earnings exp’n Modify 1st var. from “act’l” to “exp’d” Subtract modified from initial exp’n Modify 2nd var. from “act’l” to “exp’d” Subtract modified from prior exp’n Continue through sources Final earnings = zero à mgmt earnings on mgmt reserves BI approach uses this to derive formulae Finding the Truth IT Puzzle BI History BI Key Ideas Applications Source of Earnings
res. – Exp’d interest on cash-flows + res. Life Insurance Mortality = -(Actual Strain – Expected Strain) Disablement = Actual Gain – Expected Gain à Gain = Reserve Released – Reserve Set Up ( )( ) ∑ − − + = Initial Beginners m a a a m i i E P V 0 ( ) ( ) − − − − = ∑ ∑ Initial Beginners m m Initial Deaths m V S q V S 0 , 1 0 , 1 ( ) ( ) ∑ ∑ − − − = Healthy Beginners m D m H m Healthy ts Disablemen m D m H V V d V V 0 , 1 0 , 1 0 , 1 0 , 1 Finding the Truth IT Puzzle BI History BI Key Ideas Applications Source of Earnings
Earnings No approximations necessary Known approximations due to data availability à Magnitude can be estimated à Modeling variation Also acts as an error-check on the calculation à Or an order-check on approximations Finding the Truth IT Puzzle BI History BI Key Ideas Applications Source of Earnings
components Integrate with other reports Flexible over time Analysis by product, sales office, demographic etc Continuous approach EBS can be an effective management tool Finding the Truth IT Puzzle BI History BI Key Ideas Applications Source of Earnings