Professional Documents
Culture Documents
Intelligence Solutions
All rights reserved. Printed in India. No part of this publication may be reproduced, stored in a retrieval
system, or transmitted, in any form or by any means, electronic, mechanical, photocopying, or otherwise,
without the prior written permission of the publisher, SAS Institute Inc.
Restricted Rights Legend. Software and accompanying documentation are provided to the U.S.
government in a transaction subject to the Federal Acquisition Regulations with Restricted Rights. Use,
duplication, or disclosure of the software by the government is subject to restrictions as set forth in FAR
52.227-19 Commercial Computer Software-Restricted Rights (June 1987). The Contractor/Licensor is
SAS Institute Inc., located at SAS Campus Drive, Cary, North Carolina 27513.
SAS Institute Inc., SAS Campus Drive, Cary, North Carolina 27513.
Contents
Preface ........................................................................................................................................................... v
Purpose ...................................................................................................................................................... v
Who Should Read This Document........................................................................................................... v
How to Use This Document...................................................................................................................... v
Conventions ............................................................................................................................................... v
Part I. Acquisition ETL Guidelines ........................................................................................................ 1
1. Introduction ............................................................................................................................................... 2
1.1 Prerequisites ........................................................................................................................................ 2
1.2 Detail Data Store Foundation ............................................................................................................. 2
2. Guidelines for Acquisition ETL to DDS .................................................................................................. 3
2.1 Define Scope of Data Load into DDS................................................................................................. 3
2.2 Identify and Locate Data from Source Systems............................................................................... 4
2.3 Extract, Cleanse, Transform, and Consolidate Source Data in Staging Area............................... 6
2.4 Load the Reference Tables................................................................................................................. 6
2.5 Load and Validate Data into the DDS ................................................................................................ 7
Part II. IIS DDS Table Categories.......................................................................................................... 17
1. Introduction ............................................................................................................................................. 18
1.1 Main IIS DDS Tables .......................................................................................................................... 18
1.2 IIS DDS Write Back or Results Tables............................................................................................. 19
1.3 IIS DDS Reference Tables................................................................................................................. 20
Part III. Load Sequence of IIS DDS........................................................................................................ 21
1. Load Sequence for DDS ......................................................................................................................... 22
Part IV. Customizable Parameters......................................................................................................... 31
1. Customizable Parameter Details ........................................................................................................... 32
Figures
Figure 1 Sources and Stages Involved in Loading the DDS .............................................................3
Figure 2 Table Level ACORD Mapping.............................................................................................5
Figure 3 Column Level ACORD Mapping .........................................................................................5
Figure 4 Branch Office Hierarchy Example .....................................................................................18
Tables
Table 1 Input: A Sample Individual Customer Table with One Year of History .............................14
Table 2 Individual Output Table ...............................................................................................15
Table 3 INTERNAL_ORG Table ......................................................................................................19
Table 4 INTERNAL_ORG_ASSOC Table .........................................................................................19
Table 5 IIS Write Back Tables........................................................................................................19
Table 6 Category 5 Tables .............................................................................................................20
Table 7 Example of Data in the REFERENCE_MASTER Table ...................................................20
Table 8 Example of Data in the REFERENCE_DETAIL table: ......................................................20
Table 9 Load Sequence for DDS Load (General Insurance).........................................................22
Table 10 Load Sequence for DDS Load (Life Insurance) ................................................................26
Table 11 Customizable Parameters.................................................................................................32
SAS® Insurance IS 3.2 Release B 1.0 © 2006 SAS Institute Inc. iii
Usage Guide for DDS
Preface
Purpose
Insurance Intelligence Solutions contains best practice, industry-specific data, analytical models, and
templates. This document of the Insurance Intelligence Solutions provides acquisition ETL guidelines
for the Insurance DDS and the possible sources, load sequence, and priorities of tables.
For details regarding the DDS, refer to the DDS Data Dictionary and the Data Model.
Conventions
The typographic and usage conventions of this guide are as follows:
Item Usage
Italics Italicized font is used within text for the values of fields that are typed in/entered
or selected in the UI. Italicized font is also used for book titles, new terminology,
emphasis, and values of configuration options.
Bold Bold font is used within text for key names, key combinations, key sequences,
menu items, and commands on menus, buttons, and various screen elements.
Monospace Monospace font is used within text for sample code and code listings, API and
language elements (such as function names and class names), file names,
path names, directory names, table names, column names, macro names and
HTML tags.
MonoItalics MonoItalics font is used within text to indicate variable placeholders in angular
brackets.
Note: Text in a gray box indicates a point of particular interest or that special notice should be
given to the text that follows.
1. Introduction
This section introduces the Detail Data Store (DDS) as the foundation for IIS implementation.
1.1 Prerequisites
The following are prerequisites for loading data into the DDS.
• The Insurance DDS provides a single data target for loading data.
For example, assume that a customer first implements Customer Segmentation for Insurance,
and during the implementation populates the tables like CUSTOMER,
GENERAL_INSURANCE_POLICY, etc. Following the Customer Segmentation project, the
customer implements Customer Retention for Insurance. Since the CUSTOMER and
GENERAL_INSURANCE_POLICY tables have already been populated with cleansed data, the
customer can use the same tables in loading the Retention mart. Moreover, since the definition of
the DDS tables is already known, the ETL from the DDS to the Solutions data marts will be pre-
built.
• It ensures a “single version of truth” across solutions.
For example, the definition of “customer” should be the same for SAS Marketing Automation for
Insurance as well as for SAS Customer Retention for Insurance. Populating a single definition of
a customer table ensures that both of these solutions have a “single version of the truth.”
• Data created from SAS solutions can be stored in a central location and shared with other
solutions.
For example, the lapse scores from Customer Retention for Insurance are written back to the
DDS and shared with the Campaign Management for Insurance Solution.
The following sections define the recommended process to load data into the DDS. Since this is a bespoke
development, it may be customized as deemed necessary.
1. Identify data structures in the DDS that need to be loaded to meet the business needs of the bank or
financial institution.
2. Identify and locate source systems for the data by mapping DDS data and source system data.
3. Extract, cleanse, and transform the source system files and consolidate them into the staging area
designed to load data into the DDS. The data here is validated to ensure that all
interdependencies/relationships in the DDS are defined.
4. Load reference tables that store code values required in the DDS using history management tool.
5. Load data into the DDS using history management tool and retained surrogate key approach.
Please refer to the Solution to DDS Map document to map it to the Solution area of your interest.
Rather than indiscriminately populating everything, this document aims at identifying some priorities for
populating the DDS.
• Category 1: Mandatory tables for IIS. These are the tables, which are used across all the solution
areas.
• Category 2: Mandatory tables for one or more solution areas but not all.
• Category 3: Optional for solution areas or not required. These tables provide additional
information such as bureau information that provides more advanced analysis but is not
mandatory for the core functioning of the Solution Areas in IIS.
• Category 4: Output Tables. In IIS these are the Analytical Results tables. No data acquisition ETL
processes are required for these tables. These tables will be populated by the output from the
analytical models.
• Category 5: Reference tables.
The DDS tables have been classified according to these categories in Part II of this document, titled IIS
DDS Table Categories.
• Underwriting systems
• Claims management systems
• Customer management systems—marketing/CRM
• Agency management systems
• Accounting systems
• Product management systems
• Transactional systems—systems where the transactions like premium collection, agency
payment, claim payment information is stored
• Analytical model and scoring system
1. DDS Table Level: ACORD object or aggregate is mapped to the DDS table.
2. DDS Column Level: ACORD attribute to which the DDS column matches.
The mappings are expressed in ERwin Detail Data Store Diagram as User Defined Property (UDP)
at both the table level and column level. It also specifies the segment of the insurance industry.
Examples of these are shown below.
If the DDS table, which is to be populated, contains any column name ending with _CD, these
column names will have a corresponding reference table with the same column name. These
reference tables must also be populated. The table definition should clearly specify the data that is
required to populate the table.
These tables fall under Category 5 in the listing of IIS DDS table categories. Please refer to Part II of
this document, titled IIS DDS Table Categories for more information on IIS DDS categorization.
The load sequence for the reference table is provided in Part III of this document, titled Load
Sequence of IIS DDS.
The following consideration should be taken while loading the reference tables:
• Different source systems may use different codes to represent the same value.
• Codes as required by the DDS may not be defined.
• The column width of existing code columns may not match the width defined in the DDS.
To ensure that the code values are stored correctly and are as expected by the solutions that will
work off the DDS, a detailed exercise of code definition that includes business users, IT staff of the
bank or financial institution, and Insurance solution consultants, needs to be carried out. The
required codes can then be loaded using the supplied History Management macros so that the
versioning date columns are given suitable values or can be loaded manually. To know more on how
to load these tables using history management macros please refer to the History Management tool
documentation, which is included with the IIS 3.2 DDS Pack.
Once the code values have been finalized, the customizable parameter file has to be modified. This
file holds all assumed code values in macro variables along with other date values required for load.
These macro variables are used to categorize data and populate the subsequent marts above the
DDS. This file needs to be modified to contain the code present in the reference tables of DDS.
Please ensure that the parameter file and actual code values in table are in synchronization. The
parameter file is provided with the IIS DDS Pack Installation. The name of file is
IIS_customize_para.sas. A list of global parameters with their assumed value is provided in
Part IV of this document, titled Customizable Parameters.
There are a few important columns in the DDS tables, which play an important role in the DDS Load
and tracking history. These are described below.
The following table provides the structure for the reference table to generate the “RKs” for each of
the DDS tables. To generate the “RKs”, reference tables would be have to be created for the tables
that have the “Ref Table Required” value as “Y”.
Ref Table
Table Name Surrogate Key Reference Table Columns
Required
AIR_SPORT_DETAILS N LIFE_STYLE_ACTIVITY_
RK
ALARM_DETAILS Y ALARM_RK ALARM_TYPE_CD,
SUBJECT_OF_INSURANCE_RK
ANNUITY_POLICY_DETAILS N POLICY_RK
ANNUITY_PRODUCT N INSURANCE_PRODUCT
_RK
ANTI_THEFT_DEVICE N - NA -
AUTO_LOSS_DETAILS Y AUTO_LOSS_RK CLAIM_UNIT_RK, VEHICLE_NO
AVIATION_DETAILS N LIFE_STYLE_ACTIVITY_
RK
BATHROOM_TYPE_DETAILS Y BATHROOM_TYPE_RK BATHROOM_TYPE_CD
BLDG_IMPROVEMENT_DETAILS N SUBJECT_OF_INSURAN
CE_RK
BLDG_OCCUPANCY_DETAILS N SUBJECT_OF_INSURAN
CE_RK
BLDG_PROTECTION_DETAILS N SUBJECT_OF_INSURAN
CE_RK
Ref Table
Table Name Surrogate Key Reference Table Columns
Required
BUILTINS_DETAILS Y BUILTINS_RK BUILTINS_CD, DWELL_RK
CAMPAIGN Y CAMPAIGN_RK CAMPAIGN_CD
CARDIAC_MURMUR_DETAILS N - NA -
CATASTROPHE Y CATASTROPHE_RK CATASTROPHE_CD
CLAIM_ADMINISTRATOR Y CLAIM_ADMINISTRATO CLAIM_ADMINISTRATOR_NO
R_RK
CLAIM_DRIVER_DETAILS N - NA -
CLAIM_INJURED_DETAILS N - NA -
CLAIM_ITEM Y CLAIM_ITEM_RK CLAIM_ITEM_NO,
CLAIM_SERVICE_PROVIDER_RK
CLAIM_SERVICE_PROVIDER Y CLAIM_SERVICE_PROVI CLAIM_SERVICE_PROVIDER_ID
DER_RK
CLAIM_TRANS N - NA -
CLAIM_TRANS_LINE_ITEM N - NA -
CLAIM_UNIT Y CLAIM_UNIT_RK CLAIM_RK, UOE_RK
CLAIM_UNIT_X_ADMINISTRATOR N - NA -
CLAIM_UNIT_X_SERVICE_PROVID N - NA -
ER
CLAIMANT Y CLAIMANT_RK CLAIMANT_ID
CLIMBING_DETAILS N LIFE_STYLE_ACTIVITY_
RK
COINSURANCE_DETAILS N - NA -
COL_INDEX N - NA -
COMML_AUTO_SECTION N POLICY_SECTION_RK
COMML_DRIVER_DETAILS N - NA -
COMML_NON_OWNED_DETAILS Y NON_OWNED_CLASS_R NON_OWNED_CLASS_CD,
K POLICY_SECTION_RK
COMML_PROP_CONSTR_DETAILS Y COMML_PROP_CONST CONSTR_CD,
R_RK SUBJECT_OF_INSURANCE_RK
COMML_PROP_DETAILS Y SUBJECT_OF_INSURAN POLICY_SECTION_RK,
CE_RK LOCATION_RK,
SUBJECT_OF_INSURANCE_CD
COMML_PROP_SECTION N POLICY_SECTION_RK
COMML_VEHICLE_DETAILS N VEHICLE_RK
COMMUNICATION N - NA -
COMPETITION_DETAILS N LIFE_STYLE_ACTIVITY_
RK
COMPLAINT N - NA -
CONTRACT_ITEM Y CONTRACT_ITEM_RK SERIAL_NO,
SUBJECT_OF_INSURANCE_RK
COST_CENTER Y COST_CENTER_RK COST_CENTER_ID
COST_CENTER_ASSOC N - NA -
COVERAGE Y COVERAGE_RK COVERAGE_CD
COVERAGE_DETAILS Y COVERAGE_RK COVERAGE_NO
COVERAGE_OPTIONS_BENEFITS Y OPTION_RK PRODUCT_CD, COVERAGE_RK
COVERED_PERILS N - NA -
CREDIT_SCORE_DETAILS N -NA-
Ref Table
Table Name Surrogate Key Reference Table Columns
Required
CREDIT_SURCHARGE N CREDIT_SURCHARGE_ CREDIT_SURCHARGE_CD,
RK UOE_RK
CRIME_DETAILS N SUBJECT_OF_INSURAN
CE_RK
CRIMINAL_CONVICTION_DETAILS Y CRIME_TYPE_RK CRIME_TYPE_CD, INSURED_RK
CUSTOMER Y CUSTOMER_RK CUSTOMER_ID
CUSTOMER_COMMUNICATION N - NA -
CUSTOMER_SURVEY N - NA -
DECK_DETAILS Y DECK_RK DECK_ID, DWELL_RK
DEDUCTIBLE Y DEDUCTIBLE_RK DEDUCTIBLE_TYPE_CD, UOE_RK
DIVE_PURPOSE_DETAILS N LIFE_STYLE_ACTIVITY_
RK
DRIVER Y DRIVER_RK DRIVER_NO
DRIVER_HISTORY N - NA -
DRIVER_VEHICLE_DETAILS N - NA -
DWELL_DETAILS Y DWELL_RK DWELL_ID,
SUBJECT_OF_INSURANCE_RK
EMPLOYEE Y EMPLOYEE_RK EMPLOYEE_ID
EVENT N - NA -
EXTERNAL_ORG Y EXTERNAL_ORG_RK EXTERNAL_ORG_REFERENCE_N
O
EXTERNAL_ORG_ADDRESS Y ORG_ADDRESS_RK ADDRESS_TYPE_CD,
EXTERNAL_ORG_RK
EXTERNAL_ORG_ASSOC N - NA -
FAMILY_ILLNESS_DETAILS Y FAMILY_ILLNESS_RK FULL_NM, INSURED_RK
FEES Y FEE_RK INSURANCE_PRODUCT_RK,
FEE_TYPE_CD
FLEET_DETAILS Y FLEET_RK FLEET_ID
FOREIGN_TRAVEL_DETAILS N - NA -
GARAGE_TYPE_DETAILS Y GARAGE_TYPE_RK GARAGE_TYPE_CD, DWELL_RK
GENERAL_APPLN_DETAILS Y APPLICATION_RK APPLICATION_NO
GENERAL_INSURANCE_CLAIM Y CLAIM_RK INSURANCE_CLAIM_NO,
POLICY_RK
GENERAL_INSURANCE_POLICY Y POLICY_RK ORIGINAL_POLICY_NO
GENERAL_INSURANCE_PRODUCT Y INSURANCE_PRODUCT INSURANCE_PRODUCT_CD
_RK
GENERAL_POLICY_TRANS N - NA -
GENERAL_POLICY_TRANS_LINE_I N - NA -
TEM
GENERAL_PRODUCT_CATEGORY Y PRODUCT_CATEGORY_ PRODUCT_CATEGORY_CD
RK
GENERAL_UNIT_OF_EXPOSURE Y UOE_RK SUBJECT_OF_INSURANCE_RK,
PRODUCT_COVERAGE_RK
GL_ACCOUNT N - NA -
GL_ACCOUNT_ASSOC N - NA -
GL_ACCOUNT_BALANCE N - NA -
GL_JRNL N - NA -
Ref Table
Table Name Surrogate Key Reference Table Columns
Required
GL_JRNL_DETAILS N - NA -
GLASS_SIGN_TYPE_DETAILS Y SCHEDULE_TYPE_RK SCHEDULE_TYPE_CD,
SUBJECT_OF_INSURANCE_RK
HEATING_UNIT_DETAILS Y HEATING_UNIT_RK HEATING_UNIT_ID, DWELL_RK
INCIDENT_DETAILS Y INCIDENT_RK INCIDENT_TYPE_CD, LOSS_DT,
LOSS_TM
INCOME_OPTIONS Y INCOME_OPTION_RK INCOME_OPTION_CD,
INCOME_PAYOUT_RK
INCOME_PAYOUT_DETAILS Y INCOME_PAYOUT_RK PRODUCT_CD,
INSURANCE_PRODUCT_RK
INDIVIDUAL N INDIVIDUAL_RK
INDIVIDUAL_ADDRESS Y INDIVIDUAL_ADDRESS_ ADDRESS_TYPE_CD,
RK INDIVIDUAL_RK
INDIVIDUAL_ASSOC N - NA -
INSURANCE_POLICY_RESTRICTIO Y RESTRICTION_RK RESTRICTION_CD, POLICY_RK
NS
INTERIOR_FINISH_DETAILS Y INTR_FINISH_RK INTR_FINISH_ID, DWELL_RK
INTERNAL_ORG Y INTERNAL_ORG_RK INTERNAL_ORG_REFERENCE_NO
INTERNAL_ORG_ASSOC N - NA -
INVENTORY_DETAILS N SUBJECT_OF_INSURAN
CE_RK
INVESTMENT_DETAILS N POLICY_RK
INVESTMENT_PRODUCT Y INVESTMENT_PRODUC INVESTMENT_PRODUCT_CD,
T_RK INSURANCE_PRODUCT_RK
ITEM_CATEGORY Y ITEM_CATEGORY_RK ITEM_CATEGORY_CD
ITEM_CATEGORY_ASSOC N - NA -
ITEM_DETAILS N - NA -
LEASE_DETAILS N SUBJECT_OF_INSURAN
CE_RK
LIFE_APPLN_DETAILS Y APPLICATION_RK APPLICATION_NO
LIFE_INSURANCE_CLAIM Y CLAIM_RK CLAIM_REFERENCE_NO
LIFE_INSURANCE_POLICY Y POLICY_RK POLICY_NO
LIFE_INSURANCE_PRODUCT Y INSURANCE_PRODUCT PRODUCT_CD
_RK
LIFE_INSURANCE_TRANS N - NA -
LIFE_POLICY_DETAILS N POLICY_RK
LIFE_PRODUCT N INSURANCE_PRODUCT
_RK
LIFE_RISK Y INSURED_RK INSURED_ID
LIFE_STYLE_DETAILS Y LIFE_STYLE_ACTIVITY_ LIFE_STYLE_ACTIVITY_TYPE_CD,
RK INSURED_RK
LIFE_UNIT_OF_EXPOSURE Y UOE_RK COVERAGE_RIDER_RK,
INSURED_RK
LIMIT Y LIMIT_RK UOE_RK, LIMIT_APPLIES_TO_CD
LINE_OF_BUSINESS Y LOB_RK LOB_CD
LINE_OF_BUSINESS_ASSOC N - NA -
LOAN Y LOAN_RK LOAN_NO
LOCATION Y LOCATION_RK LOCATION_ID
Ref Table
Table Name Surrogate Key Reference Table Columns
Required
MEDICAL_CONDITION_DETAILS Y CONDITION_TYPE_RK CONDITION_TYPE_CD,
INSURED_RK
MEDICAL_EXAM_DETAILS N - NA -
MEDICAL_PREVENTION_DETAILS Y TEST_TYPE_RK TEST_TYPE_CD, INSURED_RK
MEDICAL_TREATMENT_DETAILS Y TREATMENT_TYPE_RK TREATMENT_TYPE_CD,
CONDITION_TYPE_RK
MILITARY_EXP_DETAILS N INSURED_RK
MONEY_DETAILS N SUBJECT_OF_INSURAN
CE_RK
PAYEE Y PAYEE_RK PAYEE_ID
PAYOUT Y PAYOUT_RK PAYOUT_CD, POLICY_RK
PERIL N - NA -
PERS_ACCIDENT_SECTION N POLICY_SECTION_RK
PERS_ACCIDENT_SECTION_DETA Y INSURED_RK INSURED_ID
ILS
PERS_AUTO_SECTION N POLICY_SECTION_RK
PERS_DRIVER_DETAILS N DRIVER_RK
PERS_PROP_CONSTR_DETAILS Y PERS_PROP_CONSTR_ CONSTR_CD, DWELL_RK
RK
PERS_PROP_SECTION N POLICY_SECTION_RK
PERS_VEHICLE_DETAILS N VEHICLE_RK
PHYSICIAN Y PHYSICIAN_RK PHYSICIAN_ID
POLICY_SECTION Y POLICY_SECTION_RK POLICY_RK,
PRODUCT_SECTION_RK
PORCH_TYPE_DETAILS Y PORCH_TYPE_RK PORCH_TYPE_CD, DWELL_RK
PRESCRIPTION_DRUG_DETAILS Y PRESCRIPTION_DRUG_ PRESCRIPTION_DRUG_TYPE_CD,
RK INSURED_RK
PRODUCER Y PRODUCER_RK PRODUCER_ID
PRODUCER_LICENSE N - NA -
PRODUCER_TARGETS N - NA -
PRODUCER_TRANS N - NA -
PRODUCER_TRANS_LINE_ITEM N - NA -
PRODUCER_X_INTERNAL_ORG N - NA -
PRODUCER_X_UOE N - NA -
PRODUCT_COVERAGE Y PRODUCT_COVERAGE_ PRODUCT_COVERAGE_CD
RK
PRODUCT_FEATURES Y FEATURE_RK FEATURE_CD,
INSURANCE_PRODUCT_RK
PRODUCT_SECTION N PRODUCT_SECTION_R
K
PROFIT_CENTER Y PROFIT_CENTER_RK PROFIT_CENTER_ID
PROFIT_CENTER_ASSOC N - NA -
PROP_LOSS_DETAILS Y PROPERTY_LOSS_RK CLAIM_UNIT_RK,
SUBJECT_OF_INSURANCE_RK
RACING_DETAILS N LIFE_STYLE_ACTIVITY_
RK
REINSURANCE_CARRIER Y REINSURER_RK REINSURER_CARRIER_CD
Ref Table
Table Name Surrogate Key Reference Table Columns
Required
REINSURANCE_DETAILS Y TREATY_RK CEDENTS_TREATY_ID
REP_GRP Y REP_GRP_RK REP_GRP_CD, SECTION_RK
REP_GRP_ASSOC N - NA -
RESERVES_ESTIMATES N - NA -
RESPONSE N - NA -
SAFE_VAULT_DETAILS Y SAFE_RK SAFE_NO,
SUBJECT_OF_INSURANCE_RK
SALVAGE_DETAILS N - NA -
SECTION Y SECTION_RK SECTION_CD
SECURITY_DETAILS N SUBJECT_OF_INSURAN
CE_RK
SERVICED_TERMINAL_DETAILS N - NA -
SPECIALTY_ROOM_DETAILS Y SPECIALITY_ROOM_RK SPECIALITY_ROOM_CD,
DWELL_RK
SUB_ACCOUNT Y SUB_ACCOUNT_RK SUB_ACCOUNT_ID
SUB_ACCOUNT_AMOUNTS N - NA -
SUBS_USAGE_DETAILS Y SUBSTANCE_TYPE_RK SUBSTANCE_TYPE_CD,
INSURED_RK
SUBSTRUCTURE_TYPE_DETAILS Y SUBSTRUCTURE_TYPE SUBSTRUCTURE_TYPE_CD,
_RK DWELL_RK
SUPER_ANNUATION_DETAILS N POLICY_RK
SURVEY N - NA -
SURVEY_ANSWER N - NA -
SURVEY_QUESTION N - NA -
SWIMMING_POOL_DETAILS Y SWIMMING_POOL_RK SWIMMING_POOL_NO,
SUBJECT_OF_INSURANCE_RK
TARIFF_DETAILS N - NA -
TRUCKERS_TERMINAL N - NA -
UNDERWATER_DIVING_DETAILS N LIFE_STYLE_ACTIVITY_
RK
UW_CLASS_DETAILS Y UW_CLASS_RK UW_CLASS_CD, COVERAGE_RK
VEHICLE Y VEHICLE_RK VEH_IDENTIFICATION_NO
VEHICLE_ACCESSORIES N VEHICLE_RK
VIOLATION_DETAILS Y VIOLATION_RK VIOLATION_TYPE_CD,
INSURED_RK
YOUNG_DRIVER_DETAILS N DRIVER_RK
• Business Timestamps – This is the value that should normally be used. Using the business
processing date timestamps as VALID_FROM_DTTM will help in cases of initial load and also
from a perspective of reconciling with the source system figures.
• DDS load DateTime – not recommended.
• ETL extract DateTime – not recommended.
PROCESSED_DTTM denotes the last time the record was updated by the data administrator for
unusual updates, such as error correction and data patching, that do not version the row. If the
record does not have unusual updates, set the value to the DateTime stamp when the record was
loaded in the warehouse.
The minimum history required for the data in the DDS tables is dependant on the solution specific
history requirement as well as on the amount of historical data available in the source system.
Some examples of the historical data requirement for the solutions that will be implemented are
given below.
• The recommended history for a reasonably accurate analytical model is 3 complete years.
• For campaign management in IIS, there is no specific minimum history required in the DDS.
The solution can initially be used even with current information. Solution capabilities can be
significantly enhanced with up to 24 months of history.
• Similarly, for the Customer Base Reporting, Claims Reporting, Product Performance
Reporting and Agency Management Solutions, history requirements depend on the specific
reporting requirements.
Usually five to six years of history can be kept in the current warehouse and the rest can be backed
up on tapes.
A history management tool is provided to load the DDS from the staging area. To understand more
about the usage of this history management macro please refer to the History Management tool
documentation included with the IIS 3.2 DDS Pack.
The sequence to load the DDS table is provided in Part III of this document, titled Load Sequence of
IIS DDS.
Initial Load
During initial load, the process of extracting the data from source systems to staging area will be
similar to the above, but will contain complete history instead of only the latest change. The
History Management macros allow the initial load of history spanning over years with some
special control parameters and assumptions. Please refer to the History Management macros
documentation for details regarding implementation.
A simple example of loading a Customer Table in IIS DDS from a sample Customer Input Table
in staging is explained. It also shows an example to call the history management macro.
Step 1
Table 1 Input: A Sample Individual Customer Table with One Year of History
Customer
NAME ADDRESS GENDER_CD RECORD_DATE
Input Table
AP1001 Sam 32, Palm Grove, Hill Range, Male 1-Jan-03
Singapore.
AP1002 Terry 35, Palm Grove, Singapore. Male 4-Jan-03
AP1001 Sam #18-02, Block 35, Tampines Male 5-May-03
North Street Singapore.
AP1001 Sam #02-05, Mandarin Gardens, East Male 7-Jul-03
Coast Road, Singapore.
AP1001 Sam #04-123, Block 2, Lavender Male 9-Oct-03
Street, Singapore.
In the above table, the customer named Sam has changed his address four times in the year
2003. The RECORD_DATE (critical for initial load which is business_dttm) actually represents a
date when the OLTP system tracked his change of address (that is, the date when they enter this
record in OLTP system).
Step 2
Perform initial load of 2003 to DDS on 01Jan2004.
Assume that you are loading all of this one year’s data into Customer table of the DDS.
The history management tool will use the Business_Dttm to populate the Valid_From_Dttm
and Valid_To_Dttm dates in the warehouse.
%update_with_history(
history_table = Customer,
update_table = Customer,
business_key = customer_id,
surrogate_key = customer_rk,
business_dttm = record_date,
versioning_base = BUSINESS_DTTM,
load_run_dttm = 01jan2004:00:00:00
);
Step 3
Output table Customer with Retain Surrogate Key Approach.
Please see the change in value of Valid_From_Dttm and Valid_To_Dttm and the retained
surrogate key Customer_Rk, which has been added.
PROCESSED_DTTM
VALID_TO_DTTM
CUSTOMER_RK
CUSTOMER_ID
GENDER_CD
ADDRESS
NAME
1 AP1001 Sam 32, Palm Grove, Hill Male 01JAN2003:00: 04MAY2003:23: 1-Jan-
Range, Singapore. 00:00 59:59 04
2 AP1002 Terry 35, Palm Grove, Male 04JAN2003:00: 31DEC4747:00: 1-Jan-
Singapore. 00:00 00:00 04
1 AP1001 Sam #18-02, Block 35, Male 05MAY2003:00: 06JUL2003:23: 1-Jan-
Tampines North 00:00 59:59 04
Street Singapore.
1 AP1001 Sam #02-05, Mandarin Male 07JUL2003:00: 08OCT2003:23: 1-Jan-
Gardens, East Coast 00:00 59:59 04
Road, Singapore.
1 AP1001 Sam #04-123, Block 2, Male 09OCT2003:00: 01DEC2003:23: 1-Jan-
Lavender Street, 00:00 59:59 04
Singapore.
1 AP1001 Sam #05-00 Astona Park, Male 02DEC2003:00: 31DEC4747:00: 1-Jan-
Kembangan, Bedok, 00:00 00:00 04
Singapore.
Step 4
Following this, all other tables related to the customers can be loaded in a similar fashion. If any
child table contains customer_rk as foreign key, then it will use one more macro, namely,
<map_business_to_surrogate> in the history management tool to generate the foreign keys
in that child table.
Regular Load
Once the initial data is in, the load frequency will become atomized and regular. The regularity
can be daily/weekly/monthly depending upon the solution requirements and data availability.
During regular load, the staging area will be populated with the CDC (change data capture)
principle, that is, with only the latest changes.
The History Management tool can be used as explained for the initial loads except few changes
in the parameters.
1. Introduction
This section provides the categorization listing for all the IIS DDS tables. The tables in the IIS DDS can be
broadly categorized into the following:
• Main IIS DDS Tables: These are the tables that will be used across multiple solution areas. To
find the tables that are required for implementing a solution area, please refer to the Solution to
DDS Map document.
• IIS DDS Write Back or Results Tables
• Reference Tables
The IIS DDS also supports any required load frequency. The load frequency for different tables may
differ, but it is important to ensure that data within the DDS remains consistent. For example, to avoid
the situation of policies without agents, the policy information should not be loaded without loading
agent information. The load frequency is generally business driven and depends on the business
expectation from solutions and reports that source data from the DDS.
ORG5
ORG3 ORG4
ORG1 ORG2
The REFERENCE_MASTER table holds all the details about the columns that have reference values,
for example, GENDER_CD, STD_OCCUPATION_CD, etc.
The REFERENCE_DETAIL table would have the details for the columns in terms of their code values
and description.
NOTE: REFERENCE_MASTER and REFERENCE_DETAIL tables are pre-populated and provided with
this DDS pack with dummy values for codes. REFERENCE_MASTER table includes all code columns from
DDS along with SAS format name for each. These formats are applied on cubes in various solutions.
The REFERENCE_DETAIL table contains _cd values for codes and their descriptions. It is often
necessary to establish the final codes and their descriptions across the enterprise. For example, across all
departments of an insurer, the transaction_type_cd values of payment, withdrawal, etc., need to be
agreed upon. Often code harmonization across departments is necessary as they view business from
different perspectives. Also, if different departments use different systems then the codes differ across
those systems. The reference tables are populated once codes and their descriptions are established
across the enterprise. The code values change very rarely and normally only the latest values are kept.
The data for these tables can sometimes come from operational systems. In other cases, they are
prepared by consultants themselves in consultation with the client.
The loading of the DDS must follow a recommended sequence in order to take care of all the table
dependencies. Based on the inter-table load dependency, the following sequence is recommended. In
each wave, the load for all the tables in the wave can happen simultaneously; however, you cannot
proceed to load any table in the next wave without completing the load for all the tables in the previous
wave, that is, the load must follow an ascending sequence of waves.
Wave 1
PRODUCER
REINSURANCE_CARRIER
SURVEY
Wave 2
CAMPAIGN
COVERAGE
CUSTOMER_SURVEY
EMPLOYEE
EXTERNAL_ORG_ASSOC
GENERAL_INSURANCE_PRODUCT
GL_ACCOUNT_ASSOC
GL_ACCOUNT_BALANCE
INDIVIDUAL_ASSOC
INTERNAL_ORG_ASSOC
LINE_OF_BUSINESS_ASSOC
PRODUCER_LICENSE
PRODUCER_TARGETS
PRODUCER_X_INTERNAL_ORG
RESERVES_ESTIMATES
SECTION
SURVEY_QUESTION
Wave 3
COMMUNICATION
COST_CENTER
PERIL
PRODUCT_SECTION
PROFIT_CENTER
REP_GRP
SURVEY_ANSWER
Wave 4
COST_CENTER_ASSOC
CUSTOMER_COMMUNICATION
PRODUCT_COVERAGE
PROFIT_CENTER_ASSOC
REP_GRP_ASSOC
Wave 5
GENERAL_APPLN_DETAILS
GENERAL_INSURANCE_POLICY
RESPONSE
Wave 6
COINSURANCE_DETAILS
COINSURANCE_DETAILS
COMML_AUTO_SECTION
COMML_PROP_SECTION
CREDIT_SCORE_DETAILS
GENERAL_POLICY_TRANS
GENERAL_POLICY_TRANS_LINE_ITEM
LOCATION
PERS_ACCIDENT_SECTION
PERS_AUTO_SECTION
PERS_PROP_SECTION
POLICY_SECTION
Wave 7
COMML_NON_OWNED_DETAILS
COMML_PROP_DETAILS
DRIVER
DWELL_DETAILS
FLEET_DETAILS
GL_JRNL
GL_JRNL_DETAILS
ITEM_DETAILS
PERS_ACCIDENT_SECTION_DETAILS
SERVICED_TERMINAL_DETAILS
TRUCKERS_TERMINAL
VEHICLE
Wave 8
ALARM_DETAILS
ANTI_THEFT_DEVICE
BATHROOM_TYPE_DETAILS
BLDG_IMPROVEMENT_DETAILS
BLDG_OCCUPANCY_DETAILS
Wave 8
BLDG_PROTECTION_DETAILS
BUILTINS_DETAILS
COMML_DRIVER_DETAILS
COMML_PROP_CONSTR_DETAILS
COMML_VEHICLE_DETAILS
CONTRACT_ITEM
CRIME_DETAILS
DECK_DETAILS
DRIVER_VEHICLE_DETAILS
GARAGE_TYPE_DETAILS
GENERAL_UNIT_OF_EXPOSURE
GLASS_SIGN_TYPE_DETAILS
HEATING_UNIT_DETAILS
INTERIOR_FINISH_DETAILS
INVENTORY_DETAILS
LEASE_DETAILS
MONEY_DETAILS
PERS_DRIVER_DETAILS
PERS_PROP_CONSTR_DETAILS
PERS_VEHICLE_DETAILS
PORCH_TYPE_DETAILS
SAFE_VAULT_DETAILS
SECURITY_DETAILS
SPECIALTY_ROOM_DETAILS
SUBSTRUCTURE_TYPE_DETAILS
SWIMMING_POOL_DETAILS
VEHICLE_ACCESSORIES
Wave 9
CATASTROPHE
COMPLAINT
COVERED_PERILS
CREDIT_SURCHARGE
DEDUCTIBLE
DRIVER_HISTORY
GENERAL_INSURANCE_CLAIM
INCIDENT_DETAILS
LIMIT
Wave 9
PRODUCER_TRANS
PRODUCER_TRANS_LINE_ITEM
PRODUCER_X_UOE
REINSURANCE_DETAILS
TARIFF_DETAILS
YOUNG_DRIVER_DETAILS
Wave 10
CLAIM_TRANS
CLAIM_TRANS_LINE_ITEM
CLAIM_UNIT
ITEM_CATEGORY
ITEM_CATEGORY_ASSOC
CLAIM_TRANS
Wave 11
AUTO_LOSS_DETAILS
CLAIM_DRIVER_DETAILS
CLAIM_INJURED_DETAILS
CLAIM_UNIT_X_ADMINISTRATOR
CLAIM_UNIT_X_SERVICE_PROVIDER
PROP_LOSS_DETAILS
SALVAGE_DETAILS
Wave 12
CLAIM_ITEM
Wave 1
INTERNAL_ORG
LIFE_INSURANCE_PRODUCT
LINE_OF_BUSINESS
PHYSICIAN
PRODUCER
REINSURANCE_CARRIER
SURVEY
Wave 2
ANNUITY_PRODUCT
CAMPAIGN
CUSTOMER_SURVEY
EMPLOYEE
EXTERNAL_ORG_ASSOC
FEES
GL_ACCOUNT_ASSOC
GL_ACCOUNT_BALANCE
INDIVIDUAL_ASSOC
INTERNAL_ORG_ASSOC
INVESTMENT_PRODUCT
LIFE_APPLN_DETAILS
LIFE_PRODUCT
LINE_OF_BUSINESS_ASSOC
PRODUCER_LICENSE
PRODUCER_TARGETS
PRODUCER_X_INTERNAL_ORG
RESERVES_ESTIMATES
SURVEY_QUESTION
Wave 3
COMMUNICATION
COST_CENTER
COVERAGE_DETAILS
INCOME_PAYOUT_DETAILS
LIFE_RISK
PRODUCT_FEATURES
PROFIT_CENTER
SURVEY_ANSWER
Wave 4
COL_INDEX
COST_CENTER_ASSOC
COVERAGE_OPTIONS_BENEFITS
CRIMINAL_CONVICTION_DETAILS
CUSTOMER_COMMUNICATION
FAMILY_ILLNESS_DETAILS
FOREIGN_TRAVEL_DETAILS
INCOME_OPTIONS
LIFE_STYLE_DETAILS
MEDICAL_CONDITION_DETAILS
MEDICAL_EXAM_DETAILS
MEDICAL_PREVENTION_DETAILS
MILITARY_EXP_DETAILS
PRESCIPTION_DRUG_DETAILS
PROFIT_CENTER_ASSOC
SUBS_USAGE_DETAILS
UW_CLASS_DETAILS
VIOLATION_DETAILS
Wave 5
AIR_SPORT_DETAILS
AVIATION_DETAILS
CARDIAC_MURMUR_DETAILS
CLIMBING_DETAILS
COMPETITION_DETAILS
DIVE_PURPOSE_DETAILS
MEDICAL_TREATMENT_DETAILS
RACING_DETAILS
RESPONSE
UNDERWATER_DIVING_DETAILS
Wave 6
ANNUITY_POLICY_DETAILS
INVESTMENT_DETAILS
LIFE_INSURANCE_POLICY
LIFE_POLICY_DETAILS
Wave 7
INSURANCE_POLICY_RESTRICTIONS
LIFE_UNIT_OF_EXPOSURE
LOAN
Wave 8
CLAIM_UNIT
COMPLAINT
LIFE_INSURANCE_CLAIM
PAYEE
PAYOUT
PRODUCER_X_UOE
REINSURANCE_DETAILS
SUB_ACCOUNT
SUB_ACCOUNT_AMOUNTS
SUPER_ANNUATION_DETAILS
Wave 9
CLAIM_TRANS
CLAIM_TRANS_LINE_ITEM
CLAIM_UNIT_X_ADMINISTRATOR
CLAIM_UNIT_X_SERVICE_PROVIDER
LIFE_INSURANCE_TRANS
PRODUCER_TRANS
PRODUCER_TRANS_LINE_ITEM
Wave 10
GL_JRNL
GL_JRNL_DETAILS