Professional Documents
Culture Documents
Product names, designations, logos, and symbols may be trademarks or registered trademarks of their respective owners.
Information in this document is subject to change without notice and may contain
inaccuracies or typographical errors.
A large percentage of EIM data migration projects suffer cost overruns, delays, or complete failure
because their scope and complexity is often underestimated.
One of the primary reasons for this failure rate is the lack of a thorough understanding of the
project complexity during the early stages of project initiation and requirements analysis.
IT experience has shown that the project complexity is always connected to the following issues:
Therefore:
To reduce the risk of failure, organizations have to find very early solutions to mitigate the
complexity inherent in EIM data migration.
The key decision in any EIM data migration project is whether to deliver a custom software
solution or choose a proprietary ETL tool to mitigate the risk of failure.
The “Custom Software Solution” increases the project complexity and the risk of failure. For this
reason, it’s commonly used by organizations having a relevant experience in data migration
projects.
To meet the project expectations, the delivery of a custom software solution requires data
migration experts on staff.
Custom Solution
Time
The usage of proprietary ETL tools is often considered the solution to reduce the risk of project
failure.
Cost
ETL
Custom Solution
Time
ETL tools allow saving time but require a significant investment at the beginning of the project.
Furthermore:
ETL tools require specialized ETL developers.
EIM data migration process uses only a small percentage of the functionalities provided by ETL
tools.
As a result:
The usage of ETL tool is not profitable to perform solely the EIM data migration process.
EIM Migration Tool allows saving time and reduces the overall cost of the project.
In addition:
Does not require large license fees.
Ensures rapid and successful implementations.
Reduces the risks of failure.
Achieves the best migration performance.
EIM Migration
Cost
Tool
ETL
Custom
Solution
Time
EMT - EIM Migration Tool (EMT) is a Software Solution designed to reduce the complexity of large
scale Siebel EIM data migration projects.
EMT reduces the risks of failure and helps organizations to deliver high performance software
solutions for Siebel EIM data migration challenges.
Complex and cost-consuming tasks can be eliminated or reduced as shown in the following chart:
Project Cost Distribution
System requirements
estimation
0.5% Migration time Define Rollout plan
Performance estimation 1%
Tuning Data Design Data
0.5%
3% Analysis Migration strategies
Migration Dry-Run - 8% 8%
Data Cleansing
14% Development Data
Migration Software
Test Target System Engine
functionalities 8%
8% Design EIM
Data Mapping
6% Development
Saved Cost for Test Extraction processes
11% 3%
Development Data Design EIM
Validation processes configuration
Test Data Migration 6% file (ifb)
(50% Development) 1%
8% Development EIM Development EIM
Development Transformation
upload processes
Recovery processes processes
6%
3% 8%
EIM Migration Tool provides a development approach for data extraction, data validation and EIM
transformation processes. Therefore, the overall cost for development and test can be further
reduced.
EMT runs exclusively on Oracle © Database Server and provides the following features:
EMT is not only a Software Solution but wants to be a “Migration Guide” that addresses new
guidelines to achieve the best results for huge Siebel EIM migrations.
The “EMT Data Migration Approach” is a proven process that includes best practices to achieve
the best migration performances, accelerate development, minimize staffing requirements and
lower the total cost of the project.
The migration approach is based on the concepts of parallel computing (Amdahl’s and Gustafson
laws), data distribution, process pipelines and leveraging of system resources available. Different
data distribution functions (Constant, Stair and Bell) combined with the parallel processing are key
factors to guarantee the best performance and scalability of the whole migration process.
EMT is able to reach the best migration performances by using the highest level of parallelisms:
Multiple Process-Multiple Data
Moreover, to ensure the full advantage of parallel execution, specific solutions are implemented
to reduce data contention, deadlocks and database workload.
Using the configuration data model, EIM upload processes can be overlapped and
distributed over different Siebel application servers.
EIM processes can be executed in parallel mode using the batch numbers distribution and
multiple EIM tasks.
Specific EIM process configurations can be defined to avoid unique constraint violation
errors generated by parallel EIM tasks.
To achieve the best performance, Siebel EIM tables are always truncated and uploaded with
a subset of data not exceeding the threshold of maximum number of records. This limit
combined with the batch size and the parallel degree is used for EIM process tuning.
EIM results (IF_ROW_STAT) are automatically checked and reported to the source records.
Multistep EIM processes can be easily configured to upload Siebel entities with parent-root
relationship (Asset, Order Item, Quote Item ...).
EIM delete processes can be configured for recovery activities.
Using the table EMT_EIM_TIME_TRACKING, elapsed execution times and EIM performance
rates are available for tuning activities.
EMT provides a full automatic data migration process including automatic recovery processes
designed to have safe and easy recovery of migration errors.
EMT provides special procedures to check configuration errors that could generate unexpected
execution results. For each configuration error or warning detected, the check configuration
procedure explains the description of the problem and, if possible, the recovery solution.
Reduce
Mitigate Risk
Complexity
EMT
System High
Resources
Optimization Performances
Advantages
The advantages of using EMT are considerable. These are the top reasons for using our solution:
EMT breaks down the cost of design, development and test of the data migration engine including
the cost for writing and issuing complex documentation.
EIM upload processes are executed according to the process configuration and do not require any
development and test activities.
Recovery and Restart processes allow saving the costs for the design and development of complex
procedures required to rollback records erroneously uploaded in Siebel.
The migration methodology together with the automatisms provided by EMT are key factors to
reduce the complexity of EIM data migration projects.
Process configuration.
Development of data extraction, data validation and data transformation processes.
System configuration.
EMT requires configuration activities based on the design of the data migration mapping. The
following mapping rules must be defined:
Process Development.
Migration processes are executed by EMT using PL-SQL procedures having a common interface
(input parameters). Using a Java Class, migration processes can be also executed by operating
system commands or complex batch scripts.
As a result, PL-SQL procedures can be used as process wrapper to execute all kinds of migration
processes.
The template provides a development approach which allows achieving the best performances
during the parallel execution.
Development efforts are connected to the complexity of the functional requirements rather than
to the technology solutions of providing high performance data migration.
System configuration.
Except for Siebel base tables upload, EMT provides the capability to perform the execution of huge
data migrations after the installation. This feature aims not only to evaluate the performance of the
tool but to estimate the system requirements and the execution time of the real data migration.
Using EMT, database and system administrators can easily identify the system resources required
to execute the data migration achieving the performance needs.
EMT addresses organizations to deliver successful project implementation due to the capability of
providing a migration approach together with a simple method of development.
EMT guarantee high migration performances due to the capability to execute the performance test
after the installation and before starting the project.
Organizations able to define EIM data mappings as well as to develop simple extraction, data
validation and EIM transformation processes will be able to succeed in EIM data migration
projects reducing costs and resources.
As a result:
EMT reduces the risk of project failure.
Using the data distribution and the pipeline processing, multiple processes can be executed
concurrently to process different batch numbers.
Through the parallel processing more instances of the same process can be executed together to
implement the highest level of parallelism: Multiple Process-Multiple Data.
Specific EIM process configurations can be defined to avoid unique constraint violation errors
generated by parallel EIM tasks.
The migration process with lower performance rate leads the overall migration time.
EMT is specifically designed to perform EIM data migration based on Oracle database. “A Strong
restriction for huge advantages”.
EMT is able to provide specific solutions aimed to get the best benefits from the parallel process
execution by reducing data contention, deadlocks and database workload.
System resources can be easily distributed between migration processes by using the process
configuration data model rather than modifying the source code.
EMT provides a methodology specifically designed to reduce the complexity inherent in EIM data
migration projects as well as automatisms to simplify the operational steps required to execute the
migration process.
Therefore:
EMT will be the “kernel” of your data migration software developed according to a proven
development method and using a well known programming language such as PL-SQL.
EMT can be evaluated at no cost due to the capability to simulate the execution of complex
data migrations after the installation.
EMT can be easily configured to simulate the execution of your real data migration (except
for Siebel target tables upload) defining the amount of data, migration entities and
migration processes.
EMT provides the configuration version “GIC Test Utility Version” which is designed to test
the whole functionalities of the tool. This version represents a complete model of EMT
configuration and can be also used for self studying activities.
EMT provides a comprehensive user manual which covers the theoretical concepts as well
as all operational and functional aspects of working with the tool.
For this reason, EMT provides a simple ‘Command Line Interface’ based on the execution of its
stored procedures. The execution output is stored in the LOG table and shown on the terminal in
formatted text better visible with fixed-width fonts such as ‘Courier New’.
Using the Command Line Interface, EMT is able to show on the terminal performance reports,
migration status reports and simple dashboards to check the execution of the migration process.
The usage of the most common Oracle IDE (Interactive Development Environment) is high
recommended due to the automatic completion of the EMT commands including valuable
information such as arguments order, types and descriptions.
EMT can be used in the most demanding high performance migration architectures and, likewise,
multiple EMT instances can be installed on the same Oracle Server to upload different Siebel
schemas. Therefore, there are many Migration Architectures which can be used with the aim to
achieve the best performance or to save costs for development and test environments.
As a result:
Without large license fee, EMT helps organizations to reach the project expectations reducing the
delivery time, resources and the total cost of Siebel EIM data migration project.
Since the beginning of our mission we have built up a reputation for delivering high quality solutions in large
scale and business critical Siebel EIM integration.
For us EIM is not only one acronym but the aim of our mission: for this reason we are proud of our experience
in the major Siebel data migration projects in Italy, Bulgaria, Belgium and UK.
Our success is combination of passion and complete understanding of the infrastructure technology involved.
Outstanding results have made our company a reliable partner for the major system integrator companies in
Europe.
We established our company in 2007 in Sofia (Bulgaria) and we are now more than ever ready to meet
professionally the individual needs of our clients.