You are on page 1of 15

EIM Migration Tool©

The alternative solution for Siebel© EIM data migration challenges

Solution Overview – Ver. 1.0

© 2010 Gecob It Consulting Ltd.

Product names, designations, logos, and symbols may be trademarks or registered trademarks of their respective owners.
Information in this document is subject to change without notice and may contain
inaccuracies or typographical errors.

No part of this document may be reproduced, stored in, or introduced into a


retrieval system, or transmitted in any form or by any means (electronic,
mechanical, photocopying, recording, or otherwise), or for any purpose, without
the express written permission of Gecob It Consulting.

Except as expressly provided in any written license agreement from Gecob It


Consulting, the furnishing of this document does not give you any license to
trademarks, copyrights, or other intellectual property.

Product names, designations, logos, and symbols may be trademarks or


registered trademarks of their respective owners.

For further information please contact us at the following e-mail address:


emt@gecobitconsulting.com

©2010 Gecob It Consulting Ltd.


22 V. Levski Blv.
1142 Sofia, Bulgaria

EMT – Solution Overview 2


Contents
The Data Migration Problem................................................................................................................. 4
The Alternative Solution ....................................................................................................................... 6
Advantages ............................................................................................................................................ 9
Conclusion ........................................................................................................................................... 13
About Gecob It Consulting ................................................................................................................. 15

EMT – Solution Overview 3


The Data Migration Problem
Unfortunately, most large scale Siebel EIM data migration projects don't go as smoothly as anticipated.

A large percentage of EIM data migration projects suffer cost overruns, delays, or complete failure
because their scope and complexity is often underestimated.

One of the primary reasons for this failure rate is the lack of a thorough understanding of the
project complexity during the early stages of project initiation and requirements analysis.

IT experience has shown that the project complexity is always connected to the following issues:

 Design of the software solution able to manage large volume of data.


 Achievement of the performance requirements.
 Analysis of the source data thoroughly to understand its content, structure, quality and
integrity.

Therefore:
To reduce the risk of failure, organizations have to find very early solutions to mitigate the
complexity inherent in EIM data migration.

The key decision in any EIM data migration project is whether to deliver a custom software
solution or choose a proprietary ETL tool to mitigate the risk of failure.

The “Custom Software Solution” increases the project complexity and the risk of failure. For this
reason, it’s commonly used by organizations having a relevant experience in data migration
projects.

To meet the project expectations, the delivery of a custom software solution requires data
migration experts on staff.

EMT – Solution Overview 4


Cost

Custom Solution

Time

The Custom solution:

 Drops the initial cost for license fees.


 It’s more time-consuming than the ETL solution.
 Increases the risk of project failure and late delivery.

The usage of proprietary ETL tools is often considered the solution to reduce the risk of project
failure.
Cost

ETL
Custom Solution

Time

ETL tools allow saving time but require a significant investment at the beginning of the project.

Furthermore:
 ETL tools require specialized ETL developers.
 EIM data migration process uses only a small percentage of the functionalities provided by ETL
tools.

As a result:
The usage of ETL tool is not profitable to perform solely the EIM data migration process.

EMT – Solution Overview 5


The Alternative Solution
The alternative solution is “EMT - EIM Migration Tool ©” which is exclusively designed to perform
Siebel EIM data migrations.

EIM Migration Tool allows saving time and reduces the overall cost of the project.

In addition:
 Does not require large license fees.
 Ensures rapid and successful implementations.
 Reduces the risks of failure.
 Achieves the best migration performance.

Compared to ETL tools:


EIM Migration Tool provides a better return on investment for EIM data migration projects.

EIM Migration
Cost

Tool
ETL

Custom
Solution
Time

EMT - EIM Migration Tool (EMT) is a Software Solution designed to reduce the complexity of large
scale Siebel EIM data migration projects.

EMT reduces the risks of failure and helps organizations to deliver high performance software
solutions for Siebel EIM data migration challenges.

EMT – Solution Overview 6


EMT delivers a rich set of benefits that offer organizations significant and tangible return on
investment reducing development time and resources.

Complex and cost-consuming tasks can be eliminated or reduced as shown in the following chart:
Project Cost Distribution
System requirements
estimation
0.5% Migration time Define Rollout plan
Performance estimation 1%
Tuning Data Design Data
0.5%
3% Analysis Migration strategies
Migration Dry-Run - 8% 8%
Data Cleansing
14% Development Data
Migration Software
Test Target System Engine
functionalities 8%
8% Design EIM
Data Mapping
6% Development
Saved Cost for Test Extraction processes
11% 3%
Development Data Design EIM
Validation processes configuration
Test Data Migration 6% file (ifb)
(50% Development) 1%
8% Development EIM Development EIM
Development Transformation
upload processes
Recovery processes processes
6%
3% 8%

EIM Migration Tool provides a development approach for data extraction, data validation and EIM
transformation processes. Therefore, the overall cost for development and test can be further
reduced.

EMT runs exclusively on Oracle © Database Server and provides the following features:

 Automatic migration process


 High performance
 High scalability
 High quality process log
 Migration execution result for each record
 Automatic Recovery process
 Performance reports
 Configuration Versioning

EMT is not only a Software Solution but wants to be a “Migration Guide” that addresses new
guidelines to achieve the best results for huge Siebel EIM migrations.

EMT – Solution Overview 7


The migration approach used by EMT is the result of many years of experiences in complex and
performance demanding EIM migration projects.

The “EMT Data Migration Approach” is a proven process that includes best practices to achieve
the best migration performances, accelerate development, minimize staffing requirements and
lower the total cost of the project.

The migration approach is based on the concepts of parallel computing (Amdahl’s and Gustafson
laws), data distribution, process pipelines and leveraging of system resources available. Different
data distribution functions (Constant, Stair and Bell) combined with the parallel processing are key
factors to guarantee the best performance and scalability of the whole migration process.

EMT is able to reach the best migration performances by using the highest level of parallelisms:
Multiple Process-Multiple Data

Moreover, to ensure the full advantage of parallel execution, specific solutions are implemented
to reduce data contention, deadlocks and database workload.

EMT uses a particular approach to execute EIM upload processes:

 Using the configuration data model, EIM upload processes can be overlapped and
distributed over different Siebel application servers.
 EIM processes can be executed in parallel mode using the batch numbers distribution and
multiple EIM tasks.
 Specific EIM process configurations can be defined to avoid unique constraint violation
errors generated by parallel EIM tasks.
 To achieve the best performance, Siebel EIM tables are always truncated and uploaded with
a subset of data not exceeding the threshold of maximum number of records. This limit
combined with the batch size and the parallel degree is used for EIM process tuning.
 EIM results (IF_ROW_STAT) are automatically checked and reported to the source records.
 Multistep EIM processes can be easily configured to upload Siebel entities with parent-root
relationship (Asset, Order Item, Quote Item ...).
 EIM delete processes can be configured for recovery activities.
 Using the table EMT_EIM_TIME_TRACKING, elapsed execution times and EIM performance
rates are available for tuning activities.

EMT provides a full automatic data migration process including automatic recovery processes
designed to have safe and easy recovery of migration errors.

EMT provides special procedures to check configuration errors that could generate unexpected
execution results. For each configuration error or warning detected, the check configuration
procedure explains the description of the problem and, if possible, the recovery solution.

EMT – Solution Overview 8


Save Cost
Time
Resources

Reduce
Mitigate Risk
Complexity

EMT

System High
Resources
Optimization Performances

Advantages
The advantages of using EMT are considerable. These are the top reasons for using our solution:

 Save Cost, time and Resources


 Mitigate Risk
 High Performance
 System Resources Optimizations
 Reduce Complexity

EMT breaks down the cost of design, development and test of the data migration engine including
the cost for writing and issuing complex documentation.

EIM upload processes are executed according to the process configuration and do not require any
development and test activities.

Recovery and Restart processes allow saving the costs for the design and development of complex
procedures required to rollback records erroneously uploaded in Siebel.

EMT – Solution Overview 9


Designers and programmers can devote their time to developing extraction, validation and data
transformation procedures rather than dealing with more complex details of providing a
successfully migration strategy.

EMT ensures rapid and successful project implementations.

The migration methodology together with the automatisms provided by EMT are key factors to
reduce the complexity of EIM data migration projects.

Using EMT the following activities are required:

 Process configuration.
 Development of data extraction, data validation and data transformation processes.
 System configuration.

EMT Process configuration.

EMT requires configuration activities based on the design of the data migration mapping. The
following mapping rules must be defined:

 From legacy systems to EMT entity tables.


 From EMT entity tables to EIM tables.
 From EIM tables to Siebel base tables. (Using EIM configuration files)

Process Development.

Migration processes are executed by EMT using PL-SQL procedures having a common interface
(input parameters). Using a Java Class, migration processes can be also executed by operating
system commands or complex batch scripts.

As a result, PL-SQL procedures can be used as process wrapper to execute all kinds of migration
processes.

EMT – Solution Overview 10


Using EMT, data validation and EIM transformation processes can be easily developed using a PL-
SQL package template.

The template provides a development approach which allows achieving the best performances
during the parallel execution.

Development efforts are connected to the complexity of the functional requirements rather than
to the technology solutions of providing high performance data migration.

EMT reduces the need to employ developers with strong experiences.

System configuration.

Except for Siebel base tables upload, EMT provides the capability to perform the execution of huge
data migrations after the installation. This feature aims not only to evaluate the performance of the
tool but to estimate the system requirements and the execution time of the real data migration.

Using EMT, database and system administrators can easily identify the system resources required
to execute the data migration achieving the performance needs.

EMT addresses organizations to deliver successful project implementation due to the capability of
providing a migration approach together with a simple method of development.

EMT guarantee high migration performances due to the capability to execute the performance test
after the installation and before starting the project.

Organizations able to define EIM data mappings as well as to develop simple extraction, data
validation and EIM transformation processes will be able to succeed in EIM data migration
projects reducing costs and resources.

As a result:
EMT reduces the risk of project failure.

EMT – Solution Overview 11


EMT is able to achieve the best migration performances by using data distribution, process pipeline
execution and parallel processing.

Using the data distribution and the pipeline processing, multiple processes can be executed
concurrently to process different batch numbers.

Through the parallel processing more instances of the same process can be executed together to
implement the highest level of parallelism: Multiple Process-Multiple Data.

Specific EIM process configurations can be defined to avoid unique constraint violation errors
generated by parallel EIM tasks.

The migration process with lower performance rate leads the overall migration time.

EMT is specifically designed to perform EIM data migration based on Oracle database. “A Strong
restriction for huge advantages”.

EMT is able to provide specific solutions aimed to get the best benefits from the parallel process
execution by reducing data contention, deadlocks and database workload.

System resources can be easily distributed between migration processes by using the process
configuration data model rather than modifying the source code.

EMT improves migration performances optimizing the system resources utilization.

EMT – Solution Overview 12


Conclusion
EMT wants to be the alternative software solution to succeed in any Siebel EIM data migration
projects based on Oracle Database technology.

EMT provides a methodology specifically designed to reduce the complexity inherent in EIM data
migration projects as well as automatisms to simplify the operational steps required to execute the
migration process.

Therefore:
EMT will be the “kernel” of your data migration software developed according to a proven
development method and using a well known programming language such as PL-SQL.

We have designed our software solution to be easily tested and evaluated:

 EMT can be evaluated at no cost due to the capability to simulate the execution of complex
data migrations after the installation.
 EMT can be easily configured to simulate the execution of your real data migration (except
for Siebel target tables upload) defining the amount of data, migration entities and
migration processes.
 EMT provides the configuration version “GIC Test Utility Version” which is designed to test
the whole functionalities of the tool. This version represents a complete model of EMT
configuration and can be also used for self studying activities.
 EMT provides a comprehensive user manual which covers the theoretical concepts as well
as all operational and functional aspects of working with the tool.

EMT – Solution Overview 13


EMT is supposed to be used by anyone having a working knowledge of Oracle database and
familiarity with the usage of packages.

For this reason, EMT provides a simple ‘Command Line Interface’ based on the execution of its
stored procedures. The execution output is stored in the LOG table and shown on the terminal in
formatted text better visible with fixed-width fonts such as ‘Courier New’.

Using the Command Line Interface, EMT is able to show on the terminal performance reports,
migration status reports and simple dashboards to check the execution of the migration process.

The usage of the most common Oracle IDE (Interactive Development Environment) is high
recommended due to the automatic completion of the EMT commands including valuable
information such as arguments order, types and descriptions.

EMT can be used in the most demanding high performance migration architectures and, likewise,
multiple EMT instances can be installed on the same Oracle Server to upload different Siebel
schemas. Therefore, there are many Migration Architectures which can be used with the aim to
achieve the best performance or to save costs for development and test environments.

As a result:

Without large license fee, EMT helps organizations to reach the project expectations reducing the
delivery time, resources and the total cost of Siebel EIM data migration project.

EMT – Solution Overview 14


About Gecob It Consulting
GECOB IT CONSULTING Ltd. is one of the leading companies in ICT market specialized in Siebel EIM
Integration.

Since the beginning of our mission we have built up a reputation for delivering high quality solutions in large
scale and business critical Siebel EIM integration.

For us EIM is not only one acronym but the aim of our mission: for this reason we are proud of our experience
in the major Siebel data migration projects in Italy, Bulgaria, Belgium and UK.

Our success is combination of passion and complete understanding of the infrastructure technology involved.

Outstanding results have made our company a reliable partner for the major system integrator companies in
Europe.

We established our company in 2007 in Sofia (Bulgaria) and we are now more than ever ready to meet
professionally the individual needs of our clients.

For more information contact:

Gecob It Consulting Ltd.


22, V. Levski Blv.
1142 Sofia, Bulgaria
T: +359 2 4881775
Email: info@gecobitconsulting.com
http://gecobitconsulting.com

EMT – Solution Overview 15

You might also like