EIM Migration Tool©

The alternative solution for Siebel© EIM data migration challenges

Solution Overview – Ver. 1.0

© 2010 Gecob It Consulting Ltd. Product names, designations, logos, and symbols may be trademarks or registered trademarks of their respective owners.

Information in this document is subject to change without notice and may contain inaccuracies or typographical errors. No part of this document may be reproduced, stored in, or introduced into a retrieval system, or transmitted in any form or by any means (electronic, mechanical, photocopying, recording, or otherwise), or for any purpose, without the express written permission of Gecob It Consulting. Except as expressly provided in any written license agreement from Gecob It Consulting, the furnishing of this document does not give you any license to trademarks, copyrights, or other intellectual property. Product names, designations, logos, and symbols may be trademarks or registered trademarks of their respective owners. For further information please contact us at the following e-mail address: emt@gecobitconsulting.com

©2010 Gecob It Consulting Ltd. 22 V. Levski Blv. 1142 Sofia, Bulgaria

EMT – Solution Overview


The Data Migration Problem................................................................................................................. 4 The Alternative Solution ....................................................................................................................... 6 Advantages ............................................................................................................................................ 9 Conclusion ........................................................................................................................................... 13 About Gecob It Consulting ................................................................................................................. 15

EMT – Solution Overview


The Data Migration Problem
Unfortunately, most large scale Siebel EIM data migration projects don't go as smoothly as anticipated.

A large percentage of EIM data migration projects suffer cost overruns, delays, or complete failure because their scope and complexity is often underestimated. One of the primary reasons for this failure rate is the lack of a thorough understanding of the project complexity during the early stages of project initiation and requirements analysis. IT experience has shown that the project complexity is always connected to the following issues:    Design of the software solution able to manage large volume of data. Achievement of the performance requirements. Analysis of the source data thoroughly to understand its content, structure, quality and integrity.

Therefore: To reduce the risk of failure, organizations have to find very early solutions to mitigate the complexity inherent in EIM data migration. The key decision in any EIM data migration project is whether to deliver a custom software solution or choose a proprietary ETL tool to mitigate the risk of failure. The “Custom Software Solution” increases the project complexity and the risk of failure. For this reason, it’s commonly used by organizations having a relevant experience in data migration projects. To meet the project expectations, the delivery of a custom software solution requires data migration experts on staff.

EMT – Solution Overview



Custom Solution Time

The Custom solution:    Drops the initial cost for license fees. It’s more time-consuming than the ETL solution. Increases the risk of project failure and late delivery.

The usage of proprietary ETL tools is often considered the solution to reduce the risk of project failure.


ETL Custom Solution


ETL tools allow saving time but require a significant investment at the beginning of the project. Furthermore:  ETL tools require specialized ETL developers.  EIM data migration process uses only a small percentage of the functionalities provided by ETL tools. As a result: The usage of ETL tool is not profitable to perform solely the EIM data migration process.

EMT – Solution Overview


The Alternative Solution
The alternative solution is “EMT - EIM Migration Tool ©” which is exclusively designed to perform Siebel EIM data migrations. EIM Migration Tool allows saving time and reduces the overall cost of the project. In addition:  Does not require large license fees.  Ensures rapid and successful implementations.  Reduces the risks of failure.  Achieves the best migration performance. Compared to ETL tools:
EIM Migration Tool provides a better return on investment for EIM data migration projects.

EIM Migration Tool ETL Custom Solution Time

EMT - EIM Migration Tool (EMT) is a Software Solution designed to reduce the complexity of large scale Siebel EIM data migration projects. EMT reduces the risks of failure and helps organizations to deliver high performance software solutions for Siebel EIM data migration challenges.


EMT – Solution Overview


EMT delivers a rich set of benefits that offer organizations significant and tangible return on investment reducing development time and resources. Complex and cost-consuming tasks can be eliminated or reduced as shown in the following chart:
System requirements estimation 0.5% Performance Tuning 3% Migration Dry-Run Data Cleansing 14% Test Target System functionalities 8%

Project Cost Distribution
Migration time estimation 0.5% Define Rollout plan 1% Data Analysis 8%

Design Data Migration strategies 8% Development Data Migration Software Engine 8% Design EIM Data Mapping 6% Development

Saved Cost for Test 11%

Test Data Migration (50% Development) 8% Development Recovery processes 3%

Development EIM upload processes 6%

Extraction processes 3% Design EIM Development Data Validation processes configuration file (ifb) 6% 1% Development EIM Transformation processes 8%

EIM Migration Tool provides a development approach for data extraction, data validation and EIM transformation processes. Therefore, the overall cost for development and test can be further reduced. EMT runs exclusively on Oracle © Database Server and provides the following features:         Automatic migration process High performance High scalability High quality process log Migration execution result for each record Automatic Recovery process Performance reports Configuration Versioning

EMT is not only a Software Solution but wants to be a “Migration Guide” that addresses new guidelines to achieve the best results for huge Siebel EIM migrations.

EMT – Solution Overview


The migration approach used by EMT is the result of many years of experiences in complex and performance demanding EIM migration projects. The “EMT Data Migration Approach” is a proven process that includes best practices to achieve the best migration performances, accelerate development, minimize staffing requirements and lower the total cost of the project. The migration approach is based on the concepts of parallel computing (Amdahl’s and Gustafson laws), data distribution, process pipelines and leveraging of system resources available. Different data distribution functions (Constant, Stair and Bell) combined with the parallel processing are key factors to guarantee the best performance and scalability of the whole migration process. EMT is able to reach the best migration performances by using the highest level of parallelisms: Multiple Process-Multiple Data Moreover, to ensure the full advantage of parallel execution, specific solutions are implemented to reduce data contention, deadlocks and database workload. EMT uses a particular approach to execute EIM upload processes:     Using the configuration data model, EIM upload processes can be overlapped and distributed over different Siebel application servers. EIM processes can be executed in parallel mode using the batch numbers distribution and multiple EIM tasks. Specific EIM process configurations can be defined to avoid unique constraint violation errors generated by parallel EIM tasks. To achieve the best performance, Siebel EIM tables are always truncated and uploaded with a subset of data not exceeding the threshold of maximum number of records. This limit combined with the batch size and the parallel degree is used for EIM process tuning. EIM results (IF_ROW_STAT) are automatically checked and reported to the source records. Multistep EIM processes can be easily configured to upload Siebel entities with parent-root relationship (Asset, Order Item, Quote Item ...). EIM delete processes can be configured for recovery activities. Using the table EMT_EIM_TIME_TRACKING, elapsed execution times and EIM performance rates are available for tuning activities.

   

EMT provides a full automatic data migration process including automatic recovery processes designed to have safe and easy recovery of migration errors. EMT provides special procedures to check configuration errors that could generate unexpected execution results. For each configuration error or warning detected, the check configuration procedure explains the description of the problem and, if possible, the recovery solution.

EMT – Solution Overview


Save Cost Time Resources

Reduce Complexity

Mitigate Risk


System Resources Optimization

High Performances

The advantages of using EMT are considerable. These are the top reasons for using our solution:      Save Cost, time and Resources Mitigate Risk High Performance System Resources Optimizations Reduce Complexity

EMT breaks down the cost of design, development and test of the data migration engine including the cost for writing and issuing complex documentation. EIM upload processes are executed according to the process configuration and do not require any development and test activities. Recovery and Restart processes allow saving the costs for the design and development of complex procedures required to rollback records erroneously uploaded in Siebel.

EMT – Solution Overview


Designers and programmers can devote their time to developing extraction, validation and data transformation procedures rather than dealing with more complex details of providing a successfully migration strategy. EMT ensures rapid and successful project implementations.

The migration methodology together with the automatisms provided by EMT are key factors to reduce the complexity of EIM data migration projects. Using EMT the following activities are required:    Process configuration. Development of data extraction, data validation and data transformation processes. System configuration.

EMT Process configuration. EMT requires configuration activities based on the design of the data migration mapping. The following mapping rules must be defined:    From legacy systems to EMT entity tables. From EMT entity tables to EIM tables. From EIM tables to Siebel base tables. (Using EIM configuration files)

Process Development. Migration processes are executed by EMT using PL-SQL procedures having a common interface (input parameters). Using a Java Class, migration processes can be also executed by operating system commands or complex batch scripts. As a result, PL-SQL procedures can be used as process wrapper to execute all kinds of migration processes.

EMT – Solution Overview


Using EMT, data validation and EIM transformation processes can be easily developed using a PLSQL package template. The template provides a development approach which allows achieving the best performances during the parallel execution. Development efforts are connected to the complexity of the functional requirements rather than to the technology solutions of providing high performance data migration. EMT reduces the need to employ developers with strong experiences. System configuration. Except for Siebel base tables upload, EMT provides the capability to perform the execution of huge data migrations after the installation. This feature aims not only to evaluate the performance of the tool but to estimate the system requirements and the execution time of the real data migration. Using EMT, database and system administrators can easily identify the system resources required to execute the data migration achieving the performance needs.

EMT addresses organizations to deliver successful project implementation due to the capability of providing a migration approach together with a simple method of development. EMT guarantee high migration performances due to the capability to execute the performance test after the installation and before starting the project. Organizations able to define EIM data mappings as well as to develop simple extraction, data validation and EIM transformation processes will be able to succeed in EIM data migration projects reducing costs and resources. As a result: EMT reduces the risk of project failure.

EMT – Solution Overview


EMT is able to achieve the best migration performances by using data distribution, process pipeline execution and parallel processing. Using the data distribution and the pipeline processing, multiple processes can be executed concurrently to process different batch numbers. Through the parallel processing more instances of the same process can be executed together to implement the highest level of parallelism: Multiple Process-Multiple Data. Specific EIM process configurations can be defined to avoid unique constraint violation errors generated by parallel EIM tasks. The migration process with lower performance rate leads the overall migration time.

EMT is specifically designed to perform EIM data migration based on Oracle database. “A Strong restriction for huge advantages”. EMT is able to provide specific solutions aimed to get the best benefits from the parallel process execution by reducing data contention, deadlocks and database workload. System resources can be easily distributed between migration processes by using the process configuration data model rather than modifying the source code. EMT improves migration performances optimizing the system resources utilization.

EMT – Solution Overview


EMT wants to be the alternative software solution to succeed in any Siebel EIM data migration projects based on Oracle Database technology. EMT provides a methodology specifically designed to reduce the complexity inherent in EIM data migration projects as well as automatisms to simplify the operational steps required to execute the migration process. Therefore: EMT will be the “kernel” of your data migration software developed according to a proven development method and using a well known programming language such as PL-SQL.

We have designed our software solution to be easily tested and evaluated:   EMT can be evaluated at no cost due to the capability to simulate the execution of complex data migrations after the installation. EMT can be easily configured to simulate the execution of your real data migration (except for Siebel target tables upload) defining the amount of data, migration entities and migration processes. EMT provides the configuration version “GIC Test Utility Version” which is designed to test the whole functionalities of the tool. This version represents a complete model of EMT configuration and can be also used for self studying activities. EMT provides a comprehensive user manual which covers the theoretical concepts as well as all operational and functional aspects of working with the tool.

EMT – Solution Overview


EMT is supposed to be used by anyone having a working knowledge of Oracle database and familiarity with the usage of packages. For this reason, EMT provides a simple ‘Command Line Interface’ based on the execution of its stored procedures. The execution output is stored in the LOG table and shown on the terminal in formatted text better visible with fixed-width fonts such as ‘Courier New’. Using the Command Line Interface, EMT is able to show on the terminal performance reports, migration status reports and simple dashboards to check the execution of the migration process. The usage of the most common Oracle IDE (Interactive Development Environment) is high recommended due to the automatic completion of the EMT commands including valuable information such as arguments order, types and descriptions. EMT can be used in the most demanding high performance migration architectures and, likewise, multiple EMT instances can be installed on the same Oracle Server to upload different Siebel schemas. Therefore, there are many Migration Architectures which can be used with the aim to achieve the best performance or to save costs for development and test environments. As a result: Without large license fee, EMT helps organizations to reach the project expectations reducing the delivery time, resources and the total cost of Siebel EIM data migration project.

EMT – Solution Overview


About Gecob It Consulting
GECOB IT CONSULTING Ltd. is one of the leading companies in ICT market specialized in Siebel EIM Integration. Since the beginning of our mission we have built up a reputation for delivering high quality solutions in large scale and business critical Siebel EIM integration. For us EIM is not only one acronym but the aim of our mission: for this reason we are proud of our experience in the major Siebel data migration projects in Italy, Bulgaria, Belgium and UK. Our success is combination of passion and complete understanding of the infrastructure technology involved. Outstanding results have made our company a reliable partner for the major system integrator companies in Europe. We established our company in 2007 in Sofia (Bulgaria) and we are now more than ever ready to meet professionally the individual needs of our clients.

For more information contact:

Gecob It Consulting Ltd. 22, V. Levski Blv. 1142 Sofia, Bulgaria T: +359 2 4881775 Email: info@gecobitconsulting.com http://gecobitconsulting.com

EMT – Solution Overview


Master your semester with Scribd & The New York Times

Special offer for students: Only $4.99/month.

Master your semester with Scribd & The New York Times

Cancel anytime.