Atrium Integrator 7.6.

04

User’s Guide

January 2011

www.bmc.com

Contacting BMC Software
You can access the BMC Software website at http://www.bmc.com. From this website, you can obtain information about the company, its products, corporate offices, special events, and career opportunities.

United States and Canada
Address BMC SOFTWARE INC 2101 CITYWEST BLVD HOUSTON TX 77042-2827 USA Telephone 713 918 8800 or 800 841 2031 Fax 713 918 8000

Outside United States and Canada
Telephone (01) 713 918 8800 Fax (01) 713 918 8000

If you have comments or suggestions about this documentation, contact Information Design and Development by email at doc_feedback@bmc.com.

© Copyright 2011 BMC Software, Inc. BMC, BMC Software, and the BMC Software logo are the exclusive properties of BMC Software, Inc., are registered with the U.S. Patent and Trademark Office, and may be registered or pending registration in other countries. All other BMC trademarks, service marks, and logos may be registered or pending registration in the U.S. or in other countries. All other trademarks or registered trademarks are the property of their respective owners. DB2, IBM, and Informix are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. Oracle and Java are registered trademarks of Oracle and/or its affiliates. Other names may be trademarks of their respective owners. The information included in this documentation is the proprietary and confidential information of BMC Software, Inc., its affiliates, or licensors. Your use of this information is subject to the terms and conditions of the applicable End User License agreement for the product and to the proprietary and restricted rights notices included in the product documentation.

Restricted rights legend
U.S. Government Restricted Rights to Computer Software. UNPUBLISHED -- RIGHTS RESERVED UNDER THE COPYRIGHT LAWS OF THE UNITED STATES. Use, duplication, or disclosure of any data and computer software by the U.S. Government is subject to restrictions, as applicable, set forth in FAR Section 52.227-14, DFARS 252.227-7013, DFARS 252.227-7014, DFARS 252.227-7015, and DFARS 252.227-7025, as amended from time to time. Contractor/Manufacturer is BMC Software, Inc., 2101 CityWest Blvd., Houston, TX 77042-2827, USA. Any contract notices should be sent to this address.

Customer Support
You can obtain technical support by using the Support page on the BMC Software website or by contacting Customer Support by telephone or email. To expedite your inquiry, please see “Before Contacting BMC Software.”

Support website
You can obtain technical support from BMC Software 24 hours a day, 7 days a week at http://www.bmc.com/support. From this website, you can:
s s s s s s s

Read overviews about support services and programs that BMC Software offers. Find the most current information about BMC Software products. Search a database for problems similar to yours and possible solutions. Order or download product documentation. Report a problem or ask a question. Subscribe to receive email notices when new product versions are released. Find worldwide BMC Software support center locations and contact information, including email addresses, fax numbers, and telephone numbers.

Support by telephone or email
In the United States and Canada, if you need technical support and do not have access to the Web, call 800 537 1813 or send an email message to customer_support@bmc.com. (In the Subject line, enter SupID:<yourSupportContractID>, such as SupID:12345.) Outside the United States and Canada, contact your local support center for assistance.

Before contacting BMC Software
Have the following information available so that Customer Support can begin working on your issue immediately:
s

Product information — — — Product name Product version (release number) License number and password (trial or permanent)

s

Operating system and environment information — — — — — Machine type Operating system type, version, and service pack System hardware configuration Serial numbers Related software (database, application, and communication) including type, version, and service pack or maintenance level

s s s

Sequence of events leading to the problem Commands and options that you used Messages received (and the time and date that you received them) — Product error messages — Messages from the operating system, such as file system full — Messages from related software

enter SupID:<yourSupportContractID>. Outside the United States and Canada.bmc.License key and password information If you have a question about your license key or password. contact your local support center for assistance. contact Customer Support through one of the following methods: s E-mail customer_support@bmc. (In the Subject line.com. such as SupID:12345.com/support. s s . call 800 537 1813.) In the United States and Canada. Submit a new issue at http://www.

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Integration Job Builder wizard . . . Performance considerations . . . . . . . . . . . . . . . . . . . Calbro Services user story. . . . . . . Mapping source data to BMC Atrium CMDB. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Editing the job in Spoon . . . . . . . . . . . . . . . . . . . . . . . . Atrium Integrator terminology . . . . Atrium Integrator console . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Accessing the Atrium Integrator console . . . Creating a data transfer job . . . . . . . . . Datasets . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Running the job . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Mapping relationship classes. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Spoon . . . . . . . . . . . . . . . . . . . . . . . . . . . . Preparing to transfer Calbro Services data. . Carte . . . . . . . . . . . . . . . . .Contents BMC Atrium Core documentation Chapter 1 Understanding Atrium Integrator 9 13 14 14 15 16 17 17 18 20 20 20 21 23 23 24 24 27 28 28 28 30 30 31 31 31 32 40 45 48 49 50 Atrium Integrator value proposition . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Transferring Calbro data to BMC Atrium CMDB . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Manage Data Stores tool. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Creating a dataset for the Calbro data . . . . . . . Verifying that the transferred data is in BMC Atrium CMDB . . . . . . . . . . . . . . . . . . . . . . . . . Overview of the data transfer process . . . . . . . . Opening the job and transformations in Spoon. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Contents 5 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Chapter 2 Scenario for transferring data to BMC Atrium CMDB Source data organization at Calbro Services . Creating a database connection. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Preparing to transfer data . . . . . Adding an attribute to the BMC_DiskDrive class . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Overview of Atrium Integrator . . . . . . . . . . . . . . . . Atrium Integrator components . . . . . . . . . . . . . . Monitoring the job . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . 55 Creating a new data store connection . . . . . . . . . 64 Creating a complex job in Spoon . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 89 Transformation hop colors . . . . . . . 102 Changing source configuration . . . . . . . . . . . . . . . . . . . . . . 98 Launching several copies of a step. . . . 108 Viewing job history . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 112 6 User’s Guide . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 82 Chapter 5 Editing jobs and transformations 85 Opening your job or transformation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 110 Changing the job schedule . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 89 Deleting a hop. . . . . . . . . . . . . . . . . . . . . 81 Creating a job to migrate data from a development server to a production server. . 59 Chapter 4 Creating a job 61 Creating a simple job through the Integration Job Builder wizard. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97 Editing transformation properties . . . . . . . . . . . . . . . . . . . 93 Editing transformation steps. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62 Creating a job through the Integration Job Builder wizard . . . . . . . . . . . . . . . . . . . . . . . 88 Creating a hop . . . . . . . . . . . . 86 Mapping the Integration Job Builder wizard output to Spoon steps . . . . . . 89 Disabling a hop. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58 Editing a data store connection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 90 Adding intermediate steps to a job . . . . . . . . . . . . . 101 Exploring a database connection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 54 Supported data types . . . . . . . . . . . . . . . . 106 Monitoring jobs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58 Deleting a data store connection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 90 Adding intermediate steps to a transformation. . . . 101 Browsing source data . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 88 Reversing the direction of a hop . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 103 Chapter 6 Running and monitoring a job 105 Running a job from the Atrium Integrator console . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62 High-level steps for creating a job through the Integration Job Builder wizard . . . . 87 Connecting transformation steps or job entries in Spoon. . . . . . . . . 89 Specifying the condition on which a job entry is executed . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 100 Changing data mappings . . . . . . . . . . . . . 108 Viewing job details. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55 RPC Ports in BMC Atrium CMDB. . . . . . . . .Chapter 3 Working with data store connections 53 Before you begin . . . . 106 Running a job in Spoon . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . 115 Job not running from the Atrium Integrator console. . . . . . . . . . . . . . . . . . . . . . . 116 Troubleshooting errors displayed in Spoon. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 114 Job fails to run . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 114 Job not displayed on the Atrium Integrator console . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 118 Error connecting to a Microsoft SQL Server database using Windows Authentication in Spoon . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 128 Index 131 Contents 7 . . . . . . . . . . . . 128 Tasks. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 119 Atrium Integrator Error Messages . . . . . 120 Chapter 8 Appendix A Migrating jobs to a production server Moving from BMC Atrium Integration Engine to Atrium Integrator 125 127 Terminology . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .Chapter 7 Debugging and troubleshooting jobs 113 Troubleshooting Atrium Integrator console issues. . . . . . . . . . . . . . . . 118 Location of log files . . .

8 User’s Guide .

BMC Atrium Configuration Management Database (BMC Atrium CMDB). and asset analysts. BMC Atrium Core documentation 9 .6.com/support. including manuals.6. BMC Atrium CMDB 7. Administrator's Guide federation. configuring Configuration managers. and relationship classes for each class. application administrators. videos. Contains only information about the CDM at first.04 Data Model Help Description and details of superclasses. help systems.04 Best practices for using the classes that BMC application administrators. BMC Atrium CMDB 7.bmc.6.04 Hierarchical diagram of all classes in the Common Configuration managers. Data Modeling Guide provides for BMC Atrium CMDB (both the CDM and extensions) to model complex business entities.6.6. an impact model. and so on. at http://www. attributes. configuring application administrators.04 User's Guide Description Information about defining source and target connections. Common Data Model Data Model (CDM).04 Information about setting permissions. and asset analysts. and other Atrium Integrator concepts. subclasses. and other administrative tasks in and asset analysts. focusing on the use of multiple related CIs to model an entity rather than on general information about a class or attribute. Audience Users who are responsible for setting up data transfer integrations between external data stores and BMC Atrium CMDB. Unless otherwise noted. modifying the data model. but you can update it to include information about data model extensions that you install. editing and monitoring jobs.BMC Atrium Core documentation This section describes the complete set of BMC Atrium Core documentation. Configuration managers.6. To find this documentation on the BMC Customer Support site. and asset analysts. choose Product Documentation > Supported Product A-Z List > BMC Atrium CMDB Enterprise Manager >7. Diagram applicable relationships. including unique attributes and application administrators. It is not available on the BMC Customer Support site. on the BMC Atrium Core media.04 Title Atrium Integrator 7. BMC Atrium CMDB 7. Note: This Help is provided in HTML and is available Configuration managers. creating jobs and transformations. documentation is available free of charge on the BMC Atrium Core documentation media (DVD or Electronic Product Download bundle) and on the BMC Customer Support site. BMC Atrium CMDB 7.

BMC Atrium Core: Taking Your Data Into Production End to End End-to-end high-level steps for bringing data into BMC Atrium CMDB from a third-party source and making it available in your production dataset. application administrators. Compatibility Matrix from the BMC Customer Support site at http://www. application administrators. methods. Normalization and CMDB and reconciling CIs from different data application administrators. Users that work with CIs and need to understand the relationships that exist within BMC Atrium CMDB. and asset analysts.6.04 Compatibility Matrix Information about the BMC Atrium Core configurations that are expected to work together based on design.6.04 Title BMC Atrium CMDB 7.04 Information about using BMC Atrium CMDB. configuration managers. Normalization Engine.04 Information about normalizing data in BMC Atrium Configuration managers. or general understanding of the interaction between products.Atrium Integrator 7.6. Configuration managers. asset analysts. BMC Atrium Core 7.04 Configuration managers. BMC Atrium CMDB 7.04 Concepts and Planning Guide Information about CMDB concepts and high-level steps for planning and implementing BMC Atrium Core.6. application administrators. relating CIs.04 Javadoc Help Description Audience Information about Oracle Java classes. running impact simulations. IT leaders.bmc. It is not available on the BMC Customer Support site. and Application programmers. Note: Download the BMC Atrium Core 7. Note: This Flash video is available on the BMC Atrium Core media. and asset analysts are some who will benefit from this information. CMDBs in general.6. and viewing federated data. user interface. User's Guide including searching for and comparing CIs and relationships. and the functionality of BMC Atrium CMDB in particular. BMC Atrium Core 7.6. variables that integrate with BMC Atrium CMDB. and asset analysts. BMC Atrium CMDB 7. Reconciliation Engine. 10 User’s Guide . viewing history. BMC Atrium CMDB 7. testing. It is not available on the BMC Customer Support site. and so on.6. Note: This Help is provided in HTML and is available on the BMC Atrium Core media. and asset analysts.html?c=n. and users that work with CIs and need to understand the Note: This Help is provided in HTML and is available relationships that exist through the Help links in the BMC Atrium CMDB within BMC Atrium CMDB. Configuration managers. BMC Atrium Product Catalog. application administrators. It is not available on the BMC Customer Support site. Reconciliation Guide providers into a single production dataset. including Atrium Integrator.6.com/support/ reg/remedy-compatibility-tables. Anyone who wants to learn about and understand BMC Atrium Core products.04 Online Help Help for using and configuring BMC Atrium CMDB.

6.04 Master Index BMC Atrium Core 7. It is not available on the BMC Customer Support site. adding products.04 ADK Developer's Guide Information about how to build adapters that can transfer information between an external data store and either BMC Remedy AR System forms or BMC Atrium CMDB. IT and DML. and categorizations.6. filter.6. managers. BMC Atrium Core 7. and creating aliases for managers. Atrium Core components.04 Web Services Help on the BMC Atrium Core media. Everyone. Application administrators.04 Installation Guide BMC Atrium Core 7. known issues. and BMC console error messages and their solutions. other late-breaking topics. disambiguate web services.6. and other qualified personnel who are familiar with their computing and networking environment. set versions. network products. BMC Atrium Core documentation 11 . It is not or BMC Remedy available on the BMC Customer Support site.04 Product Catalog and DML Guide Information about installing. Information about resolving issues with BMC Application administrators.04 Online Help Integration Engine. BMC Atrium Integration Help for using and configuring BMC Atrium Engine 7. Note: This Help is provided in HTML and is available BMC Atrium Core 7. AR System.6. Information about new features. and use BMC Atrium Core Web Services data structures and operations.6. including how to publish and find and programmers.6. and programmers. Developers who have a basic understanding of BMC Atrium Integration Engine and want to build adapters that can exchange data between two data sources. Combined index of all guides.6. interfaces in the Web Services Registry. including API. Users who are responsible for setting up data transfer integrations between Note: This Help is provided in HTML and is available external data stores and through the Help links in the BMC Atrium either BMC Atrium CMDB Integration Engine user interface. Information about using BMC Atrium Core Web Application administrators Services. manufacturers. BMC Atrium Core 7.Title Description Audience Application administrators and programmers. Information about configuring the Product Catalog System administrators. upgrading.04 Release Notes BMC Atrium Core 7. and Everyone. configure security policies and encryption. Support personnel. and uninstalling BMC Atrium Core features.04 Information about creating API programs using C Developer’s Reference Guide API functions and data structures. BMC Atrium Integration Engine 7.6.04 Troubleshooting Guide BMC Atrium Core 7.

application administrators. BMC Atrium Integration Information about creating data exchanges and data Engine 7. and asset analysts. activating event-driven data exchanges. and other BMC Atrium Integration Engine concepts. defining connection settings. defining rules and queries. Mapping Your Data to Spreadsheet that maps common IT objects to the BMC Atrium CMDB 7. Configuration managers.6.04 User's Guide mappings.04 appropriate class. and best practices for creating normalized relationships.6.6.Atrium Integrator 7. 12 User’s Guide . whether part of the CDM or an Classes extension.04 Title Description Audience Users who are responsible for setting up data transfer integrations between external data stores and either BMC Atrium CMDB or BMC Remedy AR System. This spreadsheet also includes information about further categorizing instances using key attributes.

native databases.Chapter 1 Understanding Atrium Integrator Atrium Integrator is an integration engine that enables you to transfer data from external data stores to BMC Atrium Configuration Management Database (BMC Atrium CMDB) classes. The following topics are provided: Atrium Integrator value proposition (page 14) Overview of Atrium Integrator (page 14) Calbro Services user story (page 15) Datasets (page 16) Atrium Integrator terminology (page 17) Overview of the data transfer process (page 17) Atrium Integrator components (page 18) Performance considerations (page 23) Preparing to transfer data (page 24) Accessing the Atrium Integrator console (page 24) Chapter 1 Understanding Atrium Integrator 13 . ODBC. Atrium Integrator provides you with the ability to clean and transform your data before putting it into BMC Atrium CMDB. BMC Atrium Integration Engine will be deprecated in a future release. web services. You can connect to a wide variety of input sources using connectors such as JDBC. and complex XML. JMS. You can continue using BMC Atrium Integration Engine for existing data mappings and exchanges. Atrium Integrator replaces BMC Atrium Integration Engine. but BMC recommends that you use Atrium Integrator for all new data transfers.

This architecture is shown in Figure 1-1.6. an XML file. For example. where it can be reconciled with data from other sources to your production dataset. you can schedule and perform bulk data transfers. you can use Atrium Integrator to synchronize IT data from a discovery application with BMC Atrium CMDB. depending on how you have configured your integration: Reads records Creates new records Updates records Deletes records Modifies data (such as concatenating fields) Overview of Atrium Integrator This section describes how Atrium Integrator integrates with the BMC Atrium Core components to form a solution. You can use Atrium Integrator to load data from multiple external repositories into the BMC Atrium CMDB. You want to load this data into the BMC Atrium CMDB. and data synchronization.Atrium Integrator 7. and a non-BMC discovery dataset. You can define how external data maps to Atrium CMDB and transform external data using various rules With Atrium Integrator.04 Atrium Integrator value proposition Your IT management data resides in multiple repositories–for example. During data transfers. in an SQL table. You can also use Atrium Integrator for initial data loading. 14 User’s Guide . incremental data transfers. Atrium Integrator identifies the records to be transferred and performs some or all of the following tasks.

Although Calbro Services is a fictional company. Seeing how Calbro Services completes tasks should prove useful as you implement Atrium Integrator in your own environment. and XML files in various locations across the globe. Calbro Services also wants to transfer the personnel records of employees from the Dublin site to the New York site. disk drives. and Adelaide sites to their New York centralized database. Dublin. Calbro Services needs to transfer its existing data about processors. When the data is in a BMC Atrium CMDB dataset. it is based on research of actual BMC customers. and so on to their centralized database in New York. This guide provides examples for transferring this data. London. printers. see “Datasets” on page 16. This data resides in multiple databases. Calbro Services user story This document uses a fictional company named Calbro Services to explain how Atrium Integrator principles and procedures are used in practice. Chapter 1 Understanding Atrium Integrator 15 . the Normalization Engine ensures that data from different data providers is consistent. flat files. Calbro Services wants to transfer information from its Chicago. The Reconciliation Engine merges data from multiple import datasets into the BMC Asset dataset.Calbro Services user story Figure 1-1: BMC Atrium Core architecture BMC Atrium Core BMC Atrium CMDB Reconciliation Engine Normalization Engine Production dataset Sandbox dataset Other Consumers BMC Remedy Asset Mgmt Databases Complex XML file CSV file Discovery application Atrium Integrator Import datasets Federated data BMC Atrium Product Catalog Atrium Integrator transfers data from an external datastore to BMC Atrium CMDB. For more information about datasets.

6.IMPORT. as shown in Table 1-1. All CIs and relationships in BMC Atrium CMDB reside in a particular dataset.6.SANDBOX DatasetID BMC. If you use a third-party product to discover products.ASSET BMC. The primary purpose of datasets is to partition data according to the data providers. Data consumers should use this consolidated view of your data and you should base your business decisions on the data in this dataset. Each discovery application that you use should store the data it collects in a separate dataset. BMC discovery products and BMC Remedy Asset Management provide the default datasets in BMC Atrium CMDB. It is a collection of CIs and relationships for a given purpose. The Reconciliation Engine merges data from multiple import datasets in the BMC Asset dataset.6.ASSET. transfer the data into another dataset and then reconcile it into BMC Asset. SANDBOX BMC BladeLogic Client Automation BMC Configuration Import BMC.04 Datasets A dataset is a logical group of data in BMC Atrium CMDB. CONFIG BMC Atrium Discovery and Dependency Mapping BMC Topology Import BMC. NOTE Do not use Atrium Integrator to transfer data directly into the BMC Asset dataset. Instead. see the BMC Atrium CMDB 7. see the BMC Atrium CMDB 7.ASSET. which is specified by the value of their DatasetID attribute. You can also use datasets for any other logical group of data.04 Normalization and Reconciliation Guide.TOPO The BMC Asset dataset is used as the production dataset and is used by BMC products for reconciled data.Atrium Integrator 7. 16 User’s Guide .IMPORT.04 Normalization and Reconciliation Guide.SAMPLE BMC. Table 1-1: Default datasets in BMC Atrium CMDB Data created by BMC Atrium CMDB BMC Remedy Asset Management Dataset name BMC Asset BMC Sample BMC. For more information about configuring datasets. you should create a different dataset to bring in this data. A dataset can represent data from a particular source or a snapshot from a particular date. For information about creating datasets.

Overview of the data transfer process To transfer data into BMC Atrium CMDB. It reads data from the source data store. see Chapter 3. Step 1 Configure source and target connection. Steps are connected by hops. user name. A transformation consists of a series of steps. The following terms are used in Atrium Integrator to describe the various aspects of an integration: A transformation is the combination of steps and hops that make an integration between source and target data stores possible. For instructions. and the related step is highlighted. the graphic is repeated. Steps define the input and output data stores as well the clean up or adjustment actions that you might want to perform on the data before adding it to BMC Atrium CMDB. transforms it according to the rules that you specify.” Chapter 1 Understanding Atrium Integrator 17 .Atrium Integrator terminology Atrium Integrator terminology The complete process of transferring data from an external source (for example. and password) to your external data store and BMC Atrium CMDB. “Working with data store connections. follow the process outlined in the following steps. You can also use a repository to store the logs that are generated when executing transformations and jobs. port number. After you create a connection. which indicate the direction of the data flow. Figure 1-2: Overview of the data transfer process 1 Con gure source & target connection 2 Create and schedule job 3 Edit transformation or job 4 Run job 5 Monitor job Each step represents a procedure. In the section that relates to each procedure. and stores it in the target data store. A repository is a relational database in which you can store your transformations and jobs. You must define connection parameters (such as host name. A job defines the order in which a series of transformations are run so that the dependencies of the individual transformations are met. an XML file) to a BMC Atrium CMDB CI class is referred to as an integration. you can reuse it for multiple transformations or jobs.

The Integration Job Builder wizard guides you through the process of creating a job or transformation.” Chapter 2. If the job displays error messages. you can migrate them to a production server. “Scenario for transferring data to BMC Atrium CMDB” takes you through the complete data transfer process for a sample scenario. see Chapter 8. For instructions. If the job completes without any errors. You can add intermediate steps for cleaning up or manipulating your data before adding it to BMC Atrium CMDB. For instructions. debug the job and run it again.com/display/EAI/ Spoon+User+Guide. see Chapter 5. the wizard makes recommendations on the relationships for the selected CIs. For instructions.pentaho. “Running and monitoring a job. “Running and monitoring a job. Spoon provides support for JavaScript and a wide variety of prebuilt functions. Step 3 Edit your transformation or job in Spoon. verify that the data has been added to the appropriate BMC Atrium CMDB class.” Step 5 Monitor your jobs. After you create and run your job. see Chapter 6.” You can also create a job in the Pentaho Spoon application. After you specify the source and the CIs that you want to import. you can monitor it. “Migrating jobs to a production server. For information. “Creating a job. For information. see the Spoon User Guide at http://wiki.6.04 Step 2 Create a job or transformation. For instructions.Atrium Integrator 7. see Chapter 4. Atrium Integrator components Atrium Integrator uses the Pentaho Data Integration tool and has the following main components: Manage Data Stores tool (page 20) Integration Job Builder wizard (page 20) Spoon (page 21) Carte (page 23) 18 User’s Guide . see Chapter 6.” Step 6 Migrate your jobs to a production server After you create and test your data transfer jobs on a development computer.” Step 4 Verify and run your job. “Editing jobs and transformations. The Atrium Integrator console displays the job run information.

in relation to the BMC Atrium Core architecture. Chapter 1 Understanding Atrium Integrator 19 .Atrium Integrator components Figure 1-3 on page 19 shows the Pentaho Data Integration tool components. Figure 1-3: Pentaho Data Integration components in relation to BMC Atrium Core BMC Atrium Core Console Atrium Integrator console Source data to be tranferred to BMC Atrium CMDB Pentaho Spoon BMC Remedy Action Request System BMC Remedy Mid Tier CMDB plugin Carte server Database BMC Atrium CMDB Repository Figure 1-4 on page 20 shows how the Atrium Integrator components work together. Spoon and the Pentaho Carte application.

You can specify the source and target details.6. reject files. XML Input Job Carte server Runs the job BMC Atrium CMDB Output Pentaho Spoon (Optional) Edit a job to add complex steps Repository Stores the job Manage Data Stores tool The Manage Data Stores tools helps you define connection parameters (such as host name. port number. user name and password) to your external data store and BMC Atrium CMDB. and logging. Atrium Integrator console The left panel of the Atrium Integrator console displays a list of jobs available in the Spoon repository. 20 User’s Guide . Integration Job Builder wizard The Integration Job Builder wizard helps you create a job for transferring your data from an external data store to BMC Atrium CMDB.04 Figure 1-4: Atrium Integrator components Atrium Integrator console Manage Data Stores tool Create a data store connection Integration Job Builder wizard Create a job Job Scheduler Schedule the job Job Monitoring Monitor the job CMDB plugin Database. CSV. deletes. specify the CI types and relationships to transfer.Atrium Integrator 7. and define your preferences for deltas.

and description of a job. and monitor a job. The Integration Job Details tab displays the date. schedule a job. Chapter 1 Understanding Atrium Integrator 21 . Spoon has a drag-and-drop graphical user interface that makes it easy for you to edit your transformations and clean up your data before putting it into BMC Atrium CMDB. You can start and stop a job.Atrium Integrator components The History tab on the right panel displays the job run information for the selected job. For more information about the tasks that you can perform from the Atrium Integrator console. see the following sections: “Working with data store connections” on page 53 “Creating a job” on page 61 “Running and monitoring a job” on page 105 Spoon After you build your job. The Atrium Integrator console provides access to the Manage Data Stores tool and Integration Job Builder wizard. source and target types. You can also display jobs with a specific status or jobs that executed within a range of dates. you can edit it in the Spoon application.

6. The View tab maintains a history of the different types of steps that were added to the active transformation or job. and running or debugging the job or transformation. editing it. connecting to a repository. The Design tab provides an organized list of transformation steps or job entries used to build transformations and jobs.04 Figure 1-5: Spoon application Menu bar Navigation panel steps Toolbar Active transformation or job Hop Transformation step Canvas Menu bar The menu bar provides access to common actions such as creating a new transformation or job. this tab displays the steps that a transformation must include to run successfully.Atrium Integrator 7. For a new transformation or job. 22 User’s Guide . Navigation panel The navigation panel on the left contains a View tab and Design tab.

the DiskDrive transformation is the active transformation. Best practices Following are some best practices that can improve the performance of Atrium Integrator: Create index entries on: The BMC_BaseElement class for keys that are used as primary keys Relationship keys for relationship data exchanges Chapter 1 Understanding Atrium Integrator 23 . Seemingly minor additions could have a major impact if your database contains many records. and the external data store load. It also provides buttons for quick access to common actions specific to the active transformation or job. The steps containing the search phrase are displayed. Canvas The canvas is the main design area for building transformations and jobs. In Figure 1-5 on page 22.Performance considerations You can perform a search in either tab by typing a phrase in the search field and pressing the Enter key. but configuration considerations can influence performance. if you have 1200 records in your database and a change adds an additional half-second to the run time for each record. Performance considerations Performance considerations for Atrium Integrator depend on your network. opening a saved file. BMC Remedy Action Request System (BMC Remedy AR System). the BMC Remedy AR System server database. Carte Carte is a simple web server that you can use to execute transformations and jobs remotely. For example. Predicting the effect of a specific change on Atrium Integrator performance is difficult. such as Run. Toolbar The toolbar provides buttons for common actions such as creating a new file. Preview. Click the icon to expand all steps and the icon to collapse the steps. the data transfer might take an additional 10 minutes to run. Active transformation or job The canvas displays a number of tabbed views that represent the open transformations and jobs. Although it is easy to add field mappings or extra transformations for each field. and Debug. and saving a file. remember that each item you add is compared against every record in your database.

For more information about the Fast Thread and List Thread options and how to specify the number of threads. Limit the columns that you map. the slower the transformation runs. see the BMC Remedy Action Request System 7. Launch multiple copies of a step. see the BMC Atrium CMDB 7. Use JavaScript and lookup steps sparingly as they can significantly increase the processing time.04 External data stores for exchanges with the External Data to CMDB data direction and for relationship data exchanges Provide minimum and maximum values for the Fast Thread and List Thread options in the BMC Remedy AR System Administration Console. Step 2 Create index entries on the BMC_BaseElement class in the Class Manager application to improve the performance of Atrium Integrator.04 Configuration Guide. you can launch 20 copies of a step. 24 User’s Guide . For optimum performance. For example: http://midTier:port/arsys midTier is the name of the web server where the BMC Remedy Mid Tier is installed. you cannot runs steps in parallel. Datasets help in categorizing data by providers. You can then reconcile your dataset with BMC. however. run job and transformation steps in parallel to improve throughput. Preparing to transfer data This section illustrates the high-level steps that you perform to prepare for transferring data. Distribute a step to multiple processing flows when you want to split the transformation flow to multiple processing paths. Step 1 Create a new source dataset to which you can migrate your source data to. enter the URL designated by an administrator. You can access the other Atrium Integrator components from the console. Accessing the Atrium Integrator console The Atrium Integrator console is the main user interface for Atrium Integrator. For instructions.04 Administrator's Guide.ASSET.Atrium Integrator 7.6. When possible. The more columns you map.6.6. If dependencies exist. To access the Atrium Integrator console 1 In a browser.

Accessing the Atrium Integrator console port is the port number of the web server where the BMC Remedy Mid Tier is installed. type your user name. choose BMC Atrium Core > Atrium Core Console. In the Authentication field. If you access multiple servers from the AR System Home page. which is required only if the web server is not using the default port (80 if using Microsoft IIS or 8080 if using Apache Tomcat). type the authentication string (if one was provided by an administrator) 3 Click Login. The Application Launcher bar appears on the left side of the console. specify the following details: In the User Name field. 4 In the AR System Home page. Chapter 1 Understanding Atrium Integrator 25 . 5 From the Application Launcher bar. Figure 1-6: Atrium Integrator link from the Application Launcher The Atrium Integrator console appears. 2 In the login page. type your password. you would choose BMC Atrium Core > serverName > Atrium Core Console. choose Integration Engines > Integrator. In the Password field.

6.04 26 User’s Guide .Atrium Integrator 7.

you can see how the components of Atrium Integrator work together to help you migrate data from an external database to BMC Atrium CMDB. creates and runs an Atrium Integrator job. Allen Allbrook. The following topics are provided: Source data organization at Calbro Services (page 28) Preparing to transfer Calbro Services data (page 30) Transferring Calbro data to BMC Atrium CMDB (page 31) Opening the job and transformations in Spoon (page 40) Editing the job in Spoon (page 45) Running the job (page 48) Verifying that the transferred data is in BMC Atrium CMDB (page 49) Monitoring the job (page 50) Chapter 2 Scenario for transferring data to BMC Atrium CMDB 27 . Through this example. and schedules it to run repeatedly. prepares his CMDB for Atrium Integrator. verifies its success.Chapter 2 Scenario for transferring data to BMC Atrium CMDB This tutorial describes a sample BMC Atrium CMDB scenario in which the Calbro administrator.

The external database has separate tables for computers. Figure 2-1: Organization of the computer and disk drive database tables Computer table HostName SerialNumber vm2-w4-dev01 MX2435 vm2-w3-dev02 VL3421 vm2-w4-dev03 DW2313 vm2-w5-dev06 MX2400 vm2-w7-dev10 MX550 Manufacturer Dell HP Dell Dell HP Disk Drive table Name Disk 1520 Disk 1523 Disk 1560 Disk 1534 Disk 1530 SerialNumber 23541 24761 24645 24671 26541 AssociatedComputer vm2-w4-dev01 vm2-w3-dev02 vm2-w4-dev03 vm2-w5-dev06 vm2-w7-dev10 Mapping source data to BMC Atrium CMDB The records in the Computer table correspond to instances of the BMC_ComputerSystem class in BMC Atrium CMDB. processors. The organization of the database tables for computers and disk drives is shown in Figure 2-1. not just information about the CIs themselves. 28 User’s Guide . the AssociatedComputer attribute in the BMC_DiskDrive class and the HostName attribute in the BMC_ComputerSystem class contain the data necessary to create the relationship. Each record in the Disk Drive table contains the name of its corresponding computer in the AssociatedComputer column. In this case. disk drives. and so on.Atrium Integrator 7. For example.04 Source data organization at Calbro Services Calbro Services has an external database that stores information about all the hardware components in its environment.6. you can select a relationship that associates a particular instance of BMC_DiskDrive with a particular instance of BMC_ComputerSystem. Mapping relationship classes Much of the value of BMC Atrium CMDB comes from the ability to store information about the relationships between configuration items (CIs). in Figure 2-1 on page 28. The records in the Disk Drive table correspond to instances of the BMC_DiskDrive class in BMC Atrium CMDB. This relationship associates a specific instance of a disk drive in the external database with a specific instance of a computer. memory. Because each disk drive is associated with a computer. disk 1520 in the Disk Drive table is associated with computer vm2-w4-dev01 in the Computer table.

The relationship between computer systems and disk drives at Calbro Services is stored within the source tables. Figure 2-2: Creating relationships based on attributes in both CI classes External data store BMC Atrium CMDB Computer table HostName SerialNumber vm2-w4-dev01 MX2435 vm2-w3-dev02 VL3421 vm2-w4-dev03 DW2313 vm2-w5-dev06 MX2400 vm2-w7-dev10 MX550 Disk Drive table Name SerialNumber AssociatedComputer Disk 1520 23541 vm2-w4-dev01 Disk 1523 24761 vm2-w3-dev02 Disk 1560 24645 vm2-w4-dev03 Disk 1534 24671 vm2-w5-dev06 Disk 1530 26541 vm2-w7-dev10 Manufacturer Dell HP Dell Dell HP BMC_ComputerSystem Name Manufacturer vm2-w4-dev01 Dell vm2-w3-dev02 HP vm2-w4-dev03 Dell vm2-w5-dev06 Dell vm2-w7-dev10 HP IntegrateId* MX2435 VL3421 DW2313 MX2400 MX550 InstanceId F8FEF67A 1F8FBE71C 1E6A2L5AF 1C4E8A2FF 1A2B2C5CD Transformation BMC_DiskDrive Name IntegrateId* Disk 1520 23541 Disk 1523 24761 Disk 1560 24645 Disk 1534 24671 Disk 1530 26541 ParentIntegrateId** vm2-w4-dev01 vm2-w3-dev02 vm2-w4-dev03 vm2-w5-dev06 vm2-w7-dev10 InstanceId 1F6ABC21F 1B3CFA89D 1E8AFB71E 1A2CAC48F 1F5AFE19A Transformation Relationship Class Transformation BMC_HostedSystemComponents Source. BMC_ComputerSystem is the source (primary) member and BMC_DiskDrive is the destination (secondary) member of the BMC_HostedSystemComponents relationship class.Source data organization at Calbro Services Each relationship class in BMC Atrium CMDB defines one CI class as the source member of the relationship and another CI class as the destination member of the relationship.InstanceId 1F8FEF67A 1F8FBE71C 1E6A2C5AF 1C4E8A2FF 1A2B2C5CD Destination. because that transformation needs the instance IDs of the related CIs for their relationship instance. as shown in Figure 2-1 on page 28. Chapter 2 Scenario for transferring data to BMC Atrium CMDB 29 . The wizard schedules the transformations in this order automatically.InstanceId 1F6ABC21F 1B3CFA89D 1E8AFB71E 1A2CAC48F 1F5AFE19A *IntegrateId = CalbroIntegrationId **ParentIntegrateId = CalbroParentIntegrationId For each BMC_DiskDrive instance. NOTE The transformations that bring data from the external data store into the CI classes (in this case. and then how a relationship class instance is created based on attributes in the CI classes. For more information about relationship classes.04 Concepts and Planning Guide. In this case. BMC_DiskDrive and BMC_ComputerSystem) must finish before the transformation for the relationship class can run.6. a match between its AssociatedComputer value and the Name value in a BMC_ComputerSystem instance causes the creation of a BMC_HostedSystemComponents relationship between the two CIs. Figure 2-2 on page 29 shows how data from the external database is transferred into BMC Atrium CMDB to create CIs. see the BMC Atrium Core 7.

6 In the Accessibility field.Import) and ID (CALBRO.InstanceId for the BMC_DiskDrive instance. Preparing to transfer Calbro Services data Allen Allbrook prepares to transfer the Calbro Services computer system and disk drive data to BMC Atrium CMDB by: Creating a dataset for the transferred data Creating connections to the source and destination databases Adding an attribute to the BMC_DiskDrive CI class Creating a dataset for the Calbro data As BMC recommends. specify the Name (Calbro. click Create Dataset . 5 In the Dataset Editor. To create a dataset 1 Use the direct access URL to open the BMC Remedy AR System Server midtier and log in with your user name and password.IMPORT. choose BMC Atrium Core > Atrium Core Console. in BMC Atrium CMDB.InstanceId for the BMC_ComputerSystem instance and Destination. 2 On the AR System Home page. 4 In the Reconciliation console. The CALBRO.Atrium Integrator 7. select Writable. 30 User’s Guide . 3 In the BMC Atrium Core Console. 7 Click Save. Allen Allbrook creates a dataset. A separate dataset helps partition data according to data providers. choose Application Launcher > Reconciliation.6.IMPORT) for the dataset.04 The instance IDs of these member CIs are stored in the relationship instance as Source. CALBRO.IMPORT dataset is created in BMC Atrium CMDB.

select CMDB as the Data Store Type. 7 To verify your source database connection parameters. click Manage Data Store Connections 3 Click New Data Store . 8 Click Save. Allen then creates a connection to communicate with the BMC Atrium CMDB server. click Test Connection. which is the destination for the data.Transferring Calbro data to BMC Atrium CMDB Creating a database connection Now Allen creates a data store connection to communicate with the external database. Adding an attribute to the BMC_DiskDrive class Allen creates the ExternalParentIntegrationId attribute in the BMC_DiskDrive CI class using the Class Manager. 4 Specify the remaining information for the target database. . which is the source of the data. select the Data Store Type as Database. 5 Type Calbro Source Tables in the Name field. 6 Specify the remaining information for your source database. 3 In the Data Store Name field. Allen Allbrook transfers the data by: Creating a data transfer job through the Integration Job Builder wizard Editing the job to map an additional column to a target attribute Running the job Chapter 2 Scenario for transferring data to BMC Atrium CMDB 31 . To create a target database connection 1 Click New Data Store . choose Application Launcher > Integration Engines > Integrator. 4 In the New Data Store section on the right side of the Manage Data Stores window. type Calbro Connection to CMDB. For more information about creating attributes. 6 Click Save. Transferring Calbro data to BMC Atrium CMDB After preparing the data. 2 In the Atrium Integrator console. 2 In the New Data Store section on the right side of the Manage Data Stores window. To create a source database connection 1 In the BMC Atrium Core Console.6. see the BMC Atrium CMDB 7. 5 To ensure that you can connect to BMC Atrium CMDB.03 Administrator's Guide. click Test Connection.

The wizard helps Allen Allbrook create a basic job. Allen Allbrook: Verifies that the data is in BMC Atrium CMDB Monitors the data transfer job in the BMC Atrium Integrator console Creating a data transfer job Allen uses the Integration Job Builder wizard to create a data transfer job. which he can then edit in Spoon to tailor it to meet Calbro’s data transfer requirements. enter Transfer Calbro data. select CALBRO. Figure 2-3: General page of the Integration Job Builder wizard 3 In the Job Name field. select Calbro Source Tables. 32 User’s Guide .6. .Atrium Integrator 7. The General page appears. select Calbro Connection to CMDB. 4 In the Description field. and in the Dataset ID. To create a job 1 In the Atrium Integrator console. 6 In the Name field of the Specify Data Store Details for Target area. enter Transfer computer system and disk drive information to CMDB. 5 In the Type field of the Specify Data Store Details for Source area. click Create Job 2 Click anywhere in the Overview page.IMPORT. select Database and in the Name field.04 After the transfer is completed.

The CI TypeRelationships page appears. Computer system is moved to the Selected CI Types area. 10 Select computer system and click Add. The CI Type Selection page appears. Chapter 2 Scenario for transferring data to BMC Atrium CMDB 33 . Figure 2-4: CI Type Selection page of the Integration Job Builder wizard 8 In the Select CI Type from area.IMPORT dataset and then reconciles it into BMC Asset. Allen Allbrook does not use Atrium Integrator to transfer data directly into the BMC Asset dataset. select CI List. 9 In the Available List of CI Types. 12 Click Next.Transferring Calbro data to BMC Atrium CMDB As BMC recommends. Instead. The search criteria applies as you enter text. type computer. 11 Repeat step 9 and step 10 to add disk drive. he transfers the data into the CALBRO. 7 Click Next. and the matching CIs update automatically in the CI Types table.

as shown in Figure 2-5 on page 34. The Computer system Mapping page appears. 14 Click Next. The step toolbar is updated to reflect the selections that Allen Allbrook made. select SYSTEMDEVICE and click Add. 34 User’s Guide .Atrium Integrator 7.04 Figure 2-5: CI TypeRelationships page of the Integration Job Builder wizard 13 From the Available CI Types of Relationships area. Allen maps attributes from the BMC_ComputerSystem class to columns from the source table to specify the fields and attributes to be transferred. which displays the target CI class as BMC_ComputerSytem.6. This relationship identifies computer system as the parent CI and disk drive as the child CI. Here.

16 In the Schema field. Chapter 2 Scenario for transferring data to BMC Atrium CMDB 35 . select dbo. and click Map. 17 Select a target attribute and corresponding source column as displayed in the following table.Transferring Calbro data to BMC Atrium CMDB Figure 2-6: Computer system Mapping page of the Integration Job Builder wizard 15 On the Select Source field. leave the default selection of Table. select CalbroComputerSystem. and in Table.

20 For Delta. which displays the target CI class as BMC_DiskDrive. select the Source Key check box (which indicates that the HostName column uniquely identifies each row of data in the source table). select dbo. 24 In the Schema field. 21 For Response. The Disk drive Mapping page appears.6. Note that the default value of Delta is Yes only when your source table has a date/ time column.04 Repeat this step for each row in the table.Atrium Integrator 7. 19 Click the Transformation Options tab. The names in the Source column are the Computer table database columns in Figure 2-1 on page 28. 22 Click Next. and in Table. select CalbroDiskDrive. 18 For the HostName row. Figure 2-7: Disk drive Mapping page of the Integration Job Builder wizard 23 On the Select Source field. leave the default selection of No. 36 User’s Guide . leave the default selection of Yes and select the LastModified column. leave the default selection of Table. Target attribute Name SerialNumber ManufacturerName Source Column HostName SerialNumber Manufacturer Each row is added to the Mapped Columns area.

Figure 2-8: Relationship Mapping page of the Integration Job Builder wizard Chapter 2 Scenario for transferring data to BMC Atrium CMDB 37 . 29 For Response. and lists the Parent CI as Computer system and child CI as Disk drive. Allen specifies how the two source tables are related to each other. On this page. Select the source column to be used for delta. The names in the Source column are the Computer table database columns in Figure 2-1 on page 28. select the Source Key check box (which indicates that the SerialNumber column uniquely identifies each row of data in the source table). 27 Click the Transformation Options tab.Transferring Calbro data to BMC Atrium CMDB 25 Select a target attribute and corresponding source column as displayed in the following table. Repeat this step for each row in the table. The Relationships Mappings page appears. 30 Click Next. Target attribute Name SerialNumber ExternalParentIntegrationId Source Column Name SerialNumber Associated Computer 26 For the SerialNumber row. and click Map. leave the default selection of Yes. leave the default selection of No. 28 For Delta.

The Computer system Key Columns table displays the Source key that Allen had selected in step 26 on page 37 (HostName). Calbro Services wants to update the database with ATM transactions. 32 From the Disk drive Columns area. 36 In the Interval area.04 31 Leave the default selection of Key Columns of Computer system in table “CalbroComputerSystem” are mapped to columns of “Disk drive” in table “CalbroDiskDrive”. 38 User’s Guide . schedules a data exchange at an interval of an hour to populate the database with the information of the ATM transactions. see “Mapping relationship classes” on page 28. where Allen specifies the time at which the job is to run. leave the default selection of Yes for Delta and select the LastModified column. 34 Click Next. enter 5:00:00 PM. For more information. and the time interval between jobs. This indicates that relationship information is stored in the computer system and disk drive source tables.6. Figure 2-9: Schedule page of the Integration Job Builder wizard 35 In the Start Time field. select AssociatedComputer. This indicates that for each BMC_DiskDrive instance. a match exists between its AssociatedComputer value and the HostName value in a BMC_ComputerSystem. 33 In the Transformation Options tab. The Schedule page appears. type 1 in the Hours field.Atrium Integrator 7. therefore. Allen.

Figure 2-11: List of transformations generated by the Integration Job Builder wizard Chapter 2 Scenario for transferring data to BMC Atrium CMDB 39 . Figure 2-10: Summary page 38 In the Summary page. The Summary page appears. The Generated Transformations dialog box displays the list of transformations generated to transfer the computer system and disk drive records to BMC Atrium CMDB. click Finish.Transferring Calbro data to BMC Atrium CMDB 37 Click Next.

enter admin. The Spoon Repository login page appears. To open the job in Spoon 1 On the computer where you have the Spoon client installed. Figure 2-12: Spoon Repository Login 2 Login as follows: a In the Repository field.6. click Start > All Programs > BMC Software > Atrium Integrator > BMC Atrium Integrator Spoon. d Click OK. The job is listed in the job catalog on the left side of the Atrium Integrator console. Transfer Calbro data_Computer system) 39 Click OK. If you want to do a test run. 40 User’s Guide . and runs as scheduled. c In the Password field. b In the Login field. Allen Allbrook opens the job in Spoon to edit it. Opening the job and transformations in Spoon After creating a simple data transfer job through the Integration Job Builder wizard. select the job from the job catalog and click Start Job .Atrium Integrator 7.04 The following naming convention is used: Name of job_CI being transferred (for example. leave the default entry of NGIEREPD. enter admin (the default password).

Figure 2-14: Transfer Calbro data job Chapter 2 Scenario for transferring data to BMC Atrium CMDB 41 . Figure 2-13: Jobs and transformations for Calbro Services 6 Double-click the Transfer Calbro data job. 4 In the Repository explorer dialog box. 5 Now expand the Transfer Calbro data directory.Opening the job and transformations in Spoon 3 In the Spoon window. All the jobs in the NGIEREPD repository are displayed. and then expand the directory. The job opens. expand the Jobs directory. choose Repository > Explore Repository.

Atrium Integrator 7.6.04

7 Double-click the Set variables step.

The Set Variables dialog box shows the delta and response settings that Allen Allbrook specified when creating his job through the Integration Job Builder.
Figure 2-15: Set variables step in the Transfer Calbro data job

8 Click OK and then double-click the Sub_Transfer Calbro data step.

The Executing a job dialog box shows the delta and response arguments. The argument number is specified within the respective transformations.
Figure 2-16: Executing a job dialog box

9 Click OK.

42

User’s Guide

Opening the job and transformations in Spoon

10 Right-click the Sub_Transfer Calbro data step and select Open job.

The transformations created for the Transfer Calbro data job are displayed.

11 Right-click Transfer Calbro data_Computer system and select Open

transformation. The computer system transformation is displayed. Allen Allbrook makes edits to this transformation in “Editing the job in Spoon” on page 45.
Figure 2-17: Computer system transformation in Spoon

Chapter 2

Scenario for transferring data to BMC Atrium CMDB

43

Atrium Integrator 7.6.04

Table 2-1 describes each step in the Transfer Calbro data_Computer system_Delta transformation.
Table 2-1: Steps in the Transfer Calbro data_Computer system_Delta job transformation (Sheet 1 of 2) Step name What the step does Gets the latest time stamp from the NGIEDELTA table. For a delta job, records are transferred to BMC Atrium CMDB only if the Table Source Delta has a later time stamp than the Table Source Time Stamp. Specifies the argument number for the delta setting. This steps gets the appropriate argument number from the Set variables step as shown in Figure 2-15 on page 42. Specifies whether delta is set to yes, in which case the LastModified time stamp determines whether to transfer the records on a subsequent run. If delta is set to no, all records are transferred. Deletes fields that are not required. This step is only for internal processing.

Specifies the source table.

Provides a placeholder step to add a new field by performing simple calculations.

Provides a placeholder step to map a field to a constant value.

Specifies the argument number for the response setting. This steps gets the appropriate argument number from the Set variables step as shown in Figure 2-15 on page 42. Specifies the BMC Atrium CMDB class, namespace, and Dataset ID to which the data is to be transferred. This step also specifies the source key and input file–target attribute mappings. After the records are transferred to BMC Atrium CMDB, the NGIEDELTA table is updated to reflect the time that the latest record was created in the source table.

44

User’s Guide

Editing the job in Spoon Allen Allbrook wants to make the following edits to the job that he created: The abbreviation that Calbro Services uses for the name of the marketing department has changed from Mktg to MKTG. only records that have a time stamp later than this will be transferred. the response values in the source table is set to 1. Calbro Services wants to transfer data from the dbo.Editing the job in Spoon Table 2-1: Steps in the Transfer Calbro data_Computer system_Delta job transformation (Sheet 2 of 2) Step name What the step does Specifies the name of the transformation. For those records that were not transferred to BMC Atrium CMDB. the response values in the source table is set to 1. Otherwise. After the data is transferred to BMC Atrium CMDB. updates the NGIEDELTA table with the time stamp of the latest-created record in the source table. Specifies the name and path of the file to which errors are written to. Chapter 2 Scenario for transferring data to BMC Atrium CMDB 45 . Allen uses the Filter rows step to set this up. the response values in the source table is set to 0. Map an additional source field to a target attribute. Allen Allbrook uses a calculator step to convert the values in the Department source column to uppercase before transferring them to BMC Atrium CMDB. Defines the job flow. For those records that were not transferred to BMC Atrium CMDB.ComputerSystem. the job updates the specified source field. If you set Response as Yes. For those records that were transferred successfully to BMC Atrium CMDB. they want to keep the value in the target database. On the next delta run.Department field only if the value is not NULL.

ensure that the value of the From step is Filter 2 row. 2 From the Flow menu in the navigation panel. Figure 2-18: Calculator step 2 In the New field column. select the Department column.04 To change the Department column values to uppercase 1 In the Transfer Calbro data_Computer system_Delta transformation. double-click the Calculator step. 5 Click OK. select UpperCase of a String A. 7 Click OK.Atrium Integrator 7. click Design. The upper case values from the Department column will be written to the Used By column. enter Used By. click the Dummy plugin step and place it over the Filter rows 2 step. press the CTRL key. 3 In the Calculation row. 5 Right-click the Dummy plugin step and select New hop. and then select the Dummy plugin step. 4 Click the Filter rows 2 step. Figure 2-19: Inserting the Filter rows step 3 From the Transform menu in the navigation panel. 4 In Field A. click the Filter rows step and drag it between the IsResponse and CMDBOutput steps. Click Yes to split the hop. To add a step to transfer data from the Department field only if the value is not NULL 1 In the navigation panel. 46 User’s Guide . This enables you to set a condition and data that does not comply with your condition is transferred over to the Dummy plugin step.6. 6 In the Hop dialog box. and the Enable hop check box is selected. the value of the To step is Dummy plugin.

Figure 2-21: CMDBOutput dialog box Chapter 2 Scenario for transferring data to BMC Atrium CMDB 47 . c For Send false data to step. enter the appropriate values. To map additional fields to target attributes 1 Double-click the CMDBOutput step. enter Dummy plugin. d For the condition. b For Send true data to step. 8 Double-click the Filter rows 2 step. 9 In the Filter rows dialog box. enter Filter rows. select Distribute.Editing the job in Spoon In the dialog box that appears. enter CMDBOutput. A hop connects the Filter rows 2 and Dummy plugin steps. Figure 2-20: Filter rows dialog box 10 Click OK. specify Used By as IS NOT NULL. a For Step name.

leave the default selection of Local execution. Allen would execute the job remotely. Allen has completed his edits. Allen Allbrook runs it to verify that it runs correctly. 5 Choose File > Save. 1 In the Spoon window. 2 Choose File > Save. click the Sub_Transfer Calbro data tab. 48 User’s Guide . The job runs and displays the logging details (in the Logging tab) in the bottom half of the window. 3 Click Run .04 2 In the Table field column in the Update fields table of the CMDBOutput dialog box. 3 In the Stream field column. Allen Allbrook selects these values to map the Used By column to the Assigned to attribute. 5 Click Launch. and in the Update column. Running the job After editing the job in Spoon. If the Spoon client is installed on a different computer. 4 In the Execute a job window. select Assigned to. NOTE Allen Allbrook runs this job locally because Calbro has BMC Atrium Core installed on the same computer as the Spoon client.6. 4 Click OK. select Y. select Used By.Atrium Integrator 7.

select the Calbro. disk drive. click Options. click the Find tab. Verifying that the transferred data is in BMC Atrium CMDB After the Transfer Calbro data job completes running. Allen Allbrook verifies that the computer system.Import dataset and click OK. 4 In the Query list. and relationship records have been transferred to BMC Atrium CMDB. To verify that the records have been transferred to 1 Return to the browser window and open the BMC Atrium Core Console. 3 In BMC Atrium Explorer. 2 Click Application Launcher > CMDB Applications > Explorer. 5 In the Dataset list.Verifying that the transferred data is in BMC Atrium CMDB Figure 2-22: Job Run window You can also see the job progress on the Atrium Integrator console. The Edit Query Options dialog box appears. Chapter 2 Scenario for transferring data to BMC Atrium CMDB 49 .

Figure 2-23: History tab of the Atrium Integrator console 50 User’s Guide . The disk drives and computers from the external data store are displayed in the search results.Atrium Integrator 7. A new view of the CALBRO. The relationship between Computer vm2-w5-dev06 (parent) and Disk 1534 (child) is displayed. c Drag a CI (for example.IMPORT. The History tab displays the start and end times for each run of this job. Disk 1534) to the relationship panel.IMPORT dataset appears. b Click the New View button and select CALBRO.6. as shown in Figure 2-23 on page 50. 7 To view the relationship between the disk drives and computers. To monitor the data transfer job 1 From the job catalog of the Atrium Integrator console.04 6 In the !Quick search of all CIs area. perform the following steps: a Click the View tab. Monitoring the job Allen Allbrook can monitor the Calbro jobs (whether he ran them from the Atrium Integrator console. click Search. or Spoon) in the Atrium Integrator console. d Right-click the CI and select Expand Parents. select the Transfer Calbro data job.

Monitoring the job 2 Click the Integration Job Details tab to view additional details of the selected job. Figure 2-24: Integration Job Details tab of the Atrium Integrator console Chapter 2 Scenario for transferring data to BMC Atrium CMDB 51 .

Atrium Integrator 7.04 52 User’s Guide .6.

Chapter 3 Working with data store connections This section describes how to connect to your data stores. 1 Con gure source & target connection 2 Create and schedule job 3 Edit transformation or job 4 Run job 5 Monitor job The following topics are provided: Before you begin (page 54) Supported data types (page 55) Creating a new data store connection (page 55) Editing a data store connection (page 58) Deleting a data store connection (page 59) Chapter 3 Working with data store connections 53 . which is the first step in the data transfer process.

04 Before you begin Use Table 3-1 to gather and record the required configuration information.Atrium Integrator 7.6. which you will need when you create a data store connection. Table 3-1: Required configuration information Type of information BMC Atrium CMDB BMC Remedy AR System server name Host name Port RPC Program Number User ID Password CSV or Excel files Path to directory where the file is saved Database Host name Database type Database name Port Instance name (only for Microsoft SQL Server) User ID Password Value 54 User’s Guide .

Chapter 3 Working with data store connections 55 . with a list of defined data sources. 2 Click Manage Data Store Connections . The Atrium Integrator console appears. The Manage Data Stores window appears. The New Data Store section appears on the right side of the Manage Data Stores window. choose Application Launcher > Integration Engines > Integrator.Supported data types Supported data types Table 3-2 shows the supported external data store types and indicates whether you must define specific connection parameters when using that type. Table 3-2: Supported data store types Type Requires specific connection parameters BMC Atrium CMDB Yes Comma separated No value (CSV) flat file XML Databases IBM® Informix® Microsoft SQL Server My SQL Oracle® Sybase No Yes Creating a new data store connection 1 In the BMC Atrium Console. Figure 3-1: Manage Data Stores window 3 Click New Data Store .

complete the following steps. c (optional) Type the port number. NOTE You cannot specify a private RPC port for data transfers into BMC Atrium CMDB. skip to step 7 on page 57. To create a connection to a database. type the RPC port if you use one. a Type a name for the connection.Atrium Integrator 7. e Type the user ID and password to log in to BMC Atrium CMDB. complete the following steps: 56 User’s Guide . You must use the ports defined by BMC Atrium CMDB. 6 To create a connection to a CSV or XML file. skip to step 6 on page 56. For more information about the RPC ports defined by BMC Atrium CMDB. type the name of your BMC Remedy AR System server. b In the AR Server Name field. The fields below the Data Store Type change depending on the data store you selected.6.04 Figure 3-2: New Data Store section of the Manage Data Stores window 4 Select the Data Store Type. To create a connection to a CSV or XML file. 5 To create a connection to BMC Atrium CMDB. see RPC Ports in BMC Atrium CMDB (page 58). d (optional) In the RPC Program Number field.

7 To create a connection to a database. b Specify the path to the folder that contains the source file.Creating a new data store connection Figure 3-3: Creating a connection to a CSV or XML file a Type a name for the connection. The default port for the specified database is displayed. b Enter the host name. Chapter 3 Working with data store connections 57 . Note that the source files must be on the same computer on which you have installed the BMC Remedy Mid Tier. c Specify the database type. complete the following steps: Figure 3-4: Creating a connection to a database a Type a name for the connection. d Enter the name of the database you want to connect to.

Table 3-3: Icons associated with data stores Icon Associated data store type CMDB CSV file XML file Database Clicking on a data store provides the connection parameter details for that source. 8 Click Test Connection to verify the connection parameters.6. Each connection has an icon attached to it depending on the data store type. RPC Ports in BMC Atrium CMDB BMC Atrium CMDB has assigned the following RPC ports for Atrium Integrator: # define CMDB_RPC_PROGRAM_NUM_STANDARD # define CMDB_RPC_PROGRAM_NUM_ADMIN # define CMDB_RPC_PROGRAM_NUM_PRIVATE_MIN # define CMDB_RPC_PROGRAM_NUM_PRIVATE_MAX 390696 390697 390698 390699 Editing a data store connection All data store connections are displayed in the Data Stores section of the Manage Data Stores window.04 e (optional) For a SQL Server database. select the data store for which you want to edit the connection information. The data store connection is created and displayed in the Data Stores section on the left side of the Manage Data Stores window. type the instance name. 1 In the Manage Data Stores window. 58 User’s Guide . Connection details for the selected data store are displayed on the right side of the window. f Type the user ID and password to log in to the database. as described in Table 3-3 on page 58.Atrium Integrator 7. 9 Click Save.

Jobs that were based on the deleted connection are not affected. Note that you cannot edit the data store type. The data store connection is saved. 2 Click Delete Data Store . 1 In the Manage Data Stores window. 3 Click Test Connection to verify the connection parameters. Any new jobs that you create will be based on the edited connection. The data store connection is deleted. Deleting a data store connection All data store connections are displayed in the Data Stores section of the Manage Data Stores window.Deleting a data store connection Figure 3-5: Connection details in the Manage Data Stores window 2 Make the necessary changes. Chapter 3 Working with data store connections 59 . 4 Click Save. but jobs defined using the previous connection are not updated. select the data store for which you want to delete the connection.

6.Atrium Integrator 7.04 60 User’s Guide .

or ITSM forms. To import and export data from inputs like LDAP. The following topics are provided: Creating a simple job through the Integration Job Builder wizard (page 62) Creating a complex job in Spoon (page 81) Chapter 4 Creating a job 61 . 1 Con gure source & target connection 2 Create and schedule job 3 Edit transformation or job 4 Run job 5 Monitor job Atrium Integrator provides an easy-to-use wizard for creating a simple data transfer job for importing data into BMC Atrium CMDB. you can first create a simple data transfer job using the wizard. BMC Remedy AR System forms. you can create a job in Spoon using the samples provided by BMC.Chapter 4 Creating a job You can create a job in the Atrium Integrator console by using the Integration Job Builder wizard. For complex data manipulations. and then refine the generated job and transformations in Spoon. or in the Spoon application.

Using the wizard has the following benefits: You need to specify only the business names for the information types to be transferred to BMC Atrium CMDB. The wizard adheres to best practices for populating data. CSV files.6. 1 Specify source and target details 2 Select CI types to transfer 3 Select relationships for the CI types to transfer 4 Map target attributes to source columns 5 De ne relationship mapping 6 Schedule job 7 View job summary 62 User’s Guide . data transfers are sequentially ordered. such as auto populating categorizations and name fields for relationships.04 Creating a simple job through the Integration Job Builder wizard You can use the Integration Job Builder wizard in the Atrium Integrator console to create a simple job for transferring data from XML files. IBM Informix. The wizard has built-in templates that specify typical integrations based on BMC experience in populating CMDB. The wizard automatically selects the Common Data Model (CDM) classes and relationships based on the information entered. and Sybase) to BMC Atrium CMDB. Best practice BMC recommends that you use the Integration Job Builder wizard to automatically generate a job and transformations from best practice templates. When multiple CI and relationship classes are selected. or databases (IBM DB2®. Processing of delta records is simplified. High-level steps for creating a job through the Integration Job Builder wizard This section describes the high-level steps for creating a job to transfer data from an external data store to BMC Atrium CMDB using the Integration Job Builder wizard. This will improve your productivity by providing a starting point for developing and simplifying the transformation of data into BMC Atrium CMDB. Oracle. Microsoft SQL Server. My SQL.Atrium Integrator 7.

or select CIs based on a template. see “Creating a job schedule” on page 79. external data store. For more information. see “Viewing the job summary” on page 80. Specify whether the source has a: Direct association between parent and child classes This option creates a mapping for a relationship class based on attributes in the CI classes (parent-child) that are members of this relationship. Step 7 View the job summary. see “Selecting CI types to transfer” on page 65. For more information. Step 5 Define the relationship mapping for the CI types to be transferred. Map the target attributes of the CI to the columns in the external data store. Based on the CI types that you want to transfer. Step 2 Select CI types to transfer. see “Defining relationship mapping for the CI types to transfer” on page 74. Separate table to define relationships This option creates a mapping for a relationship class based on relationship data stored in the external data store. You must specify the job name and description. For more information. the Integration Job Builder wizard displays the relationships between the CI types. For more information. see “Mapping target attributes to source columns” on page 69. Select the CI types that you want to transfer from the external data store. For more information. and the CI types and relationships that you are transferring. Chapter 4 Creating a job 63 . and the CMDB class and DatasetID to which you want to transfer data. Verify the job name. For more information. You can either select CIs from a list. Step 4 Map target attributes to source columns. For more information.Creating a simple job through the Integration Job Builder wizard Step 1 Specify source and target details. see “Specifying source and target details” on page 64. Select the relationships that you want to transfer. 6 Schedule the job to run at a specific time or timed interval. see “Selecting relationships to transfer for the CI types” on page 68. Step 3 Select the relationships to transfer for the CI types.

click anywhere on the screen. enter the name and description of the job.04 Creating a job through the Integration Job Builder wizard Atrium Integrator provides a wizard to simplify the process of creating a job to transfer data into BMC Atrium CMDB. click Create Job 2 In the Overview page.6. The General page appears. . Figure 4-1: General page of the Integration Job Builder wizard 3 In the General page.Atrium Integrator 7. Specifying source and target details 1 Specify source and target details 2 Select CI types to transfer 3 Select relationships for the CI types to transfer 4 Map target attributes to source columns 5 De ne relationship mapping 6 Schedule job 7 View job summary To specify source and target details 1 In the Atrium Integrator console. This topic presents the steps for each wizard page in a separate procedure. Follow the procedures sequentially. 64 User’s Guide . as indicated in the graphic.

or select the CI types for which you want to transfer data from a CI list. The Next button is enabled only after the Job Name. transfer the data into another dataset and then reconcile it into BMC Asset. click Data Store to create a new connection. see “Creating a new data store connection” on page 55. and virtual machine template. see “Creating a new data store connection” on page 55. specify the type and name of the external data store. Each available template groups together the appropriate CIs and relationships. and DatasetID fields have valid entries. select the name of the data store and DatasetID of the BMC Atrium CMDB class to which you are transferring data. see “To select CI types to transfer from a CI list” on page 67. For more information. For more information. If you do not have a data store connection to BMC Atrium CMDB. 5 In the Specify Data Store Details for Target area. the wizard automatically moves all related CIs to the Selected CI Types area. For example. Instead. the virtual machine template groups all the CIs that make up that virtual machine. Source and Target Name. To select CI types from a template. Selecting CI types to transfer 1 Specify source and target details 2 Select CI types to transfer 3 Select relationships for the CI types to transfer 4 Map target attributes to source columns 5 De ne relationship mapping 6 Schedule job 7 View job summary You can select CI types grouped together in a template. To select independent CI types. If you select this template. click Data Store to create a new connection. To select CI types to transfer from a templates list The Integration Job Builder wizard offers a desktop. The CI Type Selection page appears. server.Creating a simple job through the Integration Job Builder wizard 4 In the Specify Data Store Details for Source area. NOTE Do not use Atrium Integrator to transfer data directly into the BMC Asset dataset. 6 Click Next. Chapter 4 Creating a job 65 . see “To select CI types to transfer from a templates list” on page 65. If you do not have a data store connection to your source data.

Atrium Integrator 7. 4 Click Next. You can remove a CI by selecting it and clicking Remove. Figure 4-2: CI Type Selection page of the Integration Job Builder wizard–Templates 2 Select the template from which to transfer CI types. The selected template moves to the Selected Templates list. 3 Click Add.04 1 In the CI Type Selection page. to see the CIs The CIs bundled with the selected template are displayed in the Selected CI Types area.6. The Next button is enabled after one or more templates have been added to the Selected Templates column. The CI Type Relationships page appears. 66 User’s Guide . leave the default selection of Templates in the Select CI Types from area. Click and relationships included in that template.

The CI Relationships page appears. When you hover over a CI type. To select multiple CI types. Chapter 4 Creating a job 67 . To filter the CI types by name. 4 Click Next. Type. click Select CI Types from CI List.Creating a simple job through the Integration Job Builder wizard To select CI types to transfer from a CI list 1 In the CI Type Selection page. The selected CI types move to the Selected CI Types list. its class name and Product categorization attributes (Category. Figure 4-3: CI Type Selection page of the Integration Job Builder wizard– CI List 2 Select the CI type you want to transfer. 3 Click Add. Filtering is case insensitive and displays all results containing the filter text. press the Ctrl key and then select the CI types. type in the Available List of CI Types field. The Next button is enabled after a CI type has been added to the Selected CI Types column. and Item or CTI) are displayed.

Atrium Integrator 7. type in the Available Relationships field.6. 3 Click Next. When you hover over a relationship type. 68 User’s Guide . Filtering is case insensitive and displays all results containing the filter text. Figure 4-4: CI Relationships page of the Integration Job Builder wizard 2 Click Add to move the selected relationships to the Selected CI Types Relationships list.04 Selecting relationships to transfer for the CI types 1 Specify source and target details 2 Select CI types to transfer 3 Select relationships for the CI types to transfer 4 Map target attributes to source columns 5 De ne relationship mapping 6 Schedule job 7 View job summary The CI Types Relationships page displays the available relationships for the selected CI types. To select relationships to transfer for the CI types 1 In the CI Relationships page. To select multiple relationships. the relationship name and parent and child CIs are displayed. To filter the relationships by name. press the Ctrl key and select the relationships. select the relationships that you want to transfer.

You can then map target attributes to source columns based on this view. You can choose attributes to use for the source key that are already in the standard identification rule. For example. such as the Description attribute. the record cannot be identified and it cannot be transferred. the step toolbar would be updated. Figure 4-5: Step toolbar of the Integration Job Builder wizard Mapping target attributes to source columns 1 Specify source and target details 2 Select CI types to transfer 3 Select relationships for the CI types to transfer 4 Map target attributes to source columns 5 De ne relationship mapping 6 Schedule job 7 View job summary Mapping target attributes to source columns defines how data in the source corresponds to data in BMC Atrium CMDB and which actions to take when transferring between them. consider the following points: Do not use an attribute whose value could change or could be NULL. After a data transfer. For example. If your external database has records with empty values.6. This ensures that you can use a Standard Job for reconciliation. If the source key of a record is NULL. you can create a view of your external database to filter out such records. and Operating system CIs and the SYSTEMOS relationship. Choose a unique attribute that you can also use for identification during reconciliation. For more information about Standard Jobs. You must specify the attributes of the CI class and the corresponding column in the external data store that together make up the source key.04 Normalization and Reconciliation Guide. Disk drive. A source key uniquely identifies a row of data. and Operating system to be transferred to BMC Atrium CMDB. if you had selected the Computer system. the Operating system Mapping page would appear.Creating a simple job through the Integration Job Builder wizard The Mapping page for the last selected CI type appears. Best practices When choosing an attribute as a source key. Note that the step toolbar at the top of the page is updated to display a mapping step for each CI type that you selected and a step for the relationships. if you had selected Computer system. see the BMC Atrium CMDB 7. the source key is the link that matches a record in the external data store with its counterpart in BMC Atrium CMDB. Each relationship is represented as a tab in the relationship page. Disk drive. Chapter 4 Creating a job 69 .

To filter attributes by name. To map target attributes to source columns for CSV or XML files 1 In the Mapping page. To map the selected attribute to a constant value. 3 From the Source Columns table. select a column from which you want to transfer data to the selected attribute. Filtering is case insensitive and displays all results containing the filter text. Figure 4-6: Mapping page of the Integration Job Builder wizard for CSV or XML files 2 Select a target attribute to which you want to transfer data. For the sample scenario shown in Figure 2-1 on page 28. This simplifies your reconciliation setup by allowing multiple classes to inherit identification rules from the BMC_BaseElement class. type in the Source Columns field. enter the value in the field below the Source Columns table. To filter columns by name. NOTE You must map all attributes identified by a * preceding the attribute name (for example. type in the Target Attributes field. Columns from the selected file are displayed in the Source Columns list.6. *Name).Atrium Integrator 7.04 If you cannot use the standard rules. use attributes inherited from the BMC_BaseElement class. Filtering is case insensitive and displays all results containing the filter text. you would define a source key that relates a drive ID in the Disk drive ID column of the CalbroDiskDrive table with the CalbroIntegrationID attribute in the BMC_DiskDrive class. 70 User’s Guide . select the CSV or XML file from which you want to transfer records.

NOTE You must have at least one attribute/source column mapping in addition to those specified as source keys. Chapter 4 Creating a job 71 . select the Source Key check box for the Target Attribute/Source Column row that you want to specify as a source key. 7 Repeat step 6 for each source key that you want to map. 6 In the Mapped Columns table. The selected attribute and source column move to the Mapped Columns table. That means a data row in the external data store matches an instance in BMC Atrium CMDB only if each pair of attributes in the source key matches.Creating a simple job through the Integration Job Builder wizard 4 Click Map. the expressions are joined with an AND operator. 5 Repeat step 2 through step 4 for each attribute to which you want to transfer data. When you have a source key with more than one attribute from each side.

Figure 4-7: Transformation Options tab–Mapping page of the Integration Job Builder wizard 9 In the Delta area: Select No to retrieve all source records each time your job runs. 72 User’s Guide . During each data transfer. If the source is a CSV file. the only records retrieved from the source are new records and those with a last modified time stamp that is later than the most recent successful transfer. If you specify Delta=No (that is.6.04 8 Click the Transformation Options tab. Then select the column in your source that holds the time stamp indicating when each record was last modified. The default value for Delta is Yes if a column in your source table has a Date/ Time value. the transformation that is designed will require significant manual changes in Spoon to make it delta enabled. select full mode). Select Yes to import only new or updated source records since the last transfer was run. Best practice BMC recommends that you select the Delta=Yes mode at design time so that the job can be run in both delta and full modes in the future.Atrium Integrator 7. all columns are listed in the Delta area.

you might need to store the ID number of the target record just created. or you might want to update a time stamp in the source data. 11 Click Next. If you select yes. you use a response field when a value is generated at the time a target record is created or modified and you want that value stored in the source record. Figure 4-8: Mapping page of the Integration Job Builder wizard for database tables 2 Select the Schema and Table name for the source data. The Mapping page for the next CI type appears. You can specify a field that is updated in the source record after a record is created or updated in the target. Chapter 4 Creating a job 73 . To map target attributes to source columns for database tables or views 1 In the Mapping page. specify whether your source data is in a table or a view. if you had selected Computer system and Disk drive to be transferred to BMC Atrium CMDB. Best practice Typically. indicating the time that a transfer took place. For example. the Schedule page appears. If you selected only one CI. the Disk drive Mapping page appears. select the column in your source that you want to update. For example.Creating a simple job through the Integration Job Builder wizard 10 Specify whether you want to set a Response field. The columns from the source table are displayed in the Source Column Name list box.

the AssociatedComputer attribute in the BMC_DiskDrive class and the Name attribute in the BMC_ComputerSystem class contain the data necessary to create the relationship. This attribute associates an instance of a disk drive with an instance of a computer. follow the steps in “Defining relationship mapping based on attributes in CI classes” on page 74. In this case. In this case. 74 User’s Guide . You would have defined a mapping for the BMC_DiskDrive CI class that contains an attribute called AssociatedComputer. Defining relationship mapping for the CI types to transfer 1 Specify source and target details 2 Select CI types to transfer 3 Select relationships for the CI types to transfer 4 Map target attributes to source columns 5 De ne relationship mapping 6 Schedule job 7 View job summary How you define the relationship between the CI types that you are transferring to BMC Atrium CMDB depends on whether the relationship data in your source tables is class-based or stored in an external table. This attribute defines the name of a computer that you have in inventory. Each relationship class in BMC Atrium CMDB defines one CI class as the parent member of the relationship and another CI class as the child member of the relationship. Defining relationship mapping based on attributes in CI classes If your relationship data is stored within your source CI tables. For example. You also would have defined a mapping for the BMC_ComputerSystem CI class that contains an attribute called Name. follow the steps in“Defining relationship mapping with an external data store as the source” on page 75.04 Concepts and Planning Guide. you can create a mapping for the BMC_HostedSystemComponents relationship class that associates a particular instance of BMC_DiskDrive with a particular instance of BMC_ComputerSystem. you can follow the example in “Source data organization at Calbro Services” on page 28. disk 1520 in the Disk Drive table is associated with computer vm2-w4-dev01 in the Computer table. If your relationship source is an external data store. If your relationship source is CI class.Atrium Integrator 7. For more information about relationship classes. see the BMC Atrium Core 7.6. Because each disk drive in your company is associated with a computer. BMC_ComputerSystem is the source (parent) member and BMC_DiskDrive is the destination (child) member of the BMC_HostedSystemComponents relationship class.04 3 Follow step 2 on page 70 to step 11 on page 73 to map target attributes to source columns.6.

Chapter 4 Creating a job 75 . leave the default selection which says that the relationship data is contained within the source columns of the two CIs. the Computer system Key Column displays SerialNumber (the source key for computer system). The Relationship Mapping page appears. Defining relationship mapping with an external data store as the source This method compares attributes between each CI class and the external data store.InstanceId. the Calbro administrator selects the AssociatedComputer column. 2 From the child CI column. Figure 4-9: Relationship Mapping page of the Integration Job Builder wizard–CI classes as source The source key that you specified for the parent CI (SerialNumber for Computer system in the example) is displayed in the first column.Creating a simple job through the Integration Job Builder wizard To define relationship mapping with CI classes as the source 1 In the Relationship Mappings page. In the sample Calbro scenario (“Creating a data transfer job” on page 32). no relationship instance is created. From the Disk drive Columns. If no attribute values correspond. 3 Click Next. select the column that contains the information that associates the child CI with the parent CI.InstanceId and Destination. The instance IDs of these member CIs are stored in the relationship instance as Source. which maps a disk drive to appropriate computer system.

6. no relationship is created. The Name attribute from the Disk Drive Information table from the external data store is mapped to the Name attribute in the BMC_DiskDrive class.04 Figure 4-10 and Figure 4-11 on page 77 present an example of mapping in two stages based on relationship data stored in an external data store. Instance IDs for individual members of the BMC_ComputerSystem class are generated. 76 User’s Guide . In this stage.Atrium Integrator 7. Figure 4-10: Stage 1 of creating a data mapping based on relationship data stored in an external data store In Stage 1. Instance IDs for individual members of the BMC_DiskDrive class are also generated. the Name attribute from the Computer Information table from the external data store is mapped to the Name attribute of the BMC_ComputerSystem class.

Best practice BMC recommends that you use this method for many-to-many relationship mappings. The instance IDs of the member CIs are stored in the BMC_HostedSystemComponents relationship class as Source. a match is found between the values of the AssociatedComputer attribute from the Disk Drive Information table and the Name attribute from the BMC_ComputerSystem class. Chapter 4 Creating a job 77 . This relationship is stored in the BMC_HostedSystemComponents relationship class. In this example. you can define the relationships in an external database table or in a file that defines the mapping of an attribute and an equivalent column. BMC_ComputerSystem becomes the source class and BMC_DiskDrive becomes the destination class for the relationship mapping. when the data exchange runs. attributes from the Disk Drive Information table in the external data store correspond to the attributes in the BMC_ComputerSystem and BMC_DiskDrive tables in BMC Atrium CMDB. a relationship is created between the two CI classes in BMC Atrium CMDB. When you populate the data in the primary and secondary classes. A relationship is thus created between BMC_ComputerSystem and BMC_DiskDrive.InstanceId and Destination.InstanceId for BMC_ComputerSystem and BMC_DiskDrive. When attributes from a data table in an external data store correspond between two CI classes in BMC Atrium CMDB.Creating a simple job through the Integration Job Builder wizard Figure 4-11: Stage 2 of creating a data mapping based on relationship data stored in an external data store In Stage 2.

Atrium Integrator 7. the source key is displayed in the left column. In the Association Table Columns. 4 For the child CI. The Schedule page appears.6. the source key is displayed in the left column. select the button whose label says that the key columns of the CIs are related using columns in an external table. Figure 4-12: Relationship Mapping page of the Integration Job Builder wizard–external data store as source 2 Specify the schema and name of the external table containing the relationship information. 6 Click Next.04 To define relationship mapping with external data store as the source 1 In the Relationship Mappings page. 78 User’s Guide . select the column from the external table that maps to the source key. select the column from the external table that maps to the source key. 5 Click the Transformation Options tab and specify the delta options. In the Association Table Columns. 3 For the parent CI.

because the reconciliation jobs and Atrium Integrator jobs could query or update the same data. Any changes made to a job are implemented at the next scheduled interval. Figure 4-13: Schedule page of the Integration Job Builder wizard 2 Enter the time (BMC Remedy AR System server time) at which you want the job to first run. 4 Click Next. The Summary page appears. 3 Enter the interval in days. hours.Creating a simple job through the Integration Job Builder wizard Creating a job schedule 1 Specify source and target details 2 Select CI types to transfer 3 Select relationships for the CI types to transfer 4 Map target attributes to source columns 5 De ne relationship mapping 6 Schedule job 7 View job summary To create a schedule for the job 1 On the Schedule page. or minutes at which you want the job to run. Chapter 4 Creating a job 79 . select Enable. The interval is the time to wait after one job is completed before starting the next one. make sure that you do not run the reconciliation jobs and Atrium Integrator jobs at the same time. Best practice When you run reconciliation jobs.

If you make changes that have dependencies.6. the mapping between key source columns and target columns. you must update the CI type relationships. and relationship mapping. click Back. If you need to make any changes. A job is created and saved in the Spoon repository. verify the CI types and relationships that you have selected. 80 User’s Guide .04 Figure 4-14: Summary page of the Integration Job Builder wizard Viewing the job summary 1 Specify source and target details 2 Select CI types to transfer 3 Select relationships for the CI types to transfer 4 Map target attributes to source columns 5 De ne relationship mapping 6 Schedule job 7 View job summary To view the job summary 1 In the Summary page. For example. 3 Click OK. A list of the transformations created for your job is displayed. If an error occurred while creating your job. 2 Click Finish. an error message is displayed.Atrium Integrator 7. if you change the CI type to transfer. you must go page by page and update your selections.

enter admin. Creating a complex job in Spoon You can use Spoon to import and export data from inputs like LDAP. c In the Password field. AR forms. ITSM forms. Figure 4-15: Spoon Repository Login 2 Login as follows: a In the Repository field. enter admin. d Click OK. b In the Login field. Chapter 4 Creating a job 81 . click Start > Programs > BMC Software > Atrium Integrator > BMC Atrium Integrator Spoon. leave the default entry of NGIEREPD. keep the repository password secure and encrypted. and those requiring complex staging tasks or complex data manipulations. To customize a sample job or transformation 1 On the computer where you have the Spoon client installed. The Spoon Repository login page appears. Back up the repository database frequently. BMC provides several sample jobs that you can use as a starting point.Creating a complex job in Spoon Best practice For security reasons.

6 In the properties window.Atrium Integrator 7. Creating a job to migrate data from a development server to a production server You can create a job in Spoon to migrate data from the BMC Atrium CMDB on your development server to the BMC Atrium CMDB on your production server.04 3 In the Spoon window. right-click the canvas and select New note. see the Spoon User Guide at http://wiki. 3 In the navigation panel. Add notes to your jobs and transformations to keep track of complex flows and functionality. save the job in the Kettle repository so that you can monitor and schedule it in the Atrium Integrator console.pentaho. 5 Double-click the CMDBInput step. The Repository explorer dialog box shows the sample jobs in the Jobs/BMC SAMPLES directory and the sample transformations in the Transformations/BMC SAMPLES directory. For more information about creating a job in Spoon. Use the same name prefix to identify related jobs and transformations. After you verify that a job is working in production. Select a connection to the BMC Atrium CMDB on your development server. enter a name for the job or transformation and then click OK. 7 Edit the job or transformation as needed. do one of the following. To add a note. 82 User’s Guide . choose Repository > Explore Repository. Use variables for file paths or computer-specific connection information so that file paths and so forth can be determined dynamically instead of statically. The sample job or transformation is saved with the name that you specify.com/display/EAI/Spoon+User+Guide. 2 In the Spoon window. click Input. 5 Choose File > Save as. To create a migration job 1 Follow step 1 through step 3 on page 82 to log in to the default Spoon repository. Create a new connection to the BMC Atrium CMDB on your development server by following the steps below. 4 Click CMDBInput and drag it to the canvas. Best practices Use a naming convention for jobs and transformations that makes them easy to identify. choose File > New > Transformation. In the Connection field of the CMDBInput dialog box. 4 Double-click a sample job or transformation.6.

c (optional) Type the port number. select InstanceId in the Table field column and type InstanceId in the Stream field 1 column. Chapter 4 Creating a job 83 . b In the Server Name field of the Database Connection dialog box. d (optional) In the RPC Program Number field.Creating a complex job in Spoon a Click New. For more information about the RPC ports defined by BMC Atrium CMDB. This mapping enables you to keep the same Instance Ids as you transfer data from the BMC Atrium CMDB on your development server to the BMC Atrium CMDB on your production server. You can run this transformation in Spoon. f Click Test to validate the connection. click the CMDBOutput step and drag it to the canvas. 7 The NameSpace field displays the namespace for the selected class. 17 Choose File > New > Job. type the RPC port if you use one. see “Connecting transformation steps or job entries in Spoon” on page 88. 15 In the Transformation Properties dialog box. 14 Choose File > Save as. 16 Click OK. g Click OK. type the name of your BMC Remedy AR System server. select the dataset from which you want to migrate data. 9 Click OK. specify a name for the transformation. 6 In the Class Name field. e Type the user ID and password to log in to BMC Atrium CMDB. click Browse to select the BMC Atrium CMDB class from which you want to migrate data. You must use the ports defined by BMC Atrium CMDB. 13 Create a hop from the CMDBInput step to the CMDBOutput step. For information on creating a hop. see RPC Ports in BMC Atrium CMDB (page 58). However. 10 From the Output menu in the navigation panel. NOTE You cannot specify a private RPC port for data transfers into BMC Atrium CMDB. 12 In the key look up area. 11 Repeat step 5 to step 8 on page 83 to create a connection to the BMC Atrium CMDB on your server through the CMDBOutput step. you must envelop this transformation in a job to be able to monitor and run it from the Atrium Integrator console. 8 In the Dataset Id field.

22 Click OK. 20 Double-click the Transformation step. 24 In the Job Properties dialog box. 23 Choose File > Save as. 21 In the Name of transformation field. The job is now displayed in the Atrium Integrator console.Atrium Integrator 7. click to select the transformation you had created in step step 15 on page 83. 25 Click OK. select the Start step and drag it to the canvas. 84 User’s Guide .6.04 18 From the General menu in the navigation panel. specify a name for the job. 19 Click and drag the Transformation step to the canvas.

Chapter 5 Editing jobs and transformations After you create your job with the Integration Job Builder wizard. 1 Con gure source & target connection 2 Create and schedule job 3 Edit transformation or job 4 Run job 5 Monitor job The following topics are provided: Opening your job or transformation (page 86) Mapping the Integration Job Builder wizard output to Spoon steps (page 87) Connecting transformation steps or job entries in Spoon (page 88) Adding intermediate steps to a job (page 90) Adding intermediate steps to a transformation (page 93) Editing transformation steps (page 97) Editing transformation properties (page 98) Launching several copies of a step (page 100) Changing data mappings (page 101) Exploring a database connection (page 101) Browsing source data (page 102) Changing source configuration (page 103) Chapter 5 Editing jobs and transformations 85 . you can edit it in the Spoon application. Best practice BMC recommends that you validate and clean up your source data before transferring it to BMC Atrium CMDB.

6. The Repository explorer dialog box shows all the jobs and transformations in the NGIEREPD repository. leave the default entry of NGIEREPD.04 Opening your job or transformation After you create your job through the Integration Job Builder wizard. Figure 5-1: Spoon Repository Login 2 Login as follows: a In the Repository field. 3 In the Spoon window.Atrium Integrator 7. choose Repository > Explore Repository. d Click OK. The Spoon Repository login page appears. click Start > Programs > BMC Software > Atrium Integrator > BMC Atrium Integrator Spoon. b In the Login field. c In the Password field. enter admin. enter admin. 1 On the computer where you have the Spoon client installed. 86 User’s Guide . you need to open it in Spoon to make edits.

CI Type Selection Relationships Selection CI Mapping Data mapping CMDBOutput.Mapping the Integration Job Builder wizard output to Spoon steps Figure 5-2: Repository explorer window with sample jobs and transformations Mapping the Integration Job Builder wizard output to Spoon steps This section describes how each page in the Integration Job Builder wizard maps to Spoon steps. go to the Manage Data Stores—New Data Store page. go to the Manage Data Stores—New Data Store page. General—Data Store details for Target To create a target data store. This will help you understand what steps you should edit in Spoon.ClassName field CMDBOutput.ClassName field CMDBOutput CMDBOutput (table section) Chapter 5 Editing jobs and transformations 87 Output > CMDBOutput step Corresponding Spoon step Name of job_CI being transferred Input step . Table 5-1: Mapping the Integration Job Builder wizard output to Spoon steps (Sheet 1 of 2) Wizard page General—Job Name General—Data Store details for Source To create a source data store.

Atrium Integrator 7. A transformation hop defines the direction of the data flow. a hop connects one transformation step or job entry with another in the Spoon application. 88 User’s Guide . open the job or transformation to which you want to add a hop.6. 2 Select the first step. Figure 5-3: Transformation hop A job hop defines the job execution order and the condition on which the next job entry is to be executed. Figure 5-4: Job hop Creating a hop You can create a hop between steps in a transformation or between jobs.04 Table 5-1: Mapping the Integration Job Builder wizard output to Spoon steps (Sheet 2 of 2) Wizard page Key mapping Relationship Mapping Configuration and Logging options Corresponding Spoon step CMDBOutput (key section) CMDBLookUp Set variables Connecting transformation steps or job entries in Spoon In Spoon. To create a hop 1 In Spoon.

and then press the right mouse button and select New hop. The steps are connected by a hop. The hop is deleted. Press the Control key and select the second step. The direction of the hop is reversed. Deleting a hop To delete a hop Right-click a hop and select Delete hop. The hop is disabled and its color changes to gray. Specifying the condition on which a job entry is executed You can specify the condition on which the next job entry is to be executed by specifying an evaluation mode for the hop that goes to that job entry. The hop arrow indicates the direction of the data flow. To specify the evaluation mode 1 Right-click a job hop and select Evaluation. To flip a hop Right-click a hop and select Flip direction. NOTE The Disable hop command appears only when you right-click on an active hop. Reversing the direction of a hop You can change the direction of the data flow by reversing the direction of the hop.Connecting transformation steps or job entries in Spoon 3 Perform one of the following actions: Press the Shift key and draw a line to the second step. 2 Select one of the following commands: Chapter 5 Editing jobs and transformations 89 . To disable a hop Right-click on a hop and select Disable hop. Disabling a hop You can disable a hop for testing purposes.

6. or to a custom job you create through the Spoon application. Adding intermediate steps to a job You can add intermediate steps to a job that you create through the Integration Job Builder wizard. Transformation hop colors Transformation hops are displayed in a variety of colors based on the properties and state of the hop. If multiple hops are leaving a step. This job hop uses the icon. The hop is disabled. Provides information about the step and copies rows.Atrium Integrator 7. all rows of data are copied to all target steps. Follow when result is false specifies that the next job entry is to be executed when the result of the originating job entry is false. The hop carries rows that caused errors in source steps. An unconditional job hop uses the icon. Follow when result is true specifies that the next job entry is to be executed when the result of the originating job entry is true. If multiple hops are leaving a step. Provides information about the step and distributes rows. To add an intermediate step to a job 1 Click the step you want to add and drag it to the canvas. Table 5-3 lists the common steps you can add to your job to manipulate the data before adding it to BMC Atrium CMDB. rows of data are evenly distributed to all target steps. 90 User’s Guide . This job hop uses the icon.04 Unconditional specifies that the next job entry must be executed regardless of the result of the originating job entry. as described in Table 5-2. Table 5-2: Hop line colors Hop color Black Description Gray Green Red Yellow Magenta Red dot line The hop has a defined target step.

When the contents of the files are the same. This is useful for creating trigger files from within jobs. Deletes one or more folders and all the content in them. Clears an error state found in a job and forces it to the success state. Creates a folder at the specified location. Displays a message box in the job to enable you to see where you are in the process. Sends a text or HTML e-mail with optional file attachments. Starts a job. Executes a previously defined job.pentaho. Create an empty file at the specified location. Pings a host machine using the ICMP protocol.com/display/EAI/Spoon+User+Guide. otherwise. Compares the contents of two files and controls the flow of the job by it. The dummy step does not perform any evaluation. HTTP Chapter 5 Editing jobs and transformations 91 . What it helps you do Delete filenames from Delete all the filenames that are in the result files list of the last result job entry. Copies or moves all the filenames that are in the result files list of the last job entry. This list of filenames can then be used in the various job entries all around. Delete files Delete folders File Compare Deletes a set of files. Deletes the specified file. Executes a previously defined transformation. the success outgoing hop is followed.Adding intermediate steps to a job For information about additional steps that you can add to your job. Retrieves emails from a POP server and store them into one or more files. see the Spoon User Guide at http://wiki. Truncates one or several tables. Compares two folders to check if their content is identical. Aborts the specified job. Copies one of more files or folders. the failure hop is followed. Gets a file from a web server using the HTTP protocol. Table 5-3: Intermediate steps for jobs (Sheet 1 of 3) Option General menu Start Dummy Abort job Display Msgbox Info Job Ping a host Success Transformation Truncate tables Write to Log Mail menu Get mails from POP Mail File management menu Add filenames to result Compare folders Copy files Copy or Move result filenames Create a folder Create file Delete file Adds a set of files or folders to the result list of the job entry. Adds a dummy step to enable you to test your job. Writes a specific string to the PDI logging system.

6. BulkLoad into Mysql Loads data from a text file into a MySQL table. Executes an SQL script. Creates a standard ZIP archive using the options that you specify. the red one to indicate failure. 92 User’s Guide . Zip file Conditions menu Check if a folder is empty Check if file exists Columns exist in a table Evaluate rows number Define the success condition that can be evaluated. You can connect two steps with the output of the Simple Evaluation. you can check the number of rows if they are: Equal to Different from Smaller than Smaller or equal to Greater than Greater or equal to File Exists Simple evaluation Verify if the specified file exists on the server on which Kettle runs. This job entry sleeps and periodically checks whether the specified file exists. The job in a table process can be branched by the result of this step. Table exists Wait for Scripting menu JavaScript SQL Shell Bulk loading menu BulkLoad from Mysql Loads data from a MySQL table to a text file. Waits for a file. after which the flow continues. Wait for the specified time before running the next job entry. into file BulkLoad into MSSQL Loads data from a text file into a Microsoft SQL Server table. Verifies that one or more columns exist in a database table. Executes a shell script on the host where the job is running. folders. Executes a JavaScript script. Verifies if the specified table exists on a database. or both to alternate locations on your file system.Atrium Integrator 7. The green connection is used to indicate success. Evaluates contents of a variable or a field in the result stream. Verifies if a certain file exists on the server on which Kettle runs. Verifies if a folder is empty (contains no files). Unzips one or more files. For the success condition.04 Table 5-3: Intermediate steps for jobs (Sheet 2 of 3) Option Move Files Unzip file Wait for file What it helps you do Moves a number of files and. The job entry can either wait indefinitely for the file or it can time out after a certain time.

Gets one or more files from an FTP server using the Secure FTP protocol. Gets one or more files from an FTP server. To add an intermediate step to a transformation 1 Click the step you want to add and drag it to the canvas. Table lists the common steps that you can add to your transformation to manipulate the data before adding it to BMC Atrium CMDB. Puts one or more files on an FTP server. Transforms the specified XML file into another document. Verifies that an XML file corresponds to a certain structure or format. What it helps you do Adding intermediate steps to a transformation You can add intermediate steps to a transformation in a job that you create through the Integration Job Builder wizard.Adding intermediate steps to a transformation Table 5-3: Intermediate steps for jobs (Sheet 3 of 3) Option XML menu Check if XML is well formed DTD Validator XSD Validator XSL Transformation File transfer menu Get a file with FTP Get a file with SFTP Put a file with FTP Put a file with SFTP Repository menu Check if connected to repository Checks whether you are connected to the repository. Puts one or more files on an FTP server using the Secure FTP protocol. Validates the specified XML file against the specified XML Schema Definition (XSD) file. Verifies that one or more files contain well formed (allowed) XML content. or to a custom job you create through the Spoon application. Chapter 5 Editing jobs and transformations 93 .

Atrium Integrator 7. Calbro Services can calculate the total cost of the computer systems in all their sites and add that information to BMC Atrium What it helps you do CMDB. Normalizes data from pivoted tables. Ensure that the input stream is sorted otherwise. Calbro Services can map 1 to Intel PC. and so on. Calbro Services can split the domain name for their computer systems from adprod. Calbro Services can add Disk drive as the Short Description value when transferring disc drive information from their SQL table to the BMC_Disc Drive CI class. Replace in string Row flattener Row normalizer Split fields Replaces the text string in a field with the specified value. Calbro Services can run the perl. The Value mapper provides you with a simple alternative. 94 User’s Guide . see the Spoon User Guide at http://wiki.com/display/EAI/ Spoon+User+Guide.exe file passing the Site value from the source database as a parameter to indicate the location of each computer system. For example. For example.6. Maps string values from one value to another. Mapping is usually solved by storing the conversion table in a database. String cut Unique rows Returns the substring of characters in a string starting at a specified position up to an optional end position.calbro. 3 to Dell PC. Table 5-4: Intermediate steps for transformations (Sheet 1 of 4) Step Transform menu Add constants Adds constant values to the specified field in the destination data source. Executes a shell script on the host where the job is running. Allows you to flatten data sequentially. Splits fields based on delimiter information. For example. For example. Removes duplicate rows from the input streams. Value mapper Utility menu Delay row Execute a process Delays each input row by the specified period before proceeding to the next step.com to just adprod before adding this information to BMC Atrium CMDB. For example.pentaho. only consecutive double rows are evaluated correctly.04 For information about additional steps that you can add to your transformation. 2 to HP laptop. Calculator Provides you with predefined functions that can be executed on input field values.

JavaScript scripts. String. stored procedures. "=" and "<value>" areas to construct a condition. after Calbro Services transfers data from source tables to BMC Atrium CMDB. you can click on the "<field>". Process files Write to log Copies. Allows you to filter rows based on conditions and comparisons.) Processing the complete row but only for specific fields by name For example. The row layout for the input data coming from both steps has to be identical: the same row lengths. Adds a placeholder (dummy) step for testing purposes. or for synchronization purposes. If you want to test a file input step. and saves the log file in the following directory: C:\Documents and Settings\Administrator\Local Settings\Temp\ Flow menu Abort Aborts a transformation upon seeing input. Null if Sets the value of a field to null if its string representation is equal to the specified value. or deletes files by providing the source and target file names in the data stream. the last row is sent to the next step or the complete input is sent to the next step. they might decide to overwrite null values in the target database (BMC Atrium CMDB) on subsequent runs in one of the preceding ways. For example. You can use the Blocking step for triggering plugins. Calbro Services might not be interested in tracking computer systems with a Macintosh operating system. Blocking step Blocks all output until the very last row is received from the previous step. and might decide to replace the field value “Mac” with null. For example. At that point. For example. Pentaho routes rows of data to one or more target steps based on the value encountered in a certain field. Implements the Switch/Case statement found in popular programming languages like Java. processing the second stream only after the first is finished. the same fields at the same field indexes in the row.Adding intermediate steps to a transformation Table 5-4: Intermediate steps for transformations (Sheet 2 of 4) Step What it helps you do If field value is Replaces null values by one of the following methods: null Processing the complete row with all fields Processing the complete row but only for specific field types (Number. Append streams Reads the data from two steps. the same data types. Date. and so on. you can use this step so that a transformation can be aborted after a specified number of rows flow to an error hop. you can connect it to a dummy step. Writes job and transformation details to a log file. moves. After this step is connected to a previous step. Dummy Filter rows Switch/Case Chapter 5 Editing jobs and transformations 95 . to have a transformation. The main use of this step is in error handling. you need at least two steps connected to each other.

The second option can be used to use parameters in SQL scripts. For example. CMDBLookUp Allows you to look up values in the BMC Atrium CMDB based on the primary key that you specified. Performs an XML Schema Definition (XSD) validation against data in a file or in an input field. Calbro Services can execute an SQL script which returns category IDs from the categories table where the name equals the value obtained for the Category field. Provides an expression-based user interface for building JavaScript expressions. or once for every input row that the step is given. the regular expression for finding all text files in a file manager is . Database lookup File exists Looks up values in a database table. A regular expression is a special text string for describing a search pattern. Allows you to create multiple scripts for each step.04 Table 5-4: Intermediate steps for transformations (Sheet 3 of 4) Step Scripting menu Execute SQL script Executes an SQL script either once during the initialization phase of the transformation. The result is a Boolean flag field that gets added to the input fields in the output. 96 User’s Guide . Mail Validator Checks if an email address is valid. Verifies the existence of a file where the filename comes from previous steps. Performs a web services lookup using the Web Services Description Language (WSDL). Lookup values are added as new fields onto the stream. which creates a work group by appending the virtual machine type to the operating system. or data lengths. For example. XSD Validator Statistics menu Group by Calculate values over a defined group of fields. Lookup values are added as new fields onto the stream. Calbro Services can create an if/then/else statement to identify the operating system of a computer based on its serial number. a distinct list of values.*\.txt. For example. Regex Evaluation Allows you to validate an input field against a regular expression. Java expression Lookup menu Call DB Procedure Allows you to execute a database procedure (or function) and direct the result to the output step. What it helps you do User defined Uses the specified Java expressions as a basis for calculating new values. Formula Modified Java Script Value Calculates formula expressions within a data stream. The script can also include the concatenate function.Atrium Integrator 7.6. This can be a value range. Web services lookup Validation menu Data Validator Allows you to define simple rules to describe what the data in a field should look like.

What it helps you do Editing transformation steps You can right-click on any step in your transformation and perform the actions described in Table 5-5. Allows you to configure a step so that instead of halting a transformation when an error occurs. It accepts one (and only one) row of data to set the value of a variable. Edit step description Opens the Step description dialog box so that you can edit the description. Deletes the hops to the selected step. Determines all the fields and their origin by tracing the input streams back to their source. or to distribute the rows among the target steps. the rows that caused an error are passed to a different step. Copy to clipboard Duplicate step Delete step Hide step Detach step Show input fields Show output fields Align/Distribute Check selected step Define error handling Preview Copies the selected step to the clipboard so that you can use it again in the same transformation or a new transformation. Deletes the selected step. Displays a list of all the steps in the current transformation. Hides the selected step. Determines all the fields and their origin by tracing the output streams back to their source. Splits the transformation flow to multiple processing paths. This step can return rows or add values to input rows. see “Launching several copies of a step” on page 100. Data movement Allows you to specify whether you want the selected step to copy all output rows to all target steps. Allows you to set variables in a job or in the virtual machine. Creates a duplicate of the selected step. Change number of copies to start from Chapter 5 Editing jobs and transformations 97 . this might improve performance by reducing latency.Editing transformation steps Table 5-4: Intermediate steps for transformations (Sheet 4 of 4) Step Job menu Get Variables Set Variables Allows you to get the value of a variable. Allows you to launch the selected step multiple times. For a database lookup step. Table 5-5: Right-click options for transformation steps Menu option Edit step What it helps you do Opens the selected step so that you can edit it. Checks the selected step and displays any warnings and errors. For more information.

open the transformation that you want to edit is open.6. Transformation filename. 2 Choose Transformation > Settings. 5 Click the Logging tab. The Created by and Created at fields display the user name of the person who created the transformation in the Integration Builder wizard and the date and time at which it was created. Description. Version. Figure 5-5: Transformation Properties window in Spoon 3 In the Transformation tab. 4 Specify the Status. To edit transformation properties 1 In the Spoon window. 98 User’s Guide .Atrium Integrator 7. and Directory of the transformation.04 Editing transformation properties Transformation settings are the collection of properties that describe the transformation and configure its behavior. and Extended description as required. edit the Transformation name. The Transformation Properties window appears. The Last modified by and Last modified at fields display the user name of the person who is editing the transformation and the date and time it was last modified.

Number of lines rejected from this step to write to the log table. 8 Specify the name of the log table. 18 In the Feedback size field. This enables you to have the logging text and the run results in the same table. Number of output lines from this step to write to the log table. Number of lines from the target step to write to the log table. Number of lines updated in the file or database to write to the log table. 13 Click the Dependencies tab. 12 Specify the date setting. For example. 9 Select the Batch-ID check box if you want to have a batch ID in the log table. Number of lines from the input file or database to write to the log table. enter the number of rows to process before entering a feedback entry into the log.Editing transformation properties 6 Specify the following information: Field Name Read log step Input log step Write log step Output log step Update log step Rejected log step What to specify Number of lines from the source step to write to the log table. Do not change this parameter unless you are running low on memory. 7 Specify the log connection to write to the log table. If the values in these lookup tables have changed. click the Dates tab. change the size of the buffers between the connected steps in a transformation. 17 Select the Show a feedback row in transformation steps checkbox if you want to add a feedback entry into the log file while the transformation is being executed. extend the date range to force a full refresh of the dimension. By default. 14 Enter the dependencies for the transformation. make sure that the lookup tables have not changed. Click Get dependencies to detect dependencies automatically. 16 In the Number of rows in rowsets field. Chapter 5 Editing jobs and transformations 99 . Dependencies allow you to determine if a table has changed when you have a "data last changed" column in the table. TIP Set this to a higher value when processing large amounts of data to reduce the amount of information in the log file. 11 In the Transformation Properties window. 15 Click the Miscellaneous tab. 10 Select the Use logfield to store logging in check box if you want to store the logging text in the logging table. if a dimension depends on three lookup tables. for example. this feature is enabled and configured to display a feedback record every 5000 rows.

20 In the Shared objects field. The Nr of copies of step dialog box appears. Enabling this option is required to allow a failing transformation to be rolled back completely. To launch several copies of a step 1 Right-click on the step that you want to launch multiple times. 22 Click the Partitioning tab. Figure 5-6 on page 101 shows how Spoon indicates that a step has been launched multiple times. 23 Click the New button to create a new partition. 25 Select the Enable step performance monitoring check box if you want to monitor each step of the transformation as it is being executed. 26 Click the SQL button to generate the SQL code necessary for creating the logging table. The Simple SQL Editor appears.Atrium Integrator 7. launching multiple copies of the step might improve performance. 27 Click OK. which allows you to execute an SQL statement against the logging connection. 100 User’s Guide . Launching several copies of a step In certain situations. if a step uses a large amount of CPU (such as a JavaScript step) and you have multiple processor cores in your computer. 24 Click the Monitoring tab. If a step has to deal with network latencies (such as a database lookup step).04 19 Select the Make the transformation database transactional checkbox if you want to open one unique connection per defined and used database connection in the transformation. which lowers the latency. The number of steps appears in the upper-left corner of the step icon. and select Change number of copies to start. launching multiple copies of a step improves performance. This can be useful in some situations where the cost of using the logic exceeds the benefit of the thread prioritization.6. 2 Enter the number of times you want to launch this step. specify the location of the XML file used to store shared objects like database connections or clustering schemas. 21 Select the Manage thread priorities check box if you want to enable the internal logic for changing the Java thread priorities based on the number of input and output rows in the rowset buffers. For example. launching the same step several times keeps the database busy on different connections. and click OK. The available database partitions are displayed. The selected transformation is updated according to the options that you set. Enabling this option is also necessary when trying to alter connection settings before a query using an Execute SQL script step.

select Y. The CMDBOutput dialog box appears. 6 Click OK. For more information. see “Opening your job or transformation” on page 86. 2 Click . To explore a database connection 1 Open your transformation in Spoon. Exploring a database connection You can explore configured database connections in Spoon. For more information. you mapped key source columns to corresponding target columns. 5 In the Update cell. 2 Double-click the CMDBOutput step. When you created a job in the Integration Job Builder wizard. click in the Table field cell and select the target attribute that you want to map. In Spoon. Chapter 5 Editing jobs and transformations 101 . 4 In the Stream field cell. see “Opening your job or transformation” on page 86. 3 In the Update fields section. add a new attribute to import to BMC Atrium CMDB. select the source field you want to map to the selected attribute. you can change the data mapping–for example. The selected attribute is mapped to the specified source column. To change data mapping 1 Open your transformation in Spoon.Changing data mappings Figure 5-6: Launching several copies of a step Indicates that this step was launched 3 times Changing data mappings A data mapping defines how data in the source corresponds to data in the target and which actions to take when transferring between them.

The Database explorer dialog box appears with a list of all the schemas. and click OK. 102 User’s Guide . you can browse the source data before running your job or transformation. 3 Click Preview.6. see “Opening your job or transformation” on page 86. Allows you to specify the number of rows to return from the selected table. tables. Show Layout Generate DDL Generate DDL for other connection Open SQL Truncate table What it does Returns the first 100 rows from the selected table. and so on from the selected table. and views in the selected connection. Number of rows. Displays a list of column names. Launches the Simple SQL Editor for the selected table.. data types. For more information. Generates a TRUNCATE table statement for the current table. Browsing source data In Spoon.04 The Make your selection dialog box appears. rows of. The Enter preview size dialog box appears. 4 Enter the number of rows of source data that you want to preview.. 2 Double-click the input step.The buttons to the right provide quick access the following features for the selected table: Button Preview first 100 rows Preview first . To browse source data 1 Open your transformation in Spoon. Returns the total number of rows that the selected table contains. The input step dialog box appears. then generates the DDL to create the selected table based on the selected connection type. The Examine preview data dialog box appears with the specified number of rows of data from the source table or file.. Generates the DDL to create the selected table based on the current connection type. Prompts you to select another connection.. 4 Select the table that you want to explore. 3 Select the database connection that you want to explore.Atrium Integrator 7.

Changing source configuration

5 Click Show log to view the log file. 6 Click Close when you have finished previewing the data.

Changing source configuration
You can manipulate your source data in Spoon before transferring it to BMC Atrium CMDB. For example, you can limit the number of records to be transferred on an initial run. This is very useful for initial verification before bulk-loading data into BMC Atrium CMDB. You can also write an SQL query to limit the data to be processed rather than processing all the data from the source table.

Limit number of rows for initial processing
1 Open your transformation in Spoon. For more information, see “Opening your job

or transformation” on page 86.
2 Double-click the input step.

The input step dialog box appears.
3 In the Limit size field, enter the number of records to import to BMC Atrium

CMDB.
4 Click OK.

When you run the transformation, only the specified number of records from the source table are transferred to BMC Atrium CMDB.

Importing a subset of the data
1 Open your transformation in Spoon. For more information, see “Opening your job

or transformation” on page 86.
2 Double-click the input step.

The input step dialog box appears.
3 Click Get SQL select statement. 4 Type an appropriate query. 5 Click OK.

When you run the transformation, records from the source table are transferred to BMC Atrium CMDB depending on the query you specified.

Chapter 5

Editing jobs and transformations

103

Atrium Integrator 7.6.04

104

User’s Guide

Chapter

6

Running and monitoring a job

If you created your job through the Integration Job Builder wizard, you can run it from the Atrium Integrator console. If you created or edited your job in the Spoon application, you can run it in Spoon.

1 Con gure source & target connection

2 Create and schedule job

3 Edit transformation or job

4 Run job

5 Monitor job

The following topics are provided: Running a job from the Atrium Integrator console (page 106) Running a job in Spoon (page 106) Monitoring jobs (page 108) Changing the job schedule (page 112)

Chapter 6 Running and monitoring a job

105

The selected job begins to be executed in the Pentaho Carte server. 2 Click Stop Job . Running a job in Spoon If you edited or created your job in Spoon. you can run it in Spoon as well. The selected job stops running.Atrium Integrator 7. select the job that you want to run from the job list on the left panel. To run a job 1 In the Atrium Integrator console. select the job that you want to stop from the job list on the left panel. For more information. To stop a job 1 In the Atrium Integrator console. see “Opening your job or transformation” on page 86. Confidential . 106 User’s Guide BMC Software Inc. as shown in Figure 6-1 on page 107. Ensure that the Carte server is running before running a job from the Atrium Integrator console. you can run your job from the Atrium Integrator console. To run a job in Spoon 1 Open your job.6. The Execute a transformation window appears.04 Running a job from the Atrium Integrator console If you created your job using the Integration Job Builder wizard. “Debugging and troubleshooting jobs. For more information. 2 Click Start Job .”. The History tab displays the job status as it runs. see Chapter 7.. 2 Click Run .

Chapter 6 Running and monitoring a job 107 . BMC recommends that you set this to Rowlevel so that it is easy to track down errors. 5 Click Launch. and the details are splayed in the Executing Results section of the Spoon window. If you want to run the job remotely. The job begins running.Running a job in Spoon Figure 6-1: Running a job in Spoon 3 Specify whether you want to run the job locally or remotely. specify the remote host. As a best practise. 4 Specify logging details.

For information on how to run the Carte server. To view job history and details 1 Select a job from the job catalog on the left panel.6. Confidential . You can also view job details on the Carte server. see Chapter 7. The Job Run Details area displays the following information: Batch Id Start time—Job start time 108 User’s Guide BMC Software Inc. “Debugging and troubleshooting jobs.” Viewing job history You can view the job history and logging details for a selected job. Completed . Figure 6-2: Atrium Integrator console All jobs in the repository are displayed in the job catalog in the left side of the window. The right side of the window displays the job information and run history of the selected job. where you can sort the jobs by name..04 Monitoring jobs You can view the job details in the Atrium Integrator console. or Failed next to the job name to display the job run details.Atrium Integrator 7. The History tab displays the following information for the job selected in the job catalog (left side of the window): Name—Job name Status—Running 2 Click .

Monitoring jobs Status—Job status End time—Job end time Total Input Records—Number of records in the source data Total Output Records Number of Records Read Number of Records Written—Number of records written to BMC Atrium CMDB Number of errors—Number of errors in the job run Number of Records Updated—Number of records updated in the BMC Atrium CMDB To view logging details 1 Select a job from the job catalog on the left panel. Chapter 6 Running and monitoring a job 109 . click View Log Details . Figure 6-3: Logging Details in the Atrium Integrator console View Log Details button 3 In the Logging Details area. 2 Click the Logging Details bar to display log details. The log file appears.

Viewing job details You can view the details of a selected job. 2 Click the Integration Job Details tab. 110 User’s Guide BMC Software Inc. 5 Specify the file name and path for the log file.Atrium Integrator 7. To view job details 1 Select a job from the job catalog on the left panel. 6 Click Save. Confidential .6. The log file is saved.04 Figure 6-4: Log file in the Atrium Integrator console 4 Click Export to File..

Chapter 6 Running and monitoring a job 111 .Monitoring jobs Figure 6-5: Integration Job Details area The Integration Job Details area displays the following information for the selected job: Job Id and Job Name Created By—User name of the person who created the job Create Date—Date on which the job was created Modified By—User name of the person who modified the job Modified Date—Date on which the job was modified Source Type—Source data store for the job Target Type—Target data store to which data is to be transferred (BMC Atrium CMDB) Directory—Location where the job is saved in the repository Job Description—Description that was entered in the Integration Job Builder wizard Job Schedule—Start time of the job. The Job Schedules area displays information on whether the selected job has been scheduled to run at a specified interval. and interval between job runs.

112 User’s Guide BMC Software Inc. click Manage Job Schedule ..Atrium Integrator 7. as required.04 Changing the job schedule You can specify the schedule for a job while designing it through the wizard. To edit a job schedule 1 In the Atrium Integrator console. 3 Click Save.6. if required. The Job Schedule window appears with the job name and directory displayed. 2 Edit the start time and interval. and later edit the schedule from the Atrium Integrator console. Confidential .

The following topics are provided: Troubleshooting Atrium Integrator console issues (page 114) Troubleshooting errors displayed in Spoon (page 118) Location of log files (page 118) Error connecting to a Microsoft SQL Server database using Windows Authentication in Spoon (page 119) Atrium Integrator Error Messages (page 120) Chapter 7 Debugging and troubleshooting jobs 113 .Chapter 7 Debugging and troubleshooting jobs This section describes the steps that you can take to debug and troubleshoot errors that might occur when you execute a data transfer job.

The log file appears.Atrium Integrator 7. Figure 7-1: Logging Details in the Atrium Integrator console View Log Details button 4 In the Logging Details area. To troubleshoot a job that failed to run 1 In the Atrium Integrator console.6. click next to the last run of the failed job. select the failed job. 2 In the History tab. 3 Click Logging details (below the Job Run Details area).04 Troubleshooting Atrium Integrator console issues This section describes how you can troubleshoot some common Atrium Integrator console issues. Job fails to run If the Job Name in the left side of the Atrium Integrator console is in red and has a next to it. the job failed to run. click View Log Details . 114 User’s Guide .

04 Installation Guide. 2 Ensure that the pluginsvr_config. For more information. see Chapter 5.ARDBC.6. For information on opening a job in Spoon.xml file does not exist at this location. follow the steps in “Troubleshooting errors displayed in Spoon” on page 118. Job not displayed on the Atrium Integrator console If a job was created successfully through the Integration Job Builder wizard but does not appear on the Atrium Integrator console. 10 After the job completes running. see the BMC Atrium Core 7. consider the following possible causes: The CMDB plugin might not be available on the server on which you installed the Spoon application.ATRIUM. you may need to reinstall Atrium Integrator. open the job in Spoon.xml NOTE If the pluginsvr_config. 9 Click Launch to run the job. change Log level to Rowlevel (very detailed). 6 If the log file does not contain enough information for you to debug the error. Some .” 7 Click Run . To troubleshoot Atrium Integrator console issues 1 Open the following file: AtriumCoreInstallationDirectory\cmdb\plugins\shared\ pluginsvr_config.jar files might be missing.NGIE Chapter 7 Debugging and troubleshooting jobs 115 . 8 In the Execute a job dialog box.xml file contains the following entry: BMC. “Editing jobs and transformations.Troubleshooting Atrium Integrator console issues Figure 7-2: Log file in the Atrium Integrator console 5 Click Export to File and save the log file to the desired location.

6.6.ATRIUM.04 3 Ensure that all the . and runs in the background.NGIE section exist at the specified locations. Job not running from the Atrium Integrator console You can run a job from the Atrium Integrator console only if the Carte server is running. For example: C:\Program Files\Java\jdk1.jar files listed in the BMC. 116 User’s Guide . To verify that the Carte server is running by using the command line 1 In a command line window. open the NGIE:Config form and click Search.bat file. navigate to the location of the JDK on your computer. The repository and Carte details are displayed. Figure 7-3: NGIE:Config form 2 The Dir Path field displays the location of the Carte. Carte is automatically installed on the same computer.ARDBC. However. To view the Carte server details 1 In the BMC Remedy User tool on the computer where you have installed the Atrium Integrator server.Atrium Integrator 7. you might have to start the Carte server manually. if you restart the operating system.0_12\bin 2 Type jps. When you install the Atrium Integrator server.

Troubleshooting Atrium Integrator console issues The Carte server details are displayed. 2 Click Enter. The Carte server is started. To start the Carte server manually 1 In a command line window. To verify that the Carte server is running by using a browser 1 In a browser window. type: http://HostName:PortNumber HostName is the host name of the computer where the Atrium Integrator server is installed.bat aus-idd-w28r2-vm1 20000 3 Click Enter. click Show status. HostName is the host name of the computer where the Atrium Integrator server is installed. The status of the jobs and transformations that have been run from the Atrium Integrator console are displayed. you might type: Carte. and PortNumber is the number displayed in the Port field of the NGIE:Config form. 4 In the Status window. and PortNumber is the number displayed in the Port field of the NGIE:Config form.bat HostName portNumber. For example. 5 Click on a job to display the log details. 3 Log in using cluster for the user name and the password. navigate to the following directory: AtriumIntegratorInstallationDirectory\server\data-integration\ 2 Type Carte. Chapter 7 Debugging and troubleshooting jobs 117 .

click Refresh to get the latest results. Figure 7-4: Execution Results area in the Spoon window 2 Click the Logging tab. To troubleshoot Spoon errors 1 In the Execution Results area. 3 Click Show error lines .txt 118 User’s Guide .log The error files for each job or transformation that you run are located in the following directory: AtriumIntegratorInstallationDirectory\server\dataintegration\ngie\bin\error\jobName_transformationName_Error. Location of log files If you are running the Tomcat web server.6.04 Troubleshooting errors displayed in Spoon When you run a job or transformation in Spoon. 4 To get more information about the errors. The text file output dialog box displays the location of the error file in the Filename field. double-click the Error logging step. 5 Open the specified file to see the error details. the Atrium Integrator console log files are located in the following directory on the computer where you installed the mid tier: C:\Program Files\Apache Software Foundation\Tomcat 6. The job or transformation errors are displayed.Atrium Integrator 7.0\logs\stdout_currentDate. the Execution Results area in the Spoon window displays the results.

5/jtds-1. 5 Copy the \jtds-1. But.2.zip file and unzip it.dll.dll file as ntlmauth_32.5dist. 15 Click OK. Use the following steps to fix the error.Error connecting to a Microsoft SQL Server database using Windows Authentication in Spoon Error connecting to a Microsoft SQL Server database using Windows Authentication in Spoon On a 32-bit JVM. 11 In the Database Connection dialog box (General tab).5-dist\x64\SSO\ntlmauth. 8 Open your job or transformation.2. enter the domain of the database server. 1 Navigate to the following directory: AtriumIntegratorInstallationDirectory\server\dataintegration\libswt\win32 2 Rename the ntlmauth.net/projects/jtds/files/jtds/1. 14 Click Test to ensure that the database connection is valid. specify appropriate values for the following fields: Connection Name Host Name Database Name Port Number 12 Click the Options tab. 13 In the Parameter column. enter domain and in the Value column. 7 Launch Spoon. 10 Click New (next to the Connection field). Windows Authentication displays an error on a 64-bit JVM.2. 6 Close the Spoon window. Chapter 7 Debugging and troubleshooting jobs 119 . 9 Double-click the table input step.2. Windows Authentication when connecting to a Microsoft SQL Server in Spoon works properly. 3 Navigate to the following URL: http://sourceforge.dll file to the AtriumIntegratorInstallationDirectory\server\data-integration\libswt\win32 directory.5-dist.zip/download 4 Download the jtds-1.

Solution Confirm connectivity to BMC Atrium CMDB by clicking the Test Connection button in the Manage Data Store tool. NGIE000004 Error Job Creation failed. Also verify that the CI Class is defined correctly for the selected CI Type. Solution Verify the BMC Remedy AR System server details specified in the target data store connection. message type. NGIE000006 Error Error retrieving Schemas for the source. Solution Verify the BMC Remedy AR System server details specified in the target data store connection.04 Atrium Integrator Error Messages The following table lists the error number. Solution Confirm connectivity to BMC Remedy AR System by clicking the Test Connection button in the Manage Data Store tool. 120 User’s Guide . and solution Error retrieving DatasetIds for the selected target data store. Table 7-1: Atrium Integrator error messages (Sheet 1 of 5) Error number NGIE000001 Message type Error Message. message text. description. NGIE000003 Error Error retrieving CI Relationships for the selected CI Types.Atrium Integrator 7. NGIE000002 Error Error retrieving CI Types for the selected target data store. description. and solution for errors that Atrium Integrator generates. Solution Verify the BMC Remedy AR System server details specified in the target data store connection.6. Solution Verify the data entered in the Integration Job Builder wizard pages and check your connection to the Pentaho server. Also confirm that one or more some target attributes have been mapped to the source column on the CI Mapping page of the Integration Job Builder wizard. Also confirm that a relationship has been selected for the selected CIs on the CI TypeRelationships page of the Integration Job Builder wizard. NGIE000005 Error Error retrieving CI attributes for the selected CI Type.

NGIE000011 Error No Columns available for the selected source. Solution Check your connection to the Pentaho server. Solution Confirm connectivity to BMC Remedy AR System by clicking the Test Connection button in the Manage Data Store tool. Chapter 7 Debugging and troubleshooting jobs 121 . NGIE000010 Error Error retrieving Columns for the source. NGIE000009 Error Error retrieving Files for the source. Check whether an entry has been created in the NGIE: FileMetaData form. Also check whether the schema has any view defined. NGIE000008 Error Error retrieving Views for the schema. Solution Confirm connectivity to BMC Atrium CMDB by clicking the Test Connection button in the Manage Data Store tool. NGIE000012 Error Error retrieving fields from the selected file. description. Solution Check your connection to the Pentaho server and verify that the table or view is defined correctly in the source database.Atrium Integrator Error Messages Table 7-1: Atrium Integrator error messages (Sheet 2 of 5) Error number NGIE000007 Message type Error Message. Check whether an entry has been created in the NGIE: FileMetaData form. and solution Error retrieving Tables for the schema. Also check whether the schema has any table defined. Solution Confirm connectivity to BMC Remedy AR System by clicking the Test Connection button in the Manage Data Store tool. NGIE000101 Error Failed to connect to Atrium Integrator. Solution Confirm connectivity to BMC Remedy AR System by clicking the Test Connection button in the Manage Data Store tool. Solution Confirm that the source database table has valid columns.

NGIE000107 Error Failed to get list of job runs. The AtriumCoreInstallationDirectory\cmdb \plugins\shared\pluginsvr_config.ATRIUM. Solution Check your connection to Atrium Integrator. 122 User’s Guide .NGIE All the . and solution Failed to get list of NGIE Jobs. NGIE000203 Error Error deleting data store. Solution Check your connection to the Pentaho server.jar files listed in the BMC. Also check whether there is an entry in the NGIE: JOBLOG form.NGIE section exist at the specified locations. Solution Check your connection to Atrium Integrator.Atrium Integrator 7. Solution Check your connection to the Pentaho server.04 Table 7-1: Atrium Integrator error messages (Sheet 3 of 5) Error number NGIE000102 Message type Error Message. NGIE000106 Error Failed to get list of job runs. NGIE000105 Error Failed to stop NGIE job. NGIE000201 Error Error creating data store. Solution Check your connection to the Pentaho server.6.ATRIUM. Also confirm that the Carte server is running. NGIE000104 Error Failed to start NGIE job. Also check whether there is an entry in the NGIE: JOBLOG form. NGIE000202 Error Error updating data store. Also confirm that the Carte server is running. Solution Check your connection to the Pentaho server. description.ARDBC. Solution Confirm that the Carte server is running. NGIE000103 Error Failed to delete NGIE job.ARDBC. Solution Check your connection to the Pentaho server.xml file contains the following entry: BMC. Solution Check the following: Your connection to the Pentaho server.

NGIEA000305 Error Please check the name and path details. Solution Check your connection to the repository database server. NGIEA000303 Error Error occurred while trying to connect to the data store. you can copy the job and transformation files saved in the user profile on the mid tier (C:\Documents and Settings\Administrator\jobName\) to the Spoon repository. Solution Check your connection to the repository database server. description. Solution Check your connection to the Pentaho server. you can copy the job and transformation files saved in the user profile on the mid tier (C:\Documents and Settings\Administrator\jobName\) to the Spoon repository. and solution Error getting data stores. NGIEA000304 Error Error occurred while trying to connect to the data store. Solution Check the data store connection details. Solution Check your connection to the Pentaho server. NGIEA000311 Error Error publishing the transformation to the repository. After you fix the connection. After you fix the connection. NGIEA000310 Error Error publishing the job to the repository. Solution Check the data store connection details.Atrium Integrator Error Messages Table 7-1: Atrium Integrator error messages (Sheet 4 of 5) Error number NGIE000204 Message type Error Message. NGIE000205 Error Error getting data store types. Chapter 7 Debugging and troubleshooting jobs 123 . Solution Verify the directory path and check whether the folder specified in the path exists on the Atrium Integrator server.

Atrium Integrator 7.6.04

Table 7-1: Atrium Integrator error messages (Sheet 5 of 5) Error number NGIEA000315 Message type Message, description, and solution Response column in Transformation Options for one or more CI Types is not set. Solution Check whether the source column to be updated has been specified for the Response area in the Transformation Options tab for the CI Mapping and Relationship Mappings pages of the Integration Job Builder wizard. NGIEA000316 Delta column in Transformation Options for one or more CI Types is not set. Solution Check whether the source column to be used for Delta has been specified for the Delta area in the Transformation Options tab for the CI Mapping and Relationship Mappings pages of the Integration Job Builder wizard.

124

User’s Guide

Chapter

8

Migrating jobs to a production server
If you create and test your data transfer jobs on a development computer, you can migrate them to a production server.

To migrate jobs from a development computer to a production server
1 On the development computer, open the job in the Spoon window. 2 Choose File > Export to an XML file.

NOTE
To export a job and its related transformations, choose File > Export all linked resources to XML.
3 Save the job as a .kjb file in a directory on the development computer. 4 Copy the .kjb file from the development computer to the same directory on the

production server.
5 On the production server, click Start > BMC Software > Atrium Integrator > BMC

Atrium Integrator Spoon.

Chapter 8

Migrating jobs to a production server

125

Atrium Integrator 7.6.04

Figure 8-1: Spoon window

6 Log on to the NGIEREPD repository in Spoon. 7 In the Spoon window, choose File > Import from an XML file. 8 In the Open dialog box, select the .kjb file. 9 Click Open.

The job is opened in Spoon.
10 Click Save

to save the job in the NGIEREPD repository.

126

User’s Guide BMC Software, Inc., Confidential

The following topics are provided: Terminology (page 128) Tasks (page 128) Appendix A Moving from BMC Atrium Integration Engine to Atrium Integrator 127 .A Appendix Moving from BMC Atrium Integration Engine to Atrium Integrator This appendix describes Atrium Integrator terminology and tasks that correspond to BMC Atrium Integration Engine terminology and tasks.

For more information. external database For more information.Atrium Integrator 7.6. For more information. Define rules Edit the job or transformations in Spoon. Table A-1: Mapping Atrium Integrator terms to BMC Atrium Integration Engine terms BMC Atrium Integration Engine Corresponding Atrium Integrator term term data exchange data transfer data mapping job or transformation job or transformation CI and relationship mapping Tasks The following table describes Atrium Integrator tasks that map to BMC Atrium Integration Engine tasks. see “Creating a new data store connection” on page 55. For more information. Table A-2: Mapping Atrium Integrator tasks to BMC Atrium Integration Engine tasks (Sheet 1 of 2) BMC Atrium Integration Engine Corresponding Atrium Integrator task task Populate field menus Create a data store connection so that the wizard can display source columns. Create a data mapping for relationship classes Map target attributes to source columns in the Relationship Mappings page of the Integration Job Builder wizard. Create a data mapping for CI classes Map target attributes to source columns in the CI Mapping page of the Integration Job Builder wizard. Define connection settings to an Create a data store connection. see “Creating a job schedule” on page 79. For more information. see “Mapping target attributes to source columns” on page 69. see “Defining relationship mapping for the CI types to transfer” on page 74. see Chapter 5.” 128 User’s Guide . see “Creating a new data store connection” on page 55. For more information. Define and execute a data exchange Schedule a job and execute it. “Editing jobs and transformations.04 Terminology The following table describes Atrium Integrator terms that map to BMC Atrium Integration Engine terms.

See errors directly in the Execution Results area of Spoon. Use multithreading to improve Launch several copies of the CMDBOutput step to performance. improving performance. Appendix A Moving from BMC Atrium Integration Engine to Atrium Integrator 129 . increase the overall throughput of the data transfer job. Each Spoon session is a different process. For more information. see “Launching several copies of a step” on page 100.Tasks Table A-2: Mapping Atrium Integrator tasks to BMC Atrium Integration Engine tasks (Sheet 2 of 2) BMC Atrium Integration Engine Corresponding Atrium Integrator task task Use multiple BMC Atrium You can open multiple sessions of Spoon to run Integration Engine instances for different jobs. View log files to debug errors.

04 130 User’s Guide .Atrium Integrator 7.6.

contacting 2 C Carte server 116 CI types to transfer.A B C D E F G H I J K L M N O P Q R S T U V W X Y Z Index A Atrium Integrator as a replacement product for BMC Atrium Integration Engine 13 components 18 datasets supported by 13 overview of 14 performance considerations 23 value proposition of 14 Atrium Integrator scenario creating a database connection 31 creating a dataset 30 editing the job in Spoon 45 monitoring the job 50 opening a job in Spoon 40 running the job 48 use case for 28 H hops colors 90 creating 88 definition of 17 deleting 89 disabling 89 reversing 89 I Integration Job Builder wizard benefits of using 62 creating a job 62 creating a job schedule 79 mapping target attributes to source columns 69 selecting CI types to transfer from a list 67 selecting CI types to transfer from a template 65 selecting relationships to transfer 68 specifying source and target details 64 B BMC Software. 59 gathering information about 54 supported data types 55 Index 131 . selecting 63 creating jobs 62 customer support 3 J jobs adding intermediate steps 90 changing schedule of 112 creating 62 definition of 17 monitoring 108 opening in Spoon 86 running from Spoon 106 running from the Atrium Integrator console 106 schedule 63 viewing details 110 viewing history 108 viewing summary 63 D data store connection creating 55 editing 58.

. Inc. specifying 63 target attributes to source columns.A B C D E F G H I J K L M N O P Q R S T U V W X Y Z L launching multiple copies of a step 100 log files 109 M mapping Integration Job Builder output to Spoon steps 87 migrating data 82 jobs 125 monitoring jobs 108 P product support 3 R relationships for CI types to transfer 63 repository 17 running jobs 106 S scheduling jobs 63 source and target details. mapping 63 technical support 3 transformations adding intermediate steps 90 connecting steps in Spoon 88 definition of 17 editing 97 editing properties 98 132 User’s Guide BMC Software. specifying 63 Spoon 21 steps 17 support. customer 3 T target and source details. Confidential .

.

*987671* *987671* *987671* *987671* *176789* .

Sign up to vote on this title
UsefulNot useful