Professional Documents
Culture Documents
Eugene Gonzalez
Support Enablement Manager, Informatica
1
Agenda
Troubleshooting PowerCenter issues require a
combination of basic PowerCenter knowledge and
techniques
• Knowledge
• Understand the PowerCenter architecture and components
• Learn the other building blocks in the system
• Database
• Operating system
• Techniques
• Identify exact error message and search Knowledgebase
• Isolate the issue to a component, scenario or data element
2
Agenda
• Troubleshooting
• Installation and configuration
• Upgrading to PowerCenter 8
• Running Workflows and Sessions
• Performance issues
3
Troubleshooting : PowerCenter 8 -
Installation and configuration
4
Installation Resources
• Documentation
• Installation and Configuration Guide
• Administrator Guide
• Release notes
5
Before you Install
• Review
• Minimum system and OS patches requirements
• Database requirements
• Code page requirements
• Consistent 32 bit or 64 bit environment
• Open necessary network ports
6
PowerCenter 8 Architecture
Domain config
Metadata database
Node Service Manager
(Logging, Licensing,
Sources Domain config)
Targets
Application Services
Integration
Service
Repository
Service
Domain Repository
Repository
Metadata database
7
PowerCenter 8 – New concepts
• Default domain gateway node port
• http protocol 6001
• https protocol 8443
• Default services ports are dynamic with in default range : 6005 –
6105
• New Configuration files
• Domains.infa (Install Directory)
• nodemeta.xml (..\server\config)
• New admin console
• To assist in Administration, Configuration and Upgrades
• Service pack releases
• Integrated patch process
8
Server side Installer steps
9
Where exactly to look for errors?
10
Collecting log information
• InfaLogs (for PowerCenter 8x)
• InfaLogs aids the user to extract meaningful and necessary
PowerCenter log files (session Logs, repository server and agent
logs, pmserver logs, tomcat logs).
• catalina. Out
• node.log
• services.log
• exceptions.log
• WebServices_Hub.log
• Logs are collected and automatically placed in a zip file.
• The zip file can also be submitted to support
• Use of this tool allows the user to quickly get the logs without
needing the knowledge of where the logs are located.
• Download from “my.informatica” support tools.
11
Common Installation Problems
• Firewall settings
• Domain console hangs.
• Domain services begin to start but shuts down right away.
• Firewall port setting should not block PowerCenter ports.
12
Common Installation Problems
13
Common Installation Problems
14
Support Scan Utility (SSCAN)
15
Tips and Techniques
• Restart server
• After installing drivers on Windows
• After installing patches
16
What info to send to support?
• InfaLogs – Collects relevant logs
• catalina. Out
• node.log
• services.log
• exceptions.log
• SSCAN – Collects system environmental information.
• Creates and xml file as an output
• Collects system, memory, path, and patch level information
• What to look for the tools output
• LANG settings
• System and library path
• Database client library path
• OS Patch information
• Error messages
• Download tools from “my.informatica” support tools.
17
Upgrading to PowerCenter 8 Using the
Upgrade Planner
18
PowerCenter 8.5 - Upgrade Planner
19
PowerCenter 8.5 - Upgrade Planner
Topics Covered
•e-learning module
•30 min duration
•Architectural overview
•Upgrade Paths
•Upgrade Process
•Architecture
•Upgrading from PC7.X or
from PC8.1.1
Functional Changes
Upgrade Resources
20
PowerCenter 8.5 - Upgrade Planner
Multimedia Presentation
Use button to mover
forward or backward
21
PowerCenter 8.5 - Upgrade Planner
22
PowerCenter 8.5 - Upgrade Planner
23
PowerCenter 8.5 - Upgrade Planner
24
PowerCenter 8.5 - Upgrade Planner
25
PowerCenter 8.5 - Upgrade Planner
26
PowerCenter 8.5 - Upgrade Planner
27
PowerCenter 8.5 - Upgrade Planner
28
PowerCenter 8.5 - Upgrade Planner
29
PowerCenter 8.5 - Upgrade Planner
30
PowerCenter 8.5 - Upgrade Planner
31
PowerCenter 8.5 - Upgrade Planner
32
PowerCenter 8.5 - Upgrade Planner
33
PowerCenter 8.5 - Upgrade Resources
• Post-Upgrade Reference Documentation
• Post-Upgrade Summary e.g.
34
Tips and Techniques
35
Tips and Techniques
36
What info to send to support?
37
Troubleshooting PowerCenter
38
Troubleshooting Notes
39
Verify Domain is Running
40
Domain Check
41
If Domain is Not Running
Service Manager Log File
42
If Domain is Running
43
Understanding Log Events
• The Service Manager and application services send log events
to the LogManager. The Log Manager generates log events for
each service type. To view the log events in the Log Viewer, you
must configure the type of log events you want to search for in
the Log Viewer.
• You can view the following log event types in the Log Viewer:
• Domain log events.
• Repository Service log events. .
• Integration Service log events.
• Metadata Manager Service log events.
• SAP BW Service log events.
• Web Services Hub log events.
44
Understanding Log Events
45
Log Events
Example: Integration Service logged event
46
Application Service Log Events
47
Application Service Log Events
48
Application Service Log Events
Display Settings
select columns
to be displayed
49
Managing Application Service Logs
Log Management
50
Domain Audit Reports
51
Integration Service Changes
52
Integration Service Process(es)
53
Integration Service Load Balancer
54
Integration Service DTM
Data Transformation Manager (DTM)
• Retrieves and validates session • Runs pre-session shell commands,
information from the repository. stored procedures, and SQL.
55
Integration Service DTM
Pre-Session Post-Session
Thread Thread
Transformation
Thread
Reader Writer
Thread Thread
56
Troubleshooting :
workflow and session issues
57
Important session settings
58
Finding Workflow and Session Information
Using MetaQuery 1.0
59
Using MetaQuery 1.0
Question: What sessions have the DTM buffer set to AUTO?
60
Using MetaQuery 1.0
DTM Buffer Size
Record selection
or all records
61
Using MetaQuery 1.0
Excel
Notepad
62
Log files
63
Tips and Techniques
• Isolate
• Is it the reader, writer or the transformation ?
• Has the session ever worked before?
• If yes, has anything changed since then to cause the
problem?
• Is it the only one session failing ?
• Is it due to a specific data row/feature ?
• Is the issue consistent ?
• Change settings one at a time.
64
Tips and Techniques
65
What info to send to support?
66
Troubleshooting :
Session performance
67
Session environment
Node
Service Manager
Session 1 Mapping
Thread
DTM Master
Thread
Pre-Session Post-Session
Thread Thread
Transformation
Thread
Reader Writer
Thread Thread
Session 2 Mapping
Thread
DTM Master
Thread
Pre-Session Post-Session
Thread Thread
Transformation Repository
Thread
Reader Writer
Thread Thread
68
Understanding Session Thread Statistics
69
Thread Types
Pre/Post Processing One thread each to perform pre- and post-session operations.
Reader (Provider) One thread for each partition for each source pipeline.
Reads from sources.
Relational sources use relational reader threads, and file sources use
file reader threads.
Writer (Consumer) One thread for each partition, if a target exists in the source pipeline.
Writes to targets.
Relational targets use relational writer threads, and file targets use file
writer threads.
70
Session architecture
***** RUN INFO FOR TGT LOAD ORDER GROUP [1], CONCURRENT SET [1] *****
Thread [READER_1_1_1] created for [the read stage] of partition point
[SQ_ods_invoice_summary_ff] has completed: Total Run Time = [39.875000] secs, Total Idle Time =
[18.359375] secs, Busy Percentage = [53.957680].
Thread [TRANSF_1_1_1] created for [the transformation stage] of partition point
[SQ_ods_invoice_summary_ff] has completed: Total Run Time = [55.046875] secs, Total Idle Time =
[0.562500] secs, Busy Percentage = [98.978144].
Thread [TRANSF_1_2_1] created for [the transformation stage] of partition point [AGGTRANS] has
completed: Total Run Time = [12.187500] secs, Total Idle Time = [2.718756] secs, Busy
Percentage = [77.692261].
Thread [WRITER_1_*_1] created for [the write stage] of partition point [EDW_INVOICE_SUM] has
completed. The total run time was insufficient for any meaningful statistics.
71
PowerCenter Performance Features
• Pipelined transformation-read/write/transform in
parallel
• Parallelism at data level by partitioning
• Bulk load support/Native drivers support
• High speed, memory-based binary search for
Lookup transformations
• Aggregations, sorting done fully in memory
72
PowerCenter 8 – New concepts
• Pushdown optimization
• Concurrent lookup caching
• Auto memory settings
• Lookup – any row matching, lookup override
• Session on grid
• Repagent caching
• Concurrent workflows
• Bigint Precision of 19
73
Performance Tuning – Iterative process
74
Performance Tuning Areas
PowerCenter Performance and Tuning Guide
• Covers the following areas:
• Identify Bottlenecks
• Optimizing:
• Mappings
• Sources / Targets
• Transformations
• Sessions
• Grid Deployment
• Partitioning
• Use of performance counters
75
#1: Reduce Network traffic and Disk I/O
• Network traffic
• Move target database to ETL server
• Local disk is faster than network
• Disk I/O
• Reduce paging
• Reduce I/O contention (spread source, target and cache)
76
#2: Optimizing Mappings
77
#3: Optimizing Sessions
78
#3: Optimizing Sessions - Session Logs
Statistics
Thread [READER_1_1_1] created for [the read stage] of partition point [SQ_ods_invoice_summary_ff] has completed:
Total Run Time = [39.875000] secs, Total Idle Time = [18.359375] secs, Busy Percentage = [53.957680].
Thread [TRANSF_1_1_1] created for [the transformation stage] of partition point [SQ_ods_invoice_summary_ff] has
completed: Total Run Time = [55.046875] secs, Total Idle Time = [0.562500] secs, Busy Percentage =
[98.978144].
Thread [TRANSF_1_2_1] created for [the transformation stage] of partition point [AGGTRANS] has completed: Total
Run Time = [12.187500] secs, Total Idle Time = [2.718756] secs, Busy Percentage = [77.692261].
Thread [WRITER_1_*_1] created for [the write stage] of partition point [EDW_INVOICE_SUM] has completed. The
total run time was insufficient for any meaningful statistics.
79
#4: Optimizing Sources/Targets
80
Performance Analyzer 1.0
81
Performance Analyzer 1.0
•Specify precision
•Enter the number of row
•to be processed
•Enter the nubmer of partitions
•Select the “Analyze Mapping”
button
82
Performance Analyzer 1.0
83
Summary
• Q&A
84
85