Whats New In PowerCenter

and PowerExchange 9.5

Wei Zheng
Senior Director, Product Management
Informatica
John Haddad
Director, Product Marketing
Informatica
1

Agenda
Data Integration Overview and Update
Whats New in PowerCenter v9.5
Data Integration Analyst Option
PowerCenter Data Virtualization Edition
Data Validation Option

Proactive Monitoring for PowerCenter

Metadata Manager Update (Advanced Edition)
PowerCenter for Hadoop

Whats New in PowerExchange v9.5

Safe Harbor
The information being provided today is for
informational purposes only. The development, release
and timing of any Informatica product or functionality
described today remain at the sole discretion of
Informatica and should not be relied upon in making a
purchasing decision. Statements made today are based
on currently available information, which is subject to
change. Such statements should not be relied upon as
a representation, warranty or commitment to deliver
specific products or functionality in the future.

The Dominant Leader in Data Integration

Gartner Magic Quadrant for
Data Integration Tools, 2011

Forrester Wave: Enterprise

ETL, Q1 12

Forrester Wave: Data

Virtualization, Q1 12

Power of
The Platform

Big Trends Defining the DI Market

Big Data, Data Virtualization, Self Service, Governance
Web

Services

CUSTOMER

Transactions

SQL

ORDER

Batch

CLAIM

Interactions

PRODUCT

Analytics

Archived

Search all

Home
Term Definition

Go

Term: Past Due

Relationship Diagram

History

Business Lineage

Comments

Payments System
Customer Vision
Due Date
Past Due Accounts Report

Grace Period

Past Due

Pending Foreclosure Report

Mortgage App

In Loan Modification

Data Integration Analyst Option

How Long Does a Change Take?

Reporting Scenario: On-going requests for data that is NOT in the DW

Business
Change
Request

? if?
What

IT
Deploy to
Production

3-6 Months
Weeks/Days
Change Request Approve & Prioritize Analyze & Design Build Test Deploy
66% of BI requirements change on between a daily and monthly basis
71% of the respondents said they have to ask data analysts to create custom reports for them
36% of custom report requests require a custom cube or data mart to answer the request
77% of respondents cited that it takes between days and months to get their BI requests fulfilled
Source: Forrester Research, Agile BI: Best Practices for Breaking Through the BI Backlog, 2010

Data Integration Analyst Option

For PowerCenter & Data Services (Released in 9.1)

Informatica
PowerCenter

Informatica
Data Services

New Option

Data Integration Analyst

Immediate access to data

Savings in project duration and cost
Improved analyst and developer
productivity due to better businessIT collaboration

Easily map data sources to both physical and virtual data targets

Quickly find data via integrated business glossary

Specify transformation logic using reusable expressions

Include pre-built rules and mappings (e.g. ETL, data quality)

Test and validate specification results

Efficiently collaborate with developers

Automatically generate PowerCenter mappings and publish SQL views

Analyst Defines and Validates Mapping

Specification
Easily map data
sources to both
physical and virtual
data targets

Preview and validate

specification results

Include pre-built ETL

and data quality rules
as transformations in
mapping specification

Which source
attributes map to
target attributes?
What transformations
and rules are required
to map the sources to
targets?

Specify transformation
logic using reusable
expressions

Include transformation
descriptions to instruct
developer

Easily Extend Auto-generated Mapping

Extend the generated
mapping for rapid
development

Mapping logic
automatically generated
from analyst defined
specification
Extend mapping to
dynamically mask
sensitive data

Extend mapping to
consume web services

10

Rapidly Deploy as a SQL View, Web

Service or Batch ETL
What is the fastest
way to deploy this
change to
production

Deploy as a SQL view

Deploy to PowerCenter

Deploy as a web service

11

PowerCenter Data Integration Analyst Option

New in 9.5
Guided Mappings Join recommendations from metadata,
auto-map source & target, midstream data preview
Usability improvements for mapping specification edit and
join logic definition
Embedded profiling within mapping specifications

Better PowerCenter collaboration using descriptions

SQL query interface against mapping specification
Support for adapter SDK

Informatica proprietary/confidential. Informational purposes only. No representation, warranty or commitment

regarding future functionality. Not to be relied upon in making purchasing decision.

12

PowerCenter Data Virtualization Edition

13

Enterprise Challenges
Organizations have an incomplete, old and
inaccurate view of the business because:
It takes too long to deliver integration projects
(Example Business Intelligence (BI), MDM, SOA)
Many iterations are needed to get the requirements
right
The underlying architecture is inflexible making it
too hard to support change

NO AGILITY & PRODUCTIVITY

14

Data Virtualization Can Help

BI

Composite Apps

Portal

Data
Consumers

COMMON DATA
ACCESS LAYER

Logical Data Objects

FAST, DIRECT
ACCESS

Data
Abstraction
CUSTOMER

ORDER

PRODUCT

Enterprise
Data Sources

ABSTRACTION &
REUSE
KEY USE CASES

Logical View of All Underlying Data

Think Virtual Machines for DATA!

BI / DW

MDM

SOA

15

PC DVE Key Use Cases

1

DW/Business Intelligence (BI)

Business

IT

Prototype DW & accelerate new data

& reports from months to days

Change
Request

Deploy to
Production

MDM
Deliver a complete view of master &
transactional data in real-time

INCOMPLETE VIEW
OF CUSTOMER

Virtual View

Weeks/Days
Months
MDM
HUB
TRANSACTIONAL
SYSTEMS
DATA
WAREHOUSE

16

Introducing
NEW
PowerCenter
Data Virtualization Edition

Partitioning

New PowerCenter Edition for

AGILITY & PRODUCTIVITY
Combines:
Data integration (PowerCenter SE)

Data Profiling

Data Virtualization (IDS Full Use)

Data Federation

Data Profiling (IDE Full Use)

Developer Tool

Business-IT Collaboration (Analyst)

Analyst Tool
2 Adapters
(PWX for Relational)

ETL

(PC Standard Edition)

Packaged for simplicity and

attractively priced

Reuses existing skills and

resources

Informatica proprietary/confidential. Informational purposes only. No representation, warranty or commitment

regarding future functionality. Not to be relied upon in making purchasing decision.

17

Data Validation Option

18

Why Data Validation?

Data is moved
or transformed

Enterprise Data

But is it correct?

Enterprise Data

19

Some DVO use cases

Data Being Transformed
ETL Reconciliation
Data Masking
ETL Testing
Application Migration

Data is Identical
ETL version upgrade
ETL Migration
Database migration
Application Retirement

20

Current Approach: Like a Photo Hunt

21

Current Approach: Stare and Compare

Data Set #1

Data Set #2

22

What is the Data Validation Option?

DVO is a black box testing solution

that provides automation,
repeatability and auditability to

virtually any data testing or

reconciliation process.

23

How DVO works with PowerCenter

Data Validation Option
Repository
& Warehouse

DVO Clients

Database
Views

Reports

V_Summary
Id: name
name: string
V_Tests
Price: integer
DateId:in:name
date
V_Results
Datename:
out: date
string
Salary:
float
Price:
integer
DateId:
in:name
date
string
Datename:
out: date
Price:
Salary:
floatinteger
Date in: date
Date out: date
Salary: float

Define
Tests

Results

Execute Tests

Data
Accessed

Repository and Integration Services

Repository
PowerCenter

Enterprise
Data

24

Data Validation Option: Benefits

Increased likelihood of project success, lower project risk
Significant cost savings, faster time to market
50% source-to-target testing
80% - 90% regression / upgrade testing

Ability to test all data, not just a small sample

Ability to test in heterogeneous environments
No need to write SQL
Complete Audit Trail of all your testing activities

No need to acquire additional server technology: leverage

PowerCenters scalability, platform support and data access

25

PowerCenter Data Validation Option

New in 9.5
Focused functionality on Operational (Production) validation
scenarios
Incremental validation
Enhanced reports and dashboards with drill down (Jasper)
Single Sign-on

Testing across heterogeneous table joins

Extending data support
SalesForce.com, SAS, SAP, Mainframe

Informatica proprietary/confidential. Informational purposes only. No representation, warranty or commitment

regarding future functionality. Not to be relied upon in making purchasing decision.

26

Proactive Monitoring for PowerCenter

27

Why Monitor PowerCenter?

I have to manually login everyday

to determine if I have any issues.

It is difficult for me to see when

data is trending off the norm by X%.

We monitor a lot of individual

activities but its difficult for us to
correlate them.

We have a lot of custom scripts

for monitoring, but they are hard to
update (often the developer has left)
and inflexible.

28

Proactive Monitoring for PC Operations

PowerCenter
Runtime

Customer Written Rules

PC Monitor

Built-in Rules

PC User

Customizable Rules
Built-in Analytics

PC Admin
Data Architect
App Architect

PowerCenter
Repository

Solution Infrastructure

IT Security

Alert Recipients

Data Sources

Continuous monitoring 24x7

Pre-built Application + Self-Service Extendable Tool =
Immediate ROI + Continuously increasing ROI
Case Study: Sample rules

Built-in: PowerCenter Session succeeded, but loaded zero row s(Data Architect)
Built-in: PowerCenter Domain is down (PC Admin)
Customizable: PowerCenter Workflow Running Time exceeded SLA (App Architect)

29

Governance & Operations In Action

Environment &
Correlation
Enrichment

Real time Workflow

and Session Data

PowerCenter
LM API

(other monitors, etc)

Workflow
Controls

PowerCenter
Repository

Workflow
Statistics

Monitor & Alert

Proactive Monitoring
for PowerCenter

OS (CPU, Memory, Disk)

DB (Tablespace, Listener)

(Source Feeds, Rules/Templates,

Watchlists, Alerts)
Alerts
(Dashboards, e-mail, DBs, other systems, etc)

30

Whats New: Proactive Monitoring for

PowerCenter
Operations Improve Uptime

Governance Improve Quality

Identify issues before workflows fail or

lead to erroneous reports

Identify development best practices

violations before they hit production

20+ prebuilt alerting rules and

templates

100s of pre-configured attributes

simplify rule customization

NEW environmental variables (CPU,

memory, tablespace) to track and
correlate against schedules and jobs

Regulate SQL overrides, enforce commit

and cache sizes and dozens of other
documented practices

31

Metadata Manager 9.5 Update

32

PowerCenter Metadata Manager

Personalized Data
Lineage

Consolidated
Metadata Catalog

Business Glossary

3rd party BI

Metadata
Reports

Metadata
Bookmarks

Metadata Manager
Repository

Metadata Connectivity

Mainframe

ERP

Relational &
Flat Files

Data Modeling
Tools

BI Tools

Informatica proprietary/confidential. Informational purposes only. No representation, warranty or commitment

regarding future functionality. Not to be relied upon in making purchasing decision.

Custom

33

PowerCenter Metadata Manager

New in 9.5
New XConnect for SAP BW 7.0, 7.3
New XConnect for custom metadata
Rule-based linking
Easier to develop and manage:
Validation, user-friendly logging

Revamped all XConnects for BI and data modeling tools

New certifications
Cognos 10, OBIEE 11g, Microstrategy 9.2,
ER/win 8, PowerDesigner 16, ER/studio 9,

Informatica proprietary/confidential. Informational purposes only. No representation, warranty or commitment

regarding future functionality. Not to be relied upon in making purchasing decision.

34

PowerExchange for 9.5

35

Big Transaction Data

PowerExchange for Relational, Data Warehousing, Applications

New with 9.1:

PWX for Greenplum

PWX for MS Dynamics CRM
PWX for Oracle CDC Direct to Log
Support for Exadata: Source/target and repository

New with 9.5:

PWX for SAP: SAP HANA extract/load via ODBC, SAP
for BW 7.3

PWX SQLServer:

Datetime2 support, bulk load

performance

Informatica proprietary/confidential. Informational purposes only. No representation, warranty or commitment

regarding future functionality. Not to be relied upon in making purchasing decision.

36

Big Interaction Data

PowerExchange for Social Media

Available with 9.1+:

Connect to leading Social Platforms with

PowerExchange for Facebook, Twitter, LinkedIn

Informatica proprietary/confidential. Informational purposes only. No representation, warranty or commitment

regarding future functionality. Not to be relied upon in making purchasing decision.

37

Checkout Related Breakout Sessions

Breakout Sessions
Whats New in Data Services 9.5
Informatica for Hadoop

Proactive Monitoring for PowerCenter

AutoDVO: Data Validation for Production Use Cases

HOLs (Hands on Lab)

Powercenter and Self Service DI

PowerExchange
Metadata Manager and Business Glossary
Data Services & Web Services
Hadoop Data Processing
hParser
Proactive Monitoring for PowerCenter
Informatica Data Validation
38

Questions?

39