You are on page 1of 46

EIM160

Landscape Transformation Replication Server –


Real-Time Data Integration into SAP HANA
Tobias Koebler, Matt Kangas, Tobias Karpstein
Disclaimer

This presentation outlines our general product direction and should not be relied on in making a
purchase decision. This presentation is not subject to your license agreement or any other agreement
with SAP. SAP has no obligation to pursue any course of business outlined in this presentation or to
develop or release any functionality mentioned in this presentation. This presentation and SAP's
strategy and possible future developments are subject to change and may be changed by SAP at any
time for any reason without notice. This document is provided without a warranty of any kind, either
express or implied, including but not limited to, the implied warranties of merchantability, fitness for a
particular purpose, or non-infringement. SAP assumes no responsibility for errors or omissions in this
document, except if such damages were caused by SAP intentionally or grossly negligent.

© 2012 SAP AG. All rights reserved. 2


Agenda

Positioning & Architectural Concept


Core Functions
Table Settings and Transformation Capabilities
Additional features and use cases
Summary & Outlook

© 2012 SAP AG. All rights reserved. 3


Positioning &
Architectural Concept
Product Name and Positioning

SAP Landscape Transformation


Replication Server for SAP HANA

SAP LT Replication Server (SLT) is positioned for real-time data replication


from SAP and non-SAP sources (SAP supported data bases only)
 Mainly Recommended for real-time data replication business scenarios

© 2012 SAP AG. All rights reserved. 5


Overview

SAP LT Replication Server does not have to be a separate SAP


system and can run on any SAP system with SAP NetWeaver 7.02
ABAP stack (Kernel 7.20EXT)

HANA Studio

Replication Configuration
Application Table
Trigger Based RFC / DB DB
Connection Replication Engine
Delta Recording Connection
Application Table

SAP / non-SAP source


system SAP LT Replication Server SAP HANA system

Connection(s) between source system and SAP HANA system are Data load and replication are
defined as “Configuration” on the SAP LT Replication Server triggered via SAP HANA Studio

© 2012 SAP AG. All rights reserved. 6


Architectural Concept 1/2
Replication from SAP sources system

RFC Structure mapping &


Read module
Connection Transformation

DB
Write module
Connection
Application table Logging table
Application table
DB trigger

SAP source system SAP LT Replication Server SAP HANA system

Efficient initialization of data Flexible and reliable replication process, incl. Fast data replication via DB connect
replication based on DB trigger data migration LT replication functionality is fully
and delta logging concept integrated with HANA Modeler UI

© 2012 SAP AG. All rights reserved. 7


Architectural Concept 2/2
Replication from non-SAP sources system

DB Read module
Connection

Structure mapping &


Transformation
Application table Logging table DB
Write module Connection
DB trigger
Application table

Non-SAP source system SAP LT Replication Server SAP HANA system

In a first step, SAP LT Replication Server transfers all metadata table definitions from the non-SAP source system to the HANA system. From
the HANA Studio perspective, non-SAP source replication works as for SAP sources. When a table replication is started, SAP LT Replication
Server creates logging tables within the source system. As a difference, the read modules are created in the SAP LT Replication Server. The
connection to the non-SAP source system is established as a database connection.

© 2012 SAP AG. All rights reserved. 8


Multi System Support 1/2

Source systems are


System A
Schema 1 connected to separate
Schema 2 HANA schema on the
System B
Source systems SAP HANA system
same HANA System

Source systems are


System A Schema 1 connected to separate
HANA systems. Schema
System B Schema 1
name can be equal or
Source systems SAP HANA system different

Source systems are


System A
connected to same HANA
Schema 1
System B
system and also the same
Source systems SAP HANA system
schema

© 2012 SAP AG. All rights reserved. 9


Multi-System Support 2/2
1:N Replication for SAP source systems

SAP source system is


Schema 1 connected to separate
HANA systems or to the
System A Schema 2 same system with
SAP Source system SAP HANA systems different schema name.

If one source system is connected to


several target schemas (currently up
to 1:4 supported), the relevant target
schema can be selected in the data
provisioning UI.

© 2012 SAP AG. All rights reserved. 10


Core Functions
Configuration and Monitoring Dashboard
Setup of connections in SAP LT Replication Server

Call SAP LT Replication Server


Configuration (Transaction: LTR)

Define configuration data

© 2012 SAP AG. All rights reserved. 12


Configuration and Monitoring Dashboard
Setup for non-SAP source system

Start with transaction LTR

To replicate from Non-SAP source


system select Non-SAP system and the
affected database system.

Depending on the Database System, additional


required information needs to be specified (e.g.
for DB2 specify the DB Connection and the
tablespace name).

© 2012 SAP AG. All rights reserved. 13


Configuration and Monitoring Dashboard
New Settings for a Configuration

A dedicated tablespace can be


defined for the logging tables. If more
than one tablespace was already
defined, they will still be displayed.

Flag to allow usage of source system


in different configurations (1:N
Flag for client-specific load and
replication).
replication. The data is only read
from the client which is specified in
the RFC connection.
© 2012 SAP AG. All rights reserved. 14
Configuration and Monitoring Dashboard
Statistics

Statistical data can be displayed in the Statistics


tab page. You can view the status, the latency
times, number of records that have been
replicated, and the relevant operation (insert,
update, delete).

© 2012 SAP AG. All rights reserved. 15


SAP HANA Studio
Start Data Replication from SAP HANA System
Choose data provisioning to launch
SAP HANA Modeler UI 1. 1. Select source system as defined in SAP LT Replication
Server; related system information and schema will be displayed
2. 2. Use button
1. Load to start only a load process
2. Replicate to start load and replication process
3. 3. Use button Stop Replication to finish replication
4. 4. Use button Suspend to pause replication
5. 5. Use button Resume to continue replication

© 2012 SAP AG. All rights reserved. 16


Demo
Table Settings and
Transformation Capabilities
Table Settings and Transformation Capabilities 1/4
Selective Data Replication / Filtering

Reduce Number of Records by Filter

RFC/DB DB
Connection Connection

Source system SAP LT Replication Server SAP HANA system

Scenario
 Replicating certain data only
 Only data of specific years, departments, clients, etc. should be used in HANA

© 2012 SAP AG. All rights reserved. 19


Table Settings and Transformation Capabilities 2/4
Transformation Data

Conversion of Data

RFC/DB DB
Connection Connection

Transformation of
Data
Source System SAP LT Replication Server SAP HANA System

Scenarios
 To make certain fields anonymous  HR reporting
 To fill initial fields
 To convert units or currency and recalculate amounts and values

© 2012 SAP AG. All rights reserved. 20


Table Settings and Transformation Capabilities 3/4
Structure Change of (Target) Table Structure

Extension/Reduction of Target Table Structures

RFC/DB DB
Connection Connection

Source system SAP LT Replication Server SAP HANA system

Scenarios
 Merging the same tables (BSEG) from different systems (and create an additional field, for example a client field
in order to avoid duplicate entries)
 Merge different tables into one table in the HANA system
 Additional fields are required (for example can be calculated/filled during load/replication)
 Not all fields are required in the HANA system
© 2012 SAP AG. All rights reserved. 21
Table Settings and Transformation Capabilities 4/4
UI to Specify Table Settings
Transaction IUUC_REPL_CONTENT

2 Select table

1
Select Configuration

3
Specific table settings:
 Assignment of transformation rules
– Reduce Number of Records by Filter
– Conversion of Data
 Extension/Reduction of Target Table Structures
 Adjust / optimize performance of load and replication

© 2012 SAP AG. All rights reserved. 22


Demo
Additional features
and use cases
Monitoring with SAP Solution Manager 7.1 SP5

Replication notifications and alerts


are now visible in SAP Solution
Manager 7.1 SP5.

SLT monitoring summarizes the following


information per configuration:
 Connectivity to source and target system
 Status of latency time last 24h replication
 Status of master and load jobs
 Trigger status

© 2012 SAP AG. All rights reserved. 25


SAP Replication Manager – Mobile Application 1/2
Benefits and Requirements

Monitor Monitor the data replication process and system parameters.

Execution Trigger execution of important data replication functions.

Higher Flexibility Application can be run anytime and anywhere from a mobile device which is connected to the internet.

Statistics View Provide an analytical perspective of real-time data replication in terms of latency.

Infrastructure Requirements
• SUP 2.1
• Gateway (NW 7.02) (Minimal gateway)
• Backend
• IW_BEP 200 (SP2.0)
• DMIS_MOB SP01
• DMIS_2010 SP07
• SLT system should be a NW 700 EHP2 with SAP Kernel 7.20 EXT

© 2012 SAP AG. All rights reserved. 26


SAP Replication Manager – Mobile Application 2/2
Screenshots

Statistics
View
Execute

Monitor

Higher
Flexibility

© 2012 SAP AG. All rights reserved. 27


Technical Enabler for Multiple Data Provisioning Use Cases
Table-based Replication integrated into HANA Studio
 Real-time for SAP and NON-SAP sources
 Enabling SAP HANA Rapid Deployment Solutions and SAP HANA Application
Accelerators (e.g. CO-PA)

Replication engine for existing RDS Solutions Replication engine for new
and ERP Accelerators SAP HANA Application Accelerators

CO-PA Accelerator
 Reporting in Drill-Down Tool
 Accelerated Virtual Info Provider
ERP SAP Banking CRM Sales
 Operative transactions like Top-Down Distribution
Operational Financial Pipeline
Reporting Reporting Analysis FI and CO
• General Ledger
• Profit-Center Accounting
SAP Banking • Asset Accounting
FI/CO
Transaction
History
Accelerator • Overhead Cost Controlling
• Material Ledger

© 2012 SAP AG. All rights reserved. 28


SLT and SAP HANA in the Cloud
Architecture and Integration with SLT

IUUC_TAB_ALLOWED
RFC Connection
via WAN

SAP source system

Control table IUUC_TAB_ALLOWED in the SAP source system restricts the set of tables/clients
that are allowed to be defined for load/replication from the HANA Studio (located in the cloud).

© 2012 SAP AG. All rights reserved. 29


Outlook: SAP LT Replication Server & BW

SAP or non-SAP sources SAP LT Replication Server


SAP NetWeaver BW
(no SAP NW BW!)

MD
DSO
RFC / DB RDA
Daemon
Connection
RFC - BAPI
WebService
Connection DataSource

Row & Column Store

SQL/Calc/Planning/Aggr. Engine
SAP HANA
 Enabling real-time data supply into SAP NetWeaver BW
 Replicating Data of any SAP System (or non-SAP) into SAP NetWeaver BW
 Using a WebService DataSource as interface for SAP NetWeaver BW
 Real-Time data processing via SAP NW BW Realtime Data Acquisition (RDA)
Daemon into a DataStore Object (DSO) or master data tables (MD)

© 2012 SAP AG. All rights reserved. 30


Summary & Outlook
Key Benefits of SAP LT Replication Server for SAP HANA

 Allows real-time (and scheduled) data replication


 Table Settings and transformation capabilities (e.g. only replicate certain records, enrich table structure)
 Ability to migrate data into HANA format while replicating data in real-time
 „Unlimited“ release coverage (from SAP R/3 4.6C onwards) sourcing data from SAP ERP and other ABAP based
SAP applications
 Fully integrated with SAP HANA Studio
 Enhanced monitoring capabilities via SAP Solution Manager 7.1 SP5 and mobile app SAP Replication Manager

SAP LT Replication Server is the ideal solution for all HANA customers who need real-
time or scheduled data replication sourcing from SAP and NON-SAP sources

© 2012 SAP AG. All rights reserved. 32


What’s new in SAP HANA SPS05*

 SLT for SAP NetWeaver BW: ready for proof-of-concepts and prototyping projects (general availability expected in Q1/2013)

 Technical readiness for integrated use of SLT with SAP ERP Accelerators and other SAP HANA Application Accelerators

 Improved usability
– Help Center with detailed context-related documentation
– Advanced status tracking (when using Access Plan / Range Calculation)

 Improved stability
– Manual steps on SLT system after implementing a note or support package eliminated
– Support-related expert functions streamlined

 New and improved performance options (for initial load and replication)
– Data load using ROW ID approach with reading type 4
– Optimized job management: free-up background jobs and resources for tables in replication with low change rates

* This presentation and SAP„s strategy and possible future developments are subject to change and may be changed by SAP at any time for any reason without notice. This document is provided
© 2012 SAP AG. All rights reserved. without a warranty of any kind, either express or implied, including but not limited to, the implied warranties of merchantability, fitness for a particular purpose, or non-infringement 33
Key Information Sources and Contacts

General SAP Note - LT Replication Server for HANA:


 SAP Note 1605140: includes all important information, links to overview presentation, offline demo as well as
SAP corrections

Service Market Place and Help Portal


(http://service.sap.com/hana; http://help.sap.com/hana)
 Installation Guide
 Security Guide
 Operations Guide

Do not hesitate to contact your SAP Account Team or the HANA Customer Solution
Adoption Team for more details.

© 2012 SAP AG. All rights reserved. 34


Feedback
Please complete your session evaluation for EIM160.

Thanks for attending this SAP TechEd session.


Exercise
Source System &
SAP HANA system
SAP LT Replication
Server

SAP Logon SID: M95, M96, M97 HANA Studio: ANC


 check your sheet  check your sheet

User: EIM160_XX User: SYSTEM


PW: eim160 PW: manager
Appendix
Technical Requirements and System Set-Up Information for SAP LT
Replication Server (SAP HANA 1.0 SPS04)
RFC DB
Connection Connection
SAP Source system SAP LT Replication Server (*) SAP HANA system

Installation: Installation: Installation:


 respective DMIS 2010 version  Addon DMIS 2010_1_700  HANA SPS04: includes LT replication
 Minimum support pack level: SP05(**)  Minimum support pack level: SP07 functionality fully integrated into the UI of
the HANA modeler
Basic Configuration: Basic Configuration:
Basic Configuration:
 Optional: define separate table space  Define RFC connection to source system
 Create a DB user (if required)
for logging tables  Define DB connection to HANA system
 Define RFC user with appropriate authorization  Define max. number of jobs to be used for data replication

System Requirements: System Requirements:


 SAP Basis 4.6C and higher  SAP Basis: NetWeaver 702, with Kernel 7.20EXT (64BIT
 All databases Unicode) PL90 - see SAP note 1597627, => currently
limited platform availability
 Filesystem: 100 GB
 RAM: 16-32 GB
 CPU: 2-4 cores
 Recommended number of background jobs: 10

(*) LT replication server can run on any SAP system with SAP NetWeaver 7.02 ABAP stack (using SAP Kernel 7.20EXT),
for example on Solution Manager 7.1 or the source system – it does not have to be a separate SAP system!
(**) A few new SLT features available with HANA SPS04 may require DMIS_2010 SP07

© 2012 SAP AG. All rights reserved. 38


Technical Requirements and System Set-Up Information for SAP LT
Replication Server (SAP HANA 1.0 SPS04)
DB DB
Connection Connection
Non-SAP Source system SAP LT Replication Server (*) SAP HANA system

Installation: Installation:
 Addon DMIS 2010_1_700  HANA SPS04: includes LT replication
 Minimum support pack level: SP07 functionality fully integrated into the UI of
the HANA modeler
Basic Configuration: Basic Configuration: Basic Configuration:
 Create DB user for Secondary DB connection  Define DB connection to source system  Create a DB user (if required)
 Define DB connection to HANA system
 Define max. number of jobs to be used for data
replication
System Requirements: System Requirements:
 the OS/DB restrictions of NetWeaver 7.02  SAP Basis: Netweaver 702, with Kernel 7.20EXT (64BIT
apply (see at http://service.sap.com/pam) Unicode) PL90 - see SAP note 1597627, => currently
limited platform availability
 - Filesystem: 100 GB
- RAM: 16-32 GB
 CPU: 2-4 cores
 Recommended number of background jobs: 10

(*) LT replication server can run on any SAP system with SAP NetWeaver 7.02 ABAP stack (using SAP Kernel 7.20EXT),
for example on Solution Manager 7.1 or the source system – it does not have to be a separate SAP system!

© 2012 SAP AG. All rights reserved. 39


DB Supportability Matrix (HANA 1.0 SPS04)
Loading Data via SAP LT Replication Server for SAP HANA

Technical availability
Database SAP Sources Non SAP Sources (*)
MSFT SQL Server Enterprise Edition OK OK

Oracle Enterprise Edition OK OK

IBM DB2 LUW/ UDB (DB6) OK OK

IBM DB/2 zSeries OK OK

IBM DB2 iSeries (former AS/400) OK Planned

IBM Informix OK Planned

SAP MaxDB OK OK

Sybase ASE
OK OK
(with DB-Version 15.7.0.11) (with DB-Version 15.7.0.11)

For non-SAP source systems, the customer database license needs to cover a permanent database
connection with 3rd party products like LT replication server.
(*) Since a DB connection from LT replication server to a non-SAP system is required, the OS/DB restrictions of NetWeaver 7.02 apply (see at
http://service.sap.com/pam)

© 2012 SAP AG. All rights reserved. 40


SLT and HANA “compatibility matrix” SAP Note 1709225

Source System SLT HANA DB/Studio

DMIS 2010 SP3/4 DMIS 2010 SP4 HANA 1.0 SPS2

DMIS 2010 SP3-7 DMIS 2010 SP5-7 HANA 1.0 SPS3

DMIS 2010 SP3-7 DMIS 2010 SP5-7 HANA 1.0 SPS4

• SAP HANA can be upgraded from SPS3 to SPS4 without upgrading DMIS component
• The DMIS component can be upgraded from SP5 to a higher support package level without the need to
upgrade the HANA database or studio

If not all systems are installed on the newest support package, some functionalities
like 1:N replication or Load from SAP Archives might not be available.

© 2012 SAP AG. All rights reserved. 41


Load from SAP Archive 1/2
Architecture and Key Building Blocks

The ILM API must be available in the source system.


The API can be installed by means of SAP Note 1652039
(46C – 731).

Read Module RFC Structure Mapping &


Connection Transformation

ADK Archive Write Module DB


Access API Connection
Application Table

ADK Archive
SAP LT Replication
SAP Source system Server SAP HANA system

Archived data can be selected by the date of the archiving session.

© 2012 SAP AG. All rights reserved. 42


Load from SAP Archive 2/2
Define Load Object from SLT System

Select replication configuration


Select Archive Object

Define Selection Criteria

Select Relevant table


within current archive
object

© 2012 SAP AG. All rights reserved. 43


Key Information Sources and Contacts

General SAP Note - LT Replication Server for HANA:


 SAP Note 1605140: includes all important information, links to overview presentation, offline demo as well as
SAP corrections

Service Market Place and Help Portal


(http://service.sap.com/hana; http://help.sap.com/hana)
 Installation Guide
 Security Guide
 Operations Guide

Do not hesitate to contact your SAP Account Team or the HANA Customer Solution
Adoption Team for more details.

© 2012 SAP AG. All rights reserved. 44


Resources: Enterprise Information Management with SAP

• Understand the big picture of SAP’s enterprise information


management offerings
• Explore step-by-step instructions for working with SAP Data
Services
• Learn how to perform the most important tasks in SAP
Information Steward, SAP NetWeaver Information Lifecycle
Management, SAP Master Data Governance, and SAP
Extended Content Management
• All royalties donated to Doctors Without Borders

Enter 6Y8DF3 as your discount code when ordering


at SAP PRESS

© 2012 SAP AG. All rights reserved. 45


© 2012 SAP AG. All rights reserved.

No part of this publication may be reproduced or transmitted in any form or for any purpose without the express Google App Engine, Google Apps, Google Checkout, Google Data API, Google Maps, Google Mobile Ads,
permission of SAP AG. The information contained herein may be changed without prior notice. Google Mobile Updater, Google Mobile, Google Store, Google Sync, Google Updater, Google Voice,
Google Mail, Gmail, YouTube, Dalvik and Android are trademarks or registered trademarks of Google Inc.
Some software products marketed by SAP AG and its distributors contain proprietary software components of
other software vendors. INTERMEC is a registered trademark of Intermec Technologies Corporation.
Microsoft, Windows, Excel, Outlook, PowerPoint, Silverlight, and Visual Studio are registered trademarks of Wi-Fi is a registered trademark of Wi-Fi Alliance.
Microsoft Corporation.
Bluetooth is a registered trademark of Bluetooth SIG Inc.
IBM, DB2, DB2 Universal Database, System i, System i5, System p, System p5, System x, System z, System
Motorola is a registered trademark of Motorola Trademark Holdings LLC.
z10, z10, z/VM, z/OS, OS/390, zEnterprise, PowerVM, Power Architecture, Power Systems, POWER7,
POWER6+, POWER6, POWER, PowerHA, pureScale, PowerPC, BladeCenter, System Storage, Storwize, Computop is a registered trademark of Computop Wirtschaftsinformatik GmbH.
XIV, GPFS, HACMP, RETAIN, DB2 Connect, RACF, Redbooks, OS/2, AIX, Intelligent Miner, WebSphere,
Tivoli, Informix, and Smarter Planet are trademarks or registered trademarks of IBM Corporation. SAP, R/3, SAP NetWeaver, Duet, PartnerEdge, ByDesign, SAP BusinessObjects Explorer, StreamWork,
SAP HANA, and other SAP products and services mentioned herein as well as their respective logos are
Linux is the registered trademark of Linus Torvalds in the United States and other countries. trademarks or registered trademarks of SAP AG in Germany and other countries.
Adobe, the Adobe logo, Acrobat, PostScript, and Reader are trademarks or registered trademarks of Adobe Business Objects and the Business Objects logo, BusinessObjects, Crystal Reports, Crystal Decisions, Web
Systems Incorporated in the United States and other countries. Intelligence, Xcelsius, and other Business Objects products and services mentioned herein as well as their
respective logos are trademarks or registered trademarks of Business Objects Software Ltd. Business Objects
Oracle and Java are registered trademarks of Oracle and its affiliates.
is an SAP company.
UNIX, X/Open, OSF/1, and Motif are registered trademarks of the Open Group.
Sybase and Adaptive Server, iAnywhere, Sybase 365, SQL Anywhere, and other Sybase products and services
Citrix, ICA, Program Neighborhood, MetaFrame, WinFrame, VideoFrame, and MultiWin are trademarks or mentioned herein as well as their respective logos are trademarks or registered trademarks of Sybase Inc.
registered trademarks of Citrix Systems Inc. Sybase is an SAP company.
HTML, XML, XHTML, and W3C are trademarks or registered trademarks of W3C®, World Wide Web Crossgate, m@gic EDDY, B2B 360°, and B2B 360° Services are registered trademarks of Crossgate AG
Consortium, Massachusetts Institute of Technology. in Germany and other countries. Crossgate is an SAP company.
Apple, App Store, iBooks, iPad, iPhone, iPhoto, iPod, iTunes, Multi-Touch, Objective-C, Retina, Safari, Siri, All other product and service names mentioned are the trademarks of their respective companies. Data
and Xcode are trademarks or registered trademarks of Apple Inc. contained in this document serves informational purposes only. National product specifications may vary.
IOS is a registered trademark of Cisco Systems Inc. The information in this document is proprietary to SAP. No part of this document may be reproduced, copied,
or transmitted in any form or for any purpose without the express prior written permission of SAP AG.
RIM, BlackBerry, BBM, BlackBerry Curve, BlackBerry Bold, BlackBerry Pearl, BlackBerry Torch, BlackBerry
Storm, BlackBerry Storm2, BlackBerry PlayBook, and BlackBerry App World are trademarks or registered
trademarks of Research in Motion Limited.

© 2012 SAP AG. All rights reserved. 46