Data Archiving in Business

Intelligence 7.0

Applies to:
This Article applies to SAP BI 7.0.

Summary
With the fast growing databases, it will not be long before the database sizes grows from Terabytes to
Petabytes and to Exabytes. But in reality not all the data residing on the database is used every day. This
results in lot of dormant data on the disk. Huge databases would result in performance issues and
maintenance costs. In the wake of above problems, SAP came up with a Data Archiving solution. This article
describes the step-by-step process of Data Archiving solution provided by SAP for BI in NetWeaver 2004s.
Author:

Kalyan Reddy Kothinti

Company: Intelligroup Asia Pvt. Ltd.
Created on: 25 December 2008

Author Bio
Kalyan Reddy Kothinti is working as a Senior SAP BI Consultant at Intelligroup Asia Pvt Ltd. He
has been in this space for 3 years now and also has expertise in reporting SAP BI data using BO
Crystal Reports.

SAP DEVELOPER NETWORK | sdn.sap.com
© 2008 SAP AG

BUSINESS PROCESS EXPERT COMMUNITY | bpx.sap.com
1

Data Archiving in Business Intelligence 7.0

Table of Contents
Creating Data Archiving Process........................................................................................................................3
Step 1 ..............................................................................................................................................................4
Step 2 ..............................................................................................................................................................5
Step 3 ..............................................................................................................................................................5
Step 4 ..............................................................................................................................................................6
Step 5 ..............................................................................................................................................................7
Writing the Archive File.......................................................................................................................................7
Step 1 ..............................................................................................................................................................7
Step 2 ..............................................................................................................................................................8
Step 3 ..............................................................................................................................................................9
Step 4 ..............................................................................................................................................................9
Deletion of data from Database........................................................................................................................11
Step 1 ............................................................................................................................................................11
Step 2 ............................................................................................................................................................11
Checking the Statistics .....................................................................................................................................13
Reloading Data .................................................................................................................................................15
Step 1 ............................................................................................................................................................15
Step 2 ............................................................................................................................................................16
Step 3 ............................................................................................................................................................17
Related Content................................................................................................................................................20
Copyright............................................................................................................ Error! Bookmark not defined.

SAP DEVELOPER NETWORK | sdn.sap.com
© 2008 SAP AG

BUSINESS PROCESS EXPERT COMMUNITY | bpx.sap.com
2

structure of the archive file. HIPAA and BASEL II to name a few which states the duration of time the data has to be retained before it is archived. which in turn results in unacceptable system response times and maintenance costs. • Storing the archive files – The main purpose of archiving is to offload the inactive data from the database and store it separate storage media. a DSO with 33. In this step. Internal requirements include need of history data for doing trend analysis. The archiving procedure is divided into three steps: • Creating the archive files . Archive Development Kit (ADK). With the advancement of technology it has become easier now to create and store data than ever. XML archiving is primarily used for XML objects implemented by ABAP applications and JAVA applications.com © 2008 SAP AG BUSINESS PROCESS EXPERT COMMUNITY | bpx.com 3 . With the data growing at a very high pace each day. ADK based and XML based. Though data has such an important role to play. the archive files created in first step are moved to a storage media. the amount of inactive data residing on the database also increases. evolved as a solution for organizations to handle the large databases and keep a check on the increasing volumes of data. Writing the Archive File – In this phase.0 into three phases. we make all the necessary settings required for data archiving. 3. we execute the write process which writes the data we have selected for archiving into the archive files in the directory we specify. Though this is very little amount of data to be archived.Data Archiving in Business Intelligence 7. Procedure We can classify the data archive data in BI 7. such as characteristics for partitioning. etc. Creating the Data Archiving Process – in this phase. forecasting. etc. Creating Data Archiving Process For demonstrating the data archiving procedure. is a SAP tool used for archiving.In this step. the data which has been archived is deleted from the database. such as a tape or a hard disk. the deletion program deletes the data from the database which has been archived.sap.sap. before Data Archiving is implemented it is mandatory that the data is retained long enough to meet both internal and external requirements.0 Introduction Data plays the most important part in success or failure of an organization. • Deletion of data from the database – In this step. Data Archiving in BI . it loses its importance after a period of time resulting in inactive data residing on the database.816 records has been chosen.Solution provided by SAP Main advantage of Data Archiving in BI when compared to other SAP components is the ease of use. SAP provides two types of archiving solutions. 1. archive file location. External requirements include government regulations such as Sarbanes-Oxley Act. 2. Data Archiving. Deletion of data from Database – In this phase. it has been chosen purely for this demonstration. the data and the archive files. In this article we will be focusing on ADK based archiving. It acts as abstract layer between the SAP applications. the data selected for archiving is written into archive files in the location specified. SAP DEVELOPER NETWORK | sdn. where in inactive data is offloaded from the databases and stored on alternate storage systems. Defining a data archiving process in BI is easy as the system generates the Archiving Object and the necessary Write and Delete programs for us instead of we creating them. It becomes difficult to manage such high volumes of data for organizations. However.

0 Step 1 Select the InfoProvider which we want to archive from RSA1->InfoProvider and right click to access the Context menu.sap. From the Context menu select “Create Data Archiving Process”.Data Archiving in Business Intelligence 7. SAP DEVELOPER NETWORK | sdn.com 4 .com © 2008 SAP AG BUSINESS PROCESS EXPERT COMMUNITY | bpx.sap.

If you have Nearline storage system available.sap.Data Archiving in Business Intelligence 7. This topic is out of scope for this article. Below we can see that in addition to Fiscal Period.0 Step 2 “ADK-Based Archiving” check box is selected by default. select the characteristics on which you want to partition. SAP DEVELOPER NETWORK | sdn. Controlling area is also chosen for partitioning.com 5 . New Archiving Object is created for every InfoProvider chosen for archiving.sap. Make sure we have at least one Time Characteristic available for archiving. followed by seven characters of the InfoProvider technical name. This would require additional hardware. Archiving Object name will begin with BW and will have O for and DSO or C for a cube. Note: Nearline Storage is a new technology which would allow users to have access to the archived data.com © 2008 SAP AG BUSINESS PROCESS EXPERT COMMUNITY | bpx. Step 3 On the “Selection Profile” tab. you can select it here.

0 Step 4 On the Semantic Group tab.com © 2008 SAP AG BUSINESS PROCESS EXPERT COMMUNITY | bpx. SAP DEVELOPER NETWORK | sdn.sap.com 6 .sap. we select all the fields. we can make selection on which fields should the newly created archive file will have. Usually.Data Archiving in Business Intelligence 7.

this can be accessed from the Context menu of the InfoProvider and selecting “Manage ADK Archive”.0 Step 5 On the last tab “ADK”.Data Archiving in Business Intelligence 7.sap. SAP DEVELOPER NETWORK | sdn. if we want we can have a new file name and location by maintaining in FILE transaction.com 7 . Writing the Archive File Step 1 Go to “Archive Administration”. We can select here how we want to start the delete job once the write job is finished. It is recommended to start the delete job manually.sap. as shown below or from transaction SARA. We can select the Logical File name here.com © 2008 SAP AG BUSINESS PROCESS EXPERT COMMUNITY | bpx. If we want we can start the delete job either automatically or after occurrence of an event. we specify all the parameters which will be used for archiving. Activate the Data Archiving process we just created. for demo the default file name has been chosen.

sap.Data Archiving in Business Intelligence 7.com © 2008 SAP AG BUSINESS PROCESS EXPERT COMMUNITY | bpx.sap. Variant creation is discussed in the following steps. SAP DEVELOPER NETWORK | sdn.com 8 .0 Step 2 Click on Write and create a variant by in the following screen.

#2. #3. In our example. This process can be executed using execute button. we have chosen to archive the data for Fiscal periods 2004/006 and 2004/007. enter the selection conditions for the data which needs to be archived. here we can maintain values of which Controlling areas data needs to be archived. for example we have chose Controlling Area as additional partitioning characteristic.sap. Choosing “Test Mode” would only simulate the process and not actually create the archive files. save the variant and go back to previous screen. We can access the logs using Logs button.com © 2008 SAP AG BUSINESS PROCESS EXPERT COMMUNITY | bpx. Once these parameters are maintained. will be archived for all Controlling areas. Once we have maintained all the attributes.sap. #1 highlighted in RED. SAP DEVELOPER NETWORK | sdn. For our demo we did not maintain any value for Controlling Area. It is important that we chose Production Mode here. Therefore “Production Mode” must be chosen if we want to carry out archiving and not just simulate the process. Start date allows us to schedule archiving process. we are all set to start the write process. Spool parameters allow us to maintain the print parameters for the archiving log.com 9 . Step 4 In this screen we need to maintain Start Date and Spool Parameters.0 Step 3 On the variant creation screen.Data Archiving in Business Intelligence 7. which means data. We can maintain further restrictions also.

sap.sap.0 Screenshot below shows the log of the write process.com © 2008 SAP AG BUSINESS PROCESS EXPERT COMMUNITY | bpx.Data Archiving in Business Intelligence 7. Highlighted in the screenshot are the location and the file name of the archive file created and the number of records selected for archiving (14. SAP DEVELOPER NETWORK | sdn. We have successfully created the archive files.com 10 .565 records met the selection criteria of Fiscal period 2004/006 and 2004/007).

Deletion process can be automated as discussed earlier. execute the deletion phase by choosing #2. Step 1 Select “Delete” from the Archive Administration (transaction SARA).0 Deletion of data from Database The main reason an organization would consider data archiving could be. For resolving the performance problems caused by large volumes of data available on the database. shown in the screen shot #1. So it is necessary that the archived data be deleted from the database. Step 2 Select the Archive session which you want to delete and maintain the Start Date and Spool Parameters. Once all the necessary parameters are maintained.Data Archiving in Business Intelligence 7. Allows organizations to spend less on the system maintenance. SAP DEVELOPER NETWORK | sdn. To take back up of sensitive data as part of disaster management. but it is better to execute this step manually as discussed below. 1. 2.com © 2008 SAP AG BUSINESS PROCESS EXPERT COMMUNITY | bpx. 3.com 11 .sap. You can access the logs from #3.sap.

sap. Note: Data is deleted from the active table only for DSO and Fact table for the Cubes.sap.0 Below is the screen shot of the deletion log and highlighted area shows the selection conditions used for deletion from the active table of the DSO. SAP DEVELOPER NETWORK | sdn.Data Archiving in Business Intelligence 7.com © 2008 SAP AG BUSINESS PROCESS EXPERT COMMUNITY | bpx.com 12 .

sap.Data Archiving in Business Intelligence 7.com 13 .565 entries have been written to Archive file.251 entries which are available in the DSO’s active table.816 – 14. Checking the Statistics Statistics can be accessed from transaction SARA.com © 2008 SAP AG BUSINESS PROCESS EXPERT COMMUNITY | bpx.565 = 19. Initially we started our demo with an active table which had 33. SAP DEVELOPER NETWORK | sdn.sap.0 Screen shot below shows the number of entries in the active table of DSO after the Deletion phase.816 entries and in the write phase we have seen in the log that 14. Which leaves us with 33.

com © 2008 SAP AG BUSINESS PROCESS EXPERT COMMUNITY | bpx.com 14 . SAP DEVELOPER NETWORK | sdn.sap.Data Archiving in Business Intelligence 7.0 Statistics displays the information about the Disk Space before and after and the number of data records which have been archived.sap.

This is because.com 15 .sap. we resort to data archiving only when we are sure that we will not be using the data on the database any more.sap.com © 2008 SAP AG BUSINESS PROCESS EXPERT COMMUNITY | bpx.Data Archiving in Business Intelligence 7. we want it back on the database. Step 1 From transaction SARA->Goto->Reload.0 Reloading Data Reloading the archived data is not a very common situation unless it is an exceptional case. we have archived the wrong data. SAP DEVELOPER NETWORK | sdn. the following procedure is discussed. Though it is very unlikely that reloading will be necessary. but still considering the worst case scenario. But there could be some exceptional cases like.

sap.Data Archiving in Business Intelligence 7.sap.0 Note: SAP also warns us saying that Reloading is done in exceptional cases only with a warning message.com 16 . if you want to simulate and choose Reload if we want the data to be actually reloaded.com © 2008 SAP AG BUSINESS PROCESS EXPERT COMMUNITY | bpx. SAP DEVELOPER NETWORK | sdn. Choose Test Run. Step 2 Create a variant and save it.

SAP DEVELOPER NETWORK | sdn. Reloading can be executed using #2 and logs can be accessed from #3. just like we did for Deletion Phase.sap.sap. #1 in screen shot.0 Step 3 Choose the archive session which you want to reload and maintain the Start Date and Spool Parameters.com © 2008 SAP AG BUSINESS PROCESS EXPERT COMMUNITY | bpx.com 17 .Data Archiving in Business Intelligence 7.

Two requests are displayed in our example. Selection conditions used for archiving are also displayed.sap.816.com 18 . Details about the archiving can also be accessed via the Manage on the DSO administration.. 33. This is exactly equal to the number of entries which were present in the DSO initially.com © 2008 SAP AG BUSINESS PROCESS EXPERT COMMUNITY | bpx.Data Archiving in Business Intelligence 7. Once the Data Archiving Process has been activated a new tab “Archiving” is displayed. i.0 Screenshot below displays the number of records in the DSO’s active table after the reload.e. one is for the Archiving and the other is for Reloading.sap. SAP DEVELOPER NETWORK | sdn.

Archive Administration can also be accessed from here.com © 2008 SAP AG BUSINESS PROCESS EXPERT COMMUNITY | bpx.Data Archiving in Business Intelligence 7.com 19 .0 We can also schedule Archiving runs from the Manage->Archive tab.sap.sap. SAP DEVELOPER NETWORK | sdn.

com 20 .sap.com/saphelp_nw04s/helpdata/en/2a/fa0391493111d182b70000e829fbfe/frameset.com/saphelp_nw04s/helpdata/en/b7/78104292615833e10000000a155106/frameset.Data Archiving in Business Intelligence 7.com/saphelp_nw04s/helpdata/en/fa/2250e2bc4b1442a39265abba676cd9/frameset.sap.htm http://help.sap.0 Related Content http://help.com © 2008 SAP AG BUSINESS PROCESS EXPERT COMMUNITY | bpx.htm http://help.com/saphelp_nw04s/helpdata/en/8d/3e4d70462a11d189000000e8323d3a/frameset.htm SAP DEVELOPER NETWORK | sdn.htm http://help.sap.sap.sap.