BW OLAP Aggregation

BW OLAP
Aggregation
Lothar Schubert, BW RIG
SAP Labs America, LLC
March 2003
Introduction The Role of the OLAP Engine
Business
Explorer
Master Data
MultiProvider
No Data
ODS Object
Virtual
InfoCube
InfoSet
SAP AG 2002, Title of Presentation, Speaker Name
InfoProvider Interface
With Data
Basic
InfoCube
OLAP
Engine
Overview
KF/CKF Properties and Exception Aggregation
OLAP Processor Under the Hood
Case Study Revenue Calculation
Calculation with Reference to Characteristic
Formula Collision
Percentage and Summary Functions
Overview
Formula Collision
Exception Aggregation Settings on KF Level
Example:
Department Headcount
D1
100
D2
80
Result
180 << SUM
Month
Headcount
1/3/03
160
2/3/03
180
Result
170 << AVG, with regards to Month
Exception Aggregation - Counting

CNT: Counting of all values with respect to reference characteristic
Business Scenario: How many different materials does a customer
have "Open Orders" for?
Dr
illd
ow
Exception Aggregation - Average

AVG: Average of all values with respect to reference characteristic
Business Scenario: Average "Open Order Qty" per Material
Calculation Steps
Dr
illd
ow
Aggregate values
using standard
aggregation
n
Aggregate values
using exception
aggregation
Drill-down by Material
explains result
309 = ( 225 + 20 + 630
+ 360) / 4
Exception Aggregation First & Last Value

FIR, LAS Exception Aggregation (see note 310791)
Should only be used with non-cumulative key figures
Generally use time characteristic as reference characteristic
If being used for cumulative key figures:
Completeness of values with respect to reference characteristic
necessary.
If being used with non time char. as reference characteristic:
Sorting is done ascending according to key (internal presentation)
Plant
Posting Date Value

1
06/15/03
25
1
06/16/03
15
2
06/15/03
20
Plant
Cumulative InfoCube Example:
Posting Date Value

1
2
15 << last posted value concerning plant 1 - 6/16

20 << last posted value concerning plant 2 - 6/15
15 << last posted value concerning plant 1+2 - 6/16
Result
Key Figure (Selection, Formula) Properties
Note, that the those

calculations always act on
displayed data only
CKF Aggregation Behavior Assignment

Complexity Assignment, if of type= KF
Exception Aggregation Behavior (and reference) can be set freely
Default is setting of underlying Basic KF
PROPERTIES
10
CKF Aggregation Behavior Simple

Complexity Simple, if exclusively operands of same aggregation, where
operands can have complexity Simple themselves (KF, Constants, CKF)
Before / After Aggregation can be set
11
CKF Aggregation Behavior Complex

Complexity Complex applies to all other cases
Enhance options are not ready for input (greyed out)
Calculation always occurs after aggregation
12
Overview
Formula Collision
13
OLAP Initialization
Check Authorizations
Is it ok to execute query?
Is it ok to read data from InfoProvider?
Process Variables
Exit for global variables (before variable input) is processed
Prompt for variable input
Exit for global variables (that failed before input) is processed
Variable values are distributed to fixed filter, hierarchy settings, dynamic
filter, conditions & exceptions, formulas,
Initialize OLAP Processor

Notify Presentation hierarchies (if used)
Check time stamps for OLAP cache (and release respective Ids)
14
OLAP Processor in Detail I
1. OLAP request arrives from client

Request for free characteristics
Request for Dynamic filters
2. Include additional characteristics necessary for aggregation /

calculation. For example:
Exception aggregation
Elimination of internal business volume
Formula variables with replacement from attribute value, if used in
restricted key figure (RKF)
3. Check authorization for navigation state (where necessary)

4. Search for Cached data in OLAP Cache
Skip steps 5-14 and go to step 15 if cached data is found
15
if OLAP Cache is NOT utilized
OLAP Processor in Detail II

5. Request data from database
6. Receive data from database
Data arrives in blocks up to 1000 rows
Data is still separated by InfoProvider (in case of MultiProvider)
Data is still separated by Aggregate of InfoCube
Data is still separated into cumulative and non-cumulative key figures
7. Call BusinessAdd-In Virtual Characteristics and Key Figures

8. Check global filters (if not already done by database)
9. Add attributes values for variables with replacement from attribute
used in RKF
10. Separate data according to RKFs and selections in structure
elements
11. Perform currency translation
12. Process sums and calculated key figures (CKFs)
before aggregation
13. Aggregate data to detail level (see 2.)
14. Perform Hierarchy aggregation
16
OLAP Processor in Detail III

15. Filter and aggregate data (result lines)
16. Perform Elimination of Internal Business Volume (where applicable)
17. Perform Exception aggregation
18. Execute Currency/Unit aggregation
19. Add attributes values for variables with replacement from attribute
used in formulas
20. Calculate formulas and CKFs after aggregation
Check Currencies/Units
21. Perform List Operations, e.g.

Sort
Conditions
Local calculations/aggregations
Cumulated values
17
Overview
Formula Collision
18
OLAP Engine, w/ Example of Revenue Calculation

InfoCube contains field Quantity
Material Attribute contains field Price
Revenue should be calculated by the OLAP Processor
KH_ATTRIBUTE_REPLACEMENT
Calendar year
Key Figures
KHMAT2
Quantity, CKF (QU * PR)
KHMAT2
M1
M2
Overall Result
Quantity
11.000 PC
15.000 PC
26.000 PC
CKF (QU * PR)

$ 110.00000 PC
$ 300.00000 PC
$ 410.00000 PC
KH_ATTRIBUTE_REPLACEMENT
Calendar year
Key Figures
KHMAT2
Quantity, CKF (QU * PR)
Calendar year
2001
2002
Overall Result
Quantity
12.000 PC
14.000 PC
26.000 PC
19
CKF (QU * PR)

$ 190.00000 PC
$ 220.00000 PC
$ 410.00000 PC
Data Model (1)
Key Figure Quantity
InfoCube Definition
20
Data Model (2)
Price Attributes
InfoCube Definition
21
Data
InfoCube
Material Master
22
Formula Variable, based on Attribute Value
Crea
te
23
1. Try: Usage in Formula
Formula Editor
KHMAT2
M1
M2
Overall Result
Quantity
Calendar year
2001
2002
Overall Result
Quantity
24
11.000 PC
15.000 PC
26.000 PC
'KHF1' * 'Quantity'
$ 110.00000 PC
$ 300.00000 PC
X
12.000 PC
14.000 PC
26.000 PC
'KHF1' * 'Quantity'
X
X
X
2. Try: RKF, Before Aggregation (1)

Properties
Cre
ate
Price
25
2. Try: RKF, Before Aggregation (2)

OLAP Processor
Explanation
Query Definition
Quantity = AVG, CKF, Before
Quantity
KHMAT2
M1
M2
Overall Result
11.000 PC
15.000 PC
26.000 PC
Quantity
Calendar year
2001
2002
Overall Result
12.000 PC
14.000 PC
26.000 PC
26
KHK1_BEFORE
$ 20.00
$ 40.00
$ 60.00
KHK1_BEFORE
$ 30.00
$ 30.00
$ 60.00
Material
M1
M1
M2
M2
Year
Material
M1
M2
Result
Year
Quantity
2001
2001
2002
2002
Price
5
6
7
Quantity Price
11
15
26
10
10
20
20
40
60
3. Try: RKF, After Aggregation

OLAP Processor
Explanation
Quantity = SUM, CKF, After
Quantity
KHMAT2
M1
M2
Overall Result
Calendar year
2001
2002
Overall Result
11.000 PC
15.000 PC
26.000 PC
Quantity
12.000 PC
14.000 PC
26.000 PC
27
KHK1_AFTER
$ 10.00
$ 20.00
$ 30.00
KHK1_AFTER
$ 30.00
$ 30.00
$ 30.00
Material
M1
M2
Year
Quantity Price
2001
11
2001
15
Material
M1
M2
Result
Year
Quantity Price
11
15
26
10
20
30
4. Try: Formula, using CKF from before

OLAP Processor
Explanation
Quantity
KHMAT2
M1
11.000 PC
M2
15.000 PC
Overall Result 26.000 PC
KHK1_AFTER
$ 10.00
$ 20.00
$ 30.00
'Quantity' * 'KHK1_AFTER'
$ 110.00000 PC
$ 300.00000 PC
$ 780.00000 PC
Calendar year
Quantity
2001
12.000 PC
2002
14.000 PC
KHK1_AFTER
$ 30.00
$ 30.00
$ 30.00
'Quantity' * 'KHK1_AFTER'
$ 360.00000 PC
$ 420.00000 PC
$ 780.00000 PC
Qu * Pr = Formula
Material
M1
M1
M2
M2
Year
Price
Qu * Pr
Material
M1
M2
Result
Year
Quantity Price
11
15
26
Qu * Pr
10
20
30
Material
M1
M2
Result
Year
Quantity Price
11
15
26
Qu * Pr
10
110
20
300
30
780
28
2001
2002
2001
2002
5
6
7
8

Material
M1
M1
M2
M2
Year
Material
Year
Result
Quantity
Qu * Pr = Formula
Quantity
2001
2002
2001
2002
Price
Qu * Pr
5
6
7
8
Quantity Price
2001
12
2002
14
26
Qu * Pr
30
360
30
420
30
780
5. Try: Revenue Calculation within RKF (1)
29
5. Try: Revenue Calculation within RKF (2)

OLAP Processor
Explanation
Quantity
KHMAT2
M1
11.000 PC
M2
15.000 PC
CKF (QU * PR)

$ 110.00000 PC
$ 300.00000 PC
$ 410.00000 PC
Quantity
Calendar year
2001
12.000 PC
2002
14.000 PC
CKF (QU * PR)

$ 190.00000 PC
$ 220.00000 PC
$ 410.00000 PC
30
Material
M1
M1
M2
M2
Year
Material
M1
M2
Result
Year
Qu * Pr = CKF
Quantity
2001
2002
2001
2002
Price
Qu * Pr
5
6
7
8
Quantity Price
11
15
26
10
20
30
Qu * Pr
110
300
410
Some additional Notes

Be careful when using multiple aggregation types (see example below,
for a mix of before and after).
Allowed in CKF:
= KF * Attribute,
= KF / Attribute,
e.g. = Quantity * Price

e.g. = Quantity / Price
Not allowed in CKF (i.e. leading potentially to unwanted results):

= Attribute,
= Attribute / KF
e.g. = Price
e.g. = Price / Quantity
Performance impacts, in case of before aggregation

All required records have to be read into OLAP processor (and processed individually)
No aggregates cannot be applied
In case of MultiProviders
Datasets are processed individually per InfoProvider first
In case of Inventory (non cumulative) InfoCubes

Before aggregation does not allow formulas with mix of KF types
Always consider calculation already in UpdateRules (see Note 379832)

KHMAT2
M1
M2
Overall Result
Quantity
11.000 PC
15.000 PC
26.000 PC
KHK1_BEFORE
$ 20.00
$ 40.00
$ 60.00
KHK1_AFTER
$ 20.00
$ 40.00
$ 60.00
CKF (QU * PR)

$ 110.00000 PC
$ 300.00000 PC
$ 410.00000 PC
Calendar year
2001
2002
Overall Result
Quantity
12.000 PC
14.000 PC
26.000 PC
KHK1_BEFORE
$ 30.00
$ 30.00
$ 60.00
KHK1_AFTER
$ 30.00
$ 30.00
$ 60.00
CKF (QU * PR)

$ 190.00000 PC
$ 220.00000 PC
$ 410.00000 PC
31
Overview
Formula Collision
32
Motivation
Mostly, the OLAP first aggregates data and then applies
calculations
Sometimes you would like to change this sequence
(however you do not want to use before aggregation for all
characteristics combinations, due to performance reasons)
Example Cube Data:
Price per Unit
Here, it would be ok to aggregate first by Material and Month, but

its required to perform the calculation prior to aggregation on
Order.
33
After Aggregation would deliver wrong results
34
Usage of Reference to Characteristic (1)
35
Usage of Reference to Characteristic (3)
This attribute is available for every Characteristic (also 2.0b/2.1c)

Also here: Consider performance impacts
Perhaps calculation can already occur in Update Rules.
36
Overview
Formula Collision
37
Formula Collision
*'Quantity' * 'Quantity'
Quantity
2001
12.000 PC
2002
+14.000 PC
Summary
26 PC
Quantity
12.000 PC
14.000 PC
26 PC
Quantity
2001
12.000 PC
2002
14.000 PC
Summary
26 PC
Quantity
12.000 PC
14.000 PC
26 PC
'Quantity' * 'Quantity'
144.00000 PC^2
196.00000 PC^2
676.00000 PC^2
Quantity
2001
12.000 PC
2002
14.000 PC
Summary
26 PC
Quantity
12.000 PC
14.000 PC
26 PC
'Quantity' * 'Quantity'
144.00000 PC^2
196.00000 PC^2
340.00000 PC^2
144.00000 PC^2
196.00000 PC^2
676.00000 PC^2
Available in case of formulas with multiple structures,

under Formula Properties.
Collisions always occur when point and dash calculations or
functions are mixed in competing formulas.
If you do not make a definition, the formula that was set
(defined and saved) last takes priority.
38
Overview
Formula Collision
39
Percentage Functions (1)

a%b
difference in percentage:
How much does a value deviate from the absolute amount of b: = (a-)/abs(b)?
a%Ab
share in percentage:
How large is a share a for the total value b: = a/abs(b)
%CTa
share in terms of percentage for the result:
The value of the key figure a is related to the next higher value that is aggregated (the
"subresult" of a with respect to a characteristic is 100%).
GTa
share in terms of percentage for the total result:
The value of the key figure a is related to the aggregated value for all characteristics (the
"result" of the entire table for the key figure a is 100%).
%RTa
share in terms of percentage for the report result:
The value of the key figure a is related to the aggregated value for all characteristics, for
which the dynamic filter is ignored. If, for example, a free characteristic is restricted by a
filter value, the global result of the key figure a in the displayed table is not 100%. The
aggregation via all filter values results in 100%.
40
Percentage Functions (2)

KHMAT2
KHMAT2
M1
Overall Result
Calendar year
Quantity
2001
5.000 PC
2002
6.000 PC
Result
11.000 PC
2001
7.000 PC
2002
8.000 PC
Result
15.000 PC
26.000 PC
KHMAT2
M1
M2
Calendar year
Quantity
2001
5.000 PC
2002
6.000 PC
'Quantity' % 10
-50.00000 %
-40.00000 %
10.00000 %
'Quantity' % 10
-50.00000 %
-40.00000 %
10.00000 %
-30.00000 %
-20.00000 %
50.00000 %
160.00000 %
'Quantity' %A 10
50.00000 %
60.00000 %
110.00000 %
70.00000 %
80.00000 %
150.00000 %
260.00000 %
%CT 'Quantity'
45.45455 %
54.54545 %
42.30769 %
46.66667 %
53.33333 %
57.69231 %
100.00000 %
%GT 'Quantity'
19.23077 %
23.07692 %
42.30769 %
26.92308 %
30.76923 %
57.69231 %
100.00000 %
'Quantity' %A 10
50.00000 %
60.00000 %
110.00000 %
%CT 'Quantity'
45.45455 %
54.54545 %
100.00000 %
%GT 'Quantity'
45.45455 %
54.54545 %
100.00000 %
%RT 'Quantity'
19.23077 %
23.07692 %
42.30769 %
%RT 'Quantity'
19.23077 %
23.07692 %
42.30769 %
26.92308 %
30.76923 %
57.69231 %
100.00000 %
a%b
difference in percentage
a%Ab
share in percentage
%CTa
share in terms of percentage for the result
GTa
share in terms of percentage for the total result
%RTa
share in terms of percentage for the report result
41
Summary Functions
SUMGTa
The value of the key figure a is related to the aggregate value via all characteristics.
Aggregation is completed using the deepest-level characteristic.
SUMCTa
The value of the key figure a is related to the next highest aggregate value.
SUMRTa
The value of the key figure a is related to the aggregate value of all characteristics in
which the dynamic filter is ignored.
KHMAT2
KHMAT2
M1
Overall Result
Calendar year
Quantity
2001
5.000 PC
2002
6.000 PC
Result
11.000 PC
2001
7.000 PC
2002
8.000 PC
Result
15.000 PC
26.000 PC
KHMAT2
M1
M2
Quantity
Calendar year
2001
5.000 PC
2002
6.000 PC
SUMCT 'Quantity'
11.000 PC
11.000 PC
11.000 PC
42
SUMCT 'Quantity'
11.000 PC
11.000 PC
26.000 PC
15.000 PC
15.000 PC
26.000 PC
26.000 PC
SUMGT 'Quantity'
11.000 PC
11.000 PC
11.000 PC
SUMGT 'Quantity'
26.000 PC
26.000 PC
26.000 PC
26.000 PC
26.000 PC
26.000 PC
26.000 PC
SUMRT 'Quantity'
26.000 PC
26.000 PC
26.000 PC
SUMRT 'Quantity'
26.000 PC
26.000 PC
26.000 PC
26.000 PC
26.000 PC
26.000 PC
26.000 PC
Copyright 2002 SAP AG. All Rights Reserved

No part of this publication may be reproduced or transmitted in any form or for any purpose without the express
permission of SAP AG. The information contained herein may be changed without prior notice.
Some software products marketed by SAP AG and its distributors contain proprietary software components of other
software vendors.
Microsoft, WINDOWS, NT, EXCEL, Word, PowerPoint and SQL Server are registered trademarks of
Microsoft Corporation.
IBM, DB2, DB2 Universal Database, OS/2, Parallel Sysplex, MVS/ESA, AIX, S/390, AS/400, OS/390,
OS/400, iSeries, pSeries, xSeries, zSeries, z/OS, AFP, Intelligent Miner, WebSphere, Netfinity, Tivoli,
Informix and Informix Dynamic ServerTM are trademarks of IBM Corporation in USA and/or other countries.
ORACLE is a registered trademark of ORACLE Corporation.
UNIX, X/Open, OSF/1, and Motif are registered trademarks of the Open Group.
Citrix, the Citrix logo, ICA, Program Neighborhood, MetaFrame, WinFrame, VideoFrame, MultiWin and
other Citrix product names referenced herein are trademarks of Citrix Systems, Inc.
HTML, DHTML, XML, XHTML are trademarks or registered trademarks of W3C, World Wide Web Consortium,
Massachusetts Institute of Technology.
JAVA is a registered trademark of Sun Microsystems, Inc.
JAVASCRIPT is a registered trademark of Sun Microsystems, Inc., used under license for technology invented
and implemented by Netscape.
MarketSet and Enterprise Buyer are jointly owned trademarks of SAP AG and Commerce One.
SAP, SAP Logo, R/2, R/3, mySAP, mySAP.com and other SAP products and services mentioned herein as well as
their respective logos are trademarks or registered trademarks of SAP AG in Germany and in several other
countries all over the world. All other product and service names mentioned are trademarks of their respective
companies.
43
Copyright 2002 SAP AG. Alle Rechte vorbehalten

Weitergabe und Vervielfltigung dieser Publikation oder von Teilen daraus sind, zu welchem Zweck und in welcher
Form auch immer, ohne die ausdrckliche schriftliche Genehmigung durch SAP AG nicht gestattet. In dieser
Publikation enthaltene Informationen knnen ohne vorherige Ankndigung gendert werden.
Die von SAP AG oder deren Vertriebsfirmen angebotenen Softwareprodukte knnen Softwarekomponenten auch
anderer Softwarehersteller enthalten.
Microsoft, WINDOWS, NT, EXCEL, Word, PowerPoint und SQL Server sind eingetragene Marken der
Microsoft Corporation.
IBM, DB2, DB2 Universal Database, OS/2, Parallel Sysplex, MVS/ESA, AIX, S/390, AS/400, OS/390,
OS/400, iSeries, pSeries, xSeries, zSeries, z/OS, AFP, Intelligent Miner, WebSphere, Netfinity, Tivoli, Informix
und Informix Dynamic ServerTM sind Marken der IBM Corporation in den USA und/oder anderen Lndern.
ORACLE ist eine eingetragene Marke der ORACLE Corporation.
UNIX, X/Open, OSF/1 und Motif sind eingetragene Marken der Open Group.
Citrix, das Citrix-Logo, ICA, Program Neighborhood, MetaFrame, WinFrame, VideoFrame, MultiWin und
andere hier erwhnte Namen von Citrix-Produkten sind Marken von Citrix Systems, Inc.
HTML, DHTML, XML, XHTML sind Marken oder eingetragene Marken des W3C, World Wide Web Consortium,
Massachusetts Institute of Technology.
JAVA ist eine eingetragene Marke der Sun Microsystems, Inc.
JAVASCRIPT ist eine eingetragene Marke der Sun Microsystems, Inc., verwendet unter der Lizenz der von
Netscape entwickelten und implementierten Technologie.
MarketSet und Enterprise Buyer sind gemeinsame Marken von SAP AG und Commerce One.
SAP, SAP Logo, R/2, R/3, mySAP, mySAP.com und weitere im Text erwhnte SAP-Produkte und -Dienst-leistungen
sowie die entsprechenden Logos sind Marken oder eingetragene Marken der SAP AG in Deutschland und anderen
Lndern weltweit. Alle anderen Namen von Produkten und Dienstleistungen sind Marken der jeweiligen Firmen.
44

BW OLAP Aggregation

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

BW OLAP Aggregation

Uploaded by

Copyright:

Available Formats

BW OLAP

Introduction The Role of the OLAP Engine

SAP AG 2002, Title of Presentation, Speaker Name

SAP AG 2002, Title of Presentation, Speaker Name

Exception Aggregation Settings on KF Level

SAP AG 2002, Title of Presentation, Speaker Name

Exception Aggregation - Counting

SAP AG 2002, Title of Presentation, Speaker Name

Exception Aggregation - Average

SAP AG 2002, Title of Presentation, Speaker Name

Exception Aggregation First & Last Value

Posting Date Value

Cumulative InfoCube Example:

Posting Date Value

15 << last posted value concerning plant 1 - 6/16

SAP AG 2002, Title of Presentation, Speaker Name

Key Figure (Selection, Formula) Properties

Note, that the those

SAP AG 2002, Title of Presentation, Speaker Name

CKF Aggregation Behavior Assignment

SAP AG 2002, Title of Presentation, Speaker Name

CKF Aggregation Behavior Simple

SAP AG 2002, Title of Presentation, Speaker Name

CKF Aggregation Behavior Complex

SAP AG 2002, Title of Presentation, Speaker Name

SAP AG 2002, Title of Presentation, Speaker Name

Initialize OLAP Processor

SAP AG 2002, Title of Presentation, Speaker Name

OLAP Processor in Detail I

1. OLAP request arrives from client

2. Include additional characteristics necessary for aggregation /

3. Check authorization for navigation state (where necessary)

SAP AG 2002, Title of Presentation, Speaker Name

if OLAP Cache is NOT utilized

OLAP Processor in Detail II

7. Call BusinessAdd-In Virtual Characteristics and Key Figures

SAP AG 2002, Title of Presentation, Speaker Name

OLAP Processor in Detail III

21. Perform List Operations, e.g.

SAP AG 2002, Title of Presentation, Speaker Name

SAP AG 2002, Title of Presentation, Speaker Name

OLAP Engine, w/ Example of Revenue Calculation

Quantity, CKF (QU * PR)

CKF (QU * PR)

Quantity, CKF (QU * PR)

SAP AG 2002, Title of Presentation, Speaker Name

CKF (QU * PR)

Data Model (1)

Key Figure Quantity

SAP AG 2002, Title of Presentation, Speaker Name

Data Model (2)

SAP AG 2002, Title of Presentation, Speaker Name

SAP AG 2002, Title of Presentation, Speaker Name

Formula Variable, based on Attribute Value

SAP AG 2002, Title of Presentation, Speaker Name

1. Try: Usage in Formula

SAP AG 2002, Title of Presentation, Speaker Name

2. Try: RKF, Before Aggregation (1)

SAP AG 2002, Title of Presentation, Speaker Name

2. Try: RKF, Before Aggregation (2)

Quantity = AVG, CKF, Before

SAP AG 2002, Title of Presentation, Speaker Name

3. Try: RKF, After Aggregation