Professional Documents
Culture Documents
1 Introduction..................................................................................... 3
2 Conflicts with Mandatory Standards............................................... 3
3 References...................................................................................... 3
4 Definitions....................................................................................... 4
5 General........................................................................................... 8
6 Utility Software................................................................................ 9
7 Interface OSIsoft’s Standard Software......................................... 10
8 Tags.............................................................................................. 11
9 Instrument Accuracy versus Resolution (Precision)..................... 13
10 Data Fidelity.................................................................................. 14
11 High Fidelity Data Compression Configuration............................. 14
12 Moderate Fidelity Data Compression Configuration..................... 16
13 Basic Fidelity Data Compression Configuration........................... 17
14 Interface Configuration.................................................................. 19
15 Performance Monitoring................................................................ 20
16 Compressing Configuration and Archive Files Size..................... 20
Appendix A – Documentation.................................................................. 22
Appendix B – Compression Configuration – Summary........................... 24
Appendix C – Performance Tags Example (Random Interface)............. 25
Appendix D – Impact of Compression
Configuration on Archive Files Size................................... 26
Revision History...................................................................................... 27
Page 2 of 27
Document Responsibility: Process Control Standards Committee SABP-Z-001
Issue Date: 19 December 2006
Next Planned Update: 19 December 2011 Plant Information System Data Compression
1 Introduction
1.2 Scope
This Practice defines configuration of attributes and parameters used for data
compression specification as well as software required to ensure data
compression is configured in standard way on the company Plant Information
Systems in Saudi Aramco plants.
1.3 Disclaimer
This SABP is not intended to detail all aspects of the configuration and does not
include adequate information to enable it to be used as an instruction manual.
The equipment manufacturer's instruction manuals and data sheets will also need
to be referenced and utilized.
In the event of a conflict between this Best Practice and other Mandatory Saudi Aramco
Engineering Requirements, the Mandatory Saudi Aramco Engineering Requirements
shall govern.
3 References
Specific sections of the following documents are referenced within the body of the
document. Material or equipment supplied to this best practice, shall comply with the
referenced sections of the latest edition of these specifications. Where specific sections
are not referenced, the system shall comply with the entire referenced document.
Page 3 of 27
Document Responsibility: Process Control Standards Committee SABP-Z-001
Issue Date: 19 December 2006
Next Planned Update: 19 December 2011 Plant Information System Data Compression
4 Definitions
This section contains definitions for acronyms, abbreviations, words, and terms as they
are used in this document.
Page 4 of 27
Document Responsibility: Process Control Standards Committee SABP-Z-001
Issue Date: 19 December 2006
Next Planned Update: 19 December 2011 Plant Information System Data Compression
Archive Files: Files that contain the PI data (value and time). These files,
defined by start and end times, shall be contiguous and non-overlapping.
Archive Subsystem: The PI Archive subsystem stores and serves the data after
it comes out of the Snapshot subsystem.
Data Archive: The Data Archive (also called just “the Archive”) is a historical
record of values for each point in the Point Database.
Exception: Exception reporting takes place on the Interface Node. The point of
Exception reporting is to reduce the communication (I/O) burden between the PI
Server and the Interface Node by filtering out “noise”.
ExcDev: The ExcDev attribute specifies in engineering units how much a value
may differ from the previous value before it is considered to be a significant
value. This is a dead band, which when exceeded, causes an exception. This is
configured for each PI Point in either the ExcDev or ExcDevPercent attribute.
Page 5 of 27
Document Responsibility: Process Control Standards Committee SABP-Z-001
Issue Date: 19 December 2006
Next Planned Update: 19 December 2011 Plant Information System Data Compression
ExcMax: The ExcMax (Exception Maximum) attribute sets a limit on how long
the interface can go without reporting a value to PI. After the ExcMax time
period, the interface sends a value to PI, regardless of whether the new value is
different from the last reported value.
Interface Node: Interface Nodes run PI interfaces. PI interfaces get the data
from the data sources and send it to the PI Server. Each different data source
needs a PI interface that can interpret it. Another word for Interface Node is
Scan Node.
Interfaces: Software modules for collecting data from data sources or sending
PI data to other systems.
Page 6 of 27
Document Responsibility: Process Control Standards Committee SABP-Z-001
Issue Date: 19 December 2006
Next Planned Update: 19 December 2011 Plant Information System Data Compression
OPC: OPC is open connectivity via open standards (formerly known as OLE
for Process Control).
PE Points: Calculated points, PI tags that take their data from results of the
Performance Equations (PE) subsystem.
Primary Archive: The archive file that ends at the current time. All events
recorded at the current time are stored in this archive.
Scan Class: A code that PI interfaces use to schedule data collection. Scan
classes consist of a period, which tells PI how often to collect the data and,
optionally, an offset, which tells PI when to start collecting data. A scan class
can also optionally contain a code that requires that the interface use UTC time.
Page 7 of 27
Document Responsibility: Process Control Standards Committee SABP-Z-001
Issue Date: 19 December 2006
Next Planned Update: 19 December 2011 Plant Information System Data Compression
Tag: The unique alphanumeric string that labels a PI point – tag name.
5 General
Where exception reporting uses a simple dead band method for filtering data,
PI’s compression testing uses a more complex method that follows the slope of
the data (the swinging door compression algorithm).
Page 8 of 27
Document Responsibility: Process Control Standards Committee SABP-Z-001
Issue Date: 19 December 2006
Next Planned Update: 19 December 2011 Plant Information System Data Compression
6 Utility Software
Any new or existing PI Interface can be configured and maintained using PI-
ICU.
Requirements
Requirements
Page 9 of 27
Document Responsibility: Process Control Standards Committee SABP-Z-001
Issue Date: 19 December 2006
Next Planned Update: 19 December 2011 Plant Information System Data Compression
Requirements
Requirements
PI-OPC Interface shall be used to communicate with DCS and SCADA OPC
server.
Page 10 of 27
Document Responsibility: Process Control Standards Committee SABP-Z-001
Issue Date: 19 December 2006
Next Planned Update: 19 December 2011 Plant Information System Data Compression
7.4 Buffering
8 Tags
Description:
Page 11 of 27
Document Responsibility: Process Control Standards Committee SABP-Z-001
Issue Date: 19 December 2006
Next Planned Update: 19 December 2011 Plant Information System Data Compression
Requirements
● Pointtype Float16 shall not be used for analog values. Float32 and Float64
shall be used instead of Float16 respectively.
Note: PI Float16 values are not really floats, but integers scaled so that they can
represent fractional values.
● Pointtype Float32 shall be used for analog values within range from
1.175494351 E-38 to 3.402823466 E+38 where acceptable precision is 7
decimal digits within this range.
● Pointtype Float64 shall be used for analog values within range from
2.2250738585072014 E-308 to 1.7976931348623158 E+308 where
acceptable precision is 15 decimal digits within this range.
● Pointtype Int16 shall be used for integer values within range from 0 to
32767 where acceptable precision is 5 decimal digits within this range.
Pointtype Int16 shall be used for values without fractions (no digits after
decimal point).
● Pointtype Int32 shall be used for integer values within range from -
2147450880 to 2147483647 where acceptable precision is 10 decimal digits
within this range. Pointtype Int32 shall be used for values without fractions
(no digits after decimal point).
Description:
Requirements
● Data series of tags with non numeric pointtype can not be compressed via PI
compression mechanism.
Page 12 of 27
Document Responsibility: Process Control Standards Committee SABP-Z-001
Issue Date: 19 December 2006
Next Planned Update: 19 December 2011 Plant Information System Data Compression
Description:
● Accuracy
The accuracy of an instrument reflects how close the reading is to the 'true'
measured value.
● Resolution (Precision)
● Measurement Error
● Example
Temperature
Working Temperature Range -20 to 125ºC standard
Calibrated Temperature Range 25 to 150ºC
Accuracy +/- 1ºC
Resolution 0.01ºC
Pressure
Working Pressure Range 0 to 15,000 psi
Calibrated Pressure Range 200 psi to 16,000 psi
Accuracy +/- 3.2 psi
Resolution < 0.01 psi
Requirements:
Page 13 of 27
Document Responsibility: Process Control Standards Committee SABP-Z-001
Issue Date: 19 December 2006
Next Planned Update: 19 December 2011 Plant Information System Data Compression
10 Data Fidelity
Requirements:
Tag database shall be divided to three data fidelity groups. Data are considered as High
Fidelity, Moderate Fidelity and Basic Fidelity.
Number of tags required High Fidelity data shall not exceed 3% total count of
tags. This limit can be increased as required to meet short term needs (e.g.
testing, commissioning, etc.)
Number of tags required Moderate Fidelity data shall not exceed 20% total
count of tags.
Tags considered sufficient with Basic Fidelity data (circa 80% total count of
tags).
Description: High Fidelity data configuration shall be used for Process control data
with high movements and most modeling applications (scan time in seconds).
Requirements:
11.1 EngUnits
11.2 Zero
11.3 Span
Tag attribute Span shall be set to value range in engineering units. Value range
is absolute difference between anticipated maximum value and minim value.
Page 14 of 27
Document Responsibility: Process Control Standards Committee SABP-Z-001
Issue Date: 19 December 2006
Next Planned Update: 19 December 2011 Plant Information System Data Compression
11.4 ExcMin
11.5 ExcMax
11.6 ExcDev
11.7 ExcDevPercent
11.8 CompMin
11.9 CompMax
11.10 CompDev
11.11 CompDevPercent
11.12 Compressing
11.13 Scan
11.14 Step
Page 15 of 27
Document Responsibility: Process Control Standards Committee SABP-Z-001
Issue Date: 19 December 2006
Next Planned Update: 19 December 2011 Plant Information System Data Compression
11.15 Shutdown
11.16 Archiving
Description: Moderate Fidelity data configuration shall be used for Process control data
with slow movements (scan time in minutes and hours).
Requirements:
12.1 EngUnits
12.2 Zero
12.3 Span
Tag attribute Span shall be set to value range in engineering units. Value range
is absolute difference between anticipated maximum value and minimum value.
12.4 ExcMin
12.5 ExcMax
12.6 ExcDev
12.7 ExcDevPercent
Page 16 of 27
Document Responsibility: Process Control Standards Committee SABP-Z-001
Issue Date: 19 December 2006
Next Planned Update: 19 December 2011 Plant Information System Data Compression
12.8 CompMin
12.9 CompMax
12.10 CompDev
12.11 CompDevPercent
12.12 Compressing
12.13 Scan
12.14 Step
12.15 Shutdown
12.16 Archiving
Description: Basic Fidelity data configuration shall be used for entire system (high and
moderate fidelity data are excluded).
Page 17 of 27
Document Responsibility: Process Control Standards Committee SABP-Z-001
Issue Date: 19 December 2006
Next Planned Update: 19 December 2011 Plant Information System Data Compression
Requirements:
13.1 EngUnits
13.2 Zero
13.3 Span
Tag attribute Span shall be set to value range in engineering units. Value range
is absolute difference between anticipated maximum value and minim value.
13.4 ExcMin
13.5 ExcMax
13.6 ExcDev
13.7 ExcDevPercent
13.8 CompMin
13.9 CompMax
Page 18 of 27
Document Responsibility: Process Control Standards Committee SABP-Z-001
Issue Date: 19 December 2006
Next Planned Update: 19 December 2011 Plant Information System Data Compression
13.10 CompDev
13.11 CompDevPercent
13.12 Compressing
13.13 Scan
13.14 Step
13.15 Shutdown
13.16 Archiving
14 Interface Configuration
More copies of specific interface can be configured and run on dedicated machine
(Interface Node). With more copies can administrator properly distribute data load and
tune better machine performance to avoid high peaks.
Requirements:
Page 19 of 27
Document Responsibility: Process Control Standards Committee SABP-Z-001
Issue Date: 19 December 2006
Next Planned Update: 19 December 2011 Plant Information System Data Compression
Proper number of Scan Classes shall be configured per each interface instance
to properly balance overall performance on Interface Node.
/id - The /id parameter shall be used to specify the interface identifier (interface
instance copy).
/f - The /f parameter shall be used to define the time period (scan class) between
scans in terms of hours, minutes, seconds, and milliseconds. Order position of /f
parameter in start up file shall be defined in Location4 for particular tag.
15 Performance Monitoring
Requirements:
Description:
Archive files size configuration depends on two primary parameters: point count and
amount of online history.
Page 20 of 27
Document Responsibility: Process Control Standards Committee SABP-Z-001
Issue Date: 19 December 2006
Next Planned Update: 19 December 2011 Plant Information System Data Compression
Several other parameters also impact size, although the effects are much less
quantitative, and therefore it is difficult to supply specific size information. Examples
of these parameters are:
● Snapshot rate,
● Archive rate,
● Compression specification (Exception and compression)
● Archive access, and
● Non-PI activity on the system
Note: Example of compression configuration impact on archive files size is discussed in
Appendix D - Impact of compression configuration on archive files size.
Requirements:
Archive file size shall be configured to accommodate one week history archived
compressed data as a minimum.
Revision Summary
19 December 2006 New Saudi Aramco Best Practice.
Page 21 of 27
Document Responsibility: Process Control Standards Committee SABP-Z-001
Issue Date: 19 December 2006
Next Planned Update: 19 December 2011 Plant Information System Data Compression
Appendix A – Documentation
Page 22 of 27
Document Responsibility: Process Control Standards Committee SABP-Z-001
Issue Date: 19 December 2006
Next Planned Update: 19 December 2011 Plant Information System Data Compression
Page 23 of 27
Document Responsibility: Process Control Standards Committee SABP-Z-001
Issue Date: 19 December 2006
Next Planned Update: 19 December 2011 Plant Information System Data Compression
#) –
Minimum values from these two values shall be used
*) –
Minimum values from these two values shall be used
Page 24 of 27
Document Responsibility: Process Control Standards Committee SABP-Z-001
Issue Date: 19 December 2006
Next Planned Update: 19 December 2011 Plant Information System Data Compression
Page 25 of 27
Document Responsibility: Process Control Standards Committee SABP-Z-001
Issue Date: 19 December 2006
Next Planned Update: 19 December 2011 Plant Information System Data Compression
Objective
Calculate space required for PI archive files for two different compressing configurations and
compare results.
Problem description
• PI database size is 20,000 tags
• 20 interfaces scan events from 20 DCS every 5 seconds
• Tag attribute pointtype is defined for all tags Float32
Approach
Scenario 1:
All tags are configured as High Fidelity Tags.
Compression configuration: Exception is disabled (excmax=0)
Compression is disabled (compressing=0)
Space occupied by 1 even for pointtype Float32 is 5 bytes
In 1 archive record (1,024 bytes) can be accommodated 200 events
Number of events for 1 tag per 2 years with scan time 5 second is:
(12 x 60 x 24 x 365 x 2) = 12 614 400 events / 1 tag / 2 years
Number of events for 20,000 tags per 2 years is:
(20,000 x 12 614 400) = 252 288 000 000 events / all tags
Number of bytes occupied by all events is:
((252 288 000 000 / 200) x 1,024) = 1 291 714 560 000 bytes
Required space on hard disk displayed in different units is:
1 261 440 000 kB, or
1 231 875 MB, or
1 203 GB, or
1.17 TB
Result: This is not acceptable configuration.
Scenario 2:
Tags are configured as Moderate Fidelity Tags.
Compression configuration: Exception is enabled
Compression is enabled
Usual exception ratio is 1:10
Usual compression ratio is 1:10
Result archiving ratio will be 1:100
Required disk space will be 12 GB
Result: This configuration is acceptable.
Page 26 of 27
Document Responsibility: Process Control Standards Committee SABP-Z-001
Issue Date: 19 December 2006
Next Planned Update: 19 December 2011 Plant Information System Data Compression
Revision History
Page 27 of 27