PI Data Tuning (Exception & Compression)

11/30/2023
PI Data Tuning (Exception & Compression)

Technical Adoption
Daniel Davalillo, Staff System Engineer
©2022 AVEVA Group plc and its subsidiaries. All rights reserved.
Exception & Compression Overview
© 2022 AVEVA Group plc and its subsidiaries. All rights reserved.
Do not present this slide
to Customers
Overview
• Provide an initial settings for Exception for filtering noises in data coming
from source.
• Tune the amount of data collected by a tag using the exception and
compression specifications
• Minimize the impact on limited network bandwidth.
to Customers
Exception and Compression Definition

• Exception Reporting: is the process when an interface poll the equipment
on a regular basis and then report new events to the PI Server only after
these events are evaluated and found to be significant (fulfil the exception
report specifications). It is basically a way of filtering data.
• Data Compression: after leaving the Snapshot, events are evaluated

according to the compression specifications to see if they are significant
events. If so, they are sent to the Event Queue. If not, they are discarded.
This process is called compression. The compression method used by PI
allows PI to keep orders of magnitude more data online than conventional
scanned systems.
to Customers
Data Flow
Interface Level Data Archive Level
Exception Reporting Data Compression
to Customers
Exception Test (Interface Level)
to Customers
Exception Test
When a value passes this test, that value and the previous value are reported.
Why? To have a better representation of the actual tag behavior.
passes the
exception test
Temperature
Trend if previous
value is not sent
Trend if previous
value is sent
+/- ExcDev
Previous value
Snapshot value
Time
to Customers
Compression Test (PI Data Archive)
o Compression testing ensures that you store just enough data to accurately reproduce the original signal.
For example, in the following illustration all the events fall on the same straight line. In a simple case
like this, you do not need to store all the points on the line. If you store just two points, you can
recreate the point value for any other time.
o The compression test can essentially recreate other events through extrapolation of surrounding
events. This compression method is called swinging-door compression.
to Customers
Compression Test (PI Data Archive)
Last
archived
value
CompMax (time)
PI Buffer Subsystem Performance Counters
to Customers
Deployment & Performance Guild- Topology 3 Performance

Performance Counter Maximum Value
Inbound Data Rate [Events/sec] PI Snapshot Subsystem_Snapshots/sec 200,000
Archive Data Rate [Events/sec] PI Archive Subsystem_Archived Events/sec 100,000
Outbound Data Rate [Events/sec] PI Archive Subsystem_Events Read/sec 2,000,000
Topology Performance Envelope Rates, Max
Inbound Data Rate [Events/Sec] 200,000

Archive Data Rate [Events/Sec] 100,000
Analysis Evaluation Rate [Eval's/Sec] 30,000
Event Frame Generation Rate [EF's/Day] 10,000
Notifications Generation Rate [Notif's/Min] 120
Outbound Data Rate [Events/Sec] 2,000,000
Tag Settings per Type of Instrument
Imperial System of Measurement Units

to Customers
Quantity Unit BPCS (HMI) Display Quantity Unit BPCS (HMI) Display
Acceleration (a) Meters per sec² m/s2 Mass kilogram, tonne kg, t
Analyzers – Concentration parts per million ppm Molecular Weight grams per mol g/mol
Analyzers – Specific Gravity Specific gravity SG Molecular Weight: used on Flares Molecular Weight Mw (to match P&ID if used)
Area meters-squared m2 pH pH pH
BS&W percentage % Mega Watts, kilowatts, MW, kW,
Conductivity Microsiemens/cm μS/cm Power
Density Kilograms/m3 kg/m3 Megavars, kilovars, MVAR, kVAR
Reactive Power
Diameter Inches (in) Not applicable
meter M A
Distance, displacement, length, height, etc. (d, x, l, h, etc.) Amperage Amperes
millimeters mm
Differential pressure millimeters of H2O or Kilopascal mmH20 or kPa Voltage kiloVolts, Volts kV, V
Force Netwon N Pressure –Gauge kiloPascal kPa
Frequency Hertz Hz Pressure - Absolute kiloPascal Absolute kPaa
Pressure – Steam over 5000 kPa MegaPascal MPa
Fire & Gas – Line of Sight (LOS) Toxic Gas parts per million per meter PPM.m
Speed – Rotational Revolutions per minute rpm
Fire & Gas – Line of Sight (LOS) Combustible Gas lower explosion limit per meter LEL.m Speed - pumpjack Strokes per minute spm
Speed, velocity Meters/ sec, millimeters/ sec m/s, mm/s
Fire & Gas – Point Detectors Toxic Gas parts per million PPM Sound decible dBA
Tank Inventory rate Actual cubic meters/ hour Am3/h
Fire & Gas – Point Detectors Combustible Gas lower explosion limit LEL Temperature Celsius °C
Time (t) Hour, minute, second hr, min, sec
Flow rate – Chemical injection Litres/ hour (see note 2) l/h
Valve Opening 0%-100% (0% = Closed, 100% = Open) %
Flow rate – Mass (Saturated Steam) Tonnes/ hour (see note 1) t/h Vendor Specific
Vibration displacement Mils peak (mil pk) (as long as metric & consistent
Flow rate – Mass (Steam tonnes/hour (see note 1) t/h across the project)
Flow rate – Volume (Actual) Actual cubic meters/ hour (see notes 1 & 3) Am3/h
Vendor Specific
Flow rate – Volume (Standard) Standard cubic meters/ hour (see notes 1 & 3) Sm3/h Vibration acceleration (a) g-force (g) (as long as metric & consistent
Flow rate – Large gas flows Standard cubic meters/ hour (see note 1) e³m³/hr across the project)
Heat: Latent Heat Kilojoules/ kilogram kJ/kg Viscosity - Dynamic centistokes cS
Heating Value Net Heating Value NHV Viscosity - Kinematic centipoise cP
Heat Megajoules, Wobbe Index MJ, WI Volume – Gross, pumpable Actual cubic meters Am3
Heat: Specific Heat Kilojoules/ kilograms-kelvin kJ/(kg-K)
Volume – Standard, corrected Standard cubic meters Sm3
Level (vessels) Percentage %
Level (Tanks) Meters m (3 decimal places) Weight kilogram, gram kg, g
to Customers
United States Customary System of Measurement Units
Quantity Unit BPCS (HMI) Display Quantity Unit BPCS (HMI) Display
Acceleration (a) feet per sec² ft/s2 pH pH pH

Analyzers – Concentration parts per million ppm Mega Watts, kilowatts, MW, kW,
Power
Analyzers – Specific Gravity Specific gravity SG A
Current Amperes
Area feet-squared ft2
Voltage kiloVolts, Volts kV, V
BS&W percentage %
Pounds per Square In or Ounces per
Conductivity Microsiemens/cm μS/cm Pressure Psi or Oz/sqin
Square In
Density lb/ft3 lb/ft3
Speed – Rotational Revolutions per minute rpm
Diameter Inches (in) Not applicable Speed - pumpjack Strokes per minute spm
Distance, displacement, length, ft ft Speed, velocity Feet per second ft/s
height, etc. (d, x, l, h, etc.) Inches (in) in Sound Decibels dBA
Tank Inventory rate See Flow rate
Differential pressure inches of H2O or Ounces per Square In inH20 or Oz/sqin Temperature Fahrenheit F
Time (t) hour, minute, second h, min, s
Frequency Hertz Hz
Valve Opening 0%-100% (0% = Closed, 100% = Open) %
Barrels per Day bbl/d
Flow rate – Volume (standard) cubic feet/ h (see notes 1 & 3) (s)cfh Vendor Specific
Gallons per minute (see note 2) gpm Vibration displacement Mils peak (mil pk) (as long as consistent across
the project)
Million Standard cubic feet/ day (see note Vendor Specific
Flow rate – Large gas flows mscfd
1) Vibration acceleration (a) g-force (g) (as long as consistent across
Level (vessels and tanks) Inches (See note 4) in the project)
Mass pounds lb Barrels bbl
Molecular Weight lb per mol lb/mol Volume – Gross, pumpable gallons g
cubic ft cuf
Molecular Weight: used on Flares Molecular Weight Mw (to match P&ID if used)
Volume – Standard, corrected Standard cubic feet scuf
Instrument Calibration Tolerance Limits

to Customers
GxP/HS E Calibration Tolerance S ystem Calibration

GxP Critical HS E Critical S ystem Critical Non Critical
Limit Tolerance Limit
Instrument / Loop Type Remark
(of Calibration Range unless (of Calibration Range
(G) (S ) (E) (N)
otherwise sp ecified unless otherwise sp ecified
Differential Pressure Transmitter (electronic ≤ 100 Pa) ± 1.5 PA 12M 12M ± 3 PA 3Y N/A
(Differential) Pressure Transmitter (electronic p ressure cell ≤ 5 Bar) ± 0.02 bar 12M 12M ± 0.04 bar 3Y N/A i f 20 mBa r i s re que s te d ca l i bra ti on i nte rva l l
s houl d be 6 month
(Differential) Pressure Transmitter (electronic p ressure ≤ 10 Bar) ± 0.03 bar 12M 12M ± 0.06 bar 3Y N/A a nd 20mba r i s onl y che ck a round the s e tpoi nt of
the i nte gri ty te s t.
Pressure Switch (≤ 5 Bar) ± 0.05 bar N/A 2Y ± 0.1 bar 3Y N/A
Temp erature Transmitter (RTD) ± 1ºC 12M 12M ± 2ºC 3Y N/A for ±0.2°C (for Bi ore a ctors ) pe ri odi ci ty 6M
Temp erature Transmitter (RTD) Room M onitoring ± 1ºC 12M 12M ± 2ºC 3Y N/A
Flow Transmitter (M ass Flow, M ID for fluids) ± 1 % of reading 12M 12M ± 2 % of reading 3Y N/A onl
onl yy down
down to to >> 10%
20% of me a
of pos s isbl
urie ngmera nge
as uri ng ra nge -
Flow Transmitter (Vortex, Orifice p lates with DP measurements\) ± 2 % of reading 12M 12M ± 4 % of reading 3Y N/A thi s a ppl i e s onl y i n bl a ch uti l i ti e s
± 1.5 % of reading Spa rge Ra te , 7%<Fl ow<20% of FS, ±4% of re a di ng.
if flow > 20% of FS And 20%<Fl ow<100% of FS, ±2% of re a di ng.
Flow Transmitter (Thermal M ass Flow for gases) 12M 12M ± 3 % of full scale 3Y N/A
± 3 % of reading s ta nda rd: ±0,5% Rd pl us ±0,1% FS
if flow > 7 % of FS onl y down to > 10% of me a s uri ng ra nge , mi ni mum
de ns i ty ne ce s s a ry - thi s a ppl i e s onl y i n bl a ck
Flow Transmitter (M ass Flow for gases) ± 2 % of reading 12M 12M ± 4 % of reading 3Y N/A
uti l i ti e s
Level Switch N/A 2Y 3Y N/A Us e wa te r to de te ct. On/Off che cks onl y
± 5 mm Conve rs i on mm to l i te r wi th l i ne a ri za ti on 20
Level Transmitter (guided Radar) 12M 12M ± 10 mm 3Y N/A
± 3 % of reading for level (mm) poi nts ->e rror of ± 1 % of FS (de a d vol ume , e tc...)
Weight Cell (Vessels). ≤ 50Kg ± 0.5 % of Reading 12M 12M ± 1 % of Reading 3Y N/A
Weight Cell (Vessels). ≤ 400Kg ± 0.5 % of Reading 12M 12M ± 1 % of Reading 3Y N/A
Weight Cell (Vessels). > 1000Kg ± 1 % of Reading 12M 12M ± 2 % of Reading 3Y N/A
Weight Cell (Platform Based).
≤ 150 Kg ± 0.5 % of Reading 12M 12M ± 1 % of Reading 3Y N/A
150Kg < W ≤ 1500 Kg ± 1 % of Reading 12M 12M ± 2 % of Reading 3Y N/A
> 1500Kg ± 2 % of reading 12M 12M ± 4 % of reading 3Y N/A
p H Cell (only one batch) ± 0.1 p H units every batch every batch ± 0.5 p H units 6W N/A more s te ri l i za ti ons a re done the re fore more dri ft
i s e xpe cte d
p H Cell ± 0.2 p H units 2W 2W ± 0.5 p H units 6W N/A
SOP s houl d fi x the ma xi mum numbe r of us a ge s
Redox Probe ± 20 mV 2W 2W ± 20 mV 6W N/A
Sp eed Transmitter. ± 1 rp m 2Y 2Y ± 2 rp m 3Y N/A
Pressure Relief Valves ± 2 % of set p oint N/A 2Y N/A N/A N/A
O2 Analy zer (dissolved O2) ± 2 % absolute every batch every batch ± 4 % absolute 12M N/A
Firs t s ignal (0/100 pF/cm ) calibration with
Cell density ± 10 p F/cm 12M 12M N.A. N.A. N/A
s im ulator ± 10 pF/cm
range 0-8 OD with ± 0.1 OD & range 0-1 OD with ±
UV ± 0.1 OD 12M 12M N.A. N.A. N/A
0.03 OD
TOC ± 5 % of reading 12M 12M N.A. N.A. N/A
M oisture Transmitters ± 2 % rH 12M 12M ± 4 % rH 12M N/A Me a s uri ng ra nge s ta rts onl y a t 1 µS/cm (Opte k)
± 1 µS/cm onl y pos s i bl e wi th a ra nge 1 - 50 µS/cm
± 3% of re a di ng onl y pos s i bl e a round the
Conductivity Probe 1 - 50 µS/cm (Op tek C220) ± 1 µS/cm 6M 6M N.A. 12M N/A ca l i bra ti on poi nt. I f the s e tpoi nt of fi na l ri ns e i s 5
µS/cm.
We ne e d to ca l i bra te the s e ns or wi th a buffe r of 5
Conductivity Probe 0.04 - 500 µS/cm (E&H) 3% of reading 6M 6M 6% of reading 12M N/A
Conductivity Probe 0.02- 250 mS/cm (Op tek C8086) 2% of reading 6M 6M 4% of reading 12M N/A
Conductivity Probe 2 - 500 mS/cm (E&H, CLS 54D) 2% of reading 6M 6M 4% of reading 12M N/A
Conductivity Probe 0,5 - 2 mS/cm (E&H, CLS 54D) 4% of reading 6M 6M 6% of reading 12M N/A
Instrument Calibration Tolerance Limits

to Customers
Recommended PI Tag Settings (Exception, Compression, Scan)

to Customers
Measurement Eng. Units HMI Display CompDevPercent CompMax CompMin Compressing ExcDevPercent ExcMax ExcMin Scan Rate
(sec)
Acceleration (a) feet per sec² ft/s2 0.2 28800 5 ON 0.1 600 0 5
Analyzers - Concentration parts per million ppm 1 28800 10 ON 0.5 600 0 10
Analyzers – Specific Gravity Specific gravity SG 0.2 28800 10 ON 0.1 600 0 10
Area feet-squared ft2 0.2 28800 10 ON 0.1 600 0 10
BS&W percentage % 0 28800 10 ON 0.1 600 0 10
Conductivity Microsiemens/cm μS/cm 1 28800 5 ON 0.5 600 0 5
Density lb/ft3 lb/ft3 2 28800 5 ON 1 600 0 5
Diameter Inches (in) in 0 28800 10 ON 0.25 600 0 10
ft ft
Distance, displacement, length, height, etc. Inches (in) in
0.5 28800 10 ON 0.25 600 0 10
inches of H2O or Ounces per

Differential pressure Square In
inH20 or Oz/sqin 0.1 28800 5 ON 0.05 600 0 5
Frequency Hertz Hz 0.2 28800 5 ON 0.1 600 0 5
Barrels per Day

bbl/d
(standard) cubic feet/ h (see
Flow rate - Volume notes 1 & 3)
(s)cfh 0.5 28800 5 ON 0.25 600 0 5
gpm
Gallons per minute
Flow rate – Gas flow Million Standard cubic feet/ day mscfd 0.5 28800 5 ON 0.25 600 0 5
Level (vessels and tanks) Inches in 0.2 28800 ON 0.1 600 0 10
Mass pounds lb 0.5 28800 10 ON 0.25 600 0 10
Molecular Weight lb per mol lb/mol 0.2 28800 5 ON 0.1 600 0 10

Mw (to match
Molecular Weight: used on Flares Molecular Weight
P&ID if used)
0.2 28800 10 ON 0.1 600 0 10
Recommended PI Tag Settings (Exception, Compression, Scan)

to Customers
Measurement Eng. Units HMI Display CompDevPercent CompMax CompMin Compressing ExcDevPercent ExcMax ExcMin Scan Rate
(sec)
pH pH pH 0.1 28800 5 ON 0.05 600 0 5
Mega Watts, kilowatts, MW, kW,
Power 0.2 28800 10 ON 0.1 600 0 10
A
Current Amperes 1 28800 10 ON 0.5 600 0 10
Voltage kiloVolts, Volts kV, V 2 28800 10 ON 1 600 0 10

Pounds per Square In or
Pressure Psi or Oz/sqin 0.5 28800 5 ON 0.25 600 0 5
Ounces per Square In
Speed – Rotational Revolutions per minute rpm 2 28800 30 ON 1 600 0 30
Speed - pumpjack Strokes per minute spm 2 28800 30 ON 1 600 0 30
Speed, velocity Feet per second ft/s 1 28800 5 ON 0.5 600 0 5
Sound Decibels dBA 2 28800 10 ON 1 600 0 10
Tank Inventory rate See Flow rate 0.5 28800 5 ON 0.25 600 0 5
Fahrenheit F 0.5 28800 10 ON 0.25 600 0 10

Temperature
Celsius C 1 28800 10 ON 0.5 600 0 10
0%-100% (0% = Closed, 100% =
Valve Opening % 0 28800 5 ON 0.1 600 0 5
Open)
Vibration displacement Mils peak (mil pk) Vendor Specific 0.2 28800 10 ON 0.1 600 0 10
Vendor Specific
(as long as
Vibration acceleration (a) g-force (g) 0 28800 10 ON 0.1 600 0 10
consistent across
the project)
Barrels bbl
Volume – Gross, pumpable gallons g 0.2 28800 5 ON 0.1 600 0 5
cubic ft cuf
Volume – Standard, corrected Standard cubic feet scuf 0.2 28800 5 ON 0.1 600 0 5
Digital Digital Status Status (On, Off) 0 86400 1 ON 0 28800 0 1
Pilot Data Tuning Results
to Customers
PI Data Tuning Results

Offshore Onshore
RIGS
PI Collective
PItoPI Interface
CVD DTH MYK
DCQ DVS PBS
DD3 ENA PBL
CY1PIINTF01V CY1PIAR02V
PItoPI Interface
DGD ENC SKY 8 Mbps
CPU Cores: 3 2
CPU Speed [GHz]: 2.2
RAM [G B]: 128
DIN END TBR

PItoPI Interface
DPN EQU TNG CY1PIAR01V
Data
DPS KG1 TSB
DPT KG2
CY1PIINTF02V CY1PIAR03V
to Customers
PI Data Tuning Approach

RIG: DPN Critical PI Tags Non-Critical PI Tags
PI Tags Total: 342 26,254

Point Type Analog Digital Analog Digital
Scan Frequency: 1 second 1 second 5 second 1 second
Exception Reporting
ExcMin 1 1 1 1
ExcMax 300 600 600 3,600
ExcDevPercent 0 0 See Table for Eng. Units 0
Compression 1 1 1 1
Compression 1 1 1 1
CompMin 1 1 1 1
CompMax 600 3,600 3,600 28,800
CompDevPercent 0 0 See Table for Eng. Units 0
to Customers

Tag: DPN.DRL.RT1-051-A00-st (Analog: Float32)
• Production tag has a scan frequency of 1 second
although the value does not change frequently. In one
hour, the number of scans to the source PI Data Archive
(located on Rig) is 3600.
• Pilot PI tag was setup with a scan frequency of 5

seconds . In one hour, the number of scans to the
source PI Data Archive (located on Rig) is 720.
• In Pilot Test #1 (using exception but compression) the

total values recorded for Production tag for 24 hours
was 11,885 values versus 1,526 values for Pilot PI Tag. In
hour the same value 0.096452951 was recorded 68
times versus 12 times in comparison with the Pilot PI
Tag.
• In Pilot Test #2 (using exception and compression) the

total values recorded for Production tag for 24 hours
was 12,630 values versus 596 values for Pilot PI Tag. In
this Pilot Test #2 the collected value is only taking into
consideration when the deviation from the previous
values scanned is greater than 0.05 or when the longest
time period allowed between sending values to the PI
Data Archive server is exceeded.
to Customers

Tag: DPN.DRL.HPU-211-A02-st (Analog: Float32)
• Production tag has a scan frequency of 1 second
although the value does not change frequently.
In one hour, the number of scans to the source
PI Data Archive (located on Rig) is 3600.
• One (01) instance of the PItoPI Interface

collecting data from Snapshot was setup with a
scan frequency of 5 seconds . In one hour, the
number of scans to the source PI Data Archive
(located on Rig) was 720.
• One (01) instance of the Interface PItoPI

Interface collecting data from History Recovery
every 3 minutes. In one hour, the number of
scans to the source PI Data Archive (located on
Rig) was 30.
• Basically, there is not difference in the number

of values collected from both Pilot Instances
(Snapshot: 3769 versus History Recovery: 3783).
to Customers

Tag: DPN.BOP.CBM_Memory.CoilFault2_IO (Digital)
• Production tag has a scan frequency of 1
second although the value does not change
frequently. In one hour, the number of scans
to the source PI Data Archive (located on Rig)
is 3600.
• Pilot PI tag was setup with a scan frequency of

10 seconds . In one hour, the number of scans
to the source PI Data Archive (located on Rig)
is 360.
• In Pilot Test #1 (using exception, Compression

ON, and CompMax =3600) the total values
recorded for Production tag for 1 day was 288
values versus 24 values for Pilot PI Tag. Thus,
duplicated value just was recorded every hour.
• In Pilot Test #2 (using exception, Compression

ON, and CompMax =28800) the total values
recorded for Production tag for one (1) day
was 288 values versus 3 values for Pilot PI Tag.
Thus, duplicated value just was recorded every
8 hours.
to Customers
Performance Increase
Measurements Performance Increase
Analog 38%
Digital 62%
to Customers
Performance Increase
1. Data collected from Pilot PI tags has the same timestamped values in comparison with the
Production PI tags but without the excessive repeated values scanned and archived observed
in the Production PI tags. This is due an acceptable configuration of the scan frequency and
exception reporting tag’s parameters.
2. Current Production PI tags configuration for Non-Critical PI tags are making an elevated
number of unnecessary scans to the source PI Data Archive. This is due to that current scan
frequency is set up for all PI tags at one second. For Analog tags most of them only report
change in value for a time period greater than 10 seconds or inclusive minutes. Regarding
Digital tags, changes are reported in hours or inclusive days.
3. The Scan Frequency, Exception Reporting and Compression settings used for this Pilot can be
used as guideline for tuning all Non-Critical PI tags for DPN and the rest of the rigs. However,
the values of those parameters can be improved even more and can be adjusted easily.
Questions?

PI Data Tuning (Exception &amp; Compression)

Uploaded by

Document Information

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

PI Data Tuning (Exception &amp; Compression)

Uploaded by

Copyright:

Available Formats

11/30/2023