You are on page 1of 7

Canary System and Capabilities Whitepaper

January 2019

Overview
Companies need to store and analyze process Tag
data so they can operate more effectively, but A single stream of time-series data, also referred
they continually encounter the same three to as points, channels, or items.
problems.

• They produce too much data to manage Historical Database (HDB) File
• The necessary software is restrictively Within each DataSet, the Historian writes tag
expensive properties and TVQs to an HDB file. HDB files
• Analytic tools are overly complicated are segmented by a time-period, typically daily.

These three roadblocks keep companies from TVQ


moving forward and leave both engineers and For each tag value change, Canary records a
executives frustrated. Canary helps companies Timestamp, a Value, and Quality. Other
defeat these problems. Their software is historical databases and SCADA platforms may
affordable, provides an easy way to store large refer to these as VTQs, VQTs, or Value-
amounts of process data, and provides
Timestamp Pairs.
simplified analytic tools that deliver powerful
results.
Data Collection
Canary collects data local to the source using
Canary Terminology industry standard formats like OPC UA/DA,
MQTT, LoRa, SQL, CSV, or through manual data
Canary System
entry. Canary also can collect data directly from
The three main components of the Canary
System are Data Collection, Data Storage, and SCADA systems or via a .NET or Web API.
Data Analytics Canary Collectors are used to create logging
sessions. Each logging session is configured
Sender based on the data source and allows for tag
A service that collects, compresses, and naming, dead-banding, data transformation, and
encrypts data locally before sending it to the additional configuration.
Canary Receiver.
Once data logging is configured, Canary’s
Receiver Sender Service encrypts, compresses, and
A service that moves the data received from the caches the data locally. Sender will then push
Sender to the Historian for permanent storage. the data packet across the network to the
Receiver can communicate with multiple storage portion of the Canary system. You can
Senders and allows for logging redundancy. use multiple logging configurations and Sender
instances across your company without
Store and Forward worrying about rising costs because both are
The ability of the Sender to buffer data locally
unlicensed. In addition, each Sender can push
when the Receiver or Historian is unavailable,
data to additional Canary storage systems
preventing data loss.
creating redundancy and fast disaster-recovery.
DataSets To move data for long-term storage Canary uses
A group of logically associated tags stored a Store and Forward Service comprised of the
within the Canary Historian.
Sender and Canary’s Receiver Service. The
Receiver Service accepts data from multiple
Senders and moves that data into the Canary
Canary System and Capabilities Whitepaper
January 2019

Historian database. If Sender and Receiver The data storage structures of the Canary
loose contact, or if Historian is offline, Sender Historian are designed to maximize read speeds
will buffer all data locally. Once the Historian’s rather than write speeds. Reads are prioritized
availability returns, all buffered data backfills because data is only written once but read many
automatically without any data loss. times. To provision read performance beyond
4,000,000 updates per second, HDB files are
organized so TVQs are physically stored with
their associated tag, rather than the traditional
Data Storage method of storing TVQs in a time block. As a
result, queries made to the Historian on a tag-by-
Canary has designed its solution to eliminate the
tag basis are optimized for both high tag count
need of a database administrator to manage the
and high-speed performance. A single historian
Historian. Once the system has been originally
can be scaled to store values for two million
configured, it needs no ongoing database
individual tags. The Historian performs
management. To help achieve this, Canary uses
continuous write speeds at 2,500,000 updates
a simple but elegant method to segment the
per second and achieves updates rates as fast
data in two ways. First is the creation of
as ten milliseconds.
DataSets, or a group of tags with logically
associated data. Second is the Historical To read data from the Historian, Canary uses the
Database (HDB) file, segmented by a time Views Service. Views connects to the Historian
period. These two organizational structures and allows for client interaction via Windows
allow for database expansion without effecting Communication Foundation (WCF). Access to
performance or requiring any management of the Historian, DataSets, or even individual tags
size or duration. can be limited with Views security parameters.
Using Windows Active Directory, individuals or
Generally, a new HDB file is created daily. Once
user groups can have inherited or explicit
closed, each HDB goes through loss-less
permissions for data access.
compression to minimize Historian’s storage
requirements. Canary stores data using lossless Canary’s Mirror Service will connect through
data compression to ensure data written to the Views and allow for the mirroring of the
Historian is identical to the data later read from Historian’s DataSets from one Historian to
it. Canary algorithms achieve a data another. This allows for fast data duplication
compression rate beyond sixty percent. from local level-one Historians to a corporate or
level-two Historian. The Historian can be
Each HDB file contains tag names, tag
installed on either a physical machine or a virtual
properties, and TVQ units comprised of a
machine and can be hosted in a cloud
timestamp, a value, and a quality score. Values
environment with multi-tenant capability.
can include Booleans, Integers, Floats, Doubles,
or Strings. Canary writes all three TVQ Since every Canary Historian can scale to two
components together ensuring the value is million tags and handle a variety of data speeds,
always paired with the correct timestamp and system requirements can vary. Factors like
quality. Other databases may store the quality scan class, change rate, data type, client activity
as a separate tag. Canary stores quality with and additional variables can affect system
both the timestamp and value to ensure it is resources. Below are hardware
never lost or out-of-sync. As an added benefit, recommendations for a typical enterprise
solution consisting of multiple sites each
additional tag licensing for quality scores are
logging data via OPC and Mirroring data to a
avoided.
corporate Canary Historian. If faster update
rates are required, increasing storage capacity is
recommended.
Canary System and Capabilities Whitepaper
January 2019

Collector and Sender Machine In total, the below chart of ten thousand tags
• Dual Core 2.0 GHz Processor would require 0.962 gigabytes of disk storage
• 8 GB of RAM per day and consume three hundred and fifty
• Windows 7 64 bit or greater gigabytes annually. A two-terabyte drive would
• .NET 4.5 or greater then store approximately five years and eight
• 500 GB HDD @7200 RPM months of historical data.

Site Historian (10,000 updates/sec) Tag Scan Change Disk


Type
Count Class Rate Space
• Quad Core 2.4 GHz Processor
0.002
• 16 GB of RAM 3000 Boolean 15000ms 5%
GB/day
• Windows 7 64 bit or greater 0.04
3000 Integer 5000ms 20%
• .NET 4.5 or greater GB/day
0.68
• 2 TB HDD @7200 RPM 3500 Float 1000ms 40%
GB/day
0.24
500 Double 1000ms 60%
Corporate Historian (50,000 updates/sec) GB/day
• Six Core 2.4 GHz Processor
• 32 GB of RAM Most industries have much slower data polling
• Windows Server 2012 or greater and even lower change rates. As an example,
• .NET 4.5 or greater Canary has found upstream oil and gas
operation to use far less storage. Based on real
• 10 TB HDD @7200 RPM
data from one million well production tags,
Canary’s compression brings total system
Storage requirements can greatly vary. Since storage to an average of seven gigabytes per
Canary Historian writes changes based on day, or roughly two terabytes annually.
exception, a tag’s change rate affects storage.
Equally important are the data types being
recorded. A Boolean has a significantly lighter
payload than a double with fifteen decimal Data Analytics
precision. For instance, compare a Boolean
Canary features four analytic tools, Asset Model,
value which rarely changes and is a single byte
Events, Axiom, and Excel Add-in. Each of these
to an eight-byte Float that is more likely to
change. The result is nearly fifty times more are included with a Historian installation at no
data. additional charge. Axiom and Excel Add-in are
licensed for a single concurrent user; additional
Tag Scan Change Disk licenses can be purchased as needed.
Type
Count Class Rate Space
0.01
Most organizations want to analyze their data by
1000 Boolean 1000ms 5% asset type. Canary makes it easy to do this
GB/day
0.48 using their Asset Model. By creating templates,
1000 Double 1000ms 60%
GB/day tags are grouped into assets, and can then be
browsed by their asset structure. Multiple asset
Finally, the number of years a company desires models can be created, and assets can function
to store data will adjust requirements. as subsets of other assets. An additional
Therefore, when estimating data storage benefit of Asset Model is the automatic
requirements, it is important to assume discovery of new tags and assets as they come
significant variations in the types of data, the online. Several Canary Collectors can
scan classes of that data, and the change rate.
automatically recognize and add more tags to
Based on real-world examples, Canary believes
Historian on a scheduled basis. As these new
the below configuration of ten thousand tags
provides a high estimate of storage tags are discovered, the Asset Model
requirements. automatically groups them into assets based on
Canary System and Capabilities Whitepaper
January 2019

template rules. For large enterprise systems using C#, advanced workflows and interactions
this greatly reduces the amount of manual work can be created. Additionally, Canary’s Asset
typically required to manage assets. Model is fully incorporated into Axiom
dashboards and trend charts allowing for asset
Once identified, assets can be monitored using comparison and monitoring.
Canary’s Events tool. Designed to find and store
unique operational events and related data, the To streamline workflow, Canary offers the Excel
Events Service monitors critical processes as Add-in. Access data directly from the Historian
they occur. Events can be used to track startups with software everyone already uses. Import
and shutdowns, phases, batches, operator lists of tag names, last data values, raw values,
shifts, down-times, and processes that go or choose to aggregate data based on time
beyond acceptable limits. Information captured interval. Access Canary Events, or, run on-the-fly
is specific to the duration of the event and asset analysis. No matter what data is needed
provides calculated metrics and key from Historian, it’s made available within
performance indicators throughout the event’s Microsoft Excel.
duration. All Canary Events are logged in an SQL
database and can be accessed by Canary For additional data connectivity to the Canary
analytic tools as well as third-party applications. Historian choose from Canary’s .Net or Web API,
HDA Server, or ODBC connector. The HDA Server
Engineers, operators, and executives use Axiom is included with every Historian installation,
to visualize events, assets, and tag values. however the Web API and ODBC connector are
Since it’s built using HTML, Axiom works from licensed separately.
smartphones, touch screens, laptops, or any
modern web browser. Axiom is easy to
understand and requires less than thirty minutes Testing and Best Practices
of training for most users. Axiom offers many
different visualization tools including feature The goal was to test the raw writing speed of the
rich trend charts and HMI dashboards. Historian using the Canary Web API Collector via
the Sender and Receiver Services.
Using the trending tool, users can individually
build their own trend charts, displaying many Specifications:
tags on a single screen. Once added, tags can
• 1,000,000 tags
be banded together, have scaling adjusted, and
• 1,000,000 TVQs per second
display high and low limit alerts. A list of OPC
• Data rate must be sustainable as a
aggregates can be applied to each tag, allowing
continuous operation, not as a
for aggregated properties to be displayed based
“burst”
on time interval. All chart data can be exported
• Timestamps updating at 100
directly from the trend charts to CSV.
nanosecond intervals
Additionally, users can create calculated tags
displaying values in real time or historically. • Value type - R4 (4-byte floating
Charts can be saved centrally to the Canary point)
server in public or private folders. • Individual TVQ Totaling 16 bytes
o Timestamp - 8 bytes
Trend charts are just one of the many dashboard o Value - 4 bytes
elements that Axiom offers. Full multi-screen o Quality - 2 bytes
HMIs can be created using the built-in drag-and- o Datatype - 2 bytes
drop editor. Other elements include tables,
gauges, symbol graphics, iframes, panels, and
more. And since every item can be scripted
Canary System and Capabilities Whitepaper
January 2019

Test Number One: Additional testing was completed to benchmark


the Historian’s writing limits. This was tested by
Amazon Machine - r4.2xlarge
continuously pushing TVQs directly into the
• Cores: 8 Historian as fast as possible without the use of
• Memory: 64GB the Sender or Receiver Services. Although this
• EBS: GP2 SSD drives method would not be used in a typical
Outcome: installation, Canary wished to document the
Historian’s limitations.
• 1,000,000 tags each changed once per
second totaling 1,000,000 TVQs per On Amazon test machine c5.18xlarge, the
second Historian peaked at 18+M TVQs per second and
• CPU utilization – 62% sustained more than 12M TVQs per second
• Physical Memory utilization – 25% throughout testing while maintaining CPU usage
• Disk I/O utilization – 42% (105 MB per at 29%.
second of 250 GB)
• Raw data input stream – 57.6 GB per Ultimately, the test concluded due to Amazon’s
hour limit of data transfer between the processing
unit and disk storage constraints. Assuming
• Disk storage – 20 GB per hour
faster drive access was made available, the rate
of TVQs per second could greatly increase as
less than one-third of the machine’s processing
Test Number Two capabilities were being used.
Amazon Machine – c5.18xlarge This last test provides value in understanding as
• Cores: 72 sensor counts grow, enterprises expand, and
• Memory: 144GB network speeds increase, the Historian in its
• EBS: GP2 SSD drives current structure can handle additional scaling.
Outcome:
• 1,000,000 tags each changed once per
second totaling 1,000,000 TVQs per Conclusion
second
The Canary System is designed to help
• CPU utilization – 11% companies find an affordable solution and
• Physical Memory utilization – 5% simplify their data collection, storage, and
• Disk I/O utilization – 42% (105 MB per analytics without requiring ongoing database
second of 250 GB) management. In the past 30 years, Canary has
• Raw data input stream – 57.6 GB per guided professionals in 52 countries with 18,000
hour installations of its product.
• Disk storage – 20 GB per hour
Canary believes their disruptive pricing model,
Comments:
ability to scale, and simplistic design approach
Both machines successfully updated on a will continue to make it a top choice for time-
continuous basis with 1,000,000 TVQs per series databases. Attached is the Canary
second without data loss. By increasing server pricing model, also available at
resources, cores and memory, the Canary www.canarylabs.com/pricing
Historian is able to take advantage of the
additional resources to deliver better overall
performance.
2019 Products and Price List

Perpetual Licensing
Part Number Description Price Price Type Term
A Canary Historian licensed for up to 100 tags and a single concurrent license for Axiom and the
EH100-P $4,000.00 One-time -
Canary Excel Add-in (perpetual)
A Chirp! Historian licensed for 1,000 Ignition tags including unlimited Axiom clients for Ignition by
CH1000-P $4,000.00 One-time -
Inductive Automation. (perpetual)

EHTAG-P A single Canary Historian tag (perpetual) $1.50 One-time -

CHTAG-P A single Chirp! Historian tag (perpetual) $1.00 One-time -

A Canary Historian with an unrestricted tag count and a single concurrent license for Axiom and the
EHUNLIM-P $89,850.00 One-time -
Canary Excel Add-in (perpetual)
A Chirp! Historian with an unrestricted Ignition tag count including unlimited Axiom clients for Ignition
CHUNLIM-P $49,000.00 One-time -
by Inductive Automation (perpetual)

AXIOM-P An Axiom client licensed for a single concurrent user (perpetual) $995.00 One-time -

TL-P A Trend Link client licensed for a single user (perpetual) $995.00 One-time -

EXCEL-P The Canary Excel Add-in licensed for a single concurrent user (perpetual) $395.00 One-time -

TE-P A Trend Export concurrent user license (perpetual) $2,995.00 One-time -

ODBC-P An ODBC Connector for the Canary Historian (perpetual) $2,995.00 One-time -

VIEWSDK-P SDK for developing connections to read and write data to the Historian Views Service (perpetual) $2,995.00 One-time -

Subscription Licensing
Part Number Description Price Price Type Term
A Canary Historian licensed for 100 tags and a single concurrent license for Axiom and the Canary Excel
EH100-S $135.00 Recurring Monthly
Add-in (subscription)
A Chirp! Historian licensed for 1,000 Ignition tags including unlimited Axiom clients for Ignition by
CH1000-S $135.00 Recurring Monthly
Inductive Automation (subscription)

EHTAG-S A single Canary Historian tag (subscription) $0.05 Recurring Monthly

CHTAG-S A single Chirp! Historian tag (subscription) $0.033 Recurring Monthly

A Canary Historian with an unrestricted tag count and a single concurrent license for Axiom and the
EHUNLIM-S $2,995.00 Recurring Monthly
Canary Excel Add-in (subscription)
A Chirp! Historian with an unrestricted Ignition tag count including unlimited Axiom clients for Ignition
CHUNLIM-S $1,635.00 Recurring Monthly
by Inductive Automation (subscription)

AXIOM-S An Axiom client licensed for a single concurrent user (subscription) $35.00 Recurring Monthly

TL-S A Trend Link client licensed for a single user (subscription) $35.00 Recurring Monthly

EXCEL-S The Canary Excel Add-in licensed for a single concurrent user (subscription) $15.00 Recurring Monthly

TE-S A Trend Export concurrent user license (subscription) $100.00 Recurring Monthly

ODBC-S An ODBC Connector for the Canary Historian (subscription) $100.00 Recurring Monthly

VIEWSDK-S SDK for developing connections to read and write data to the Historian Views Service (subscription) $100.00 Recurring Monthly

Services
Part Number Description Price Price Type Term

ENGSERV Daily 8 hour rate for remote engineering services or onsite services including travel time $1,895.00 One-time -

PROSERV Daily 8 hour rate for remote professional services or onsite services including travel time $1,495.00 One-time -

TRAVEL Travel and accommodations billed at estimated cost Custom Quote One-time -

CustomerCare includes technical support, software maintenance, remote training, and version 15% of licensed product
CUSTCARE One-time -
upgrades for all licensed Canary products retail
Canary Cloud - United States Server
Part Number Description Price Price Type Term
500 tags stored in the Canary Cloud for 3 years with up to a 30 second change rate and 99.9% data
CC500-US $460.00 Recurring Monthly
availability, includes a single concurrent license for Axiom
1000 tags stored in the Canary Cloud for 3 years with up to a 30 second change rate and 99.9% data
CC1000-US $585.00 Recurring Monthly
availability, includes a single concurrent license for Axiom
2500 tags stored in the Canary Cloud for 3 years with up to a 30 second change rate and 99.9% data
CC2500-US $760.00 Recurring Monthly
availability, includes a single concurrent license for Axiom
5000 tags stored in the Canary Cloud for 3 years with up to a 30 second change rate and 99.9% data
CC5000-US $985.00 Recurring Monthly
availability, includes a single concurrent license for Axiom
10000 tags stored in the Canary Cloud for 3 years with up to a 30 second change rate and 99.9% data
CC10000-US $1,335.00 Recurring Monthly
availability, includes a single concurrent license for Axiom
15000 tags stored in the Canary Cloud for 3 years with up to a 30 second change rate and 99.9% data
CC15000-US $1,685.00 Recurring Monthly
availability, includes a single concurrent license for Axiom
20000 tags stored in the Canary Cloud for 3 years with up to a 30 second change rate and 99.9% data
CC20000-US $2,035.00 Recurring Monthly
availability, includes a single concurrent license for Axiom
30000 tags stored in the Canary Cloud for 3 years with up to a 30 second change rate and 99.9% data
CC30000-US $2,635.00 Recurring Monthly
availability, includes a single concurrent license for Axiom
40000 tags stored in the Canary Cloud for 3 years with up to a 30 second change rate and 99.9% data
CC40000-US $3,235.00 Recurring Monthly
availability, includes a single concurrent license for Axiom
50000 tags stored in the Canary Cloud for 3 years with up to a 30 second change rate and 99.9% data
CC50000-US $3,835.00 Recurring Monthly
availability, includes a single concurrent license for Axiom

CCAXIOM-US Additional Axiom client licensed for a single concurrent user for the Canary Cloud $20.00 Recurring Monthly

CCEXCEL-US The Canary Excel Add-in licensed for a single concurrent user $15.00 Recurring Monthly

CC8YR-US Data becomes available in the Canary Cloud for 8 years rather than 3 years $50.00 Recurring Monthly

CC1SEC-US Data change rate in the Canary Cloud adjusted from 30 seconds to as fast as 1 second $100.00 Recurring Monthly

CCHS-US Data change rate in the Canary Cloud adjusted from 30 seconds to as fast as 100 milisecond $175.00 Recurring Monthly

CCAVAIL-US Data availability upgraded to 99.999% Custom Quote Recurring Monthly

CCSETUP-US Initial Canary Cloud setup and configuration $1,495.00 One-time -

Canary Cloud - International Server


Part Number Description Price Price Type Term
500 tags stored in the Canary Cloud for 3 years with up to a 30 second change rate and 99.9% data
CC500-WW $1,015.00 Recurring Monthly
availability, includes a single concurrent license for Axiom
1000 tags stored in the Canary Cloud for 3 years with up to a 30 second change rate and 99.9% data
CC1000-WW $1,045.00 Recurring Monthly
availability, includes a single concurrent license for Axiom
2500 tags stored in the Canary Cloud for 3 years with up to a 30 second change rate and 99.9% data
CC2500-WW $1,135.00 Recurring Monthly
availability, includes a single concurrent license for Axiom
5000 tags stored in the Canary Cloud for 3 years with up to a 30 second change rate and 99.9% data
CC5000-WW $1,285.00 Recurring Monthly
availability, includes a single concurrent license for Axiom
10000 tags stored in the Canary Cloud for 3 years with up to a 30 second change rate and 99.9% data
CC10000-WW $1,585.00 Recurring Monthly
availability, includes a single concurrent license for Axiom
15000 tags stored in the Canary Cloud for 3 years with up to a 30 second change rate and 99.9% data
CC15000-WW $2,005.00 Recurring Monthly
availability, includes a single concurrent license for Axiom
20000 tags stored in the Canary Cloud for 3 years with up to a 30 second change rate and 99.9% data
CC20000-WW $2,425.00 Recurring Monthly
availability, includes a single concurrent license for Axiom
30000 tags stored in the Canary Cloud for 3 years with up to a 30 second change rate and 99.9% data
CC30000-WW $3,145.00 Recurring Monthly
availability, includes a single concurrent license for Axiom
40000 tags stored in the Canary Cloud for 3 years with up to a 30 second change rate and 99.9% data
CC40000-WW $3,865.00 Recurring Monthly
availability, includes a single concurrent license for Axiom
50000 tags stored in the Canary Cloud for 3 years with up to a 30 second change rate and 99.9% data
CC50000-WW $4,585.00 Recurring Monthly
availability, includes a single concurrent license for Axiom

CCAXIOM-WW Additional Axiom client licensed for a single concurrent user for the Canary Cloud $20.00 Recurring Monthly

CCEXCEL-WW The Canary Excel Add-in licensed for a single concurrent user $15.00 Recurring Monthly

CC8YR-WW Data becomes available in the Canary Cloud for 8 years rather than 3 years $50.00 Recurring Monthly

CC1SEC-WW Data change rate in the Canary Cloud adjusted from 30 seconds to as fast as 1 second $100.00 Recurring Monthly

CCHS-WW Data change rate in the Canary Cloud adjusted from 30 seconds to as fast as 100 milisecond $175.00 Recurring Monthly

CCAVAIL-WW Data availability upgraded to 99.999% Custom Quote Recurring Monthly

CCSETUP-WW Initial Canary Cloud setup and configuration $1,995.00 One-time -

You might also like