Event stream processing - Wikipedia https://en.wikipedia.org/wiki/Event_stream_pro...

Event stream processing

Event stream processing, or ESP, is a set of technologies designed to assist the construction of event-
driven information systems. ESP technologies include event visualization, event databases, event-driven
middleware, and event processing languages, or complex event processing (CEP). In practice, the terms
ESP and CEP are often used interchangeably. ESP deals with the task of processing streams of event data
with the goal of identifying the meaningful pattern within those streams, employing techniques such as
detection of relationships between multiple events, event correlation, event hierarchies, and other aspects
such as causality, membership and timing.

ESP enables many different applications such as algorithmic trading in financial services, radio-frequency
identification (RFID) event processing applications, fraud detection, process monitoring, and location-
based services in telecommunications.

Examples
By way of illustration, the following code fragments demonstrate detection of patterns within event
streams. The first is an example of processing a data stream using a continuous SQL query (a query that
executes forever processing arriving data based on timestamps and window duration). This code fragment
illustrates a JOIN of two data streams, one for stock orders, and one for the resulting stock trades. The
query outputs a stream of all Orders matched by a Trade within one second of the Order being placed. The
output stream is sorted by timestamp, in this case, the timestamp from the Orders stream.

SELECT DataStream
Orders.TimeStamp, Orders.orderId, Orders.ticker,
Orders.amount, Trade.amount
FROM Orders
JOIN Trades OVER (RANGE INTERVAL '1' SECOND FOLLOWING)
ON Orders.orderId = Trades.orderId;

Another sample code fragment detects weddings among a flow of external "events" such as church bells
ringing, the appearance of a man in a tuxedo or morning suit, a woman in a flowing white gown and rice
flying through the air. A "complex" or "composite" event is what one infers from the individual simple
events: a wedding is happening.

WHEN Person.Gender EQUALS "man" AND Person.Clothes EQUALS "tuxedo"

FOLLOWED-BY
Person.Clothes EQUALS "gown" AND
(Church_Bell OR Rice_Flying)
WITHIN 2 hours
ACTION Wedding

See also
Complex event processing (CEP) - A related technology for building and managing event-
driven information systems.

1 of 2 2019-08-09 19:25
Event stream processing - Wikipedia https://en.wikipedia.org/wiki/Event_stream_pro...

Data Stream Management System (DSMS) - A type of software system for managing and
querying data streams
openPDC A complete set of applications for processing streaming time-series data in real-
time.
Real-time computing - ESP systems are typically real-time systems
RFID - Radio-frequency identification, or RFID, recommends application of ESP to prevent
from data flooding
SCADA - Supervisory control and data acquisition, a similar technology used in
engineering applications
Apache Flink - An open-source stream processing framework for distributed, scalable data
streaming applications
WSO2 Stream Processor (https://wso2.com/analytics) - An open-source Steaming SQL (htt
ps://www.quora.com/What-is-a-Streaming-SQL-What-are-the-tools-supporting-Streaming-S
QL) based stream processing framework for distributed, scalable data streaming
applications

References
MIT/Brown/Brandeis "Aurora" Stream Processing Project (http://www.cs.brown.edu/researc
h/aurora)
"PIPES" Project at University of Marburg (http://dbs.mathematik.uni-marburg.de/Home/Re
search/Projects/PIPES)
The Power of Events by David Luckham (ISBN 0-201-72789-7), from Stanford University,
a book on CEP.
Separating the Wheat from the Chaff (http://www.rfidjournal.com/article/view/1196)
Article about CEP as applied to RFID, appeared in RFID Journal
Complex Event Processing & Real Time Intelligence (http://www.complexevents.com) - A
source of industry neutral information on applications, research, usecases, reference
architectures, and developments in event processing, run by Prof David Luckham
Odysseus (http://odysseus.informatik.uni-oldenburg.de/index.php?id=1&L=2) - An open
source framework for event processing engines based on Java

Retrieved from "https://en.wikipedia.org/w/index.php?title=Event_stream_processing&

oldid=870961882"

This page was last edited on 28 November 2018, at 02:03 (UTC).

Text is available under the Creative Commons Attribution-ShareAlike License; additional

terms may apply. By using this site, you agree to the Terms of Use and Privacy Policy.
Wikipedia® is a registered trademark of the Wikimedia Foundation, Inc., a non-profit
organization.

2 of 2 2019-08-09 19:25