Stream applications

Stream applications typically involve ingesting live data streams from a variety of sources, transforming the data to prepare it for analysis, and applying analytics to derive intelligence and make decisions. The main components of stream applications are tuples, data streams, operators, processing elements (PEs), and jobs.

Tuple
An individual piece of data in a stream. These data can be structured or unstructured. Typically, the data in a tuple represents the state of something at a specific point in time. For example, a stock ticker quote or a temperature reading from an individual sensor.
Data stream
The running sequence of tuples.
Operator
An operator manipulates tuple data from an incoming stream and sends the results to zero or more output streams. Multiple streams and operators that are deployed in Teracloud® Streams form a dataflow graph.
Application Bundle
A file containing all logic (Operators, Data streams, and Tuple definitions) and artifacts needed to run the application in a Teracloud® Streams instance. Application bundles are generated by the SPL compiler.
Job
A running stream application. Jobs are created and started by submitting an application bundle to a running Teracloud® Streams instance. For example, via Streams Console.
Processing Element (PE)
A Linux process that performs one or more operator logics, communicating data streams to other PEs as needed. A job consists of one or more PEs.