Home
Developing
Develop stream applications with the Streams Processing Language (SPL), Java, and Python.
Development concepts
Development of stream applications consists of several components such as operators, streams, tuples, Streams Processing Language, toolkits, and more.
Toolkits
A toolkit is an organized collection of artifacts to provide reusable components for application developers.
Types of toolkits
Teracloud® Streams provides several toolkits out of the box. If provided toolkits do not meet application needs, custom toolkits can be created.

Welcome
Learn about the core capabilities of Teracloud® Streams, its architecture, and key concepts.
Installing
Use this information to install, upgrade, and uninstall the Teracloud® Streams product.
Configuring
Create a basic or an enterprise domain which is a single point for configuring and managing common resources, security, and instances.
Administering
Administer the product by using the Teracloud® Streams graphical user interface, APIs, or the streamtool command-line interface.
Developing
Develop stream applications with the Streams Processing Language (SPL), Java, and Python.
- Development concepts
  Development of stream applications consists of several components such as operators, streams, tuples, Streams Processing Language, toolkits, and more.
  - Stream applications
    A Stream application is a software program that processes streaming data. The application may consume, clean, transform, enrich, analyze, produce, and store data as part of its processing.
  - Streams and tuples
    A stream is a sequence of data that flows between operators in a stream application.
  - Operators
    Operators are the fundamental building blocks of stream applications. Typically, operators process tuples in incoming streams and produce output streams as a result.
  - Application development
    Teracloud® Streams offers the Streams Processing Language (SPL) to compose stream applications.
  - Toolkits
    A toolkit is an organized collection of artifacts to provide reusable components for application developers.
    - Types of toolkits
      Teracloud® Streams provides several toolkits out of the box. If provided toolkits do not meet application needs, custom toolkits can be created.
  - Development and runtime environments
    You can develop stream applications in an integrated development environment, then you run those applications in instances on one or more computers.
  - Running applications
    You can submit and run your applications in stand-alone or distributed runtime environments. In a stand-alone runtime environment, an application is a binary that you can launch directly, that is, it does not run on the Teracloud® Streams instance. In a distributed runtime environment, an application is run when you submit a application bundle file to a Teracloud Streams instance.
- Writing stream applications
  Teracloud® Streams provides features and functions to help you write your applications to fulfill your business needs.
- Enabling Streams data exchange
  Teracloud® Streams provides a data exchange REST API for inserting and retrieving Streams job data. You can add one or more endpoint operators to your Streams application to enable Streams data exchange. Providing a standard REST interface for Streams data exchange eases the integration of Streams data with other data services and externally hosted applications.
- Compiling stream applications
  The Streams Processing Language (SPL) Compiler is called sc and is included with the Teracloud® Streams installation package. You compile SPL to create files to run on your Teracloud Streams instance.
- Performance improvements for stream applications
  You can improve the processing of your stream application by following these guidelines and tips.
- Debugging stream applications
  The Streams Processing Language (SPL) Streams Debugger (sdb) provides a command line-based interactive debugger for debugging stream applications.
- Developing toolkits and operators
  You can create custom toolkits and operators for your applications.
Troubleshooting
Resolve problems with Teracloud® Streams using the troubleshooting tools provided with the product as well as the resources offered by Teracloud Support.
Reference
Find details on the SPL language, toolkits, APIs, commands, and more.
Glossary
Use this glossary to find terms and definitions for Teracloud® Streams.

Types of toolkits

Teracloud® Streams provides several toolkits out of the box. If provided toolkits do not meet application needs, custom toolkits can be created.

Toolkits can be categorized into the following types:

Toolkits shipped in Teracloud® Streams

Standard toolkit

The SPL standard toolkit is included with Teracloud® Streams. It contains operators, functions, types, and other artifacts that are available by default to develop stream applications.

Here are some standard operators that you might use in your application.

Aggregate: The Aggregate operator is used to compute user-specified aggregations over tuples that are gathered in a window.
Beacon: The Beacon operator is a utility source that generates tuples dynamically.
FileSink: The FileSink operator writes tuples to a file.
FileSource: The FileSource operator reads data from a file and produces tuples as a result.
Filter: The Filter operator removes tuples from a stream by passing along only those tuples that satisfy a user-specified condition.
Join: The Join operator is used to correlate tuples from two streams that are based on user-specified match predicates and window configurations.
Split: The Split operator is used to split a stream into one or more output streams, which are based on a user-specified split condition.
Throttle: The Throttle operator is used to pace a stream to make it flow at a specified rate.

Specialized toolkits

Specialized toolkits are toolkits developed for specific protocols, integrations, and business environments. Some commonly used specialized toolkits include:

Geospatial toolkit
Kafka toolkit
TimeSeries Toolkit

Custom toolkits

A custom toolkit is any toolkit not shipped by Teracloud® Streams. They may be internal to your organization, provided by third-parties, or open source. Users may want to create custom toolkits to share functionality, reduce redundancy, or standardize flows across their stream applications.

Teracloud Streams requires custom toolkits to be indexed in order to be available by compilers and tools. Streams provides the spl-make-toolkit program to perform this indexing.