Home
Developing
Develop stream applications with the Streams Processing Language (SPL), Java, and Python.
Compiling stream applications
The Streams Processing Language (SPL) Compiler is called sc and is included with the Teracloud® Streams installation package. You compile SPL to create files to run on your Teracloud Streams instance.

Welcome
Learn about the core capabilities of Teracloud® Streams, its architecture, and key concepts.
Installing
Use this information to install, upgrade, and uninstall the Teracloud® Streams product.
Configuring
Create a basic or an enterprise domain which is a single point for configuring and managing common resources, security, and instances.
Administering
Administer the product by using the Teracloud® Streams graphical user interface, APIs, or the streamtool command-line interface.
Developing
Develop stream applications with the Streams Processing Language (SPL), Java, and Python.
- Development concepts
  Development of stream applications consists of several components such as operators, streams, tuples, Streams Processing Language, toolkits, and more.
- Writing stream applications
  Teracloud® Streams provides features and functions to help you write your applications to fulfill your business needs.
- Enabling Streams data exchange
  Teracloud® Streams provides a data exchange REST API for inserting and retrieving Streams job data. You can add one or more endpoint operators to your Streams application to enable Streams data exchange. Providing a standard REST interface for Streams data exchange eases the integration of Streams data with other data services and externally hosted applications.
- Compiling stream applications
  The Streams Processing Language (SPL) Compiler is called sc and is included with the Teracloud® Streams installation package. You compile SPL to create files to run on your Teracloud Streams instance.
  - SPL Compiler
    The SPL compiler is an incremental compiler that generates artifacts needed to run your stream application. These artifacts include, for example, C++ code for several entities in your SPL program and an application bundle file.
  - Application development and deployment options
    Various application development and deployment options are provided by the SPL compiler, sc command.
  - Compiler intrinsic functions
    The SPL compiler provides these built-in functions.
  - Code generation features
    The SPL compiler is an incremental compiler, which generates C++ code.
  - Static and dynamic stream connections in SPL
    There are two types of stream connections in an SPL program that runs in the Teracloud® Streams system: static and dynamic. Static stream connections are required connections. Dynamic stream connections are optional connections.
  - Facade tuples
    The compiler provides facade tuples to avoid serialization processing.
  - SPL binary and character encoding
    SPL uses a platform independent binary and character encoding for serializing and deserializing data. This encoding is used for the FileSource, TCPSource, and UDPSource operators, as well as the FileSink, TCPSink, and UDPSink operators.
- Performance improvements for stream applications
  You can improve the processing of your stream application by following these guidelines and tips.
- Debugging stream applications
  The Streams Processing Language (SPL) Streams Debugger (sdb) provides a command line-based interactive debugger for debugging stream applications.
- Developing toolkits and operators
  You can create custom toolkits and operators for your applications.
Troubleshooting
Resolve problems with Teracloud® Streams using the troubleshooting tools provided with the product as well as the resources offered by Teracloud Support.
Reference
Find details on the SPL language, toolkits, APIs, commands, and more.
Glossary
Use this glossary to find terms and definitions for Teracloud® Streams.

Compiling stream applications

The Streams Processing Language (SPL) Compiler is called sc and is included with the Teracloud® Streams installation package. You compile SPL to create files to run on your Teracloud® Streams instance.

A stream application corresponds to a main composite in an SPL toolkit. A composite operator that is defined in an .spl file is called a potential main composite if and only if it does not have any input or output ports and mandatory parameters. A stream application has one such potential main composite that is designated as its main composite. To compile a stream application, its main composite name must be passed to the sc command.

In order for the sc command to generate an application bundle file, it needs to have access to the toolkit that contains the application's designated main composite, and other toolkits that are listed as dependencies of this toolkit. An application gets its version and dependency information from the toolkit that defines its main composite.

The result of compiling a main composite is a set of artifacts that includes an application bundle file. This application bundle file is a file format that is specific to Teracloud® Streams and contains all the necessary application artifacts to run in a Teracloud® Streams instance.

When the application bundle file is submitted to a Teracloud® Streams instance, it creates a job and determines how your application is divided into processing elements (PEs) based on the compile-time, submission-time information and the runtime resources available. PEs load the application libraries from the bundle file and serve as an execution container for one or more operator instances.