Streaming Nest

Synopsis

This operator allows to design and deploy streaming analytic processes.

Description

The streaming analytic process is designed in the subprocess of the Streaming Nest operator. A streaming connection (Flink Connection or Spark Connection) has to be provided to the connection input port. It defines on which cluster and technology the streaming analytic process is deployed, when the process is executed.

If an INFORE optimizer connection object is provided to the connection input port, the streaming workflow is not uploaded to and deployed on a streaming cluster, but the StreamGraph of the workflow is serialized and uploaded to the file server of the INFORE Optimizer Service. This graph file can then be used to perform the benchmarking in the INFORE Optimizer.

Input

connection

The connection to the streaming cluster (flink or spark), the job shall be deployed on.

If an INFORE Optimizer connection object is provided, the StreamGraph defining the streaming workflow is serialized and uploaded to the file server of the INFORE Optimizer Service instead.

input

This port is a port extender, which means if a port is connected a new input port is created. Any IOObject can be connected to the port and is passed to the corresponding inner port.

Output

output

This is port is a port extender, which means if a port is connected a new output port is created. Any IOObject can be connected to the inner port and is passed to the corresponding outer port.

Parameters

Job name

Name of the stream job.