Skip to main content

Aggregate Stream

Synopsis

This operator performs an aggregation on streamed data events in a streaming analytic workflow.

Description

This is a streaming operator and needs to be placed inside a Streaming Nest or a Streaming Optimization operator. The operator defines the logical functionality and can be used in all streaming analytic workflow for any supported streaming platform (currently Flink and Spark). The actual implementation used depends on the type of connection connected to the Streaming Nest operator in which this operator is placed.

Input

input stream

The input of this streaming operation. It needs to receive the output of a preceding streaming operator, to define the flow of data events in the streaming analytic workflow.

Output

output stream

The output of this streaming operation. Connect it to the next Streaming operator to define the flow of the data events in the designed streaming analytic workflow.

Parameters

Key

Key to be used for partitioning the data (determines the granularity of the aggregation).

Value key

Key of the value to be used in the aggregation function (e.g. amount that will be summed).

Window length

Length of time-window over which aggregation occurs.

Function

Aggregation function to be used.

  • Sum: The sum of the values of the valueKey over the window length.
  • Average: The average of the values of the valueKey over the window length.
  • Count: The count of the valueKey over the window length.
  • Minimum: The minimum of the values of the valueKey over the window length.
  • Maximum: The maximum of the values of the valueKey over the window length.