Skip to main content

Complex Event Forecasting Engine

Synopsis​

This operator deploys the Complex Event Forecasting Engine (CEF) on the provided Flink cluster and uses it to perform complex event forecasting on streamed data events in a streaming analytic workflow.

Description​

This operators first deploys the CEF Engine to the Flink cluster provided at the flink-connection input port. During start of the CEF Engine the required parameters are provided to the CEF as well by the operator. In addition the required topics (input and output) on the kafka cluster for communication with the CEF Engine are created as well.

The operator pushes the data events received at the input stream port to the input kafka topic. The CEF Engine performs the complex event forecasting

The operator reads from the output topic of the kafka cluster and pushes the detected complex events further downstream (to the output stream port).

This is a streaming operator and needs to be placed inside a Streaming Nest or a Streaming Optimization operator. The operator defines the logical functionality and can be used in all streaming analytic workflow for any supported streaming platform (currently Flink and Spark). The actual implementation used depends on the type of connection connected to the Streaming Nest operator in which this operator is placed.

Input​

kafka-connection​

The connection to the Kafka Cluster which is used by the CEF Engine for communication.

The connection to the Flink Cluster which on which the CEF Engine shall be deployed.

input stream​

The input of this streaming operation. It needs to receive the output of a preceding streaming operator, to define the flow of data events in the streaming analytic workflow.

Output​

output stream​

The output of this streaming operation. Connect it to the next Streaming operator to define the flow of the data events in the designed streaming analytic workflow.

Parameters​

Threshold​

Threshold used by the CEF Engine.

Max spread​

Max spread used by the CEF Engine.

Horizon​

Horizon used by the CEF Engine.

Patterns​

Path to the file containing the patterns (i.e., the query) for which forecasts will be made.

Declarations​

Path to the file containing the declarations (Additional info for the patterns that help forecasting) used by the CEF Engine.

K​

The frequency of updating the forecasting model. i.e., a new model will be created every k events.

Parallelism​

Parallelism of the CEF Flink job.

Offset reset​

Offset for reading input data used by the CEF Engine.

Input topic​

Name of the Kafka topic used by the CEF Engine to receive input data events

Output topic​

Name of the Kafka topic used by the CEF Engine to push output data events to.

Config topic​

Name of the Kafka topic used by the CEF Engine to store configurations.

Timestamp key​

Name of the field, whose value will be used as timestamp.

Domain stream​

Domain of the streaming workflow.

Job jar​

Path to the .jar file of the CEF Engine.