Skip to main content

Kafka Source

Synopsis​

This operator provides a Kafka topic as a source to a streaming analytic workflow.

Description​

This is a streaming operator and needs to be placed inside a Streaming Nest or a Streaming Optimization operator. The operator defines the logical functionality and can be used in all streaming analytic workflow for any supported streaming platform (currently Flink and Spark). The actual implementation used depends on the type of connection connected to the Streaming Nest operator in which this operator is placed.

Input​

connection​

The connection to the Kafka Cluster which topic should be sourced.

Output​

output stream​

The output of this streaming operation. Connect it to the next Streaming operator to define the flow of the data events in the designed streaming analytic workflow.

Parameters​

Kafka topic​

Kafka topic which is used as a source.

Start from earliest​

If selected the source starts at the earliest available event of the Kafka topic, otherwise only new events are processed.