Kafka Source

Configuration reference for the Kafka Source block — an alternative source block that consumes data from an Apache Kafka topic.

The Kafka Source block is an alternative source block used when data is consumed from an Apache Kafka topic rather than a file-based source.

Block type: kafka_connect_to_source

Subscribes to a Kafka topic and consumes messages as the input data for the dataflow.

Configuration fields

FieldDescription
Kafka Brokers *Comma-separated list of Kafka broker addresses
Topic Name *The Kafka topic to consume from
Consumer Group *The Kafka consumer group ID
Max Poll RecordsMaximum number of records to consume per poll interval

* Required field