Connect to Source - Kafka

This block enables you to define the Kafka server details. Below is the screenshot showing the fields in the block.

The table below describes the fields in the block:

Field NameDescription
kafka brokersKafka server URL. The URL is a combination of the server address and the port number.
Example: kafka-connectplus:9092
kafka topicsPredefined topic name from which you consume messages. These topics must already exist in your Kafka system. You can list multiple topics separated by commas.
Consumer Group IdSpecifies the predefined consumer group ID used for access control.
Security ProtocolSpecify the security protocol you want to use to exchange data between the Kafka client and server. The supported protocols are:

- PLAINTEXT: No data encryption or authentication.
- SSL: Uses the SSL protocol for data encryption but no SASL authentication.
- SASL_PLAINTEXT: Uses SASL protocol for authentication but does not encrypt data.
- SASL_SSL: Uses the SASL protocol for authentication and SSL for encryption.
SASL MechanismSpecify the authentication method used to connect to Kafka. The supported mechanisms are GSSAPI, PLAIN, SCRAM-SHA-256
Username and PasswordUsername and password to access the Kafka server.
Headers as AttributeChoose the headers to be used as attributes.
Kafka message headers can contain metadata such as user ID, priority, and source system. Connect+ extracts these headers as data attributes and makes them available to all steps in the flow. You can use these attributes for:

- Routing: Direct messages based on header values
- Filtering: Process only relevant messages
- Tracking: Enable observability and trace message flow
- Simplified Logic: Apply business rules without parsing the main message.