Using the Kafka Connection Manager

The Kafka Connection Manager is an SSIS connection manager that can be used to establish connections with Kafka.
To add a new connection, right-click the Connection Manager area in your Visual Studio project, and choose "New Connection..." from the context menu. You will be prompted by the "Add SSIS Connection Manager" window. Select the "Kafka (KingswaySoft)" item to add a new Kafka Connection Manager.

New SSIS Connection

Add SSIS Kafka Connection Manager.png

The Kafka Connection Manager contains the following 2 pages of configuration.

  • General
  • Advanced Settings

General Page

The General page allows you to specify connection properties and login credentials to Kafka.

Kafka Connection Manager

BootStrap Servers

Click on Add button to add different servers’ hosts and ports.

Host Name

The name of the host where the Kafka server is located.

Port

The Port is used to connect to the Kafka server.

Client ID

This is an optional identifier of a Kafka consumer (in a consumer group) that is passed to a Kafka broker with every request.

Security Protocol

The Security Protocol drop-down displays a list of protocols that allows you to pick one of them:

  • PlainText
  • SSL
  • SASL PlainText
  • SASL SSL

Kafka Connection Manager - SSL

SSL Key Location (Only for Security Protocol as SSL)

The Key location for the SSL protocol option. The ellipsis button can be used to search for it in the folder path.

SSL Key Password (Only for Security Protocol as SSL)

The SSL Key password can be specified here.

SSL Key PEM (Only for Security Protocol as SSL)

Specify the SSL Key PEM here.

SSL Certificate Location (Only for Security Protocol as SSL)

The location for the SSL Certificate. The ellipsis can be used to search for the SSL Certificate location.

SSL Certificate PEM (Only for Security Protocol as SSL)

Specify the SSL Certificate PEM here.

SSL CRL Location (Only for Security Protocol as SSL)

The SSLS CRM location to be specified in this space.

SSL Keystore Location (Only for Security Protocol as SSL)

The location for the SSLKeystore. The ellipsis can be used to search for it.

SSL Keystore Password (Only for Security Protocol as SSL)

The SSL Keystore Password can be specified here.

SASL Username (Only for Security Protocols SASL Plaintext and SASL SSL)

The SASL Username for the instance.

SASL Password (Only for Security Protocols SASL Plaintext and SASL SSL)

The SASL password for the instance.

Test Connection

After all the connection information has been provided, you may click the "Test Connection" button to test if the user credentials entered can connect to IBM MQ/WebSphere MQ.

Advanced Settings

This page contains all possible settings for a Kafka connection. Clicking on a specific setting will display a description for the selected property at the bottom of The Advanced page.

Kafka Connection Manager - Advanced