Automic Automation / Apache Kafka Agent Integration: Implementation Overview

Usually, Automic Automation the communication between the Agent and the target system is established by Connection objects. This is NOT TRUE for the Apache Kafka integration. With the Automic Automation / Apache Kafka Agent Integration, you specify the connection parameters directly in the Producer and Consumer Jobs. For more information, see Defining Apache Kafka Jobs.

These are the steps you have to follow for the integration:

Download the Apache Kafka Agent Installation Package

You can download the relevant Agent installation package from our download center at https://docs.automic.com/documentation or from our marketplace at https://marketplace.automic.com/.

For more information, see Downloads and Marketplace.

Install the Apache Kafka Agent

After downloading the relevant installation package, you have to install the Agent so that you can establish the communication between the two systems.

Important!

Before installing the Agent, check the version compatibility information at compatibility matrix. For information about how to use the compatibility matrix, see Compatibility Information.

You can install the Agent manually or in a container. The containerized Agent installation refers to building and running a Docker image hosting Java Agents in a container.

Regardless of how you install the Agents, you can use them in on-premises Automic Automation systems as well as in an Automic Automation Kubernetes Edition system.

For more information, see the Automic Automation documentation:

Define and Start the Apache Kafka Agent

Once you have installed the Agent, you have to configure its INI file to cover your system's requirements, for example, the connection between the Agent and the Automation Engine instance. Then, you define the Agent object in AWI. There are definition pages that are common to all Agents and some that are Agent-specific.

Define Apache Kafka Jobs

Once the Agent is installed and defined, you have to create and define the Producer and Consumer jobs so that you can execute the relevant processing steps in your Apache Kafka system.

Once the jobs are defined, you can execute it and monitor their progress from the Automic Web Interface.

See also:

Automic Automation / Apache Kafka Agent Integration