AAI Integration for CA Workload Automation ESP

Automic Automation Intelligence (AAI) for ESP allows you to put the runtime information of executions from different Clients in multiple ESP systems into a single view. This means that you can see running executions (and possibly failed ones) of more than one ESP system in a single interface, without having to switch from one ESP interface to another.

This page includes the following:

CA Workload Automation ESP Requirements

Before installing the ESP Connector, make sure that all the necessary CA Workload Automation ESP components are installed and configured.

ESP Connector Requirements

Before starting with the ESP Connector installation, make sure that your system meets the following requirements:

  • Minimum memory amount: 4GB

  • Minimum disk space: 1GB

  • Java is installed and PATH contains a path to Java binaries, otherwise configuring the ESP Connector is not possible because the configuration script fails.

Installation and Configuration Overview

The ESP Connector can be installed either on Windows, Linux or zLinux platforms.

Also, you can secure your Connectors using TLS 1.2 based secure connections. For more information, see Two-Way Certificate-Based Authentication over TLS 1.2.

See also Configuring Connectors for Authentication.

Installing and Configuring the ESP Connector on Windows

The configuration of the ESP connector starts automatically after the installation.

  1. Download the ESP connector from the download center and put the .ZIP file in a temp location on the server where the connector will run. Unzip the file to that location.

    You find the download center at https://downloads.automic.com/.

  2. Start the Windows Installer esp-aai-connector-(version).exe and follow the installation instructions.

    After the installation completes successfully, the ESP Connector will show in Windows Services.

  3. (If the configuration has been successful, this step is not applicable. You only need it if the configuration failed during the installation process, if changes to the configuration are required, and so on).

    To configure the ESP Connector, go to the folder where the connector was installed.

  4. (If the configuration has been successful, this step is not applicable. You only need it if the configuration failed during the installation process, if changes to the configuration are required, and so on).

    Execute setup.bat file. This will open the Command prompt window.

    Important!

    • Once setup.bat is started, the following message will prompt you to obtain the Connector certificate:

      If you are planning to make a TLS based connection to AAI then before proceeding please obtain the connector certificate package from the AAI server and copy it to C:\Program Files\esp-aai-connector\secure\

    • If using the Connector certificate, generate it now. For more information, see Configuring Connectors for Authentication.

  5. Follow the instructions and enter the required information:

    • AAI server URI

      You must specify the protocol, domain host name or IP address, and a listening port number of the AAI server. This information should be captured during the AAI server installation.

      If you are using the Connector certificate, this URI may use HTTPS and port 4443. Otherwise, it will likely be the same port that is used to launch the AAI client from a browser, for example http{s}://hostname:port.

    • Connector name

      Name of your choice. This name will be selected from the web UI when adding a scheduler to AAI.

    • Host name

      Domain name or IP address of the host where the Connector runs

    • Connector key password

      This is only required if an HTTPS connection is used between the Connector and the AAI server. If HTTP is used, leave this empty and hit Enter.

    • AAI server user name

      Only required when using HTTP.

      Name of the user ID that will be used to establish a connection to the AAI server. The user must be authorized to add new schedulers.

    • AAI server password

      This is required only if a HTTP connection is used between the Connector and the AAI server. If HTTPS is used, this can be omitted.

    • Connector domain

      Typically this is JAWS. This is the login domain for the user/password provided and it can be any of the list of domains that have been set up in AAI. For more information about domains, see User Management - Domains Panel.

  6. After you have entered the required information, the script continues with the connection to the AAI server to verify that the provided data is correct.

    If the connection is successful, the application.yml file is created in the folder where you have installed the Connector. This is a configuration file that contains the configuration values that you have just entered. At the same time, a backup copy of the application.yml is automatically created and renamed to application.yml.bak.

    In the case of a failure, the application.yml file is not populated with the values you entered. You would have to manually repeat the configuration process.

  7. Open the Automic Automation Intelligence web interface and add the ESP scheduler. For more information, see Scheduler Type - CA Workload Automation ESP.

Installing and Configuring the ESP Connector on Linux and zLinux

  1. Download the ESP connector from the download center and put the .ZIP file in a temp location on the server where the connector will run. Unzip the file to that location.

  2. To install the ESP Connector do one of the following:

    • Use the rpm command as follows:

      rpm -ihv esp-aai-connector-(version).noarch.rpm

    • Use the yum command as follows:

      yum localinstall esp-aai-connector-(version).noarch.rpm

    Note:

    Currently only one Connector per system can be installed.

  3. To configure the ESP Connector, go to the directory where the connector was installed.

  4. Execute the configure-esp-aai-connector.sh file.

  5. Follow the instructions and enter the required information:

    • AAI server URI

      Protocol, domain host name or IP address, and a listening port number of the AAI server. This information should be captured during the AAI server installation.

    • Connector name

      Name of your choice. This name will be selected from the web UI when adding a scheduler to AAI.

    • Host name

      Domain name or IP address of the host where the Connector runs

    • Connector key password

      This is only required if a HTTPS connection is used between the Connector and the AAI server. If HTTP is used, leave this empty and hit Enter.

    • AAI server user name

      Name of the user ID that will be used to establish a connection to the AAI server. The user must be authorized to add new schedulers.

      This is required only if a HTTP connection is used between the Connector and the AAI server. If HTTPS is used, this can be omitted.

    • AAI server password

      User ID password that will be used to establish a connection to the AAI server.

      This is required only if a HTTP connection is used between the Connector and the AAI server. If HTTPS is used, this can be omitted.

    • Connector domain

      Typically this is JAWS. This is the login domain for the user/password provided and it can be any of the list of domains that have been set up in AAI. For more information about domains, see User Management - Domains Panel.

      This is required only if a HTTP connection is used between the Connector and the AAI server. If HTTPS is used, this can be omitted.

  6. After you have entered the required information, the script continues with the connection to the AAI server to verify that the provided data is correct. If the connection is successful, the application.yml file is created in the directory where you have installed the Connector.

    In the case of a failure, the application.yml file is not populated with the values you entered. You would have to manually repeat the configuration process.

  7. Register the ESP Connector and the Scheduler to AAI.

    Open the Automic Automation Intelligence web interface and add the ESP scheduler. For more information, see Scheduler Type - CA Workload Automation ESP.

Setting the Connector to Request Definition Data at Start

Optionally, after installing and configuring the connector, you can verify that the JCL is submitted to ESP before starting the ESP connector:

  1. Obtain the ESP Connector ID.

    When the Connector starts, it prints out its ID in the log, for example *** Connector received (AXlmKbmkOnQ=).

    The string in brackets is the Connector ID. Keep this ID at hand because you will need it later.

  2. Retrieve the scheduler configuration using the following command:

    curl http://{host:port}/aai/api/v2/schedulers?fetch=all

    where you replace host and port with your installation data.

    The output contains the configuration data of all your schedulers.

  3. Use the Connector ID that you have just obtained to find the configuration that pertains to your Connector.

    The configuration data also provides the schedulerID. Keep this ID at hand because you will need it later.

  4. In your schedule's configuration, copy the entire json block that is called schedulerConnectionConfig and paste it to the conf.json file. Wrap that block in { }. This is what it should look like:

    {
  "schedulerConnectionConfig" : {
    ...    
  }  
}

  5. To add the configuration that enables to retrieve jobs at start, copy and paste the following template at the end of the schedulerConnectionConfig block in your conf.json file:

    "default-trigger.publish-jobs-on-startup": true

    The content of the conf.json file should be similar to this now:

    {
  "schedulerConnectionConfig" : {
    ...
    "default-trigger.publish-jobs-on-startup": true
  }  
}

  6. To update the configuration, run the following command:

    curl -v -H "Content-Type: application/json" -X PUT --data

    @conf.json -u your_username:your_password

    http://{host:port}/aai/api/v2/schedulers/{schedulerId}

    Where:

    • {schedulerId} is the scheduler ID that you have just got in the configuration data.

    • your_username and your_password are your AAI credentials

      Note:

      If you are running this command from a different folder then specify an absolute path to your conf.json file.

    • {host:port} are your installation data

  7. Once you have verified the connection, you can turn off the retrieval of jobs at start by modifying the conf.json and turning off the publish-jobs-on-startup flag. For this purpose, run again the following command:

    curl -v -H "Content-Type: application/json" -X PUT --data

    @conf.json -u your_username:your_password

    http://{host:port}/aai/api/v2/schedulers/{schedulerId}

    The content of the conf.json file should be similar to this now:

    {
  "schedulerConnectionConfig" : {
    ...
    "default-trigger.publish-jobs-on-startup": false
  }  
}

Enabling Secure Connection Between the ESP Connector and ESP Message Hub

  1. Obtain the ESP Connector ID.

    When the Connector starts, it prints out its ID in the log, for example *** Connector received (AXlmKbmkOnQ=).

    The string in brackets is the Connector ID. Keep this ID at hand because you will need it later.

  2. Retrieve the scheduler configuration using the following command:

    curl http://{host:port}/aai/api/v2/schedulers?fetch=all

    where you replace host and port with your installation data.

    The output contains the configuration data of all your schedulers.

  3. To configure a secure connection, copy and paste the following template at the end of the schedulerConnectionConfig block in your conf.json file:

    "esp-scheduler.mq-transport": "jks",

    "esp-scheduler.mq-jks-keyStore": "",

    "esp-scheduler.mq-jks-keyStorePassword": "",

    "esp-scheduler.mq-jks-trustStore": "",

    "esp-scheduler.mq-jks-trustStorePassword": ""

  4. The content of the conf.json file should be similar to this now:

    {
  "schedulerConnectionConfig": {
    ...
    "esp-scheduler.mq-transport": "jks",
    "esp-scheduler.mq-jks-keyStore": "",
    "esp-scheduler.mq-jks-keyStorePassword": ""
    "esp-scheduler.mq-jks-trustStore": "",
    "esp-scheduler.mq-jks-trustStorePassword": ""
  }  
}

  5. Update the keyStore, the trustStore and their respective passwords.

    Update the properties according to your environment. Typically, the keyStore stores the private key of the ESP Connector and the trustStore stores the public key of the Message Hub server.

    The content of the config.json file should be similar to this:

    {
  "schedulerConnectionConfig": {
    ...
    "esp-scheduler.mq-transport": "jks",
    "esp-scheduler.mq-jks-keyStore": "/u/a/keystore.jks",
    "esp-scheduler.mq-jks-keyStorePassword": "123"
    "esp-scheduler.mq-jks-trustStore": 
"/u/a/truststore.jks",
    "esp-scheduler.mq-jks-trustStorePassword": ""
  }  
}

  6. To update the configuration, run the following command:

    curl -v -H "Content-Type: application/json" -X PUT --data

    @conf.json -u your_username:your_password

    http://{host:port}/aai/api/v2/schedulers/{schedulerId}

  7. Start the ESP connector.

Starting the ESP Connector

To start the Connector service, do the following:

Windows

You have two options:

  • Through Windows Services

  • Start the command prompt as an administrator and enter the following command:

    esp-aai-connector.exe /start

For details, refer to the output.log file that is created in the folder where the Connector was installed.

Linux and zLinux

Start the command prompt as an administrator and enter the following command:

sudo systemctl start esp-aai-connector

Stopping the ESP Connector

To stop the Connector service, do the following:

  • Windows

    You have two options:

    • Through Windows Services

    • Start the command prompt as an administrator and enter the following command:

      esp-aai-connector.exe /stop

  • Linux and zLinux

    Start the command prompt as an administrator and enter the following command:

    sudo systemctl stop esp-aai-connector

Retrieving the Status of the ESP Connector

To retrieve the status of the Connector service, do the following:

  • Windows

    You have two options:

    • Go to Windows Services to get the status of the ESP connector service

    • Start the command prompt as an administrator and enter the following command:

      esp-aai-connector.exe /status

    Expected output if the service is running:

    Running.

    Auto-start.

    Expected status if the service is not running

    Not running.

    Auto-start.

  • Linux and zLinux

    Start the command prompt as an administrator and enter the following command:

    sudo systemctl status esp-aai-connector

    Expected output:

    esp-aai-connector.service - Esp-Aai-Connector   

    Loaded: loaded (/etc/systemd/system/esp-aai-connector.service; enabled; vendor preset: disabled)   

    Active: active (running) since Thu 2021-04-29 20:18:36 UTC; 1 months 9 days ago 

    Main PID: 670155 (java)    

    Tasks: 61 (limit: 100628)   

    Memory: 1.0G   

    CGroup: /system.slice/esp-aai-connector.service           

    └─670155 java -jar /opt/esp-aai-connector/esp-aai-connector.jar

Uninstalling the ESP Connector

Windows

  1. Go to Apps & features.

  2. Select esp-aai-connector-(version).exe.

  3. Select the Uninstall button and follow the instructions.

Linux

To uninstall the connector issue the following commands:

  • rpm –qa | grep <package name>

    This command returns the actual package name.

    Example: rpm –qa | grep esp-aai-connector

    Output example: esp-aai-connector-1.0.0~rc.1-.noarch

  • rpm -e grep <package name returned by rpm -qa>

    Example (supposing that the rpm -qa command returned esp-aai-connector-1.0.0 .x86_64):

    rpm -e esp-aai-connector-1.0.0 .x86_64

    Important! Remove the extra "-" character before the last section of the package name. This "-" character comes from the rpm -qa.

    For example, if the package name is esp-aai-connector-1.0.0~rc.1-.noarch, remove the last "-" so that the package name is as follows: esp-aai-connector-1.0.0~rc.1.noarch.

Note:

The application.yml and application.yml.bak files, and the EspConnector directory remain in the /opt/esp-aai-connector directory after uninstalling the Connector. You will have to delete those files and directories manually.

See also: