Prepare Configuration for AE Database

Click the image to expand it.

ClosedTo Prepare the Automation Engine Database (MS SQL Server)

See also: AWA System Requirements and Sizing

Size required for the initial installation of an AE database

Test systems:

1 GB

Production systems:

Small systems

5 - 20 GB

Medium systems

20 - 50 GB

Large system

more than 50 GB

Installation settings for SQL Server (to be configured on the DB computer, i.e. the computer where the database is installed):

You can partition your database with ILM to guarantee the optimum performance of your Automation Enginesystem. MS SQL requires additional permissions to work with ILM:

  1. Create a a new database (DB computer).

    1. Start SQL Server if it has not already been started (ServiceManager).
    2. Launch SQL Server Management Studio.
      1. Create a new database (right-click Databases > New Database).

        Automic recommends to name the database "AE" to better identify it at a later stage.

        The size of the transaction log should be about 25% of the data-file size (for test systems with truncate log). To change the size go to Database Properties > Files.

        Do not activate the Auto Shrink option in the database. This can occasionally cause an Automation Engine standstill.

  2. Create a new login (DB computer).

    1. Navigate to the Security > Logins folder.

    2. Right-click the Logins folder and select New Login...
    3. Enter a login name.
    4. Select the authentication.
      Automic recommends using SQL Server Authentication.
      The database password cannot include the special characters [ ] { } ( ) , ; ? * = ! @ \. Otherwise, the components cannot access the database.

    5. Click the User Mapping page and select the AE database.

      1. Select the following roles:

        • db_backupoperator
        • db_datareader
        • db_datawriter
        • db_ddladmin
        • db_owner
        • public
      2. Click OK.

      A new user is automatically created. The user is available in the Security > Users folder of the database.

    6. Click the Extended Properties page and use one of the following code pages:
      • "Latin1_General_CI_AS"
      • "SQL_Latin1_General_CP1_CI_AS" (CP 1252)

    7. Make sure the database is running with versioning. If not run:

      alter database xxxx set read_committed_snapshot on

    8. Click OK.

  3. Set up the data source on the Admin computer (computer used by an administrator) for ODBC access:

    Note that it is important to set the SQL cursor (1st digit=S) or to activate MarsConnection in the INI-file parameter for the ODBC access (SQLDRIVERCONNECT= ) in the particular component (Automation Engine, utility). Otherwise, the SQL Server database can only process one command at at time, which results in the following error:
    U0003590 DB error: 'SQLExecDirect', 'ERROR ', 'HY000', 'Connection is busy with results for another command'

    1. Decide whether you want to create the data source as a User DSN (user specific) or as a System DSN (once for all users of this computer).

      Automic recommends using the System DSN.

      A System DSN must be set up if the Automation Engine should be run as a service on this computer.

    2. Click the System DSN tab.

    3. Click Add... to add a new data source.
    4. Select SQL Server.

       Note that the SQL native client is required in order to use the AE database with MARS. You can download it from the Microsoft homepage, if it is not yet installed on your computer.

    5. Some basic settings are required in the following dialog box:

      1. Enter the name and description of the data source.
      2. Select local if the SQL Server is on the same computer, otherwise enter the name of the DB  computer.
      3. Click Next >.
    6. Select "SQL Server authentication" and enter the login ID and password in the following dialog box.

      Automic recommends creating a separate database user for AE.

      Do not use the user "sa" (system administrator).

    7. Click Next >.
    8. Now select the database.

    9. Select the required options in the last dialog box.

      Note that the third check box "Perform translation for character data" must not be selected.

    10. Click Finish.
    11. Click TestData Source to check the configuration,
    12. Click OK.

    Potential Problems

    • 32-Bit ODBC is used instead of 64-Bit ODBC.
    • The check box "Use ANSI nulls, paddings and warnings" is not activated.

ClosedTo Prepare the Automation Engine Database (Oracle)

See also: AWA System Requirements and Sizing

Size required for the initial installation of an AE database

Test systems:

1 GB

Production systems:

Small systems

5 - 20 GB

Medium systems

20 - 50 GB

Large system

more than 50 GB

The code-page setting of the DB client must comply with the database settings.

You can choose from either of the following three code pages, whichever fits your needs best:
WE8ISO8859P1, WE8ISO8859P15 and WE8MSWIN1252.

Which one you choose depends on the characters you need to store in the database. Therefore, ensure that the character set defined in XML_ENCODING in the variable UC_SYSTEM_SETTINGS corresponds to the character set of the database.

WE8ISO8859P15 seems the better choice as WE8ISO8859P1 does not support the Euro sign (€),
WE8MSWIN1252 supports the Euro sign plus several additional characters. Automic recommends using this code page if you are newly setting up your database.
For further details, see also ORACLE's support document no. 264294.1.

It is not necessary to convert your database to a new character set f you have your database already set up using WE8ISO8859P1 and you do not need any of the additional characters.

When using 8-bit character sets you can use the same code set for the database and the database client. In this case there is no data conversion. However, the user interface, the server and the utilities also need to be compatible with the 8-bit character set.

You can query your database settings with the following command:

SELECT * FROM NLS_DATABASE_PARAMETERS

Specifying your code-page setting:

On Windows:
Set HKEY_LOCAL_MACHINE\SOFTWARE\ORACLE\...\NLS_LANG in the registry according to your database setting.

On UNIX:
You can set the environment variable NLS_LANG as shown below:

NLS_LANG =<NLS_LANGUAGE>_<NLS_TERRITORY>.<CHARACTER SET>;export NLS_LANG

For example:

NLS_LANG=AMERICAN_AMERICA.WE8ISO8859P15;export NLS_LANG

You can also define the code-page settings in the INI files of the relevant components ( [ODBC] section).

Oracle UTF-8 and the Automation Engine

Hardware/Infrastructure

On the Database computer

A 64-bit client must be installed.

Prerequisites for ILM

You can partition your database with ILM to guarantee the optimum performance of your Automation Engine system. Oracle requires the permission on USER_OBJECTS to work with ILM.

Oracle RAC

Closed1. Define Tablespaces (DB computer)

Closed2. Create a Database User (DB computer)

It is recommended to create an additional database user for AE. This user must have the required privileges.

Closed3. Change the Storage Parameters for Large Tables (DB computer)

Closed4. Define the Rollback Segment (DB computer)

Automic recommends defining a large roll-back segment for the Automation Engine. The size should be 10-25% of the Automation Engine data.

The Automation Engine is not fully RAC enabled, as it only benefits from the increased availability of an RAC system. Its performance, however, does not improve by using RAC technology. On the contrary, you need to make sure that your system only communicates with one node of the RAC system in order to minimize data traffic through the Cluster Interconnect and administrative workload. In doing so, you also reduce the likelihood of deadlocks that might occur in the database because of database nodes that try to access the database concurrently.

Within an RAC node, Oracle generally uses row-level locking. However, block-level transfer and resource locking is used between the RAC nodes.To make sure that the AE is always only connected to one node, Automic recommends using Cluster Managed Services. You need to configure them in a way that the service only runs on one node and that the cluster software moves it to the second node if required.

Example for setting up a cluster service:

srvctl add service –d <DB NAME> -s <SERVICE NAME> -r <Node 1> -a <Node 2>

srvctl start service –d <DB NAME> -s <SERVICE NAME>

Similarly, in TNSNAMES.ORA under CONNECT_DATA=(SERVICE-NAME=<SERVICENAME<) the service name created with srvctl must be used.

Make sure that the following database parameters are set when you are using an RAC system with the AE:

The characteristics of Oracle Data Guard configuration that are relevant for use with the AE are described below. The configuration that you will use depends on the available infrastructure and your requirements.

Configuration 1 (Maximum Protection - Guaranteed Protection Mode)

The primary database will only register a transaction as committed when this transaction was also committed to at least one standby database. If the transaction could not be committed to a standby database, the primary database stops.

The advantage of this configuration is that production can continue immediately after a short manual intervention when the primary database has failed. Check whether the standby database was synchronized with the primary database at the time it failed. If so, you can activate the standby database and continue.

Maximum Protection - Stops the primary database when the last standby database is no longer available:

Configuration 2 (Maximum Availability - Instant/Rapid Protection Mode)

This configuration ensures that the standby database(s) is/are synchronized in a timely manner. However, the primary database starts processing the next transaction even it has not yet been confirmed that the previous transaction was also committed to at least one standby database. Therefore, the primary database does not stop when no standby database is available anymore. Changes made in the primary database are automatically updated in the standby database as soon as it is available again. In this configuration, you must always check manually whether the standby database was synchronized with the primary database at the time of failure.

Maximum Availability - Switching to delayed mode is possible when the standby database is not available:

Configuration 3 (Maximum Performance)

In this configuration, changes will only be transferred to the standby database when the online redo log is changed. Therefore, you cannot expect that the standby database includes up-to-date data when the primary database fails. You always need to manually check all the AE activities that have taken place since the log has been changed the last time.

Maximum Performance - Changes are propagated when the online log is filled:

Comparison of Data Guard Configurations

As a general rule, all the configurations require the same quantity of user data to be transferred between primary and standby databases. The required workload when the primary database fails is always different. The lower the workload during a failure, the higher the load in the form of longer response times during day-to-day operation.

For the reasons mentioned above, it must be calculated for each case how the demand on availability can be realized with the infrastructure that is currently available.

Data Guard Mode Failover Effort Demands on Infrastructure Performance
Maximum protection

Medium
Start: COLD (under certain circumstances)

High Behaves similarly towards the AE as in a single instance but the demands on database hardware and infrastructure (network) are considerably higher.
Maximum availability

Low
Start: NORMAL

Very high Only suitable for systems with low throughput
Maximum performance

Low
Start: NORMAL

Very high Only suitable for systems with low throughput

The illustration shown below demonstrates the connection between performance and availability of the Data Guard configurations compared to a single instance (without hardware cluster). For a single instance, the availability is always minimal compared to a Data Guard solution. However, performance is almost not affected. On the contrary, for Data Guard in maximum availability mode, the availability is very high but the negative effect on performance is also at the maximum level. When you intend to install AE Data Guard ,Automic recommends focusing on your available infrastructure in order to ensure that you won't have to deal with performance bottlenecks.

Preparation Steps Progress

Next steps:

Configuring the AE Server

Configuring the AWI Server

Configuring the ARA Database Server

Configuring the ARA Server

Configuring the ARA Client

Configuring the AE Agents

Security Setup for Super Users

Previous steps:

Download and Prepare the Installation Files