Setting AWS Glue Job Properties Through Scripts

Attributes defined for an object affect how the object is processed. Script statements allow you to dynamically change those object attributes and assign new values when the task is generated. The new values are only valid for the current generation and are not permanently stored in the object.

You can define the values of any of the settings of all AWS Glue Jobs using scripts. You do this by using :PUT_ATT commands on the Pre-Process object definition page.

For more information, see the Automic Automation product documentation:

This page includes the following:

Start Crawler Job Attributes

The attributes available for the Start Crawler Job are the following:

  • connection

    Defines the value of the AWS Glue Connection object definition

    Value: text

  • crawlerName

    Defines the name of the crawler that you want to use, for example, aa-csv-crawler.

    Value: text

Start Trigger Job Attributes

The attributes available for the Start Trigger Job are the following:

  • connection

    Defines the value of the AWS Glue Connection object definition

    Value: text

  • triggerName

    Defines the name of the relevant trigger, for example, aa-csv-job-trigger.

    Value: text

Start Job Run Job Attributes

The attributes available for the Start Job Run Job are the following:

  • connection

    Defines the value of the AWS Glue Connection object definition

    Value: text

  • runJobName

    Defines the name of the job you want to run.

    Value: text

  • parameterType

    Defines the attributes that you want to pass to the application.

    Value: JSON, File Path

    • json

      Enter the JSON payload definition. You can also use this field if you want to include this Job in a Workflow and you want to use Automation Engine variables in it.

    • filePath

      Defines the path to the JSON file containing the attributes that you want to pass to the application.

Start Blueprint Job Attributes

The attributes available for the Start Blueprint Job are the following:

  • connection

    Defines the value of the AWS Glue Connection object definition

    Value: text

  • bluePrintName

    Defines the name of the relevant blueprint.

    Value: text

  • roleARN

    Defined the role ARN of the user with the required permissions to create the worflow in AWS Glue after the Blueprint job is triggered.

    Value: text

  • parameterType

    Defines the attributes that you want to pass to the application.

    Value: JSON, File Path

    • json

      Enter the JSON payload definition. You can also use this field if you want to include this Job in a Workflow and you want to use Automation Engine variables in it.

    • filePath

      Defines the path to the JSON file containing the attributes that you want to pass to the application.

Start Workflow Job Attributes

The attributes available for the Start Workflow Job are the following:

  • connection

    Defines the value of the AWS Glue Connection object definition

    Value: text

  • workflowName

    Defines the name of the relevant workflow.

    Value: text

  • parameterType

    Defines the attributes that you want to pass to the application.

    Value: JSON, File Path

    • json

      Enter the JSON payload definition. You can also use this field if you want to include this Job in a Workflow and you want to use Automation Engine variables in it.

    • filePath

      Defines the path to the JSON file containing the attributes that you want to pass to the application.

See also: