Defining Glue Start Crawler Job Properties

{"URL":["/*.*/awa/pa_view_pa_view_START_CRAWLER_event"],"heroDescriptionIdentifier":"ice_hero_Start_Crawler_Job","customCards":[{"id":"ice_specific_Glue_Start_Crawler_Job","title":"Adding Start Crawler Job Parameters","type":"customize","url":"https://docs.automic.com/documentation/webhelp/english/ALL/components/IG_AWS_GLUE/*.*/Agent%20Guide/Content/AWS_Glue/AWS_Glue_Jobs_Crawler.htm","languages":["en-us"]},{"id":"ice_RA_Integration_Report","title":"RA / Integration Reports","type":"customize","url":"https://docs.automic.com/documentation/webhelp/english/ALL/components/IG_AWS_GLUE/*.*/Agent%20Guide/Content/AWS_Glue/AWS_Glue_Jobs_RA_Properties.htm","languages":["en-us"]},{"id":"ice_Add_Start_Crawler_Job_Glue","title":"Setting Start Crawler Job Properties through Scripts","type":"customize","url":"https://docs.automic.com/documentation/webhelp/english/ALL/components/IG_AWS_GLUE/*.*/Agent%20Guide/Content/AWS_Glue/AWS_Glue_Script.htm","languages":["en-us"]},{"id":"ice_related_information_Glue_Start_Crawler_Job","title":"Related Information","type":"customize","url":"https://docs.automic.com/documentation/webhelp/english/ALL/components/IG_AWS_GLUE/*.*/Agent%20Guide/Content/AWS_Glue/AWS_Glue_Jobs_Crawler.htm","languages":["en-us"]}]}

AWS Glue Start Crawler jobs allow you to define the crawler that you want to use to search for and extract information from the different data sources to populate your AWS Glue Data Catalog.

On the Start Crawler Job page you define the parameters relevant to run that job on AWS Glue from Automic Automation.

  • Connection

    AWS Glue Connection object containing the relevant information to connect to the application.

    To search for a Connection object, start typing its name to limit the list of the objects that match your input.

  • Crawler Name

    The name of the crawler that you want to use, for example, aa-csv-crawler.

    You can click the browse button to the right of the field to open a picker dialog with all the jobs available and select the relevant one.

Note:

The Pre-Process page allows you to define the settings of the Jobs using script statements. These statements are processed before the job is executed, see Setting AWS Glue Job Properties Through Scripts.

See also: