Google Cloud Dataproc Jobs: Start Or Stop Cluster

{"URL":["/*.*/awa/pa_view_pa_view_START_OR_STOP_CLUSTER_JOB_dataproc"],"heroDescriptionIdentifier":"ice_hero_Dataproc_Start","customCards":[{"id":"ice_specific_Dataproc_Start","title":"Start Or Stop Cluster Job Parameters","type":"customize","url":"https://docs.automic.com/documentation/webhelp/english/ALL/components/IG_GCP_DATAPROC/*.*/Agent%20Guide/Content/GCP_Dataproc/GCP_Dataproc_StartStopClusterJob.htm","languages":["en-us"]},{"id":"ice_RA_Integration_Report","title":"Defining RA / Integration Reports","type":"customize","url":"https://docs.automic.com/documentation/webhelp/english/ALL/components/IG_GCP_DATAPROC/*.*/Agent%20Guide/Content/GCP_Dataproc/GCP_Dataproc_Jobs_RA_Properties.htm","languages":["en-us"]},{"id":"ice_script_Dataproc_Job","title":"Setting Job Parameters through Scripts","type":"customize","url":"https://docs.automic.com/documentation/webhelp/english/ALL/components/IG_GCP_DATAPROC/*.*/Agent%20Guide/Content/GCP_Dataproc/GCP_Dataproc_Script.htm","languages":["en-us"]},{"id":"ice_related_information_Dataproc_Start","title":"Related Information","type":"customize","url":"https://docs.automic.com/documentation/webhelp/english/ALL/components/IG_GCP_DATAPROC/*.*/Agent%20Guide/Content/GCP_Dataproc/GCP_Dataproc_StartStopClusterJob.htm","languages":["en-us"]}]}

Automic Automation Start Or Stop Cluster jobs allow you to start and stop a cluster on your Dataproc environment from Automic Automation.

Defining Google Cloud Dataproc Start Or Stop Cluster Job Properties

On the Start Or Stop Cluster Job page, you define the parameters relevant to submit the cluster on Dataproc:

  • Connection

    Select the Dataproc Connection object containing the relevant information to connect to the application.

    To search for a Connection object, start typing its name to limit the list of the objects that match your input.

  • Project ID

    Enter the ID of the GCP project.

  • Location

    Enter the location (region) in which your data is stored and processed. For example: us-west1

  • Operation Type

    Enter the type of the operation you want to run:

    • Start

      Starts the cluster.

    • Stop

      Stops the cluster.

  • Cluster Name

    Allows you to type in or select the name of the cluster that you want to start or stop from the picker dialog.

Note:

The Pre-Process page allows you to define the settings of the Jobs using script statements. These statements are processed before the Dataproc Job is executed, see Setting Job Properties Through Scripts.

See also: