Google Cloud BigQuery Jobs: Run Transfer Configurations

{"URL":["/*.*/awa/pa_view_pa_view_JOB_bigquery"],"heroDescriptionIdentifier":"ice_hero_BigQuery_Run_Transfer_Configurations_Job","customCards":[{"id":"ice_specific_BigQuery_Run_Transfer_Configurations_Job","title":"Run Transfer Configurations Job Parameters","type":"customize","url":"https://docs.automic.com/documentation/webhelp/english/ALL/components/IG_GCP_BIGQUERY/*.*/Agent%20Guide/Content/GCP_BigQuery/GCP_BQ_Jobs_RunTransferConfiguration.htm","languages":["en-us"]},{"id":"ice_RA_Integration_Report","title":"Defining RA / Integration Reports","type":"customize","url":"https://docs.automic.com/documentation/webhelp/english/ALL/components/IG_GCP_BIGQUERY/*.*/Agent%20Guide/Content/GCP_BigQuery/GCP_BQ_Jobs_RA_Properties.htm","languages":["en-us"]},{"id":"ice_script_BigQuery_Run_Transfer_Configurations_Job","title":"Setting Run Transfer Configurations Job Parameters through Scripts","type":"customize","url":"https://docs.automic.com/documentation/webhelp/english/ALL/components/IG_GCP_BIGQUERY/*.*/Agent%20Guide/Content/GCP_BigQuery/GCP_BQ_Script.htm","languages":["en-us"]},{"id":"ice_related_information_BigQuery_Run_Transfer_Configurations_Job","title":"Related Information","type":"customize","url":"https://docs.automic.com/documentation/webhelp/english/ALL/components/IG_GCP_BIGQUERY/*.*/Agent%20Guide/Content/GCP_BigQuery/GCP_BQ_Jobs_RunTransferConfiguration.htm","languages":["en-us"]}]}

Once you have configured a data transfer, the BigQuery Data Transfer Service automatically loads data into BigQuery on a regular basis.

Run Transfer Configuration jobs allow you to start a transfer configuration pipeline and monitor its status to load data into your BigQuery system from Automic Automation.

This page includes the following:

Defining Google Cloud BigQuery Run Transfer Configuration Job Properties

On the Run Transfer Configuration Job page, you define the parameters relevant to start the transfer configuration on BigQuery:

  • Connection

    Select the BigQuery Connection object containing the relevant information to connect to the application.

    To search for a Connection object, start typing its name to limit the list of the objects that match your input.

  • Project ID

    Enter the ID of the GCP project containing the relevant transfer configuration.

  • Location

    Enter the location (region) in which your data is stored and processed. For example: us-west1

  • Transfer Config Name

    Enter the name of the Transfer Configuration that you want to run.

    You can click the browse button to the right of the field to open a picker dialog with all the Transfer Configurations available and select the relevant one.

  • Get Trace Logs

    Allows you to select when to get trace logs:

    • On error only (default)

      A trace log is only written if the job fails.

      Note:

      If the job cannot start successfully, for example due to incorrect JSON payload parameters, no log can be written.

    • Always

      A trace log is always written, regardless of the job status.

      Note:

      Enabling this parameter may increase the job's runtime.

See also: