Defining Azure Blob Storage Copy Job Properties

{"URL":["/*.*/awa/pa_view_pa_view_COPY_blob"],"heroDescriptionIdentifier":"ice_hero_copy_job_blob","customCards":[{"id":"ice_specific_Blob_Copy_Job","title":"Adding Copy Job Parameters","type":"customize","url":"https://docs.automic.com/documentation/webhelp/english/ALL/components/IG_BLOB/*.*/Agent%20Guide/Content/Azure_Blob/Azure_Blob_Jobs_Copy.htm","languages":["en-us"]},{"id":"ice_RA_Integration_Report","title":"RA / Integration Reports","type":"customize","url":"https://docs.automic.com/documentation/webhelp/english/ALL/components/IG_BLOB/*.*/Agent%20Guide/Content/Azure_Blob/Azure_Blob_Jobs_RA_Properties.htm","languages":["en-us"]},{"id":"ice_Copy_Job_script_Blob","title":"Setting Copy Job Properties through Scripts","type":"customize","url":"https://docs.automic.com/documentation/webhelp/english/ALL/components/IG_BLOB/*.*/Agent%20Guide/Content/Azure_Blob/Azure_Blob_Script.htm","languages":["en-us"]},{"id":"ice_related_information_Blob_Copy_Job","title":"Related Information","type":"customize","url":"https://docs.automic.com/documentation/webhelp/english/ALL/components/IG_BLOB/*.*/Agent%20Guide/Content/Azure_Blob/Azure_Blob_Jobs_Copy.htm","languages":["en-us"]}]}

The Azure Blob Storage Copy Job allows you to copy a blob from one container to another container in your Azure Blob Storage environment. If the file already exists in the destination container that you have specified, the file is overwritten. If the destination folder does not exist, the system creates it and copies the file into that destination.

On the Copy Job page you define the parameters relevant to run that job on the Azure Blob Storage system from Automic Automation.

Note:

Some fields allow you to open a picker dialog from where you can select the file and the container. By default, only 200 entries are displayed. If the relevant file or container is not displayed among those 200, please type in the relevant name on the Search field to narrow down the list.

  • Connection

    Connection object that has the relevant information to connect to the Azure Blob Storage environment. To search for a Connection object, start typing its name to limit the list of the objects that match your input.

  • Source Container

    Azure Blob Storage container where the blob that you want to copy is located. You can click the browse button to the right of the field to open a picker dialog with all the available containers. The original blob remains in the container. The job fails if the source container does not exist.

  • Source Blob Directory

    The source directory from where you want to copy the files to the blob container. The file path can be a folder path or a complete file path. For example: testFolder/

    Note: If you want to give a directory as input, you must use a slash (/) character. For example: testFolder/ or test/testDirectory/.

  • File Filters

    (Optional) Provide a regular expression for filtering the files for copying. For example, define hdfs.* if you want to copy only files with any file ending. If kept empty, all the files defined inside the Source File Path are copied. The files in sub-directories are not copied.

  • Destination Container

    Azure Blob Storage container to which you want the blob to be copied. You can click the browse button to the right of the field to open a picker dialog where you can select the relevant name. The job fails if the destination container does not exist.

  • Target Directory

    (Optional) Provide the target directory name or the destination path to where the files should be copied from the source container.

  • Destination Blob Name

    Name that the copied blob should have in the destination container. If you leave this field empty, the name in the Source Blob Name field will be used.

    Note:

    In case multiple files are found matching the filter criteria and the Destination Blob Name is provided, the job fails. The following exception message might display:

    More than one matched files found to copy. Please remove Destination Blob Name.

Note:

The Pre-Process page allows you to define the settings of all Azure Blob Storage jobs using script statements. These statements are processed before the Schedule Job is executed, see Setting Azure Blob Storage Job Properties Through Scripts.

  • Enable Overwrite

    (Optional) This box is checked by default, so existing files are overwritten in the target directory. This option helps you save costs because no check is required if particular files are already available. If you uncheck this box and there are existing files, the job will fail without uploading any files. The report (REP) shows the details of uploaded and overwritten files.

  • Delete Source File After Copy

    Check this box to have the source files deleted after they were copied.

  • Retry Timeout

    (Optional) The retry timeout defines the minutes and how long the job should retry to upload the files before failing in case of server-side issues.

    • 0 (default)
      There is no timeout; the job tries to upload the files until you cancel it manually on the Automic Automation side.

    • Greater than 0

      If you define a positive value here, the job tries to upload the files for the specified number of minutes and will fail afterwards. If you cancel the job within the defined number of minutes, it will also fail.

    • Less than 0

      If you define a negative value here, the job fails immediately without retrying.

See also: