Automation Engine and Google Cloud Composer

The Google Cloud Composer is a workflow orchestration service that helps you design, schedule and monitor pipelines that spin hybrid and multi-cloud environments. Broadcom's Airflow Agent Integration establishes the connection between the Automation Engine and the Google Cloud Composer on which your Airflow DAG jobs run. The Airflow Agent starts the execution of these jobs and makes both their monitoring and the corresponding reporting possible.

Automic Automation Run DAG Jobs start and monitor Airflow DAGs on Google Cloud Composer environments. The Run DAG Job that you create in Automic Automation represents the Airflow DAG on the Google Cloud Composer, not its tasks. When you execute the Automic Automation Run DAG Job, you trigger a run of the Airflow DAG on the target Google Cloud Composer environment.

The Airflow Agent Integration documentation is available at https://docs.automic.com/documentation under Components > Cloud Integrations.

Notes:

  • This integration capability, like all integrations of the Automic system, can support service orchestration workflows. Such workflows orchestrate automated processes that run across multiple platforms, domains, and applications to deliver a specific IT service. For more information, see About Service Orchestration.

  • The release cycles of the Airflow Agent Integration are independent of the Automic Automation ones.