...
Software Requirements for Universal Template and Universal Task
Requires Python 3.7.0 or higher. Tested with the Universal Agent bundled Python distribution.
Software Requirements for Universal Agent
...
This Universal Task requires the the Resolvable Credentials feature. Check that the Resolvable Credentials Permitted system property has been set to true.
To import the Universal Template into your Controller, follow the instructions here.
When the files have been imported successfully, refresh the Universal Templates list; the Universal Template will appear on the list.
Modifications of this integration, applied by users or customers, before or after import, might affect the supportability of this integration. For more information refer to Integration Modifications.
Configure Universal Task
...
Example of Universal Task for getting information on Standalone Airflow Task instance. HTTPS Proxy , CA Bundle , SSL Verification are used.
Task Output
Output Only Fields
...
The Extension Output below refers to Trigger DAG Run (Standalone) task example.
| Panel |
|---|
|
...
The Extension Output below refers to Read Airflow Task Instance information task example.
| Panel |
|---|
{
"exit_code": 0,
"status_description": "SUCCESS: Successful Task Execution!",
"changed": false,
"invocation": {
"extension": "ue-airflow",
"version": "2.0.0",
"fields": {
"connect_to": "standalone_airflow_server",
"credentials_type_google": null,
"service_account_key": null,
"base_url": "http://airflow_url:8080/api/v1",
"credentials_user": "****",
"credentials_password": "****",
"use_ssl": true,
"ssl_verify": true,
"trusted_certificate_file": "****",
"ssl_hostname_check": false,
"private_key_certificate": null,
"public_key_certificate": null,
"use_proxy": true,
"proxies": "https://ue-proxy-dev-noauth-ssl.stonebranch.org:3128",
"action": "get_task_instance",
"dag_id": "example_bash_operator",
"dag_run_id": "manual__2023-02-09T15:42:00.467617+00:00",
"task_id": "run_this_last",
"wait_for_success_or_failure": false,
"polling_interval": 1,
"configuration_parameters": {
"conf": {}
},
"dag_run_id_output": null
}
},
"result": {
"dag_id": "example_bash_operator",
"duration": 0.0,
"end_date": "2023-01-10T09:26:55.661975+00:00",
"execution_date": "2023-01-09T14:16:48.856712+00:00",
"executor_config": "{}",
"hostname": "",
"max_tries": 0,
"operator": "DummyOperator",
"pid": null,
"pool": "default_pool",
"pool_slots": 1,
"priority_weight": 1,
"queue": "default",
"queued_when": null,
"sla_miss": null,
"start_date": "2023-01-10T09:26:55.661975+00:00",
"state": "upstream_failed",
"task_id": "run_this_last",
"try_number": 0,
"unixname": "****"
}
}
|
...
STDOUT and STDERR provide additional information to User. The populated content can be changed in future versions of this extension without notice. Backward compatibility is not guaranteed.
| Anchor | ||||
|---|---|---|---|---|
|
Integration Modifications
...
This document references the following documents.
| Document Link | Description |
|---|---|
| Universal Templates | User documentation for creating, working with and understanding Universal Templates and Integrations. |
| Universal Tasks | User documentation for creating Universal Tasks in the Universal Controller user interface. |
| Credentials | User documentation for creating and working with credentials. |
| Resolvable Credentials Permitted Property | User documentation for Resolvable Credentials Permitted Property. |
| Apache Airflow Documentation | User documentation for Apache Airflow. |
| Apache Airflow API Documentation | User Documentation for Airflow REST API. |
| Google Cloud Composer Airflow | User Documentation for Google Cloud Composer. |
Changelog
ue-airflow-2.0.0 (2023-02-24)
...