Integrations

Search Integrations

Available Integrations

The following table identifies the Integrations that are available for Universal Controller.

The Name of each Integration is a link to a separate page containing detailed information about that Integration.

Name

Description

Latest Version

Release Date
(YY/MM/DD)

What's New

Name

Description

Latest Version

Release Date
(YY/MM/DD)

What's New

Amazon Bedrock

Provides native support for AWS Bedrock foundation models, enabling AI model invocation with customizable prompts and inference parameters.

1.0.0

26/02/12

Initial Version

Amazon Elastic Kubernetes Service Jobs

Trigger, control, and manage Kubernetes Jobs and CronJobs on a specified EKS cluster

1.2.0

26/01/22

Enhancements:

  • Added: Improved compatibility with future agent releases.

  • Added: Improved packaging logic which reduces extension file size.

Fixes:

  • Fixed: Issue where environment variables were not being sent during dynamic choice and dynamic command execution.

Amazon S3: Cloud Storage Bucket File Transfer

Securely transfers files from, to and between AWS S3 cloud storage buckets and folders.

1.7.0

25/02/27

Enhancements:

  • Feature: New Operation "Move" for Action: copy-object-to-bucket

  • Feature: New "Upload Write Options": Always Timestamp

  • Feature: New "Download Write Options": Always Timestamp

Amazon SQS: Message

Send an AWS SQS message towards an existing queue.

1.1.1

23/08/09

Fixed: Field 'Proxy Type' raised a data validation error on Controller 7.3.0.0 and later.

Amazon SQS: Monitor

Monitor AWS SQS messages from an existing queue and run job(s) and/or workflows accordingly.

1.1.2

25/03/20

Fixed: Excessive warning messages flooding the controller log.

Ansible: Execute and Manage Playbooks

Manage Ansible task execution through the Universal Controller user interface.

1.1.2

 

 

Apache Airflow

Integrate with Apache Airflow and use it as part of your end-to-end Universal Controller workflow, allowing high-level visibility and orchestration of data-oriented jobs or pipelines.

2.0.0

23/02/04

Enhancements:

  • Added support for Google Cloud Composer Airflow

  • Added support for passing JSON configuration parameters on "Trigger Dag Run" Action

Deprecations and Breaking Changes:

  • Breaking Change: Stop supporting Universal Agent/Controller 7.0.0.0. Support Universal Agent/Controller 7.1.0 or higher

Apache Kafka: Event Monitor

Monitor events (messages) from topics in Kafka.

1.2.0

25/11/13

Enhancements:

  • Upgraded kafka-python to version 2.1.6, bringing major enhancements in stability, performance, and compatibility, along with numerous bug fixes

  • Improved log messages

  • Added support for PLAIN mechanism under SASL authentication

  • Added validation step after initializing a consumer, for improved stability and robustness

  • Added environment variables for configuring Kafka connection and polling parameters

  • Optimized the message retrieval logic for better efficiency

  • Optimized the pipeline stages flow for better efficiency

Fixes

  • Improved consumer shutdown handling to ensure tasks terminate gracefully without leaving open connections.

  • Fixed bug where the last message was not committed when consuming multiple messages.

Apache Kafka: Publish Event

Publish events (messages) to topics in Kafka.

2.0.0

25/08/01

Enhancements

  • Added: Update dependencies and code to utilize the native Confluent Python Library

  • Added: Adding Authentication Mechanism with security_protocol: "SASL_SSL" and sasl_mechanism: "PLAIN"

  • Added: More debug log messages

Breaking Changes

  • Dropped compatibility for python 3.7 and therefore Universal Agent Version 7.5. Bundled libraries include C Bindings. Compatibility is set from Universal Agent Version 7.6 onwards.

AWS Batch

Submit new AWS Batch Jobs as well as read the status for an existing AWS Batch Job.

1.3.1

24/02/01

Fixed: Revert `certifi` as requirement.

AWS CLI

Start running commands that implement functionality equivalent to that provided by the browser-based AWS Management Console from the command prompt in your terminal program.

1.0.0

24/04/10

Initial Version

AWS EC2: Create Instances

Create an EC2 instance with parameters, either in task form, or by simply creating an EC2 instance from the existing AWS launch template.

1.2.0

25/10/27

Added: support for attaching IAM roles when launching new instances.

AWS EC2: Start, Stop, and Terminate Instances

Start, stop, terminate, and manage AWS EC2 instances on demand, simply by providing one or more instance IDs as input.

2.0.1

26/03/12

Fixed: Fix template name issue causing Job As Code error on Windows

AWS ECS

In Amazon Elastic Container Service (AWS ECS), an ECS task is a running instance of a task definition. Tasks use case is ideal for one-time or short-lived jobs. For example:

  • Batch Jobs: Suitable for batch processing, data transformations, and other workloads that complete after a certain period.

  • Task Scheduling: Useful for scheduled tasks, such as cron jobs, where you need to run a task at specific intervals.

  • Manual Execution: Good for tasks that you want to run on-demand or manually trigger through an event or user action.

This integration provides the capability to run ECS Tasks allowing the above use-cases to be fulfilled through UAC, where UAC has the role of an orchestrator.

1.0.0

24/08/14

Initial Version

AWS EMR

This integration provides the ability the start and optionally monitor (by polling at specified intervals) notebook executions as supported by AWS EMR. Additionally the user can optionally specify various configuration options relating to the notebook execution.

1.0.0

24/06/06

Initial Version

AWS Glue

Provides the capability to submit a new AWS Glue Job.

2.1.0

24/08/29

  • Added new field - Endpoint URL.

  • Proxy Type field has been removed (hidden) as it no longer needs to be filled by users on task definition.

AWS Lambda

Extends other AWS services with custom logic or creates your own back-end services that operate at AWS scale, performance, and security.

1.3.0

25/08/14

Enhancements

  • Changed: Updated the bundled Boto3 library which makes the integration compatible with more AWS environment variables like AWS_ENDPOINT_URL_STS

Fixes:

  • Fixed: "Proxy Type" field incorrectly used. It is not required to be filled anymore by users on task definition and from this version onwards it is hidden and not used

AWS Mainframe Modernization

Allows migrating and modernizing on-premises mainframe workloads to a managed runtime environment on AWS.

1.4.0

23/02/14

Enhancements:

  • JCL Files can be selected dynamically from UI.

  • Support was added for Blu Age Batch jobs

  • Engine Type (Micro Focus / Blu Age) is added to application names in order to provide visibility on their type

AWS Step Functions

Execute AWS Step Functions from Universal Controller

2.0.0

23/09/01

  • Breaking Change: This version supports Universal Agent and Universal Controller from version 7.2 onwards. Customers that used older versions of this integration on Universal Controller and Universal Agent of versions <= 7.2 are required to upgrade to use the new functionality introduced by 2.0.0.

  • Added: A suffix is added to the Execution Name before AWS Service is called. That suffix represents the execution count for a specific task instance, therefore providing uniqueness of the Execution Name.

  • Fix: The Extension Output attribute “fields.invocation.execution_name” is corrected to represent the user input after the resolution of UC Functions and variables

Azure AZ CLI

The Azure command-line interface (Azure CLI) is a set of commands used to create and manage Azure resources.

1.0.0

23/02/10

Initial Version

Azure Batch 

Provides the capability to add Azure Jobs, add Azure Batch Tasks to existing Azure Jobs, and optionally monitor Azure Task execution for completion (successful or failed).

1.0.0

23/03/20

Initial Version

Azure Blob: Manage File Transfers

Securely transfers files from, to and between Azure Blob Storage container and folders.

1.5.0

25/10/27

Added support for Service principal authentication (in addition to Shared Access Signatures (SAS) and Azure Account Keys)

Azure Data Factory: Schedule, Trigger, and Monitor

Schedule, trigger, and monitor the Azure Data Factory pipeline process directly from Universal Controller.

1.2.0

25/10/30

Added: Authenticate ADF via Certificate

Added:  install_if_missing function to install azure python packages if missing

 

Azure Kubernetes Service Jobs

Define, deploy, and delete AKS Jobs and CronJobs on a specified Azure-powered Kubernetes cluster directly from UAC.

1.1.0

26/01/22

Enhancements:

  • Added: Improved compatibility with future agent releases.

  • Added: New environment variable UE_JOB_FINALIZATION_POLL_INTERVAL to configure the polling interval for job finalization checks.

  • Added: New environment variable UE_RESOURCE_DEFINITION_LINK_GIT_PROVIDER to allow configuration of the Git provider used for retrieving Kubernetes job resource definitions).

Fixes:

  • Fixed: Issue where environment variables were not being sent during dynamic choice and dynamic command execution.

  • Fixed: Improved handling of job finalization checks to ensure completion is detected accurately and prevent timeout errors.

Azure Logic Apps: Schedule, Trigger, and Monitor Workflows

Trigger and monitor the execution of Azure Logic workflows and retrieve the execution of Azure Logic workflow output.

 

 

 

Azure OpenAI

The Azure OpenAI Integration brings the power of enterprise-grade large language models into your UAC workflows, enabling intelligent automation that can understand, generate, and transform content.

1.1.0

26/01/22

Enhancements:

  • Added: Improving Python compatibility with future Agent versions.

  • Added: Importable configuration examples.

Azure Synapse

Run, monitor, and re-start Azure Synapse Pipelines from the Universal Automation Center.

1.3.0

26/01/08

Enhancements:

  • Managed Identify has been added as additional Authentication method. It eliminates password and secret management, since Azure automatically handles credential issuance, rotation, and security.

Fixes:

  • Whenever the Authentication Token expires, a new Authentication Token is automatically generated

Azure Virtual Machines: Start, Stop, and Terminate Instances

Utilize Azure Virtual Machine (VM) name, resource group, subscription ID, and access token as inputs for the start, stop, terminate, list, and check status of Azure VMs.

 

 

 

Batchman Integration

The Universal Task for BatchMan provides an integration between Universal Automation Center (UAC) and Honico BatchMan, enabling unified scheduling, automated job and net execution, and centralized monitoring of Honico BatchMan jobs within Universal Automation Center.

1.0.0

25/12/19

Initial Version

Beta UX

Send Task Instance logs into Beta LogX, enabling automated collection, processing, and enterprise-wide availability of job logs.

1.1.0

25/10/02

Added Backlog processing

Boomi

Boomi is a cloud-based integration platform that enables businesses to connect applications, data, and systems seamlessly. The Boomi Universal Task allows you to securely execute an Integration Process in Boomi.

1.0.1

25/04/16

Corrected the API level to 1.6 (UC/UA 7.6)

Databricks: Automate Jobs and Clusters

Perform end-to-end Orchestration and Automation of Jobs & Clusters in Databricks environment, either in AWS or Azure.

1.4.0

25/10/09

Enhancements:

  • Added: repair_job option to support repairing failed or incomplete jobs.

  • Added: Support for Databricks multi-task run job outputs in Run Job.

  • Added: repair parameter for run_now and run_submit functions to enable on-demand repair.

  • Added: Enhanced Databricks job logging for improved observability and debugging.

Fixes:

  • Fixed: Minor issues with Retry Interval and Max Retry configurations.

  • Fixed: Refactored large functions into smaller, modular units to improve code quality, maintainability, and readability.

dbt Cloud Jobs

Trigger dbt Cloud jobs by making API requests to the dbt Cloud API endpoint with appropriate authentication, enabling automated execution of your data transformation workflows based on your orchestration requirements.

1.0.1

25/11/07

Fixed: Issue where job fetching did not support pagination, which could cause incomplete data retrieval for large job sets.

DBT Core CLI

Manage and transform data in a reliable and scalable manner.

1.0.1

23/10/18

Fixed: Include integration icon on Universal Template

Docker Compose: Support to Build, Up, Down, Start, Stop Docker Compose Functions

Universal Task for Docker Compose Functions, Build, Up, Down, Start, Stop Functions.

1.0.1

 

 

Docker Container: Support for Create, Start, Stop, Remove Containers and Run a Command in a Running Container

Universal Task to manage Docker Containers, Run, Create, Start, Stop and Remove Functions.

 

 

 

Docker Image: Support to Build, Remove, Pull, Push and Tag Image Functions

Universal Task to manage Docker Images, Build, Remove, Pull, Push, and Tag Functions.

 

 

 

Dynatrace Observability for UAC

The Dynatrace Extension for the Universal Controller enables Dynatrace users to scrape the metrics located on the Universal Controller using Dynatrace’s ActiveGate. Additionally, traces and logs will be ingested by the Dynatrace OneAgent, using the new http/protobuf protocol available in UAC 7.9.

1.0.0

25/10/02

Initial Version

E-Mail: SMTP and IMAP Integration

Send and retrieve E-Mails and E-Mail attachments, as well as download mail attachments to a mail folder.

 

 

This integration has been sunset and replaced by UAC Utility: Email and UAC Utility: Email Monitor.

Fivetran

Fivetran is a cloud-based data integration platform that helps businesses automate the process of extracting data from various sources, transforming it, and loading it into a data warehouse for analysis.

1.0.1

23/10/18

Fixed: Execute the integration with a Python installation, other than the Agent-bundled one

Git

Git is a free and open source distributed version control system designed to handle everything from small to very large projects with speed and efficiency.

1.1.0

 

 

GitHub: Automated Import/Export

Perform server operations, such as importing/exporting Universal Automation Center objects and integrating with GitHub, as well as allowing the import/export of Universal Automation Center objects using the Universal Controller script library.

1.1.25

23/04/06

 

Google BigQuery: Schedule, Trigger, Monitor, and Orchestrate Operations

Schedule, trigger, monitor, and orchestrate the Google BigQuery process directly from Universal Controller.

1.1.4

24/08/08

Fixed: Usage for the Double quotes for the _scriptPath

Google Kubernetes Engine Jobs

This integration provides the capability to deploy a GKE Job on a specified cluster or delete a Job from a namespace.

2.1.0

26/01/22

Enhancements:

  • Added: New environment variable to configure the polling interval for job finalization checks.

  • Added: New environment variable to allow configuration of the Git provider used for retrieving Kubernetes job resource definitions.

  • Added: Improved compatibility with future agent releases.

Fixes:

  • Fixed: Improved handling of job finalization checks to ensure completion is detected accurately and prevent timeout errors.

  • Fixed: Issue where environment variables were not being sent during dynamic choice and dynamic command execution.

Google Vertex AI

The Google Vertex AI Integration brings the power of enterprise-grade large language models into your UAC workflows, enabling intelligent automation that can understand, generate, and transform content.

1.0.0

26/02/12

Initial Version

Guidewire Batch

Fetch Batch processes from Guidewire to UAC, run a Batch job by Batch process name, and terminate batch process by name

1.3.2

26/02/24

Initial Version

HashiCorp: Terraform

An infrastructure as code tool that lets you define both cloud and on-prem resources in human-readable configuration files that you can version, reuse, and share. You can then use a consistent workflow to provision and manage all of your infrastructure throughout its lifecycle.

1.0.1

22/07/19

Fixed: Credentials can now be passed from Credential field to the variable script.

Hitachi Vantara: Pentaho Data Integration

Provides powerful ETL (Extract, Transform and Load) capabilities. Universal Controller is integrated to orchestrate the jobs and transformations within Pentaho Data Integration platform via Carte webservice calls.

 

 

 

IBM InfoSphere DataStage Jobs

Allows users to schedule, trigger, monitor, and orchestrate the InfoSphere DataStage jobs directly from Universal Controller via the InfoSphere DataStage Command-line Interface (CLI). It also helps to set up dependencies between DataStage jobs and other applications or platforms using UAC workflows and trigger DataStage Jobs from UAC either time-based or event-based.

1.0.0

23/07/28