Amazon Elastic Kubernetes Service Jobs

Enhancements:
- Added: New environment variable UE_JOB_FINALIZATION_POLL_INTERVAL to configure the polling interval for job finalization checks.
- Added: New environment variable UE_RESOURCE_DEFINITION_LINK_GIT_PROVIDER to allow configuration of the Git provider used for retrieving Kubernetes job resource definitions.

Fixes
- Fixed: Improved handling of job finalization checks to ensure completion is detected accurately and prevent timeout errors.

Securely transfers files from, to and between AWS S3 cloud storage buckets and folders.

1.7.0

Enhancements:

- Feature: New Operation "Move" for Action: copy-object-to-bucket
- Feature: New "Upload Write Options": Always Timestamp
- Feature: New "Download Write Options": Always Timestamp

Send an AWS SQS message towards an existing queue.

Monitor AWS SQS messages from an existing queue and run job(s) and/or workflows accordingly.

Fixed: Excessive warning messages flooding the controller log.

Ansible: Execute and Manage Playbooks

Manage Ansible task execution through the Universal Controller user interface.

Integrate with Apache Airflow and use it as part of your end-to-end Universal Controller workflow, allowing high-level visibility and orchestration of data-oriented jobs or pipelines.

Enhancements:

- Added support for Google Cloud Composer Airflow
- Added support for passing JSON configuration parameters on "Trigger Dag Run" Action

Deprecations and Breaking Changes:

- Breaking Change: Stop supporting Universal Agent/Controller 7.0.0.0. Support Universal Agent/Controller 7.1.0 or higher

Enhancements:

- Upgraded kafka-python to version 2.1.6, bringing major enhancements in stability, performance, and compatibility, along with numerous bug fixes
- Improved log messages
- Added support for PLAIN mechanism under SASL authentication
- Added validation step after initializing a consumer, for improved stability and robustness
- Added environment variables for configuring Kafka connection and polling parameters
- Optimized the message retrieval logic for better efficiency
- Optimized the pipeline stages flow for better efficiency

Fixes

- Improved consumer shutdown handling to ensure tasks terminate gracefully without leaving open connections.
- Fixed bug where the last message was not committed when consuming multiple messages.

Enhancements

- Added: Update dependencies and code to utilize the native Confluent Python Library
- Added: Adding Authentication Mechanism with security_protocol: "SASL_SSL" and sasl_mechanism: "PLAIN"
- Added: More debug log messages

Breaking Changes

- Dropped compatibility for python 3.7 and therefore Universal Agent Version 7.5. Bundled libraries include C Bindings. Compatibility is set from Universal Agent Version 7.6 onwards.

AWS EC2: Create Instances

Create an EC2 instance with parameters, either in task form, or by simply creating an EC2 instance from the existing AWS launch template.

Added: support for attaching IAM roles when launching new instances.

Start, stop, terminate, and manage AWS EC2 instances on demand, simply by providing one or more instance IDs as input.

Enhancements

- Added : Assume Role functionality with "ARN Role" and "Role Session Name" fields for cross-account access
- Added : New "AWS Access Key Credentials" field to replace individual aws_access_key_id/aws_secret_access_key/aws_session_token fields
- Added : Built-in AWS Region Detection mechanism that automatically discovers region from:
1. Explicit field input (EC2 Region Location)
2. AWS_REGION environment variable
3. AWS_DEFAULT_REGION environment variable
- Added : Multi-source credential retrieval mechanism with priority order:
1. Explicit credentials via "AWS Access Key Credentials" field
2. Implicit credentials from environment variables (AWS_ACCESS_KEY_ID, AWS_SECRET_ACCESS_KEY, AWS_SESSION_TOKEN)
3. EC2 instance IAM role (when running on EC2 instance)

Fixes

- Fixed : More structured and detailed logging throughout execution
- Fixed : Better error messages for credential and region detection failures

In Amazon Elastic Container Service (AWS ECS), an ECS task is a running instance of a task definition. Tasks use case is ideal for one-time or short-lived jobs. For example:

• Batch Jobs: Suitable for batch processing, data transformations, and other workloads that complete after a certain period.

• Task Scheduling: Useful for scheduled tasks, such as cron jobs, where you need to run a task at specific intervals.

• Manual Execution: Good for tasks that you want to run on-demand or manually trigger through an event or user action.

This integration provides the capability to run ECS Tasks allowing the above use-cases to be fulfilled through UAC, where UAC has the role of an orchestrator.

Provides the capability to submit a new AWS Glue Job.

Extends other AWS services with custom logic or creates your own back-end services that operate at AWS scale, performance, and security.

Enhancements
- Changed: Updated the bundled Boto3 library which makes the integration compatible with more AWS environment variables like AWS_ENDPOINT_URL_STS

Fixes:
- Fixed: "Proxy Type" field incorrectly used. It is not required to be filled anymore by users on task definition and from this version onwards it is hidden and not used

Enhancements:

- JCL Files can be selected dynamically from UI.
- Support was added for Blu Age Batch jobs
- Engine Type (Micro Focus / Blu Age) is added to application names in order to provide visibility on their type

- Breaking Change: This version supports Universal Agent and Universal Controller from version 7.2 onwards. Customers that used older versions of this integration on Universal Controller and Universal Agent of versions <= 7.2 are required to upgrade to use the new functionality introduced by 2.0.0.
- Added: A suffix is added to the Execution Name before AWS Service is called. That suffix represents the execution count for a specific task instance, therefore providing uniqueness of the Execution Name.
- Fix: The Extension Output attribute “fields.invocation.execution_name” is corrected to represent the user input after the resolution of UC Functions and variables

Schedule, trigger, and monitor the Azure Data Factory pipeline process directly from Universal Controller.

Added:  install_if_missing function to install azure python packages if missing

Trigger and monitor the execution of Azure Logic workflows and retrieve the execution of Azure Logic workflow output.

Azure Synapse

Enhancements:
- Managed Identify has been added as additional Authentication method. It eliminates password and secret management, since Azure automatically handles credential issuance, rotation, and security.

Fixes:
- Whenever the Authentication Token expires, a new Authentication Token is automatically generated

Utilize Azure Virtual Machine (VM) name, resource group, subscription ID, and access token as inputs for the start, stop, terminate, list, and check status of Azure VMs.

Boomi is a cloud-based integration platform that enables businesses to connect applications, data, and systems seamlessly. The Boomi Universal Task allows you to securely execute an Integration Process in Boomi.

Corrected the API level to 1.6 (UC/UA 7.6)

Perform end-to-end Orchestration and Automation of Jobs & Clusters in Databricks environment, either in AWS or Azure.

Enhancements:
- Added: repair_job option to support repairing failed or incomplete jobs.
- Added: Support for Databricks multi-task run job outputs in Run Job.
- Added: repair parameter for run_now and run_submit functions to enable on-demand repair.
- Added: Enhanced Databricks job logging for improved observability and debugging.

Fixes:
- Fixed: Minor issues with Retry Interval and Max Retry configurations.
- Fixed: Refactored large functions into smaller, modular units to improve code quality, maintainability, and readability.

DBT Core CLI

Send and retrieve E-Mails and E-Mail attachments, as well as download mail attachments to a mail folder.

Perform server operations, such as importing/exporting Universal Automation Center objects and integrating with GitHub, as well as allowing the import/export of Universal Automation Center objects using the Universal Controller script library.

Schedule, trigger, monitor, and orchestrate the Google BigQuery process directly from Universal Controller.

Fixed: Usage for the Double quotes for the _scriptPath

Enhancements:
- Support for deploying CronJobs and Jobs from CronJobs.
- Support for deleting CronJobs.

Breaking Changes:
- Dropped support for Application Default Credentials Authentication Method.

IBM InfoSphere DataStage Jobs

Informatica Cloud is a cloud‑native data management platform that enables organizations to integrate, transform, and orchestrate data across on‑premises and multi‑cloud environments. This integration enables users to trigger and control Informatica Cloud Taskflows, Processes and Jobs from the Controller.

Note: This Integration replaces an older Integration called Informatica Cloud: Schedule Control, and Manage

Schedule Informatica PowerCenter Workflows and Tasks, including retrieval of the workflow and session log.

Enhancements:
- Bundled with latest Rclone release v1.71.0.

Enhancements:
- Bundled with Rclone v1.71.0.
- The Use Large Additional Options checkbox is introduced that, when enabled, replaces the Additional Options field with a large text field, increasing the character limit.
- Added more information in the Progress output field.

Fixes:
- Fixed time parsing issues on systems using different date formats.

Improves the functionality of Jenkins when orchestrated from Universal Controller.

Initial Release: Basic Functionality for Jira Service Management Cloud

Kubernetes List (Get), Create,  Delete and Replace Functions.

Enhancements
- Implement client-side detection of latest dataflow refresh record
- Change polling logic to use dataflow refresh initiation timestamp for tracking
- Implemented graceful cancellation.
- Improved python compatibility with future Agent versions

Fixes
- Fixed typo in logging output

Fixes:
-Fixed: Removed the pymSSQL package from the extension.
-Fixed: Template fix

Allows users to list and select the SSIS Folder, Project, Environment Reference, and SSIS Package while creating the job. It also can trigger the SSIS package execution in the Microsoft SQL server, monitor the SSIS Package execution, and fetch SSIS logs to Universal Controller when the SSIS package execution has completed.

Send messages to an existing channel of Microsoft Teams, allowing you to integrate this solution in UAC to notify users for UAC result or send approval notifications on Microsoft teams.

Notify PagerDuty (Incident management platform) in the event of job Failure or long run of a job or early finish of a job or any other event in Universal Controller.

- Fixed: Execution of oc fails when deployed on a path that includes spaces

- Fixed: Corrected Password handling during login phase.

Enhancements:
- Added: New environmental variable UE_JOB_FINALIZATION_POLL_INTERVAL to configure the polling interval for job finalization checks.

Fixes:
- Fixed: Improved handling of job finalization checks to ensure completion is detected accurately and prevent timeout errors.

Create contact and lead objects in Salesforce, as well as execute Salesforce Object Query Language (SOQL) queries.

Schedule Crystal Reports and Webi reports, supporting multiple prompts and different output formats such as PDF, EXCEL, and Webi.

Import the SAP Factory Calendar and the related Holiday Calendar into the Universal Controller.

Queries the SAP Event history table for a selected SAP Event & Parameter. If the Event is found, it gets confirmed, so that it is not triggered again. Optionally, a task can be launched based on the occurrence of an Event & Parameter.

Enhancements
- Added: Support Variables for all Credentials and SAP Connection
- Added: Support for Universal Controller SAP connections

Export SAP Job definitions from SAP into one flat file for each Job selected for extraction.

Detect, analyze, and respond to various events in real-time in the ServiceNow Platform.

Enhancements:
- Added support for all ServiceNow Event fields.

Changes:
- This integration is no longer importable on Universal Controller 7.2 or runnable on Agent version 7.2.

Sends job status notifications to a Slack channel and enables users to send interactive messages in Slack for Universal Controller manual task approvals.

Enhancements

- Introduced a new field name called Message (large textbox) for sending additional messages to slack channels as notifications
- Color codes in Slack messages for different UAC job status

Orchestrate, schedule, trigger, and monitor the Snowflake load and unload process from different data sources (cloud storage or local VM’s) directly from Universal Controller.

Addition of key pair Authentication

SQL: ODBC Task

Enhancements:
- Added an option to quote only non-null characters.
- Added a Large Text Field option when connecting via a connection string, allowing the use of large text fields instead of regular ones.
- Enabled supplying credential fields from the task’s database credential using annotations such as: {{ database_credentials.[user | password | passphrase | key_location | token] }}

Fixes:
- Output file paths and key_location paths are now always normalized at initialization.

Temenos (T24)

Temenos COB Monitor

Universal Extension allows sending SMS/WhatsApp/Voice message to a list of recipients.

Provides robust email monitoring using IMAP and Microsoft Graph. This integration allows you to monitor a mailbox for e-mails through filtering, do certain post-actions, and trigger Universal Events to trigger follow-up workflows or tasks

Fixed: Properly handle paths with weird/special characters on both platforms

Enhancements
- Supports a Controller with the "Task Field Resolution Required" system property enabled
- Virtual Resource priority can be specified for the launched Task

Deprecations and Breaking Changes:
- Breaking Change: Dropping support for Agents with version <= 7.5 and for Python 3.7.

Enhancements
- Added: Support for UDMG server version 3.
- Added: Environment variables UE_HTTP_TIMEOUT for setting up timeout for requests and UE_SSL_CERT_FILE for setting up the path to the CA bundle.

Fixes
- Fixed: Duplicate key deletion when encryption and signing use same fingerprint.

Fixes
- Fix issue where executing dynamic choice command for Selection Method = Workflow would fail with HTTP 400
- Fix issue where Git server rejected the pushed updates but extension returned success. Now returns failure and displays the error message.

Universal Task to Run Powershell Scripts.

Run Task or Workflow on a Remote Universal Controller.

UAC Utility: Run a Command/Script on a Remote SSH Server

Allows users to run a command or Stonebranch Universal Controller (UC) data script on a remote SSH server. It enables the execution of commands and scripts from the UC script library on a remote Unix/Linux or Windows SSH server

Fixes:

- Fixed: Invalid file format when copied to a different OS

- Fixed: incorrect version name printed from within the script was corrected

Run a Universal Controller report and deliver output to a specified server and file location.

Maintenance Changes:
- Refactored the extension.
- Documentation update: added compatibility with Python 3.11 with Universal Agent 7.6

Fixes:
- Fixed error "Partner Account: Field is required" when saving a task after selecting "Dynamic Retrieval of Partner Account Options" on Universal Controller 7.6

Deprecations and Breaking Changes
- Breaking Change: Dropping support for Agents with version <= 7.5 and for Python 3.7.

Enhancements
- Added: Support for UDMG server version 3.
- Added: Environment variables UE_HTTP_TIMEOUT for setting up timeout for requests and UE_SSL_CERT_FILE for setting up the path to the CA bundle.

Added: Support for large URLs.

Schedule, trigger, and monitor the UiPath (RPA) process directly from the Universal Controller.