Panel

Table of Contents

Universal Agent for Linux or Windows Version 7.02.0.0 or later are required.
The Universal Agent needs to be installed with python option (--python yes).

...

Universal Controller 7.02.0.0 . or later is required.

Software Requirements for the Application to be scheduled

...

The Amazon S3 Task provides multiple different file transfer actions. For each action the specific fields are described.

Create Bucket - Action

The Action Creates This action creates a new S3 bucket.

Field	Description
Action	create-bucket action
AWS_ACCESS_KEY_ID	AWS Account credentials Access Key
AWS_DEFAULT_REGION	AWS Account credentials Region
AWS_SECRET_ACCESS_KEY	AWS Account credentials Secret Access Key
Useproxy ( default is NO )	[NO \| YES] If set to YES, the fields to set-up the proxy server connections are displayed: Proxy Server IP or hostname Proxy Server Port Proxy Server Credentials (optional)
Loglevel ( default is INFO )	Universal Task logging settings [DEBUG \| INFO\| WARNING \| ERROR \| CRITICAL]
Role Based Access	[NO \| YES] If set to YES, the fields to set-up the IAM Role Based Access Connection are displayed: Role Arn: Amazon Role, which is applied for the connection; for example, rn:aws:iam::111222333444:role/SB-AWSS3 Service Name [STS \| S3 ] , default is STS STS: AWS Security Token Service is used to create and provide trusted users with temporary security credentials that can control access to your AWS resources.
Endpoint URL	Only used in case of a MinIO server; connection Endpoint URL for the MinIO storage system
Bucket	Name of the AWS Bucket to create

Example for AWS S3 Universal Tasks - Create Bucket

List Buckets - Action

The Action list This action lists all buckets of an AWS Account.

...

Example for Amazon S3 Universal Tasks - List Buckets

Upload File - Action

The Action This action is used to upload a single or multiple files from a Windows or Linux server to an AWS bucket or a folder in an AWS bucket.

Field	Description
Action	Upload-file action
AWS_ACCESS_KEY_ID	AWS Account credentials Access Key
AWS_DEFAULT_REGION	AWS Account credentials Region
AWS_SECRET_ACCESS_KEY	AWS Account credentials Secret Access Key
Useproxy ( default is NO )	[NO \| YES] If set to YES, the fields to set-up the proxy server connections are displayed: Proxy Server IP or hostname Proxy Server Port Proxy Server Credentials (optional)
Loglevel ( default is INFO )	Universal Task logging settings [DEBUG \| INFO\| WARNING \| ERROR \| CRITICAL]
Role Based Access	[NO \| YES] If set to YES, the fields to set-up the IAM Role Based Access Connection are displayed: Role Arn: Amazon Role, which is applied for the connection e.g. rn:aws:iam::111222333444:role/SB-AWSS3 Service Name [STS \| S3 ] , default is STS STS: AWS Security Token Service is used to create and provide trusted users with temporary security credentials that can control access to your AWS resources.
ACL	bucket-owner-full-control \| private \| public-read \| public-read-write \| aws-exec-read \| authenticated-read \| bucket-owner-read \| log-delivery-write AWS canned ACLs; for details, refer to: AWS canned ACL The default ACL bucket-owner-full-control grant full access to the bucket owner.
Endpoint URL	Only used in case of a MinIO server; connection Endpoint URL for the MinIO storage
Sourcefile	Source file(s) to be uploaded to a bucket or specific folder in a bucket. Unix filename pattern are supported to upload a selection of files. Supported wildcards are: ? matches any single character [seq] matches any character in seq [!seq] matches any character not in seq ”*” matches everything
Operation	[copy \| move] In case of a “move” the source file(s) is/are deleted after the upload to the bucket.
Prefix	A folder in a bucket is called prefix in AWS. In the field Prefix only the name of the folder needs to be provided no “/” after the folder name.
Upload Write Options	Upload Write Options [Replace existing Object \| Do not overwrite existing Object \| Timestamp] Replace existing Object: Overwrite an existing object Do not overwrite existing Object: Cancel the operations in case an object with a similar name exists Timestamp: Add a timestamp to the uploaded Object

Example for Amazon S3 Universal Tasks - Upload File

List Objects - Action

The Action This action is used to display objects in a bucket or a specific bucket folder (prefix).

...

Download File - Action

This Action downloads is used to download one or multiple files from a bucket to a Linux or Windows folder.

Field	Description
Action	Download-file action
AWS_ACCESS_KEY_ID	AWS Account credentials Access Key
AWS_DEFAULT_REGION	AWS Account credentials Region
AWS_SECRET_ACCESS_KEY	AWS Account credentials Secret Access Key
Useproxy ( default is NO )	[NO \| YES] If set to YES, the fields to set-up the proxy server connections are displayed: Proxy Server IP or hostname Proxy Server Port Proxy Server Credentials (optional)
Loglevel ( default is INFO )	Universal Task logging settings [DEBUG \| INFO\| WARNING \| ERROR \| CRITICAL]
Role Based Access	[NO \| YES] If set to YES, the fields to set-up the IAM Role Based Access Connection are displayed: Role Arn: Amazon Role, which is applied for the connection e.g. rn:aws:iam::111222333444:role/SB-AWSS3 Service Name [STS \| S3 ] , default is STS STS: AWS Security Token Service is used to create and provide trusted users with temporary security credentials that can control access to your AWS resources.
Endpoint URL	Only used in case of a MinIO server; connection Endpoint URL for the MinIO storage system
Target Directory	Linux or Windows Target Directory For example, C:\tmp\ or /home/ubuntu/download Unix filename pattern are supported to download a selection of files. Supported wildcards are: ? matches any single character [seq] matches any character in seq [!seq] matches any character not in seq ”*” matches everything
Operation	[copy \| move] In case of a “move” the objects are deleted after they have been download from the bucket.
Download Write Options	Download Write Options: [Replace existing File \| Do not overwrite existing File \| Timestamp \| Default Windows behaviour] Replace existing File : overwrite an existing file Do not overwrite existing File: cancel the operations in case a File with a similar name exists Timestamp: add a timestamp to the uploaded file Default Windows behaviour: perform the default Windows behaviour for copying files. If a file with a similar name exists, the file names that are similar will be edited so that the files you copied have a number appended at the end of them. For example, if you’re copying a file named image.png to a folder that already has a file named image.png in it, the copied file will be named image (1).png.

Example for Amazon S3 Universal Tasks - Download File

Delete Objects - Action

The Actions This action is used to delete an object in a bucket or folder.

...

Copy Object to Bucket - Action

This Action action is used to copy a single or multiple objects from one bucket to another bucket in AWS.

Field

Description

Action

Copy-object-to-bucket action

AWS_ACCESS_KEY_ID

AWS Account credentials Access Key

AWS_DEFAULT_REGION

AWS Account credentials Region

AWS_SECRET_ACCESS_KEY

AWS Account credentials Secret Access Key

Useproxy ( default is NO )

[NO | YES]

If set to YES, the fields to set-up the proxy server connections are displayed:

Proxy Server IP or hostname
Proxy Server Port
Proxy Server Credentials (optional)

Loglevel ( default is INFO )

Universal Task logging settings [DEBUG | INFO| WARNING | ERROR | CRITICAL]

Role Based Access

[NO | YES]

If set to YES, the fields to set-up the IAM Role Based Access Connection are displayed:

Role Arn: Amazon Role, which is applied for the connection e.g. rn:aws:iam::111222333444:role/SB-AWSS3
Service Name [STS | S3 ] , default is STS

STS: AWS Security Token Service is used to create and provide trusted users with temporary security credentials that can control access to your AWS resources.

ACL

AWS canned ACLs; for details, refer to:

AWS canned ACL

The default ACL bucket-owner-full-control grant full access to the bucket owner.

Endpoint URL

Only used in case of a MinIO server; connection Endpoint URL for the MinIO storage system

Bucket

AWS bucket name

Target Bucket

target Bucket, where the object(s) will be copied to

S3key

File to be copied from one bucket to another

TargetS3Key

Target file name.

The TargetS3key supports pattern match. For example:

Bucket: stonebranchpm

Target Bucket: stonebranchpm1

S3key: dir1/report* ;

Target s3key: dir2/*

This copies all files from bucket stonebranchpm in the directory dir1 starting with the file name report to the directory dir2/ in the bucket stonebranchpm1.

Note

title	Note

If the field TargetS3key is left blank, the entire source key - including the directory - will be copied to the target bucket. For example:

Bucket: stonebranchpm

Target Bucket: stonebranchpm1

S3key: dir1/report* ;

Target s3key:

This copies dir1/report* from bucket stonebranchpm to the bucket stonebranchpm1

Note

title	ATTENTION

Do not use a non-pattern match Target S3key when the S3key uses pattern match. For example:

Bucket: stonebranchpm

Target Bucket: stonebranchpm1

S3key: dir1/report* ;

Target s3key: dir2/report1.txt

This set-up will copy only one file, even if multiple files will match the S3Key in the source.

Upload Write Options

[Replace existing Object | Do not overwrite existing Object | Timestamp]

Replace existing Object: Overwrite an existing object
Do not overwrite existing Object: Cancel the operations in case an object with a similar name exists
Timestamp: Add a timestamp to the uploaded Object

...

This action is used to delete a bucket.

Field	Description
Action	Delete-bucket action
AWS_ACCESS_KEY_ID	AWS Account credentials Access Key
AWS_DEFAULT_REGION	AWS Account credentials Region
AWS_SECRET_ACCESS_KEY	AWS Account credentials Secret Access Key
Useproxy ( default is NO )	[NO \| YES] If set to YES, the fields to set-up the proxy server connections are displayed: Proxy Server IP or hostname Proxy Server Port Proxy Server Credentials (optional)
Loglevel ( default is INFO )	Universal Task logging settings [DEBUG \| INFO\| WARNING \| ERROR \| CRITICAL]
Role Based Access	[NO \| YES] If set to YES, the fields to set-up the IAM Role Based Access Connection are displayed: Role Arn: Amazon Role, which is applied for the connection e.g. rn:aws:iam::111222333444:role/SB-AWSS3 Service Name [STS \| S3 ] , default is STS STS: AWS Security Token Service is used to create and provide trusted users with temporary security credentials that can control access to your AWS resources.
Endpoint URL	Only used in case of a MinIO server; connection Endpoint URL for the MinIO storage system
Bucket	Name of the bucket to be deleted

...

Anchor

	Changelog
	Changelog

Changelog

ut-cs-aws-s3-1.5.25 (2024-05-09)

Enhancements

Proxy setting for https adjusted to support python 3.11

ut-cs-aws-s3-1.0.0

Initial Version

...

Versions Compared

Old Version 18

New Version Current

Key

Software Requirements for the Application to be scheduled

Create Bucket - Action

Example for AWS S3 Universal Tasks - Create Bucket

List Buckets - Action

Example for Amazon S3 Universal Tasks - List Buckets

Upload File - Action

Example for Amazon S3 Universal Tasks - Upload File

List Objects - Action

Download File - Action

Example for Amazon S3 Universal Tasks - Download File

Delete Objects - Action

Copy Object to Bucket - Action

Changelog

ut-cs-aws-s3-1.5.25 (2024-05-09)

Enhancements

ut-cs-aws-s3-1.0.0

Page Comparison

Versions Compared

Old Version 18

New Version Current

Key

Software Requirements for the Application to be scheduled

Create Bucket - Action

Example for AWS S3 Universal Tasks - Create Bucket

List Buckets - Action

Example for Amazon S3 Universal Tasks - List Buckets

Upload File - Action

Example for Amazon S3 Universal Tasks - Upload File

List Objects - Action

Download File - Action

Example for Amazon S3 Universal Tasks - Download File

Delete Objects - Action

Copy Object to Bucket - Action

Changelog

ut-cs-aws-s3-1.5.25 (2024-05-09)

Enhancements

ut-cs-aws-s3-1.0.0