Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.


Panel

Table of Contents

...

Software Requirements for Universal Template and Universal Task

Requires Python 3.7.0 or higher. Tested with the Universal Agent bundled Python distribution.

...

When the task instance is canceled on the Controller, a cancel command is issued on the UDMG transfer to attempt a graceful termination.

  • If the transfer has no children (PUT, GET, LIST action):

    • Fetch the UDMG transfer status and update the output-only fields.

    • Proceed to cancel the UDMG transfer only when its status is one of PLANNED, RUNNING, INTERRUPTED, PAUSED, or ERROR.

    • Update output only fields when the operation is completed.

  • If the transfer has children (MPUT, MGET action): cancel the execution of all of the eligible child transfers on UDMG ( in status PLANNED, RUNNING, INTERRUPTED, PAUSED, ERROR). Failure on one transfer does not block the execution for the other transfers.

Re-Run

When the task instance is re-run on the Controller, a resume command is issued on the UDMG transfer for the file transfers in status ERROR.

  • If the transfer has no children (PUT, GET, LIST action):

    • Fetch the UDMG transfer status and update the output-only fields.

    • Proceed to resume the UDMG transfer only when its status is ERROR, otherwise

    • Continute the monitoring until the UDMG transfer is completed.

  • If the transfer has children (MPUT, MGET action): resume the execution of all of the eligible child transfers on UDMG (in status  ERROR). Failure on one transfer does not block the execution for the other transfers.

Task Output

Output Only Fields

...

FieldTypeDescription
Transfer IDTextThe identifier of the transfer on UDMG
Transfer StatusText

The current status of the transfer
One of PLANNED, RUNNING, PAUSED, INTERRUPTED, DONE, CANCELLLED CANCELLED or ERROR

Used for Task instance Extension Status.

Transfer Start TimeTextThe date and time the transfer has started (UDMG Server time)
Transfer End TimeText

The date and time the transfer has ended (UDMG Server time)

For a wildcard transfer, this is when the listing of matching files and the registration of the child transfers is completed.

Transfer StepTextThe current processing step of the transfer
One of NONE, PRE TASKS, DATA, POST TASKS, ERROR TASKS or FINALIZATION

Transfer Progress

Modified in version 1.2.0

TextThe progress of the data transfer in human readable format
  • size in KB, MB, or GB for a Single Transfer,
  • "x out of y files" for a Wildcard Transfer
Error CodeText

The UDMG transfer error code.

See the table below.

Error MessageTextThe error message (if an error occurred)
Transfer Task NumberTextThe number of the task in the processing step.
Only for the Transfer Steps 'PRE TASKS', 'POST TASKS', and 'ERROR TASKS'
Local FileTextLocal file path
Remote FileTextRemote file path

Transfer UUID

Introduced in version 1.1.0

TextThe UUID of the transfer on UDMG

...

Error CodeDescription
TeOkThis is the code used by default. It indicates that there is no error
TeUnknownIndicates an unknown error (the details of the error can give more information).
TeInternal

Indicates that an internal error occurred in the UDMG Server (lost connection to the database, etc.)

TeUnimplementedIndicates that the partner wanted to use a valid functionality, but which is not implemented by the UDMG Server.
TeConnectionIndicates that the connection to a remote partner cannot be established. This is the most general error code. A more specific code, if available, should be used.
TeConnectionResetMeans "connection reset by peer"
TeUnknownRemoteIndicates that the requested remote partner is not known in the UDMG Server database. For security reasons, the external use of this error code (returning this error to a client) is discouraged for incoming connections in favor of TeBadAuthentication, at the risk of leaking information (here, the account exists, but authentication failed).
TeExceededLimitIndicates that the transfer cannot be processed because the defined limits have been reached (number of connections, number of transfers, etc.)
TeBadAuthenticationIndicates a connection error caused by incorrect authentication data (user, password, certificate, etc. Details of the error can provide more information).
TeDataTransferIndicates that an error occurred during data transfer. This is a general error and a more specific code, if available, should be used.
TeIntegrityIndicates that the integrity check has failed.
TeFinalizationIndicates that an error occurred during the finalization of the transfer.
TeExternalOperationIndicates that an error occurred during the execution of pre-transfer, post-transfer, or error processing.
TeStoppedIndicates that the transfer was stopped.
TeCanceledTeCancelledIndicates that the transfer was cancelled.
TeFileNotFoundIndicates that the requested file was not found.
TeForbiddenIndicates that the remote partner is not allowed to perform an action.
TeBadSizeIndicates an error related to the size of the file (it exceeds a quota, there is not enough space left on the destination disk, etc.)
TeShuttingDownIndicates that the UDMG Server is shutting down

...

Exit CodeStatus Classification CodeStatus Classification DescriptionStatus Description
0SUCCESSSuccessful ExecutionSUCCESS
1FAILFailed ExecutionFAIL: < Error Description >
2AUTHENTICATION_ERRORBad credentialsAUTHENTICATION_ERROR: Account cannot be authenticated.
3AUTHORIZATION_ERRORInsufficient PermissionsAUTHORIZATION_ERROR: Account is not authorized to perform the requested action.
10CONNECTION_ERRORBad connection data or connection timed outCONNECTION_ERROR: < Error Description >
11CONNECTION_ERRORExtension specific connection errorCONNECTION_ERROR: 404 page not found
20DATA_VALIDATION_ERRORInput fields Validation ErrorDATA_VALIDATION_ERROR: 400 bad request:
21TRANSFER_STATUS_ERRORTransfer Execution ErrorTRANSFER_STATUS_ERROR: Transfer failed with error code: TeUnknown
22TRANSFER_STATUS_ERRORTransfer Execution ErrorTRANSFER_STATUS_ERROR: Transfer failed with error code: TeInternal
23TRANSFER_STATUS_ERRORTransfer Execution ErrorTRANSFER_STATUS_ERROR: Transfer failed with error code: TeUnimplemented
24TRANSFER_STATUS_ERRORTransfer Execution ErrorTRANSFER_STATUS_ERROR: Transfer failed with error code: TeConnection
25TRANSFER_STATUS_ERRORTransfer Execution ErrorTRANSFER_STATUS_ERROR: Transfer failed with error code: TeConnectionReset
26TRANSFER_STATUS_ERRORTransfer Execution ErrorTRANSFER_STATUS_ERROR: Transfer failed with error code: TeUnknownRemote
27TRANSFER_STATUS_ERRORTransfer Execution ErrorTRANSFER_STATUS_ERROR: Transfer failed with error code: TeExceededLimit
28TRANSFER_STATUS_ERRORTransfer Execution ErrorTRANSFER_STATUS_ERROR: Transfer failed with error code: TeBadAuthentication
29TRANSFER_STATUS_ERRORTransfer Execution ErrorTRANSFER_STATUS_ERROR: Transfer failed with error code: TeDataTransfer
30TRANSFER_STATUS_ERRORTransfer Execution ErrorTRANSFER_STATUS_ERROR: Transfer failed with error code: TeIntegrity
31TRANSFER_STATUS_ERRORTransfer Execution ErrorTRANSFER_STATUS_ERROR: Transfer failed with error code: TeFinalization
32TRANSFER_STATUS_ERRORTransfer Execution ErrorTRANSFER_STATUS_ERROR: Transfer failed with error code: TeExternalOperation
33TRANSFER_STATUS_ERRORTransfer Execution ErrorTRANSFER_STATUS_ERROR: Transfer failed with error code: TeWarning
34TRANSFER_STATUS_ERRORTransfer Execution ErrorTRANSFER_STATUS_ERROR: Transfer failed with error code: TeStopped
35TRANSFER_STATUS_ERRORTransfer Execution ErrorTRANSFER_STATUS_ERROR: Transfer failed with error code: TeCanceledTeCancelled
36TRANSFER_STATUS_ERRORTransfer Execution ErrorTRANSFER_STATUS_ERROR: Transfer failed with error code: TeFileNotFound
37TRANSFER_STATUS_ERRORTransfer Execution ErrorTRANSFER_STATUS_ERROR: Transfer failed with error code: TeForbidden
38TRANSFER_STATUS_ERRORTransfer Execution ErrorTRANSFER_STATUS_ERROR: Transfer failed with error code: TeBadSize
39TRANSFER_STATUS_ERRORTransfer Execution ErrorTRANSFER_STATUS_ERROR: Transfer failed with error code: TeShuttingDown
99CHILD_TRANSFERS_NOT_MONITORED_WARNINGAPI LimitationsCHILD_TRANSFERS_NOT_MONITORED_WARNING: Too many child transfers, skipped monitoring their completions status
100TRANSFER_STATUS_CANCELUnexpected Transfer StatusTRANSFER_STATUS_CANCEL: Unexpected CANCELLED status

...

AttributeTypeDescription
mft_transferobjectThe details of the main transfer record (the single transfer or the parent transfer in case of Wildcard Transfer).
mft_transfer.transfer_idstringThe identifier of the transfer on UDMG.
mft_transfer.statusstringThe current status of the transfer
One of PLANNED, RUNNING, PAUSED, INTERRUPTED, DONE, CANCELLLED or ERROR.
mft_transfer.startstringThe date and time the transfer has started (UDMG Server time)
mft_transfer.stopstring

The date and time the transfer has ended (UDMG Server time).

For a wildcard transfer, this is when the listing of matching files and the registration of the child transfers is completed.

mft_transfer.stepstringThe current processing step of the transfer
One of NONE, PRE TASKS, DATA, POST TASKS, ERROR TASKS or FINALIZATION.
mft_transfer.transfer_progresstextThe progress of the data transfer in human readable format
  • size in KB, MB, or GB for a Single Transfer,
  • "x out of y files" for a Wildcard Transfer.
mft_transfer.error_codestringThe error code of the transfer (if an error occurred).
mft_transfer.error_msgstringThe error message (if an error occurred).
mft_transfer.task_numberstringThe number of the task in the processing step.
Only for the steps 'PRE TASKS', 'POST TASKS', and 'ERROR TASKS'.
mft_transfer.local_filestringLocal file path.
mft_transfer.remote_filestringRemote file path.

mft_transfer.transfer_uuid

Introduced in version 1.1.0

stringThe UUID of the transfer on UDMG.

mft_transfer.transfer_info

Introduced in version 1.1.0

object

The transfer information fields. 

Set of metadata associated to the transfer on UDMG Server.

The fields with udmg_ prefix are set internally by UDMG server.

The fields with udmg_ue prefix are set by the UDMG File Transfer task.

mft_transfer.transfer_info.udmg_ue_task_uuid

Introduced in version 1.2.0

stringThe UUID of the UDMG File Transfer task.
It can be used to easily correlate the UC task executions and the corresponding UDMG file transfers.

mft_transfer.transfer_info.udmg_xfer_wildcard

Introduced in version 1.2.0

boolean

Indicator that this is a wildcard transfer.

Only for MPUT and MGET.

mft_transfer.transfer_info.udmg_xfer_cmd

Introduced in version 1.3.0

string

'list' is and indicator that this is a wildcard list command.

Only for LIST.

mft_transfer.transfer_info.udmg_xfer_childIDs

Introduced in version 1.2.0

array

A list of UDMG transfer IDs that are created in the context of this file file transfer. For each file matched the filename input, one file transfer process is created in UDMG.

Only for MPUT and MGET.

mft_transfer.transfer_info.udmg_xfer_files

Introduced in version 1.2.0

array

The list of files that matched the user input. Each of these files is transferred with a separate file transfer execution, which transfer ids can be found in “udmg_xfer_childIDs“ list.

Only for MPUT and MGET.

mft_transfer_files_summary

Introduced in version 1.2.0

objectSummary counters
mft_transfer_files_summary.donenumberNumber of file transfers with success.
mft_transfer_files_summary.errornumberNumber of file transfers in error state.
mft_transfer_files_summary.cancellednumberNumber of file transfers that are cancelled.

errors

Introduced in version 1.2.0

arrayList of errors for the child transfers.

...

FieldDescription
idThe identifier of the transfer on UDMG
status

The current status of the transfer
One of PLANNED, RUNNING, PAUSED, INTERRUPTED, DONE, CANCELLLED or ERROR

localFilepathThe path of the file on the local disk
startThe date and time the transfer has started (UDMG Server time)
stop

The date and time the transfer has ended (UDMG Server time)

filesizeThe size of file in byte (or -1 when unknown)
progressThe progress of the data transfer in bytes
remoteIDThe UUID of the transfer on UDMG
errorCodeThe UDMG transfer error code.
errorMessageThe error message (if an error occurred)

step

The current processing step of the transfer
One of NONE, PRE TASKS, DATA, POST TASKS, ERROR TASKS or FINALIZATION
taskNumberThe number of the task in the processing step.
Only for the Transfer Steps 'PRE TASKS', 'POST TASKS', and 'ERROR TASKS'
remoteFilepathThe path to the file on the remote partner
ruleThe name of the transfer rule
isSendIndicates whether the transfer is a send (true) or a receive (false)
requestedThe name of the server/partner that requested the transfer
requesterThe name of the account that requested the transfer

...

  • Breaking Change: Transfer Progress output only field is changed to text value (#32195)

Enhancements

  • AddSupport Wildcard Transfer (#32198, #32195, #32201)
    1. New actions "MPUT" and "MGET" for wildcard transfers:
      • support for wildcard in source file parameter,
      • creation of wildcard transfer on UDMG,
      • monitoring of child transfers on UDMG,
      • tabular report on STDOUT with final child transfer status,
      • short summary report in EXTENSION output,
      • PAUSE, RESUME, and CANCEL commands are propagated to child transfers
    2. "Transfer Progress" output field is redefined to show human readable value
      • size in KB, MB, or GB for single transfer,
      • "x out of y files" for wildcard transfer
    3. "Max files to monitor" parameter: limit the number of child transfers that are monitored by the task instances, 100 by default.
    4. "Wait for transfer completion" parameter: task instance only returns when the transfer is completed (with DONE or CANCELLED status) on UDMG.
      For wildcard transfers, only returns when all child transfers are completed. Activated by default.
  • Add: Refresh task instance output with re-run (#32463)
  • AddKeep UC task instance ID in UDMG file transfer metadata field udmg_ue_task_uuid (#30931)

ue-mft-transfer-1.1.0 (2023-01-31)

...