...
| Warning |
|---|
Version 4.0.0 is a major release and introduces breaking changes that might affect some users depending on their setup. Administrators are strongly advised to refer to Changelog for more information on the changes introduced in this release. Refer also to Migration Guide to apply changes in existing task definitions. |
Overview
This integration provides the capability to perform data transfers between cloud-based storage services and local or distributed file systems. It also provides data storage management capabilities like listing, creating, or deleting data storage objects.
Key Features
This integration is equipped with the following key features.
...
| System | Rclone Configuration Documentation Link | Example |
|---|
| AWS S3 | AWS S3 Rclone Configuration Guide |
| Code Block |
|---|
| language | text |
|---|
| title | Example with Credentials as UAC Functions |
|---|
| collapse | true |
|---|
| [aws_s3]
type = s3
provider = AWS
access_key_id = ${_credentialUser('${ops_ue_cloud_storage_credentials}')}
secret_access_key = ${_credentialPwd('${ops_ue_cloud_storage_credentials}')}
region = us-east-2
[aws_s3_source]
type = s3
provider = AWS
access_key_id = ${_credentialUser('${ops_ue_cloud_source_credentials}')}
secret_access_key = ${_credentialPwd('${ops_ue_cloud_source_credentials}')}
region = us-east-2
acl = bucket-owner-full-control
role_arn = arn:aws:iam::<account_id>:role/<role policy>
[aws_s3_target]
type = s3
provider = AWS
env_auth = false
access_key_id = ${_credentialUser('${ops_ue_cloud_target_credentials}')}
secret_access_key = ${_credentialPwd('${ops_ue_cloud_target_credentials}')}
region = us-east-2 |
|
| Google Cloud Storage (Google Drive) | Google Drive Rclone Configuration Guide |
| Code Block |
|---|
| language | text |
|---|
| title | Example with Credentials as UAC Functions |
|---|
| collapse | true |
|---|
| [google_cloud_storage]
type = google cloud storage
service_account_file = ${_credentialPwd('${ops_ue_cloud_storage_credentials}')}
object_acl = bucketOwnerFullControl
project_number = johnprojectno
location = europe-west3
[google_cloud_storage_source]
type = google cloud storage
service_account_file = ${_credentialPwd('${ops_ue_cloud_source_credentials}')}
object_acl = bucketOwnerFullControl
project_number = johnprojectno
location = europe-west3
[google_cloud_storage_target]
type = google cloud storage
service_account_file = ${_credentialPwd('${ops_ue_cloud_target_credentials}')}
object_acl = bucketOwnerFullControl
project_number = johnprojectno
location = europe-west3 |
|
| Microsoft OneDrive/Sharepoint | Microsoft OneDrive/Sharepoint Configuration Guide For One Drive / Sharepoint data transfers, refer also to Refresh Storage Credentials section. |
| Code Block |
|---|
| language | text |
|---|
| title | Example (OneDrive) with Credentials as UAC Functions |
|---|
| collapse | true |
|---|
| [one_drive]
type = onedrive
token = ${_credentialToken('${ops_ue_cloud_storage_credentials}')}
client_id = ${_credentialUser('${ops_ue_cloud_storage_credentials}')}
client_secret = ${_credentialPasswordcredentialPwd('${ops_ue_cloud_storage_credentials}')}
drive_id = b!reXzf-NsJk-THISISASAMPLEDRIVEIDdfA_bM-DrjNN_hR5pD0u13Fvhi
drive_type = business
[one_drive_source]
type = onedrive
token = ${_credentialToken('${ops_ue_cloud_source_credentials}')}
client_id = ${_credentialUser('${ops_ue_cloud_source_credentials}')}
client_secret = ${_credentialPasswordcredentialPwd('${ops_ue_cloud_credentials}')}
drive_id = b!reXzf-NsJk-THISISASAMPLEDRIVEIDdfA_bM-DrjNN_hR5pD0u13Fvhi
drive_type = business
[one_drive_target]
type = onedrive
token = ${_credentialToken('${ops_ue_cloud_target_credentials}')}
client_id = ${_credentialUser('${ops_ue_cloud_target_credentials}')}
client_secret = ${_credentialPasswordcredentialPwd('${ops_ue_cloud_target_credentials}')}
drive_id = b!reXzf-NsJk-THISISASAMPLEDRIVEIDdfA_bM-DrjNN_hR5pD0u13Fvhi
drive_type = business |
|
| Local Filesystem | Local Filesystem Configuration Guide |
| Code Block |
|---|
| language | text |
|---|
| title | Example |
|---|
| collapse | true |
|---|
| [linux_source]
type = local
[linux_target]
type = local
[windows_source]
type = local
[windows_target]
type = local |
|
...
On version 4.0.1 only the agent user (the user running the Universal Agent) could run this integration on Linus Linux OS.
On version 4.0.2 this limitation can be removed manually. To allow users other than the agent user to run a Cloud Data Transfer Task, follow these steps:
...
