Panel | |
---|---|
|
For the UDMG Web Transfer Client, please refer to UDMG Web Transfer Client for Linux Installation.
Upgrading Universal Data Mover Gateway
Upgrading UDMG refers to the increase of a currently installed pre-2.0.x Version, Release, or Modification level of UDMG (1.5.x, 1.4.x, 1.3.x, 1.2.x) to UDMG 2.0.x.
Warning |
---|
As a precautionary measure, it is highly recommended that you back up the UDMG database prior to upgrading. |
Upgrading from a pre-2.0 UDMG release
If you are upgrading an installation of UDMG from any release before 2.0.0.0, the following changes must be reviewed carefully.
Note | ||
---|---|---|
| ||
Starting with UDMG version 2.0, a license key must be provided to enable file transfers. Contact your Stonebranch representative or Customer Support to receive the license key before upgrading to version 2.0 or later. |
Note | ||
---|---|---|
| ||
If you are upgrading an installation of UDMG from any release before 2.0.0.0, the start parameters for several services have changed. Please review them carefully, especially for manual installation or if the Systemd service files have been edited. The following modules now require a 'start' command in server mode.
Without it, they will only display the command line usage information. In addition, a 'test' command allows the syntax of the configuration file to be verified without starting the server. | ||
Note | ||
| ||
Category | Prior releases | Release 1.3 |
user and group | mft:mft | udmg:udmg |
binaries | /usr/local/bin | /opt/udmg/bin |
configuration files | /etc/mft | /opt/udmg/etc |
log files | /var/opt/udmg/logs | /var/opt/udmg/logs |
UDMG Admin UI assets | /opt/udmg/var/www/mft | /opt/udmg/var/www/udmg |
Services |
|
|
Environment variables |
|
|
...
Pre-Installation / Upgrade Backups
The installation process overwrites the current files (exception: the configuration files are kept), this may affect your modifications.
Backing up the configuration files optimizes the time it takes you to get up and running after installing or upgrading.
/opt/udmg/etc/udmg/nginx/udmg.conf
/opt/udmg/etc/udmg/agent/client.toml
/opt/udmg/etc/udmg/agent/server.toml
/opt/udmg/etc/udmg/auth-proxy/config.toml
/opt/udmg/etc/udmg/web-transfer/config.toml
/opt/udmg/etc/udmg-server/server.ini
After upgrading RPM or DEB packages, review the new configuration file templates (with the extension .rpmnew or .dpk-new) and edit the current configuration files to add new parameters or remove deprecated parameters.
...
Release Migration
The UDMG release version is stored in the database to ensure the data structure is compatible with the version of the UDMG components.
After upgrading the component binaries and before starting the UDMG Server it is required to perform the release migration step.
The udmg-server "migrate" command handles the necessary database updates and the setting of the internal version.
Code Block |
---|
$ /opt/udmg/bin/udmg-server migrate --help
Usage:
udmg-server [OPTIONS] migrate [migrate-OPTIONS] [version]
Help Options:
-h, --help Show this help message
[migrate command options]
-c, --config= The configuration file to use
-d, --dry-run Simulate the migration but does not commit the changes
-l, --list List Migrations
-f, --file= Writes the migration commands into a file instead of sending them to the database
-v, --verbose Show verbose debug information. Can be repeated to increase verbosity
[migrate command arguments]
version: The version to which the database should be migrated |
The configuration file is used for the server mode, with the parameter for accessing the target database.
To get the list of supported target versions, use the list parameter. The last value is the release version of the udmg-server and the default target version. The current version of the UDMG database structure is shown with the [DATABASE] tag:
Code Block |
---|
$ /opt/udmg/bin/udmg-server migrate -c /opt/udmg/etc/udmg-server/server.ini --list | tail -n 2
1.5.0 [DATABASE]
2.0.0 [DEFAULT] |
It is recommended to set the verbose parameter (3 times) to follow the progress. If not specified on the command line, the target version is the latest release number.
Code Block |
---|
$ /opt/udmg/bin/udmg-server migrate -c /opt/udmg/etc/udmg-server/server.ini -vvv
[INFO ] Migration: Starting upgrade migration...
[INFO ] Migration: Applying migration 'Bump database version to 2.0.0' |
After the migration, the services for UDMG components can be started.
Upgrading Universal Data Mover Gateway for Linux
Upgrading with Linux Software Packages
...
Step 1
...
Contact your Stonebranch representative or Customer Support to receive the software package for the intended operating system.
...
Step 2
...
Perform the recommended backup of configuration files.
...
Step 3
...
Stop the components services.
The exact steps depend on the system architecture and the deployed components, for example:
sudo systemctl stop nginx
systemctl stop udmg-serversudo
systemctl stop udmg-auth-proxysudo
systemctl stop udmg-agent-clientsudo
systemctl stop udmg-agent-serversudo
...
Step 4
...
Upgrade the UDMG packages (RPM or DEB), for example:
sudo rpm -Uvh udmg-agent-2.0.0.0.build.7.x86_64.rpm
sudo rpm -Uvh udmg-admin-ui-2.0.0.0.build.4.x86_64.rpm
sudo rpm -Uvh udmg-admin-ui-nginx-2.0.0.0.build.4.x86_64.rpm
sudo rpm -Uvh udmg-auth-proxy-2.0.0.0.build.15.x86_64.rpm
sudo rpm -Uvh --force udmg-server-2.0.0.build.3.x86_64.rpm
...
Review the component configuration files.
Refer to each component installation section below for the list of parameters./opt/udmg/etc/udmg/nginx/udmg.conf
/opt/udmg/etc/udmg/agent/client.toml
/opt/udmg/etc/udmg/agent/server.toml
/opt/udmg/etc/udmg/auth-proxy/config.toml
/opt/udmg/etc/udmg-server/server.ini
Note that new configuration file templates (with the extension .rpmnew or .dpk-new) that contain all the allowed parameters are added during the software package upgrade.
Note | ||
---|---|---|
| ||
The default upstream port to reach the UDMG Authentication Proxy is set to 5775 in Please review and make sure that the same port (either 5000 or 5775) is also defined in |
...
Review the component service configuration files.
For instance, the UDMG Authentication Proxy service file (/etc/systemd/system/udmg-auth-proxy.service
) was installed with these parameters in version 1.5
Code Block | ||
---|---|---|
| ||
[Unit]
Description=Stonebranch UDMG Authentication Proxy
[Service]
Type=simple
User=udmg
Group=udmg
WorkingDirectory=/home/udmg
Environment="UDMG_AUTH_PROXY_CONFIG=/opt/udmg/etc/udmg/auth-proxy/config.toml"
ExecStart=/bin/sh -c 'exec /opt/udmg/bin/udmg-auth-proxy'
Restart=on-failure
SyslogIdentifier=udmg-auth-proxy
SyslogFacility=local0
[Install]
WantedBy=multi-user.target
|
Note the addition of the start
command on the ExecStart
directive in the version 2.0:
Code Block | ||
---|---|---|
| ||
[Unit]
Description=Stonebranch UDMG Authentication Proxy
[Service]
Type=simple
User=udmg
Group=udmg
WorkingDirectory=/home/udmg
Environment="UDMG_AUTH_PROXY_CONFIG=/opt/udmg/etc/udmg/auth-proxy/config.toml"
ExecStart=/bin/sh -c 'exec /opt/udmg/bin/udmg-auth-proxy start'
Restart=on-failure
SyslogIdentifier=udmg-auth-proxy
SyslogFacility=local0
[Install]
WantedBy=multi-user.target |
The same applies for the other components:
/etc/systemd/system/udmg-auth-proxy.service
/etc/systemd/system/udmg-agent-client.service
/etc/systemd/system/udmg-agent-server.service
...
Start the components services.
The exact steps depend on the system architecture and the deployed components, for example:
systemctl start udmg-serversudo
systemctl sudo
start
udmg-auth-proxy
systemctl sudo
start
udmg-agent-client
systemctl sudo
start
udmg-agent-server
systemctl start nginxsudo
...
Upgrading a Manual Installation
...
Step 1
...
Contact your Stonebranch representative or Customer Support to receive the software package for the intended operating system.
...
Step 2
...
Perform the recommended backup of configuration files.
...
Step 3
...
Stop the components services.
The exact steps depend on the system architecture and the deployed components, for example:
systemctl stop nginxsudo
systemctl stop udmg-serversudo
systemctl stop udmg-auth-proxysudo
systemctl stop udmg-agent-clientsudo
systemctl stop udmg-agent-serversudo
...
Step 4
...
Replace the component binaries:
cp udmg-server.bin /opt/udmg/bin/udmg-serversudo
cp udmg-client.bin /opt/udmg/bin/udmg-clientsudo
cp udmg-auth-proxy.bin /opt/udmg/bin/udmg-auth-proxysudo
Change ownership/permissions on new files:
chown -R root:udmg /opt/udmg/bin/sudo
chmod -R 750 /opt/udmg/bin/sudo
Upgrade the Admin UI:
mv /opt/udmg/var/www/udmg mv /opt/udmg/var/www/udmg_BACKUPsudo
unzip -d /opt/udmg/var/www/udmg 'udmg-admin-ui-2.0.0.0 build.4.zip' sudo
chown -R root:udmg /opt/udmg/var/www/udmgsudo
...
Review the component configuration files.
Refer to each component installation section below for the list of parameters./opt/udmg/etc/udmg/nginx/udmg.conf
/opt/udmg/etc/udmg/agent/client.toml
/opt/udmg/etc/udmg/agent/server.toml
/opt/udmg/etc/udmg/auth-proxy/config.toml
/opt/udmg/etc/udmg-server/server.ini
...
Review the component service configuration files.
For instance, the UDMG Authentication Proxy service file (/etc/systemd/system/udmg-auth-proxy.service
) was installed with these parameter in version 1.5
Code Block | ||
---|---|---|
| ||
[Unit]
Description=Stonebranch UDMG Authentication Proxy
[Service]
Type=simple
User=udmg
Group=udmg
WorkingDirectory=/home/udmg
Environment="UDMG_AUTH_PROXY_CONFIG=/opt/udmg/etc/udmg/auth-proxy/config.toml"
ExecStart=/bin/sh -c 'exec /opt/udmg/bin/udmg-auth-proxy'
Restart=on-failure
SyslogIdentifier=udmg-auth-proxy
SyslogFacility=local0
[Install]
WantedBy=multi-user.target
|
Note the addition of the start
command on the ExecStart
directive in the version 2.0:
Code Block | ||
---|---|---|
| ||
[Unit]
Description=Stonebranch UDMG Authentication Proxy
[Service]
Type=simple
User=udmg
Group=udmg
WorkingDirectory=/home/udmg
Environment="UDMG_AUTH_PROXY_CONFIG=/opt/udmg/etc/udmg/auth-proxy/config.toml"
ExecStart=/bin/sh -c 'exec /opt/udmg/bin/udmg-auth-proxy start'
Restart=on-failure
SyslogIdentifier=udmg-auth-proxy
SyslogFacility=local0
[Install]
WantedBy=multi-user.target |
The same applies for the other components:
/etc/systemd/system/udmg-auth-proxy.service
/etc/systemd/system/udmg-agent-client.service
/etc/systemd/system/udmg-agent-server.service
...
Start the components services.
The exact steps depend on the system architecture and the deployed components, for example:
systemctl start udmg-serversudo
systemctl sudo
start
udmg-auth-proxy
systemctl sudo
start
udmg-agent-client
systemctl sudo
start
udmg-agent-server
systemctl start nginxsudo
...
Installing and Configuring the Components
Note | ||
---|---|---|
| ||
Starting with UDMG version 2.0, a license key must be provided to enable file transfers. Contact your Stonebranch representative or Customer Support to receive the license key before installing version 2.0 or later. |
...
Step 1
...
Contact your Stonebranch representative or Customer Support to receive the software package for the intended operating system.
...
Step 2
...
Install the UDMG packages (RPM or DEB), for example:
sudo rpm -ivh udmg-agent-2.0.0.0.build.7.x86_64.rpm
sudo rpm -ivh udmg-admin-ui-2.0.0.0.build.4.x86_64.rpm
sudo rpm -ivh udmg-admin-ui-nginx-2.0.0.0.build.4.x86_64.rpm
sudo rpm -ivh udmg-auth-proxy-2.0.0.0.build.15.x86_64.rpm
sudo rpm -ivh udmg-server-2.0.0.build.3.x86_64.rpm
...
Step 3
...
Review the component configuration files.
Refer to each component installation section below for the list of parameters./opt/udmg/etc/udmg/nginx/udmg.conf
/opt/udmg/etc/udmg/agent/client.toml
/opt/udmg/etc/udmg/agent/server.toml
/opt/udmg/etc/udmg/auth-proxy/config.toml
/opt/udmg/etc/udmg-server/server.ini
...
Step 4
...
Start the components services.
The exact steps depend on the system architecture and the deployed components, for example:
systemctl start udmg-serversudo
systemctl sudo
start
udmg-auth-proxy
systemctl sudo
start
udmg-agent-client
systemctl sudo
start
udmg-agent-server
systemctl start nginxsudo
Performing a manual installation
Note | ||
---|---|---|
| ||
Starting with UDMG version 2.0, a license key must be provided to enable file transfers. Contact your Stonebranch representative or Customer Support to receive the license key before installing version 2.0 or later. |
UDMG Admin UI
Note |
---|
The following steps require root privilege, so make sure that you have the correct access before continuing. |
Extract the distribution files for UDMG Admin UI, under the directory that was configured as web server root directory during the NGINX Server configuration, The standard value is
/opt/udmg/var/www/udmg
.
Panel |
---|
|
- The zip file can now be deleted.
- If SELinux is enabled on the host, proceed with the steps in the section below: Using UDMG with SELinux
- Validate that the service is working properly, for example with the 'curl' command:
Panel |
---|
|
or with the browser:
UDMG User Setup
Create a dedicated user for running the UDMG modules and to be the owner of the files that are transferred by UDMG.
Panel |
---|
|
UDMG Server
Create the configuration file /opt/udmg/etc/udmg-server/server.ini with the following parameters:
Panel |
---|
|
Note | ||
---|---|---|
| ||
The lines starting with a semicolon ';' or a hash '#' are comments, either describing the option or showing the default value. The parameters must be adapted to your environment, in particular:
|
Note | ||
---|---|---|
| ||
About the log section: the DEBUG and TRACE log levels are not recommended for production environments. |
Note | ||
---|---|---|
| ||
About the global section: the requested OS file and directory creation permissions are applied after the |
...
#
# (c) Copyright 2024 Stonebranch, Inc., All rights reserved.
#
# Stonebranch, Inc.
# Universal Data Mover Gateway Server Configuration File
#
# This configuration file specifies global options for the
# udmg-server program.
#
# The configuration file is organized with the grouping of options under
# different section that are marked by brackets: [section_name]
# This organization should be maintained when modifying the file.
#
# The file syntax is:
#
# - Lines starting with a # or a ; are comments.
# - Blank lines are ignored.
# - Option lines are 'keyword = value' format.
# - keywords are not case sensitive.
# - keywords can start in any column.
# - Case sensitivity of the value depends on the value being specified.
# For example, a yes or no option is not case sensitive, but a file
# or directory name is.
# - Values must be enclosed in quotations marks (") or apostrophes (')
# if the value contains a space or tab.
# - File or folder path on Windows platform must be written with one of the following syntaxes:
# LogPath = "C:/UDMG/UDMG Server/logs"
# LogPath = "C://UDMG//UDMG Server//logs"
# LogPath = "C:\\UDMG\\UDMG Server\\logs"
# LogPath = C:\UDMG\UDMG Server\logs
# LogPath = C:/UDMG/UDMG Server/logs
#
#####################################################################
[global]
; The name given to identify this gateway instance. If the database is shared between multiple gateways, this name MUST be unique across these gateways.
GatewayName = sb-mft-01
; Default OS permission for created files
; FilePermissions = 770
...
[paths]
; The root directory of the gateway. By default, it is the working directory of the process.
GatewayHome = /home/udmg/udmg-server
; The directory for all incoming files.
; DefaultInDir = in
; The directory for all outgoing files.
; DefaultOutDir = out
; The directory for all running transfer files.
; DefaultTmpDir = tmp
[log]
; All messages with a severity above this level will be logged. Possible values are TRACE, DEBUG, INFO, WARNING, ERROR and CRITICAL.
Level = INFO
; The path to the file where the logs must be written. Special values 'stdout' and 'syslog' log respectively to the standard output and to the syslog daemon.
; LogTo = stdout
; If LogTo is set on 'syslog', the logs will be written to this facility.
; SyslogFacility = local0
; The directory for the log files of the local servers, partners, and transfers.
; No default, if not provided then the detailed log feature is disabled. If not present, the directory is created with
DirPermissions.
...
[admin]
; The address used by the admin interface.
Host = 0.0.0.0
; The port used by the admin interface. If the port is 0, a free port will automatically be chosen.
Port = 18080
; Path of the TLS certificate for the admin interface.
; TLSCert =
; Path of the key of the TLS certificate.
; TLSKey =
; Password for the key of the TLS Certificate (if key is encrypted).
; TLSPassphrase =
; API rate limiter: number of allowed requests per client IP, per second. After that HTTP code 429 is returned. Disabled if 0 or not provided.
...
[database]
; Type of the RDBMS used for the UDMG Server database. Possible values: sqlite, mysql (default), postgresql, oracle, mssql
Type = postgresql
; Address (URL:port) of the database. The default port depends on the type of database used (PostgreSQL: 5432, MySQL: 3306, MS SQL: 1433, Oracle: 1521, SQLite: none).
Address = localhost:5432
; The name of the database
Name = udmg
; The name of the gateway database user
User = udmg_user
; The password of the gateway database user
Password = udmg_password
; Path of the database TLS certificate file (only supported for mysql, postgresql).
; TLSCert =
; Path of the key of the TLS certificate file (only supported for mysql, postgresql).
; TLSKey =
; The path to the file containing the passphrase used to encrypt account passwords using AES. Recommended to be a full absolute path, if the file does not exist, a new passphrase is generated the first time.
; AESPassphrase = /opt/udmg/etc/udmg-server/passphrase.aes
; Maximum number of database connections, the default is 0 (unlimited)
; MaxConnections = 0
; Maximum number of transactions retries, the default is 3.
; MaxRetries = 3
; Delay in milliseconds between retries, the default is 100.
; MaxRetriesWait = 100
[controller]
; The frequency at which the database will be probed for new transfers
; Delay = 5s
; The maximum number of concurrent incoming transfers allowed on the gateway (0 = unlimited).
; MaxTransferIn = 0
; The maximum number of concurrent outgoing transfers allowed on the gateway (0 = unlimited).
; MaxTransferOut = 0
; The frequency at which the heartbeat will be updated
; Heartbeat = 10s
; The deadline to determine if this instance will be active
; Deadline = 5m0s
; The heartbeat to determine if this instance will be probed
; HeartbeatCheck = 20s
[sftp]
; Set to true to allow legacy and weak cipher algorithms: 3des-cbc, aes128-cbc, arcfour, arcfour128, arcfour256
; AllowLegacyCiphers = false
[tasks]
; Set to true to disable the COPY task.
DisableCopy = false
; Set to true to disable the MOVE task.
DisableMove = false
; Set to true to disable the COPYRENAME task.
DisableCopyRename = false
; Set to true to disable the MOVERENAME task.
DisableMoveRename = false
; Set to true to disable the DELETE task.
DisableDelete = false
; Set to true to disable the RENAME task.
DisableRename = false
; Set to true to disable the CHECKREGEX task.
DisableCheckRegex = false
; Set to true to disable the PUBLISHEVENT task.
DisablePublishEvent = false
; Set to true to disable the ICAP task.
DisableIcap = false
; Set to true to disable the TRANSFER task.
DisableTransfer = false
; Set to true to disable the EXECMOVE task.
DisableExecMove = false
; Set to true to disable the EXECOUTPUT task.
DisableExecOutput = false
; Set to true to disable the EXEC task.
DisableExec = true
[rule]
; Disables global rules, requiring rules to be explicitly allowed to be used.
; ExplicitRuleAssignment = false
Note | ||
---|---|---|
| ||
The AESPassphrase file is generated on the first run if it does not exist. It is recommended to set an absolute path, otherwise it is created in the current directory. Make sure to verify the file location during an upgrade and to have a backup. Without the correct AESPassphrase file, the passwords, keys, and certificates are not usable.
|
- Install the binaries under /opt/udmg/bin
:
Panel |
---|
|
UDMG Authentication Proxy
Create a directory under
/etc/udmg/:
Panel |
---|
|
- Create a configuration file for the service:
Panel |
---|
|
Panel |
---|
|
Please refer to Authentication Methods for the LDAP and SSO authentication options.
- Verify the configuration file with the 'test' command:
Panel |
---|
|
In case of syntax error, a verbose message will indicate the line and the issue:
Panel |
---|
|
- Install the binary under
/opt/udmg/bin:
Panel |
---|
|
UDMG Agent Proxy
Agent Proxy Server Configuration
Create a directory under /opt/udmg/etc/udmg
:
Panel |
---|
|
- Install the binary under
/opt/udmg/bin:
Panel |
---|
|
Generate a SSH Key for the service:
Panel |
---|
|
- Change the agent key permissions:
Panel |
---|
|
...
| |
(1) Local Accounts are converted to Shared Accounts Before this change, a local account was only defined for a given local server and not allowed to have the same account for multiple protocols. For instance, to allow a partner to transfer files over SFTP and FTP, it was required to have both an SFTP and FTP local server, each with their own local account. Each account was then maintained independently, which created additional overhead in configuration and maintenance (password or key updates). A shared Account is created once and can be assigned to several Local Servers, sharing the same login, password, and authentication records. A migrated account has the following characteristics:
(2) New permission for Shared Account management A new User and User Group permission, "sharedAccount", is created for the management of Shared Accounts. |
Note | ||
---|---|---|
| ||
The start parameters for several services have changed. Please review the start scripts, especially for manual installation or if the Systemd service files have been edited. The following modules now require a 'start' command in server mode.
Without it, they will only display the command line usage information. In addition, a 'test' command allows the syntax of the configuration file to be verified without starting the server. |
New configuration parameter with UDMG 2.0.0.0
Note | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|
| ||||||||||
UDMG Server
|
Upgrading from a pre-1.3 UDMG release
Note | ||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ||||||||||||||||||||||||
If you are upgrading an installation of UDMG from any release before 1.3.0.0, you must uninstall the older version before installing the new version. Migration from releases before 1.2.1.1 (0.7.1-sb.3) is not supported anymore.
It may be required to modify the work and data directories ownership or access rights and to update UDMG Server transfer rules to use paths that are accessible by the 'udmg' user. The configuration files must be reviewed and compared between the old and new locations. Special attention is required for the AESpassphrase parameter for UDMG Server. It must be the path for the file that was used by the previous release and must be accessible by the new service user. It is recommended to set an absolute path in the configuration file. |
Anchor | ||||
---|---|---|---|---|
|
Pre-Installation / Upgrade Backups
The installation process overwrites the current files (exception: the configuration files are kept), this may affect your modifications.
Backing up the configuration files optimizes the time it takes you to get up and running after installing or upgrading.
/opt/udmg/etc/udmg/nginx/udmg.conf
/opt/udmg/etc/udmg/agent/client.toml
/opt/udmg/etc/udmg/agent/server.toml
/opt/udmg/etc/udmg/auth-proxy/config.toml
/opt/udmg/etc/udmg/web-transfer/config.toml
/opt/udmg/etc/udmg-server/server.ini
After upgrading RPM or DEB packages, review the new configuration file templates (with the extension .rpmnew or .dpk-new) and edit the current configuration files to add new parameters or remove deprecated parameters.
Anchor db_migration db_migration
Release Migration
The UDMG release version is stored in the database to ensure the data structure is compatible with the version of the UDMG components.
After upgrading the component binaries and before starting the UDMG Server, it is required to perform the release migration step.
Note | ||
---|---|---|
| ||
The release migration is altering the database structure and requires the database user to have the DDL privileges fore creating, altering and deleting database its own objects. Please refer to Installing a Database section for the requires privileges for each the database vendor. |
The udmg-server "migrate" command handles the necessary database updates and the setting of the internal version.
Code Block |
---|
$ /opt/udmg/bin/udmg-server migrate --help
Usage:
udmg-server [OPTIONS] migrate [migrate-OPTIONS] [version]
Help Options:
-h, --help Show this help message
[migrate command options]
-c, --config= The configuration file to use
-d, --dry-run Simulate the migration but does not commit the changes
-l, --list List Migrations
-f, --file= Writes the migration commands into a file instead of sending them to the database
-v, --verbose Show verbose debug information. Can be repeated to increase verbosity
[migrate command arguments]
version: The version to which the database should be migrated |
The configuration file is used for the server mode, with the parameter for accessing the target database.
To get the list of supported target versions, use the list parameter. The last value is the release version of the udmg-server and the default target version. The current version of the UDMG database structure is shown with the [DATABASE] tag:
Code Block |
---|
$ /opt/udmg/bin/udmg-server migrate -c /opt/udmg/etc/udmg-server/server.ini --list | tail -n 2
1.5.0 [DATABASE]
2.0.0 [DEFAULT] |
It is recommended to set the verbose parameter (3 times) to follow the progress. If not specified on the command line, the target version is the latest release number.
Code Block |
---|
$ /opt/udmg/bin/udmg-server migrate -c /opt/udmg/etc/udmg-server/server.ini -vvv
2024/06/10 20:01:51 [INFO ] Migration: Starting upgrade migration from 1.5.0 to 2.0.0
2024/06/10 20:01:51 [INFO ] Migration: Applying migration 'Drop the normalized transfer view'
2024/06/10 20:01:51 [INFO ] Migration: Applying migration 'Add a "src_filename, dest_filename" columns to the transfers table'
2024/06/10 20:01:51 [INFO ] Migration: Applying migration 'Add a "src_filename, dest_filename" columns to the history table'
2024/06/10 20:01:51 [INFO ] Migration: Applying migration 'Restore and update the normalized transfer view with the new filename'
2024/06/10 20:01:51 [DEBUG ] Migration: Skipped migration 'Check for required MySQL permissions'
2024/06/10 20:01:51 [INFO ] Migration: Applying migration 'Add a 'local_storage' column to the 'local_accounts' table'
2024/06/10 20:01:51 [INFO ] Migration: Applying migration 'Fix the 'sb_user_session' table'
2024/06/10 20:01:51 [INFO ] Migration: Applying migration 'Create the 'sb_license' table'
2024/06/10 20:01:51 [INFO ] Migration: Applying migration 'Drop the normalized transfer view'
2024/06/10 20:01:51 [INFO ] Migration: Applying migration 'Add a 'local_agent_id' column to the 'transfers' table'
2024/06/10 20:01:51 [INFO ] Migration: Applying migration 'Update the 'sb_generic_group_join' table'
2024/06/10 20:01:51 [INFO ] Migration: Applying migration 'Update the 'sb_user_group_permission' table'
2024/06/10 20:01:51 [INFO ] Migration: Applying migration 'Update the 'users' table'
2024/06/10 20:01:51 [INFO ] Migration: Applying migration 'Create the 'sb_local_account_auth' table'
2024/06/10 20:01:52 [INFO ] Migration: Applying migration 'Drop the 'local_agent_id' column from the 'local_accounts' table'
2024/06/10 20:01:52 [INFO ] Migration: Applying migration 'Restore and update the normalized transfer view with the new local agent id'
2024/06/10 20:01:52 [INFO ] Migration: Applying migration 'Create the 'sb_adhoc_share' table'
2024/06/10 20:01:52 [INFO ] Migration: Applying migration 'Create the 'sb_adhoc_download' table'
2024/06/10 20:01:52 [INFO ] Migration: Applying migration 'Bump database version to 2.0.0' |
After the migration, the services for UDMG components can be started.
Upgrading Universal Data Mover Gateway for Linux
Upgrading with Linux Software Packages
Step 1 | Contact your Stonebranch representative or Customer Support to receive the software package for the intended operating system. | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|
Step 2 | Perform the recommended backup of configuration files. | ||||||||||
Step 3 | Stop the components services. The exact steps depend on the system architecture and the deployed components, for example: On the main UDMG host:
On the Proxy host: | ||||||||||
Step 4 | Upgrade the UDMG packages (RPM or DEB). For RPM based Linux: On the main UDMG host:
On the Proxy host:
For Debian based Linux: On the main UDMG host:
On the Proxy host:
| ||||||||||
Step 5 | Review the component configuration files. On the main UDMG host: On the Proxy host:
Note that new configuration file templates (with the extension .rpmnew or .dpk-new) that contain all the allowed parameters are added during the software package upgrade.
| ||||||||||
Step 6 | Perform the release migration. | ||||||||||
Step 7 | Review the component service configuration files. For instance, the UDMG Authentication Proxy service file (
Note the addition of the
The same applies for the other components:
| ||||||||||
Step 8 | Start the components services. The exact steps depend on the system architecture and the deployed components, for example: On the Proxy host:
On the main UDMG host:
| ||||||||||
Step 9 | Verify or apply the license; see UDMG Licensing. |
Upgrading a Manual Installation
Step 1 | Contact your Stonebranch representative or Customer Support to receive the software package for the intended operating system. | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|
Step 2 | Perform the recommended backup of configuration files. | ||||||||||
Step 3 | Stop the components services. The exact steps depend on the system architecture and the deployed components, for example: On the main UDMG host: On the Proxy host: | ||||||||||
Step 4 | Replace the component binaries:
Change ownership/permissions on new files:
Upgrade the Admin UI:
| ||||||||||
Step 5 | Review the component configuration files. Refer to each component installation section below for the list of parameters. | ||||||||||
Step 6 | Perform the release migration. | ||||||||||
Step 7 | Review the component service configuration files. For instance, the UDMG Authentication Proxy service file (
Note the addition of the
The same applies for the other components:
| ||||||||||
Step 8 | Start the components services. The exact steps depend on the system architecture and the deployed components, for example: On the Proxy host:
On the main UDMG host:
| ||||||||||
Step 9 | Verify or apply the license; see UDMG Licensing. |
Installing and Configuring the Components
Note | ||
---|---|---|
| ||
Starting with UDMG version 2.0, a license key must be provided to enable file transfers. Contact your Stonebranch representative or Customer Support to receive the license key before installing version 2.0 or later. |
Anchor | ||||
---|---|---|---|---|
|
Step 1 | Contact your Stonebranch representative or Customer Support to receive the software package for the intended operating system. |
---|---|
Step 2 | Install the UDMG packages (RPM or DEB). For RPM based Linux: On the main UDMG host:
On the Proxy host:
For Debian based Linux: On the main UDMG host:
On the Proxy host:
|
Step 3 | Review the component configuration files. On the main UDMG host:
On the Proxy host:
|
Step 4 | Start the components services. The exact steps depend on the system architecture and the deployed components, for example: On the Proxy host:
On the main UDMG host:
|
Performing a manual installation
Note | ||
---|---|---|
| ||
Starting with UDMG version 2.0, a license key must be provided to enable file transfers. Contact your Stonebranch representative or Customer Support to receive the license key before installing version 2.0 or later. |
UDMG User Setup
Create a dedicated user for running the UDMG modules and to be the owner of the files that are transferred by UDMG.
Panel |
---|
|
UDMG Server
Create the configuration file /opt/udmg/etc/udmg-server/server.ini with the following parameters:
Panel |
---|
|
Note | ||
---|---|---|
| ||
The lines starting with a semicolon ';' or a hash '#' are comments, either describing the option or showing the default value. The parameters must be adapted to your environment, in particular:
|
Note | ||
---|---|---|
| ||
About the log section:
|
Note | ||
---|---|---|
| ||
About the global section: the requested OS file and directory creation permissions are applied after the |
Panel |
---|
; Threshold before warning for long-running queries, the default is 10 seconds WarningTimeout=10s
|
Note | ||
---|---|---|
| ||
The AESPassphrase file is generated on the first run if it does not exist. It is recommended to set an absolute path, otherwise it is created in the current directory. Make sure to verify the file location during an upgrade and to have a backup. Without the correct AESPassphrase file, the passwords, keys, and certificates are not usable.
|
- Install the binaries under /opt/udmg/bin
:
Panel |
---|
|
UDMG Authentication Proxy
Create a directory under
/etc/udmg/:
Panel |
---|
|
- Create a configuration file for the service:
Panel |
---|
|
Panel |
---|
|
Please refer to Authentication Methods for the LDAP and SSO authentication options.
- Verify the configuration file with the 'test' command:
Panel |
---|
|
In case of syntax error, a verbose message will indicate the line and the issue:
Panel |
---|
|
- Install the binary under
/opt/udmg/bin:
Panel |
---|
|
UDMG Admin UI
Note |
---|
The following steps require root privilege, so make sure that you have the correct access before continuing. |
Extract the distribution files for UDMG Admin UI, under the directory that was configured as the web server root directory during the NGINX Server configuration, The standard value is
/opt/udmg/var/www/udmg
.
Panel |
---|
|
- The zip file can now be deleted.
- If SELinux is enabled on the host, proceed with the steps in the section below: Using UDMG with SELinux
- Validate that the service is working properly, for example with the 'curl' command:
Panel |
---|
|
or with the browser:
UDMG Agent Proxy
- The UDMG Agent Proxy client is installed inside the LAN, typically on the same host as UDMG Server.
- The UDMG Agent Proxy Server is installed on the Proxy host, typically in the DMZ.
Agent Proxy Server Configuration
Create a directory under /opt/udmg/etc/udmg
:
Panel |
---|
|
- Install the binary under
/opt/udmg/bin:
Panel |
---|
|
Generate a SSH Key for the service:
Panel |
---|
|
- Change the agent key permissions:
Panel |
---|
|
- Create a configuration file as /opt/udmg/etc/udmg/agent/
agent.toml:
Panel |
---|
|
Panel |
---|
|
The username and password keys are used for the UDMG Agent Client authentication to the UDMG Agent Server.
Agent Proxy Client Configuration
Create a directory under /opt/udmg/etc/udmg
:
Panel |
---|
|
- Install the binary under
/opt/udmg/bin:
Panel |
---|
|
Create a configuration file as
/etc/
udmg
/agent_proxy/client.toml:
Panel |
---|
|
Panel |
---|
|
The password key is used for the client authentication.
Agent Proxy Client Configuration
Create a directory under /opt/udmg/etc/udmg
:
Panel |
---|
|
- Install the binary under
/opt/udmg/bin:
Panel |
---|
|
Create a configuration file as
/etc/
udmg
/agent_proxy/client.toml:
Panel |
---|
|
Panel |
---|
|
The password key is username and password keys in the '[client]'
section are used for the client authenticationUDMG Agent Client authentication to the UDMG Agent Server.
Setup the Systemd Services
Note | ||
---|---|---|
| ||
If you are upgrading an installation of UDMG from any release before 2.0.0.0, the start parameters for several services have changed. Please review them carefully, especially for manual installation or if the Systemd service files have been edited. The following modules now require a 'start' command in server mode.
Without it, they will only display the command line usage information. In addition, a 'test' command allows the syntax of the configuration file to be verified without starting the server. |
UDMG Server
Create a new service definition:
...
Anchor | ||||
---|---|---|---|---|
|
Security-Enhanced Linux (SELinux) is enabled by default on modern RHEL and CentOS servers. Each operating system object (process, file descriptor, file, etc.) is labeled with an SELinux context that defines the permissions and operations the object can perform. In RHEL 6.6/CentOS 6.6 and later, NGINX is labeled with the httpd_t
context.
When SELinux is enabled, the UDMG Admin UI shows "403 access denied" and "404 page not found" errors on the landing page, and permission errors are reported in the NGINX log files:
Panel |
---|
|
...