Rclone 1.54.0 (64-bit)

What's new in this version:

- New backends
- Compression remote (experimental)
- Enterprise File Fabric
- This work was sponsored by Storage Made Easy
- HDFS (Hadoop Distributed File System)
- Zoho workdrive
- New Features
- Deglobalise the config
- Global config now read from the context
- This will enable passing of global config via the rc
- This work was sponsored by Digitalis
- Add --bwlimit for upload and download
- Obey bwlimit in http Transport for better limiting
- Enhance systemd integration
- Log level identification, manual activation with flag, automatic systemd launch detection
- Don't compile systemd log integration for non unix systems
- Add a --download flag to md5sum/sha1sum/hashsum to force rclone to download and hash files locally
- Add --progress-terminal-title to print ETA to terminal title
- Make backend env vars show in help as the defaults for backend flags

Build:
- Raise minimum go version to go1.12

Dedupe:
- Add --by-hash to dedupe on content hash not file name
- Add --dedupe-mode list to just list dupes, changing nothing
- Add warning if used on a remote which can't have duplicate names

Fs:
- Add Shutdown optional method for backends
- When using --files-from check files concurrently
- Accumulate stats when using --dry-run
- Always show stats when using --dry-run or --interactive
- Add support for flag --no-console on windows to hide the console window
- Genautocomplete: Add support to output to stdout
- Ncdu
- Highlight read errors instead of aborting
- Add sort by average size in directory
- Add toggle option for average s3ize in directory - key 'a'
- Add empty folder flag into ncdu browser
- Add ! (errror) and . (unreadable) file flags to go with e (empty)
- Obscure: Make rclone osbcure - ignore newline at end of line

Operations:
- Add logs when need to upload files to set mod times
- Move and copy log name of the destination object in verbose
- Add size if known to skipped items and JSON log

Rc:
- Prefer actual listener address if using ":port" or "addr:0" only
- Add listener for finished jobs (Aleksandar Jankovic)
- Serve ftp: Add options to enable TLS
- Serve http/webdav: Redirect requests to the base url without the /
- Serve restic: Implement object cache
- Stats: Add counter for deleted directories
- Sync: Only print "There was nothing to transfer" if no errors

Webui:
- Prompt user for updating webui if an update is available
- Fix plugins initialization

Bug-Fixes:
- Fix nil pointer on copy & move operations directly to remote
- Fix parsing of .. when joining remotes
- Log: Fix enabling systemd logging when using --log-file

Check:
- Make the error count match up in the log message
- Move: Fix data loss when source and destination are the same object

Operations:
- Fix --cutof-mode hard not cutting off immediately
- Fix --immutable error message
- Sync
- Fix --cutoff-mode soft & cautious so it doesn't end the transfer early
- Fix --immutable errors retrying many times

Docs:
- Many fixes and a rewrite of the filtering docs
- Many spelling and grammar fixes
- Doc fixes for commands delete, purge, rmdir, rmdirs and mount

Mount:
- Update systemd status with cache stats
- Disable bazil/fuse based mount on macOS
- Make rclone mount actually run rclone cmount under macOS
- Implement mknod to make NFS file creation work
- Make sure we don't call umount more than once
- More user friendly mounting as network drive on windows
- Detect if uid or gid are set in same option string: -o uid=123,gid=456
- Don't attempt to unmount if fs has been destroyed already

VFS:
- Fix virtual entries causing deleted files to still appear
- Fix "file already exists" error for stale cache files
- Fix file leaks with --vfs-cache-mode full and --buffer-size 0
- Fix invalid cache path on windows when using :backend: as remote

Local:
- Continue listing files/folders when a circular symlink is detected
- New flag --local-zero-size-links to fix sync on some virtual filesystems

Azure Blob:
- Add support for service principals
- Add support for managed identities
- Add examples for access tier
- Utilize the streaming capabilities from the SDK for multipart uploads
- Fix setting of mime types
- Fix crash when listing outside a SAS URL's root
- Delete archive tier blobs before update if --azureblob-archive-tier-delete
- Fix crash on startup
- Fix memory usage by upgrading the SDK to v0.13.0 and implementing a TransferManager
- Require go1.14+ to compile due to SDK changes

B2:
- Make NewObject use less expensive API calls
- This will improve --files-from and restic serve in particular
- Fixed crash on an empty file name
- Box
- Fix NewObject for files that differ in case
- Fix finding directories in a case insentive way

Chunker:
- Skip long local hashing, hash in-transit (fixes)
- Set Features ReadMimeType to false as Object.MimeType not supported
- Fix case-insensitive NewObject, test metadata detection

Drive:
- Implement rclone backend copyid command for copying files by ID
- Added flag --drive-stop-on-download-limit to stop transfers when the download limit is exceeded
- Implement CleanUp workaround for team drives
- Allow shortcut resolution and creation to be retried
- Log that emptying the trash can take some time
- Add xdg office icons to xdg desktop files

Dropbox:
- Add support for viewing shared files and folders
- Enable short lived access tokens
- Implement IDer on Objects so rclone lsf etc can read the IDs
- Set Features ReadMimeType to false as Object.MimeType not supported
- Make malformed_path errors from too long files not retriable
- Test file name length before upload to fix upload loop

Fichier:
- Set Features ReadMimeType to true as Object.MimeType is supported

FTP:
- Add --ftp-disable-msld option to ignore MLSD for really old servers
- Make --tpslimit apply

Google Cloud Storage:
- Storage class object header support
- Fix anonymous client to use rclone's HTTP client
- Fix Entry doesn't belong in directory "" (same as directory) - ignoring

Googlephotos:
- New flag --gphotos-include-archived to show archived photos as well

Jottacloud:
- Don't erroneously report support for writing mime types
- Add support for Telia Cloud

Mailru:
- Accept special folders eg camera-upload
- Avoid prehashing of large local files
- Fix uploads after recent changes on server
- Fix range requests after June 2020 changes on server
- Fix invalid timestamp on corrupted files (fixes)
- Remove deprecated protocol quirks

Memory:
- Fix setting of mime types

Onedrive:
- Add support for China region operated by 21vianet and other regional suppliers
- Warn on gateway timeout errors
- Fall back to normal copy if server-side copy unavailable
- Fix server-side copy completely disabled on OneDrive for Business
- (business only) workaround to replace existing file on server-side copy
- Enhance link creation with expiry, scope, type and password
- Remove % and # from the set of encoded characters
- Support addressing site by server-relative URL
- Opendrive;
- Fix finding directories in a case insensitive way

Pcloud:
- Fix setting of mime types

Premiumizeme:
- Fix finding directories in a case insensitive way

Qingstor:
- Fix error propagation in CleanUp
- Fix rclone cleanup

S3:
- Added --s3-disable-http2 to disable http/2
- Complete SSE-C implementation
- Fix hashes on small files with AWS:KMS and SSE-C
- Add MD5 metadata to objects uploaded with SSE-AWS/SSE-C
- Add --s3-no-head parameter to minimise transactions on upload
- Update docs with a Reducing Costs section
- Added error handling for error code 429 indicating too many requests
- Add requester pays option (kelv)
- Fix copy multipart with v2 auth failing with 'SignatureDoesNotMatch'

SFTP:
- Allow cert based auth via optional pubkey
- Allow user to optionally check server hosts key to add security
- Defer asking for user passwords until the SSH connection succeeds
- Remember entered password in AskPass mode
- Implement Shutdown method
- Implement keyboard interactive authentication
- Make --tpslimit apply
- Implement --sftp-use-fstat for unusual SFTP servers

Sugarsync:
- Fix NewObject for files that differ in case
- Fix finding directories in a case insentive way

Swift:
- Fix deletion of parts of Static Large Object (SLO)
- Ensure partially uploaded large files are uploaded unless --swift-leave-parts-on-error

Tardigrade:
- Upgrade to uplink v1.4.1

WebDAV:
- Updated docs to show streaming to nextcloud is working

Yandex:
- Set Features WriteMimeType to false as Yandex ignores mime types