Cyotek WebCopy 1.9.0 Build 822

What's new in this version:

Added:
- It is now possible to read additional URLs to scan from a text file
- Added no-directories, max-redirect and header arguments
- Added proxy, proxy-user and proxy-password arguments
- Added input-file argument
- Added Redirects To column to the results list
- Added Local File column to the files list
- Added Local File, Redirects To, Depth and Distance columns to links lists
- List views now display a configuration menu when context clicking a column header
- The GUI client now supports many of the same command line arguments as the CLI
- Added a new extension remap mode, Only HTML. This new option will change the extensions of downloaded files only if the content type is text/html, all other files will be as-is. This setting is now also the default for new WebCopy projects
- Added a new validator to try and detect unsupported websites
- Added new URL normalisation options for forcing HTTPS
- Added new URL normalisation option for ignoring case

Changed:
- Setup will now install Microsoft .NET 4.8 if not present
- Adding multiple URLs to scan is now easier using a free text field
- Command line tools now report unknown parameters
- Major reworking of internal decision making logic
- New WebCopy projects will default to saving headers
- The sitemap tree now limits the number of child elements to a maximum of 100 by default. This setting can be changed in the application options
- Documentation updates
- Rule Tester dialogue now includes rule components
- Reworked setting validation
- Rule expressions are now validated before crawling a site
- WebCopy no long treats URLs as case-insensitive for new projects
- The project URL can now be set via the Quick Scan dialogue

Removed:
-The Link Checker (GUI and CLI), URI Tester and XPath Tester tools have been removed from distribution due to lack of use

Fixed:
- Only the last argument error was displayed when running command line tools
- WebCopy will now retry URLs that fail with "The server committed a protocol violation" exceptions
- If using the default user agent, WebCopy will now try a default browser agent if a 401 response is returned when validating the URL
- When issuing a 401 challenge dialogue, WebCopy could include additional header information in the description
- The Move Down button was incorrectly enabled when adding a new password entry, causing a crash if clicked
- Fixed a pair of conditions that could cause site map generation to nest the same tree until it crashes. This should also resolve a different crash that could occur generating a site diagram
- Cookie editor now does a better job of validating entered values
- Invalid cookies should no longer cause a crash
- WebCopy would sometimes remove file extensions that weren't really extensions
- Various performance improvements, both major and minor #404]
- Last modified date is now read from meta tags if available
- Cancelling a crawl should now abort any in-progress downloads
- Fixed an issue where reading from a hybrid stream returned null bytes up to the stream capacity after exhausting existing data
- The rule editor could allow you select conflicting options
- A crash occurred accessing the Quick Scan dialog if the project URL wasn't set (regression)
- A crash occurred using the Quick Scan dialog if there was a problem with the crawl and the Use Browser Option was enabled
- A crash occurred accessing the Quick Scan dialog with an invalid project URL
- Fixed a crash that could occur when trying to use an invalid output path