File tree Expand file tree Collapse file tree 1 file changed +9
-5
lines changed Expand file tree Collapse file tree 1 file changed +9
-5
lines changed Original file line number Diff line number Diff line change 1
- # v2.1 (TBD)
1
+ # v2.1 (2017-11-16)
2
+
3
+ New features:
4
+ - If the environment variable ` LOG_TRANSFERS=true ` is given, transferred files will now be logged as they are being transferred.
5
+ Logging only occurs if the file is actually transferred, not if the target is found to be up-to-date.
2
6
3
7
Changes:
4
8
- Giving an invalid URL in ` jobs[].from.url ` now results in immediate failure during configuration parsing instead of
5
9
indeterministic errors later on.
6
10
- It is now an error for ` jobs[].from.url ` to not have a trailing slash. For now, a missing trailing slash will be added
7
11
and execution will continue, but this error will become fatal in a future version.
8
12
- The README now includes anti-usecases, in the "Do NOT use if..." section.
9
- - If the environment variable ` LOG_TRANSFERS=true ` is now given, transferred files will be logged as they are being transferred.
10
- Logging only occurs if the file is actually transferred, not if the target is found to be up-to-date.
11
13
12
14
Bugfixes:
13
15
- Percent-encoded URLs in directory listings are now decoded correctly.
@@ -38,13 +40,15 @@ Bugfixes:
38
40
39
41
# v1.1 (2017-08-21)
40
42
41
- Changes :
43
+ New features :
42
44
- Add a simple retry logic:
43
45
- A failed directory listing will be postponed and retried up to two times at the end of scraping.
44
46
- A failed file transfer will be postponed and retried once when all other transfers have completed.
45
- - Exit with non-zero status when any directory listing or file transfer fails.
46
47
- Report number of failed directory listings.
47
48
49
+ Changes:
50
+ - Exit with non-zero status when any directory listing or file transfer fails.
51
+
48
52
Bugfixes:
49
53
- Report failure when a source file cannot be retrieved (instead of uploading the error message to the target).
50
54
You can’t perform that action at this time.
0 commit comments