Skip to content

Fix Prefix used when fetching subsequent pages with ListObjectsV2#154

Open
mschout wants to merge 1 commit into
someone1:masterfrom
mschout:fix-listobjects-pagination
Open

Fix Prefix used when fetching subsequent pages with ListObjectsV2#154
mschout wants to merge 1 commit into
someone1:masterfrom
mschout:fix-listobjects-pagination

Conversation

@mschout
Copy link
Copy Markdown
Contributor

@mschout mschout commented Jun 4, 2021

The Prefix that was used when fetching subsequent pages via the
ContinuationToken was not the same prefix as the one used for the first
page.

This is incorrect, and causes the subsequent page fetches to fail.

So once your manifests prefix has enough entries that it needs to fetch the next page, zfsbackup-go blows up with an S3 error.

Seems fairly obvious this was a typo/omission from a skim of the code. Hopefully makes sense.

The Prefix that was used when fetching subsequent pages via the
ContinuationToken was not the same prefix as the one used for the first
page.

This is incorrect, and causes the subsequent page fetches to fail.
@mschout
Copy link
Copy Markdown
Contributor Author

mschout commented Jun 12, 2021

In case not clear, the issue here is that the Prefix in these 2 calls needs to match exactly:

image

jdfalk added a commit to jdfalk/zfsbackup-go that referenced this pull request Nov 13, 2022
…h ListObjectsV2.

Signed-off-by: Johnathan Falk <johnathan.falk@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant