Skip to content

Comments

Postgresql: Handle copy errors#114

Open
alip wants to merge 4 commits intomasterfrom
postgresql-handle-copy-errors
Open

Postgresql: Handle copy errors#114
alip wants to merge 4 commits intomasterfrom
postgresql-handle-copy-errors

Conversation

@alip
Copy link

@alip alip commented Dec 8, 2022

This is a relatively small change which ensures we handle libpq errors whilst COPYing data and abort in case any error occurs. This partially fixes #80 which is a partial aid against data loss where we lose at most one batch of data in case of errors on postgresql side. The batch size is hardcoded to 2000 at the moment. The second part of the issue where we ensure to retain messages in case of a libpq error is left to be fixed in a future PR.

@alip alip added the review label Dec 8, 2022
@zhuosun
Copy link

zhuosun commented Mar 24, 2023

Any update on this?

@alip
Copy link
Author

alip commented Mar 30, 2023

Any update on this?

Waiting on Belha's review. @zegeek, please let me know if there's anything I can do to help.

@alip alip requested a review from zegeek March 30, 2023 11:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Postgres modules don't check libpq errors

2 participants