EGov Filestore Service is not working with Minio client

[Ramu-kandimalla]

Sometimes the file size downloaded in local doesn't matches with file stored in minio, so exception is thrown by the filestore service

Logs:
filestore_logs.txt

[talele08]

Can you please share a sample file for which this issue is coming? We will also need steps to replicate it in our system.

[assim-beehyv]

Hi @talele08,

In the logs of filestore service, something like this comes:

2025-06-25 11:51:29.288+0000 ERROR --- [080-exec-3] o.e.f.r.i.m.MinioRepository              -- TENANTID=null, CORRELATION_ID=07d7a890-83b5-460d-a03f-8d83e0d3bf5b : Error while downloading the file
java.lang.IllegalArgumentException: Source object, 'kl/DRISTI/May/7/1746602662016gojTlqowFG.pdf', size:1118973 is smaller than the destination file, '9513774b-f5cb-4e63-8348-a7c8356b85ca', size:2237946

Not Manually Reproducible, it happens randomly sometimes, and once this error occurs, we cannot download the file. The only way to correct this is to restart the filestore service which clear it cache, after which it starts fetching the file correctly.

It didnt happens for any specific file type but mostly we are uploading pdf files only.

[talele08]

Thank you for the additional details.

Based on your observation that the issue gets resolved after restarting the filestore service, it seems likely that a internal state within the service may be causing the inconsistency. We'll investigate the flow to identify areas that might be affected by this and begin working on a hotfix to address it.

We'll keep this issue updated with our findings and the progress on the fix. Appreciate your patience and support.

[talele08]

We’ve identified the root cause of the issue.

The error occurs when a file is uploaded and downloaded, and then another file with a smaller size is uploaded to the same path, effectively overwriting the original file. When attempting to download the overwritten file, the filestore service throws an exception due to a mismatch between the expected and actual file sizes.

We were able to reproduce this by manually replacing the file directly in the S3 bucket. However, we are still uncertain how this overwrite scenario is occurring in your environment.

A patch has been created to handle this edge case. You can find the commit here:
a50ac3f

The corresponding Docker image is built from the following branch:
egovio/egov-filestore:hotfix-filestore-v2.9.1-09b8f35
hotfix-filestore-v2.9.1

This branch will be merged into master in the upcoming minor release.

You can try this build in your environment and let us know if you face any issues.
Feel free to reach out in case you encounter any problems or need further assistance.