[Feature]: Detecting when there is corruption or missing image data/files

[zatricky]

Feature detail

Note that I'm still testing Immich, so I am not personally concerned about data loss ... yet. :-)

The NFS data store I was using for /usr/src/app/upload had some corruption issues and so became read-only. After restoring the NFS service some images have missing content due to that corruption (which is obviously not Immich's fault). See included screenshot.

If the original source device still has the content, it would be useful if Immich were able to detect the issue and then cause these images to be re-uploaded from that original source device.

Platform

Server

[alextran1502]

Can you help attach one of the corrupted files? I think it is the wepb thumbnail file if you can

[zatricky]

67e52940-075c-4cd2-b7df-857c0d7f5adf.webp.gz
Looking at the image binary it's just a whole lot of SOH's (01) repeated forever. The full image is also just 01 repeated - just that instead of 7592 bytes of SOH, it is 227 575 bytes. I'm not sure how to get the on-disk filename if you would like for me to get the file directly from the NFS (assuming that would help).

[zatricky]

@alextran1502 I'd like to destroy/recreate the deployment. Is there anything you need me to preserve for this issue?

[alextran1502]

@zatricky No, I think the corrupted file there is good, so I can reproduce it when I work on the issue.

Thank you for pinging me

[jt3204]

Any updates on this? I have a number of files that I believe were corrupted after being added to immich but should still exist on the source device. I can't manually fix the problem due to the encoding of the file name by immich. See below error examples:

`
2025-03-17 13:41:11 immich_server | [Nest] 7 - 03/17/2025, 1:41:09 PM ERROR [Microservices:{"id":"d49ea911-fb20-4837-aae8-6686b9d89c32"}] Unable to run job handler (thumbnailGeneration/generate-thumbnails): Error: Input file is missing: upload/upload/00c57131-c657-45c7-9204-7583e9b52b50/42/b4/42b46794-2825-4494-8da2-078fd79ae90b.jpg

2025-03-17 13:41:15 immich_server | [Nest] 7 - 03/17/2025, 1:41:09 PM ERROR [Microservices:{"id":"d76f60c5-79f7-4042-8290-add38542fb76"}] Unable to run job handler (thumbnailGeneration/generate-thumbnails): Error: Input file is missing: upload/upload/f07fb714-f713-43b8-a8d6-4b5404bc049e/d0/3f/d03fedb5-72f4-4be8-985d-317f7ee3b54a.PNG
`