Download only media newer than the last download is fetched for that user

[zero0n3]

If there isn't already a function that allows it (I searched but I didn't find anything) it would be possible to:

• save in a log file, based on the gallery/user id, the timestamp of the last downloaded photo

• when the download is relaunched, start downloading the photos from that specific timestamp for that specific gallery/user

avoiding rereading all the photos from the beginning

[hrxn]

Well, there basically is..

Use the archive option:
https://gdl-org.github.io/docs/configuration.html#extractor-archive

Note that the exact functionality differs for different site extractors, but I'd assume that this is basically what you want to use here.

[zero0n3]

Thanks @hrxn ! That's what exactly i need. Now I added the configuration:
"archive": "./pixiv/latest.sqlite3",
I relaunched the command for download (pixiv in my case), and the file was created.

Now, do I need to add other configurations to the config file, to be able to quickly skip the already downloaded IDs or is it enough for me to have set the path of the archive file, and with that gallery-dl will automatically skip the already downloaded files?

Thanks

[mikf]

You might want to use "skip": "abort:N" (#6462) or "image-filter": "... or abort()" (#6436) to stop the data extraction process early.

The archive file lets gallery-dl skip over downloads, but it'll still fetch the download URLs before skipping them.