Description
Is your feature request related to a problem? Please describe.
Issue: aws-amplify/amplify-backend#2026 (comment)
The Fire and Forget model seems to have limited applications from a first glance... Jobs taking longer than 30 secs would benefit from a mechanism to poll/monitor progress and completion, I think...
My need right now is to recursively poll an FTP server for file paths carrying specific prefixes, build a list of file paths that need to be download then transfer the download requests to Fargate tasks on ECS to copy the file on S3. Surveying the FTP server takes some time (usually less than 30 seconds but depending on latency sometime up to a minute or so...). The files can be pretty massive, ranging from a few Gb close to a fraction of Tb, hence passing the copy request to Fargate.
Thanks for any suggestions. Adding more patterns to the docs could prove helpful!
Describe the solution you'd like
examples providing this pattern