Stop Huggingface Stream

[gsaivinay]

Hello,

I found that stopping stream is currently not possible with the provided huggingface-stream.ts package and Hf.textGenerationStream method.

I've currently implemented by creating a custom fetch with abort controller and passing it as argument to Hf.textGenerationStream, and adding a try-catch block to huggingface-stream.ts to catch the user cancel operation and signal the abort controller. I'm looking for help if there are any better solutions, or happy to raise PR with these changes.

[github-actions[bot]]

This discussion was automatically locked because it has not been updated in over 30 days. If you still have questions about this topic, please ask us at community.vercel.com/ai-sdk