Document integrating Crawlee with task distribution & management systems #696
Description
- For Scrapy there is scrapyd & scrapydweb & scrapyrt.
- We could SEO target this in the documentation.
- We should cover this by using Crawlee on the Apify platform or integrating it with other open-source libraries, such as FastAPI, Celery and others.
- This is based mostly on the discussion Does crawlee-python has a task distributed or manage system like scrapyd and scrapyd-web? #679.