test-application

This is a scrapy project used to test the development of a new http cache backend using delta compression.

To run the tests, download the repo and run test_crawl.py with a python interpreter.