This repository was archived by the owner on Jul 19, 2018. It is now read-only.

HCF experiments#27

Open

kmike wants to merge 14 commits intoscrapinghub:masterfrom

kmike:experiments

Commits on Jun 6, 2013

WIP experiment: job scheduling is removed, more granular batches processing is added (they are deleted as soon as all their requests are processed, not when the spider finishes with a success).
kmike
committed

Commits on Jun 7, 2013

Commits on Jun 8, 2013

Commits on Jun 11, 2013

more stats; less verbose log
kmike
committed

Commits on Jul 2, 2013

remove pointless self
kmike
committed