Skip to content

Commit 0d9521e

Browse files
authored
Update README.md
1 parent 9af558c commit 0d9521e

File tree

1 file changed

+3
-4
lines changed

1 file changed

+3
-4
lines changed

README.md

Lines changed: 3 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -47,7 +47,6 @@ Install [Python 3](https://www.python.org/downloads/) and the requirements.
4747

4848
1. Use Selenium headless (maybe using PhantomJS).
4949
2. Add support for cookies and basic auth.
50-
3. Add support for custom user agents.
51-
4. Add support for SEO url injection.
52-
5. Create the crawler (including support for POST requests).
53-
6. Document all code.
50+
3. Add support for SEO url injection.
51+
4. Implement [Not Your Average Web Crawler](https://github.com/tijme/not-your-average-web-crawler).
52+
5. Document all code.

0 commit comments

Comments
 (0)