Skip to content

HoichunNG7/Basic-Web-Crawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 

Repository files navigation

Basic-Web-Crawler

A basic web crawler written in python.

How to use it? Windows 10: cmd> python WebCrawlerBasic.py {input_file} {output_dir}

# {input_file} should contain URLs of webpages you want to download(one line for each URL).
# {output_dir} is where the program store those files containing downloaded texts.

About

A basic web crawler written in python.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages