WebCrawler

crawl illegal sites for detecting other illegal sites

Name		Name	Last commit message	Last commit date
Latest commit History 4 Commits
utils		utils
.gitignore		.gitignore
LICENSE		LICENSE
Pipfile		Pipfile
Pipfile.lock		Pipfile.lock
README.md		README.md
chart.py		chart.py
crawl.py		crawl.py
crawl_task.ps1		crawl_task.ps1
get_site_information.py		get_site_information.py
get_task.ps1		get_task.ps1
illegals_capture_example.db		illegals_capture_example.db
request_with_fake_headers.py		request_with_fake_headers.py
requirements.txt		requirements.txt
test.py		test.py
wget.exe		wget.exe

Provide feedback