Smart and Simple Web Crawler is a useful tool that can be implemented in your apps and run in two different modes.Here are some key features of "Smart and Simple Web Crawler":

Ссылка: https://crawler..iles/documents/3439/121224/crawler-1.2.0-binary.zip