crawling

A Simple Email Crawler in Python

Email Crawling I often receive requests asking about email crawling. It is evident that this topic is quite interesting for those who want to scrape contact information from the web (like direct marketers), and previously we have already mentioned GSA Email Spider as an off-the-shelf solution for email crawling. In this article I want to demonstrate how easy it is to build a simple email crawler in Python. This crawler is simple, but you can learn many things from this example (especially if you’re new to scraping in Python). more…

Kimono scraper is now enhanced with Pagination, Crawling and Data History

Several days ago I wrote the Kimono scraper review  where I mentioned that the service is short of pagination support and some other important functions. But it is fair to say that this service is developing quite rapidly and now they have not only added the ability to go over several pages and URLs, but even to keep the history of scraped data. Lets look at these features closely. more…

Back to top