Development

Various topics related to Web Scraper, Web Crawler and Data Processing development

Web Scraping with Java and HtmlUnit

java-htmlunit-post-front-cover-smallWeb scraping or crawling is the act of fetching data from a third party website by downloading and parsing the HTML code to extract the data you want. It can be done manually, but generally this term refers to the automated process of downloading the HTML content of a page, parsing/extracting the data, and saving it into a database for further analysis or use. more…

Php Curl download file

We want to show how one can make a Curl download file from a server. See comments in the code as explanations.

 

Python – parameterized storing into db to prevent SQL injection example

test.py

db_config.py (place it in the same directory as the test.py file)

Back to top