irfanirshad / Web_Scraper

Scrapper for magicbricks.com

Repository from Github https://github.comirfanirshad/Web_ScraperRepository from Github https://github.comirfanirshad/Web_Scraper

Web_Scraper

It scrape data from magicbricks.com using BeautifulSoup and selenium WebDriver and store it in JSON format. Selenium web-driver package take the control of the browser and mimic the given actions to trigger desired events. BeautifulSoup is used to extract the particular element from the response.

Datapoints extracted

  • Name and ID
  • Description
  • URL
  • Price
  • Location Details ( City Name, Address, Latitude, Longitude)
  • Flat Details (Number of Rooms, Furnishing Status, Floor No.)
  • Agent Details(Agent Name, Masked Mobile Number)

About

Scrapper for magicbricks.com


Languages

Language:Jupyter Notebook 59.9%Language:Python 40.1%