mejihero / rightmove_webscraper.py

Python class to scrape data from rightmove.co.uk and return listings in a pandas DataFrame object

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

rightmove-webscraper

Downloads

rightmove.co.uk is one of the UK's largest property listings websites, hosting thousands of listings of properties for sale and to rent.

rightmove_webscraper.py is a simple Python interface to scrape property listings from the website and prepare them in a Pandas dataframe for analysis.

Installation

Version 1.0.2 is now available to install via Pip:

pip install -U rightmove-webscraper

How to use

  1. Go to rightmove.co.uk and search for whatever listings you are interested in ...

  1. Filter the search however you choose ...

  1. Run the search and copy the URL of the results page ...

  1. Create an instance of the class on the URL ...
from rightmove_webscraper import RightmoveData

url = "https://www.rightmove.co.uk/property-for-sale/find.html?searchType=SALE&locationIdentifier=REGION%5E94346"
rm = RightmoveData(url)
  1. Access the data using the methods and attributes of the object ...

Get the average price of all listings returned by the search:

rm.average_price

Show the total number of listings returned by the search:

rm.results_count

Access the full results as a Pandas dataframe at the .get_results attribute.

rm.get_results

Get quick summary statistics of the results, showing the number of listings and average price grouped by the number of bedrooms:

rm.summary()

Alternatively group the results by any other column returned in the .get_results DataFrame, for example Postcode:

rm.summary(by="postcode")

Legal

@toddy86 has pointed out per the terms and conditions here the use of webscrapers is unauthorised by rightmove. So please don't use this package!

About

Python class to scrape data from rightmove.co.uk and return listings in a pandas DataFrame object

License:MIT License


Languages

Language:Python 100.0%