Scraping data from Bayut
This project aims to scrape data about apartments for rent in Egypt from bayut page of Residential Properties for rent in Egypt
This project aims to scrape data about apartments for rent in Egypt from bayut page of Residential Properties for rent in Egypt to use this data to analyze it and see the trends in this data.
Scrapy is the main tool used in this project.
-bayut: The main file which contains the Scrapy project files like the settings file and the spiders directory.
-data: The directory containing the scraped data and data sample.
Scraped about 4400 property succesfully in the Full_data.json.
Created a data sample to make the output format available without downloading the full data.
Explain how to use your code and reproduce the results. Include any dependencies and installation steps.
# Clone the repository
git clone https://github.com/ahmedemad2002/Scrape-Bayut.git
# Navigate to the project folder
cd Scrape-Bayut
# Install scrapy
pip install scrapy
# Run the code
python main.py