VivaStreet scraping
Live Demo: http://obscure-journey-81618.herokuapp.com/cars
Getting Started
These instructions will get you a copy of the project
Prerequisites
Composer, Xampp (PHP 7.3, Aapache, MySql)
Installing
composer install
cp .env.example .env
php artisan key:generate
php artisan migrate
php artisan serve
Check it out http://localhost:8000/cars
How it works
Scraping only available on cars category - https://search.vivastreet.co.uk/cars/gb
- Validate submitted link to match this regex:
^(https|http):\/\/search\.vivastreet\.co\.uk\/cars\/gb(\?.*)?$
-
Fetching main list of cars on sale
-
Fetching all individual pages of cars in order to get more info
-
Fetching images and other data
-
Storing info about car in database
-
Storing resources in storage.
-
Creating blade file and pupulating it with data
I had to put images directly into the public folder, because heroku doesn't support symlinks