CLI Scraper App - Symfony + Panther
Simple scraper for not only (extensible) pricing Packages
These instructions will get you a copy of the project up and running on your local machine for development and testing purposes.
What things you need to install the software and how to install them:
"php": ">=7.2.5",
symfony CLI
A step by step series that tell you how to get a development env running.
After cloning run:
composer install
Install ChromeDriver and geckodriver locally
vendor/bin/bdi detect drivers
Fire the sccript:
symfony console app:crawl-website
There are 2 options available:
sortBy=<'ASC','DESC'>
website=..
New Website contract definition to be added under:
App\Scraper
Unit tests:
./vendor/bin/phpunit
./vendor/bin/phpstan analyse src tests
- @Innomatrix - Idea & Initial work
- Hat tip to anyone whose code was used
- Inspiration
- References