SuperBluestar / python-scrapping

beautifulsoup, request, urllib3, html5lib

Install docker

Reference Doc to install docker in machine.

How to run project using docker

sudo docker compose up

Editable content regarding to the requirements.

To display the metadata of fetching, should addd --metadata as param.

# ./docker-compose.yml
...
command: python fetch.py https://google.com --metadata
...

How to run project without docker

Install python 3.* in local.

Run commands to setup python packages.

python -m pip install --no-cache-dir -r requirements.txt

Run script

python fetch.py https://google.com
# or
python fetch.py https://google.com --metadata

If occured error, just print the error in terminal.