sherifabdallah / wuzzuf-web-scraper

Employment Opportunities Web Scraping Tool

web-scraping-wuzzuf

Scrapping data from vacancies & career opportunities website

Table of Content

• wuzzuf-web-scraper
  • Tools
  • How to run
  • URL
  • Author

Tools

1. Python
2. Beautiful Soup
3. Streamlit

How to run

• Enter the directory where the script is located then type the following to the console

$ git clone https://github.com/sherifabdallah/web-scraping-wuzzuf web-scraping-wuzzuf

• Install Python 3.8 venv, pip and compiler

$ sudo apt-get install python3.8 python3.8-venv python3-venv

• Create a virtual environment to install dependencies in and activate it:

$ python3.8 -m venv venv
$ source venv/bin/activate

• Then install the dependencies:

(venv)$ cd web-scraping-wuzzuf
(venv)$ python -m pip install --upgrade pip
(venv)$ python -m pip install -r requirements.txt

Note the (venv) in front of the prompt. This indicates that this terminal session operates in a virtual environment set up by virtualenv.

• Finally run The App:

(venv)$ python -m streamlit run main.py

• And navigate to http://127.0.0.1:8501.

URL

• You can also navigate to the main website without needing to install python, you can navigate it from here

Author

Sherif Abdullah