D1st3f / PyTeStatistics

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

PyTeStatistics

This project was created for data scraping and data analysis of Python developer jobs on the site djinni.co. It builds graphs for detailed study and data analysis.

πŸ‘©β€πŸ’» Installation & Run

🧠 Set up the environment

On Windows:

python -m venv venv 
venv\Scripts\activate

On macOS:

python3 -m venv venv 
source venv/bin/activate

πŸ‘― Set up requirements

pip install -r requirements.txt

πŸ‘©β€ Set up config.py

You can change that file to reorder days of week or change what technologies you want to count.

🍈 How that works...

🧠 Scrapping:

  • You can run python .\Scrapper\data_scrapper.py to start process.
  • Now you will get a new .csv database in DataCollection folder.

πŸ˜‹ Work with data:

  • You can run python .\Analysis\data_processor.py to start process. It will check if database exists, if not will start scrapping.
  • In DataCollection folder you will get folder with current date, inside will be plots.
  • All diagrams will be compiled to single one - combined_plot.png. combined_plot.png
  • And there will be separate diagrams. experience_distribution.png location_distribution.png postings_per_day.png technology_mentions.png

πŸ˜‹ GL HF!

About


Languages

Language:Python 100.0%