Glassdoor Salary exploration for financial analyst positions in the UK
Contributing Members
Team Leads (Contacts) : [Samuel Lawrence]: http://samuel-lawrence.co.uk/
Webscraper adapted from https://towardsdatascience.com/selenium-tutorial-scraping-glassdoor-com-in-10-minutes-3d0915c6d905
Inspiration for the project was based on Ken Jee's youtube series 'data science project from scratch' Major changes include:
- Unique model building approach based on sklearn ensemble module
- The model was deployed to production via streamlit on heroku url: https://glassdoor-fin-analyst.herokuapp.com/
- Updated webcrawler was in need of overall due to glassdoor's updated website
- Unique field objective
-- Project Status: [Complete]
Project phases:
- Adapt web scraper for data for model
- Clean data for analysis
- Analyze data
- Submit findings
- Scale and Build Machine Learning Model
- Host product on heroku
Project Intro
The objective of this project is to further understand what it takes to be a financial analyst in London. This exercise will serve as a gateway to those seeking to become analyst themselves as well as create an entry point adapting a machine learning model in predicting what role may be expected in relation to the different variables.
Methods Used
- Inferential Statistics
- Machine Learning
- Data Visualization
- Predictive Modeling
Technologies
- Python
- Pandas
- Numpy
- Matplotlib
- Nltk
- Wordcloud
- Seaborn
- Sklean
- Selenium
- Sklearn
Project Description
As we move closer to the full cycle of graduates moving into the work force, the question has been posed is what does it take/what is it like to be a financial analyst? Some questions we plan on answering include:
-
What kind of salary should be expected?
-
What positions are the most popular?
-
Types of companies Hiring?
-
What industries are the most popular?
-
Similarities between different roles?
-
Other questions we might want answered as we explore the data some more?
things to note:
- The data was gathered from Glassdoor job postings on 6/7/2020 via web scraper with the use of the Selenium Python library. As such, COVID-19 has remained a constant factor in our lives and should be taken into consideration.
- -1 represents data that wasn't specified in the job posting
- The sample size for this data set was 1,000 entries.
- We ran the web scraper multiple times to get a wider pool of data due to the number of missing data
Key findings
- Some of the most common words mentioned in the analysis include: 'Problem Solving','Bachelor Degree','team' and 'attention to detail'
- Average salary came out to around 30K depending on the seniority level
- Most big corporations are doing the hiring at the moment
Use Case
- With more data and better feature selection, users could calculate their exact salary