Analysis-of-Data-Jobs-in-the-Market
Objectives
What is the job market like for Data Analysts in the Bay Area based on job listings scraped on LinkedIn?
- Scraping data from LinkedIn our team’s objective is to answer the questions:
- How many data analytics jobs are out there in the Bay Area and what are the skills and backgrounds of the people who are getting hired?
- What skills, education, experiences are most coveted by employers?
- What is the supply (of job seekers) vs. demand (of data jobs) in the West Coast market?
Roadblocks
- LinkedIn’s Web Scraping Security Measures
- Cleaning Scraped Data
- Zipping Data into Pandas DataFrame with Python Zip Function
- Searching for Geo-Coordinates Using Google Maps API
- Exception Handling for Companies without Geo-Coordinates
- Bypass IndexErrors
- Exception Handling for Companies without Geo-Coordinates
- Converting JSON Data Into GeoJSON Data
- Create JSON File
- Pass JSON File into JavaScript Variable
Conclusion
Data Analytics jobs are concentrated in downtown San Francisco
- Particularly the Financial District
Next Steps
- Apply Machine Learning to Predict Hiring Success
- How Does a Company Select and Hire a Candidate (Outside the Interview Process)?
- What are the Combinations of Skills, Experience and Education Required, at Minimum, to Get an Interview?
- Find Correlations Between Employees (Currently Working) vs. Companies Hiring for those Positions
- Ex: Data Analysts at Google vs. Data Analyst Job Listings at Google