This program scrapes LinkedIn jobs and enters the data into a Google Sheet. The information gathered includes job title, company and job poster.
- Go to the directory where you want the project
$ git clone https://github.com/noeldelgadom/linkedin_scraper.git$ cd linkedin_scraper$ bundle$ ruby scraper.rb
Accessing the Google Spreadsheet requires my permission.
- Jobs searched are limited to the Mexico City area.
- About 25% of job postings have the contact information visible. Hence, more jobs are scanned than actual contact information retrieved.
- Contact information always includes profile link, but rarely includes email. This is because most people hide it with privacy settings.
- To prevent duplicates, the algorithm checks if contacts have already been added.
- Two Watir browsers instances are used. One of them scrapes the jobs, the other scrapes the company and contact info.
- Login is done with a recently created 'fake' account under the name Tom Brady. This account is very empty so that job postings are not targeted in any way. If you use a real account, only relevant job postings to that account show up.