boringPpl / Linkedin-profiles-scraping

Automatically scrape the web data of people profiles on Linkedin based on a specific search query

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Web Scraping: Crawling Linkedin Profiles


Automatically scrape the web data of people profiles on Linkedin based on a specific search query

Tutorial:

Problem:

It takes 10s on average to skim through Linkedin profiles and copy that information into an excel sheet. To collect a large enough amount of data for analysis purposes, it will take time if done manually.

Approach to the problem:

To efficiently collect and cluster Linkedin profiles data, this scrip helps automatically scrape the web data of people profiles on Linkedin based on a specific search query and store the output in a CSV file


Sponsor

Scrape public LinkedIn profile data at scale with Proxycurl APIs.

  • Scraping Public profiles are battle tested in court in HiQ VS LinkedIn case.
  • GDPR, CCPA, SOC2 compliant
  • High rate Limit - 300 requests/minute
  • Fast APIs respond in ~2s
  • Fresh data - 88% of data is scraped real-time, other 12% are not older than 29 days
  • High accuracy
  • Tons of data points returned per profile

Built for developers, by developers.

About

Automatically scrape the web data of people profiles on Linkedin based on a specific search query


Languages

Language:Jupyter Notebook 77.2%Language:Python 22.8%