LinkedIn SERP Scraper
LinkedIn SERP scraper fetches results of LinkedIn public profiles from Bing search engine result page and returns result in JSON format
Setup
- Clone this project
- Install dependencies mentioned inside
requirements.txt
How to use?
In the project directory:
To scrap single linkedin profile:
$ python3 script.py --linkedin_url < url > --use_browser < browser_name >
Argument:
linkedin_url
is the linkedin profile URL.
For example, if user wants to scrap this URL https://in.linkedin.com/in/koushik-majumder-6172b412a
, the command line argument will look like python3 script.py --linkedin_url https://in.linkedin.com/in/koushik-majumder-6172b412a
--use_browser
is an optional argument, if not passed firefox will be used by default, other option available is Google Chrome.
To scrap multiple linkedin profile:
$ python3 script.py --filename < filepath >
Argument:
filename
is the path of the CSV file which contains all profile URLs separated by newline. For example: file.csv
is located at /usr/documents/file.csv
--use_browser
is an optional argument, if not passed firefox will be used by default, other option available is Google Chrome.
python3 script.py --filename /usr/documents/file.csv --use_browser firefox
Above code will use firefox by default and will scrap all linkedin profiles inside
file.csv
Help:
$ python3 script.py -h