marcogdepinto / amazon-jobs-scraper

Creating a CSV file with the jobs available at a particular URL of the Amazon.jobs website.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Amazon.jobs scraper

made-with-python

Creating a CSV file of the jobs available at a particular URL of the Amazon.jobs website.

Disclaimer: this tool is not endorsed by Amazon in any way and I am not responsible for the usage you will make of it.

Why I did this?

I wrote this software while I was searching for a job at Amazon. It can be used to pull all the information from a particular amazon.jobs URL and then elaborate them with Excel or other tools.

How does this work?

Add to the config.py file a research URL like this one. You can generate an url like this researching on amazon.jobs your target job and location. For example, this url has been generated researching for "Program Manager" in "Turin (IT)".

Below an example of the structure of the output that you can get from this script:

job_title,location,job_id,job_url

Program Manager,"IT, Turin ",943396,https://www.amazon.jobs/en/jobs/943396

Setup guide

  1. git clone https://github.com/marcogdepinto/amazon_jobs_scraper.git;
  2. $ pip install -r requirements.txt;
  3. (Windows users only) Get an updated version of the Chrome Webdrivers here and replace the one in the chromedrivers folder. You also need to have Google Chrome installed.
  4. (MacOS users only) Ensure the WEBDRIVER_PATH_MAC variable in the config.py file contains the correct path to your Chrome Webdrivers.

How to run it

  • Open a command prompt and cd into the directory in which the file is saved;
  • Edit the config.py changing the URL variable with the url you want to scrape.
  • type python scraper.py to run it.

Developers stuff

This code is pylint and mypy 100% compliant.

About

Creating a CSV file with the jobs available at a particular URL of the Amazon.jobs website.

License:MIT License


Languages

Language:Python 100.0%