oxylabs / jobs-scraper

The Jobs Scraper API is an innovative tool designed to scrape job postings from different platforms. It delivers reliable, accurate, and real-time job market data for business analysis.

Jobs Scraper API

Oxylabs’ Jobs Scraper is a data gathering solution allowing you to extract real-time information from any jobs website effortlessly. This brief guide explains how a Jobs Scraper works and provides code examples to understand better how you can use it hassle-free.

How it works

You can obtain job results by providing your own URLs to our service. We will return the HTML for any jobs page you specify.

Python code example

The example below illustrates how you can obtain the HTML of a sample job posting from indeed.com

import requests
from pprint import pprint

# Structure payload.
payload = {
    'source': 'universal',
    'url': 'https://www.indeed.com/companies/best-agriculture-companies'
}

# Get response.
response = requests.request(
    'POST',
    'https://realtime.oxylabs.io/v1/queries',
    auth=('user', 'pass1'),
    json=payload,
)

# Instead of response with job status and results url, this will return the
# JSON response with the result.
pprint(response.json())

Find code examples for other programming languages here

Output Example

{
  "results": [
    {
      "content": " ... </html>",
      "created_at": "2023-12-18 11:39:49",
      "updated_at": "2023-12-18 11:40:05",
      "page": 1,
      "url": "https://www.indeed.com/companies/best-agriculture-companies",
      "job_id": "7142478560421252097",
      "status_code": 613
    }
  ]
}

With our Jobs Scraper, you can conveniently extract public data from any job web page. Gather necessary job information such as company profiles, salary ranges, job descriptions, location, and qualifications needed to study market trends and stay ahead in your career search. If you have any queries, reach out to our support team using live chat or drop us an email at [e-mail].