F1Jobs / updater

Update mechanism of f1jobs.co

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

top-image

Introduction

This is the update mechanism of f1jobs.co, which runs on a separate server. It queries the careers pages of all the Formula 1 teams every 30 minutes, and updates the data at the client repository.

Summary

getjobs.py - This is the main script, which is responsible for making web requests, fetching, validating and formatting data, and writing it at the client repository.

getcookies.js - This is a helper script which is required only to query the Ferrari careers page, which is run as an argument to PhantomJS. This is because Ferrari decided to use XHR to fetch their job listings instead of embedding them into the markup, and to those XHRs send a valid response only when valid cookies (which are set by the Ferrari careers page) are included in the request header.

About

Update mechanism of f1jobs.co

License:GNU General Public License v3.0


Languages

Language:Python 86.1%Language:Shell 10.4%Language:JavaScript 3.5%