Backend test

Here is my solution proposition for the 2 exercices of the test.

In this README, you will find the install guide for ex01 and links to the documens containing the explanations for the choices and thinking behind both exercices.

Ex01

Installation

Install Ruby

Make sure the 3.0.4 version of Ruby is installed on your system.

with rbenv rbenv install 3.0.4
with rvm rvm install 3.0.4

Install bundler gem

gem install bundler

Move into the ex01 directory

cd ex01/

Install depencies for this application

bundle install

Setup the database

Create the database and its schema:

bundle exec rake db:create
bundle exec rake db:migrate

You're all set! 🚀

Usage

Load input data

The application uses a SQLite relational database. The first step is to import records, from the input CSV, to the app database.

The exercice input files for jobs and professions have been put in the db/data directory.

They can be imported in the database, respectively using:

bundle exec rake data:load_professions
bundle exec rake data:load_job_offers

Alternative: custom files

You can also load different data than the one initially given with the exercice, by passing the filepath as an argument to the tasks:

bundle exec rake data:load_professions db/data/professions.csv
bundle exec rake data:load_job_offers db/data/jobs.csv

Just bare in mind that there is no specific error management or check on the input files here, so the task will crash loudly if the file format differs from the initial ones.

Il you need to start from a fresh dataset, drop the existing database and recreate the schema from scratch:

bundle exec rake db:drop && bundle exec rake db:create && bundle exec rake db:migrate

Reverse geocoding

To launch the rake task that will reverse geocode all the job offers (ie get the continent from the coordinates), use

bundle exec rake geocoding:reverse_all

You can see the progress of this task by printing the count of records already reverse geocoded, and the records that have yet to be reverse geocoded with:

bundle exec rake geocoding:print_stats

Hack: Import dump

⚠️As discussed in ex01/explanations.md part, the main issue with this approach is the slowness of this step, that might take more than 1,5 hour at this point.

In the context of the correction of this exercide, in order to speed up this step, I provided a db dump, containing all the data already reverse geocoded. To replace the data with the one contained in the dump:

bundle exec rake db:drop && bundle exec rake db:create
cat db/dump.sql | sqlite3 db/development.sqlite3

Print results

Once the data has been imported and reverse geocoded, we can easily print the count of offers per category and per continent

bundle exec rake results:print
=>
+---------------+----------+---------+------+-------------------+-------+--------+------+
|               | Business | Conseil | Créa | Marketing / Comm' | Admin | Retail | Tech |
+---------------+----------+---------+------+-------------------+-------+--------+------+
| Africa        | 3        | 0       | 0    | 1                 | 1     | 1      | 3    |
| Asia          | 30       | 0       | 0    | 3                 | 1     | 6      | 11   |
| Europe        | 1371     | 175     | 205  | 759               | 396   | 426    | 1402 |
| North America | 27       | 0       | 7    | 12                | 9     | 93     | 14   |
| Oceania       | 0        | 0       | 0    | 1                 | 0     | 2      | 0    |
| South America | 4        | 0       | 0    | 0                 | 0     | 0      | 1    |
+---------------+----------+---------+------+-------------------+-------+--------+------+

Explanations

Detailed explanations for the design choices of this application can be found there: ex01/explanations.md.

Ex02

The solution for exercice 2 can be found there: ex02/scaling.md.

Durev / welcome