Razpudding / preprocessing-survey

A program to process survey data. Its main function is to obfuscate geolocation data

Processing survey data

Functionality

I wrote this code to use it in an upcoming course at the Hogeschool van Amsterdam. It converts student survey data (not included in this repo for privacy reasons) from csv to json. It also uses the module geolocation to anonymize geolocation data.

Install instructions

## Clone this repo to your local environment

## Install dependencies
npm install

## Create a folder called 'input' and a folder called 'output'
## Put csv surveydata into the input folder
## Optional: Change the settings object in the preprocessing.js file
node preprocessing.js

## Check the output in the 'output' folder

Steps to take

• Read in csv, output json
• Assign a UID to each row
• Detect type of geolocation
• Anonymize geodata
  • Made Degrees, Minutes, Seconds geolocations less precise by changing the seconds in the address to 0 which seems to obfuscate the precission of the address by about 500 meters.
  • Made Decimal Degrees geolocations less precise by only keeping 2 digits after the comma, making the address precise to about 1km.
• Refactor: remove index var for recursion, move location object to higher order function
• Formulate initial questions
• Play with data in excel, find initial patterns
• Formulate main question
• Design viz on paper
• Start working on viz in d3