One of our engineering challenges at NoRedInk is deciding how to show students the right mix of content in a performant manner. By choosing the right cross-section of content we can ensure that:
- Students achieve content mastery in the least amount of time, and
- Students don't get bored with the same questions.
We base our decision on a number of factors:
- Student ability
- Questions students have already seen
- Pedagogical hierarchy ...and more
We have simplified this problem so that you can actually get something done in a few hours.
You have 2 hours to code a solution to the following challenge.
We are providing you with two csv files:
questions.csv and usage.csv
The questions.csv file contains a mini-taxonomy. This taxonomy consists of Strands, Standards, and Questions. Strands have many Standards, and Standards have many Questions. Questions have a difficulty rating between 0 and 1, where 1 means everyone always gets the question correct, and 0 means no one ever does.
The usage.csv file contains the relevant student usage. Each row describes a single student seeing and possibly answering a single question. Questions are first assigned to the student, and then at a later time, the student may answer the question.
We would like you to write a program to select questions for a quiz. Please feel free to use any languages or libraries you choose.
- The program should prompt the user for the number of questions to put in the quiz. Any integer value greater than 0 is acceptable.
- The expected output is to display a list of question_ids.
- Use each strand as close as possible to an equal number of times. (e.g. There are two strands, so if the user asks for a 3 question quiz, it's okay to choose one strand twice and the other once.)
- Use each standard as close as possible to an equal number of times.
- Without the usage file, prefer questions that have not yet been assigned.
- Duplicating questions in the quiz is OKAY, if the quiz requires more questions than are available with even distribution!
- Not completing the basic requirements IS NOT FAILURE. We'd rather see a beautiful attempt than a complete attempt.
- Please use git to track progress. E.g. progressively commit changes so we can track your thought process.
Choose any or all of the following, time permitting:
- Write reasonable tests
- Parse the CSVs files instead of hard-coding the data.
- Order the questions in the quiz from easiest to hardest.
- Using the usage file, prefer questions that students have not answered.
- Using the usage file, prefer questions that students have not been assigned.
- Group the questions by standard, and then order the questions within each standard by difficulty (easiest to hardest).
- This is not an assessment of your front-end prowess. Function over form.
- You only have two hours. Take shortcuts, but leave real solution in comments. If you have enough time at the end, you can go back and make your solution less ugly.
- You will be assessed on both how well your function works, and how well your code reads.
- If you're about to begin, and you think to yourself: "I think I should use Rails/Django/...!" then you should know that nobody who has ever gone down that rabbit hole has ever succeeded. THERE BE DHHRAGONS! (The most successful submissions are command line applications.)