Giters

codalab / chagrade

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Barcelona - Scope Item 5 Acceptance

gibsonbailey opened this issue · comments

commented

Priority 1 Issues (And a fix for student enrollment modal)

  1. Navigate to Chagrade here and sign in with the test user's credentials.
  2. Click on blue Instructor View button, and view the first class in the list.
  3. In the class wizard, click Enroll Students.
  4. Download the sample CSV if you don't have a CSV of students of your own.
  5. Upload the CSV of students.
  6. Verify that the students from the CSV now appear in the list of students in the class.
  • P1 Fix CSV student enrollment
  1. Now click the green Add New Student button. When this modal pops up, you should see that the cancel button has been fixed.
  • Cancellation of student creation must work
  1. In the class wizard, click Define Homework.
  2. Edit one of the homeworks that have already been created.
  3. Click on the due date input. There should be no dropdown menu with ISO dates.
  • P1 Remove obfuscation from datepickers. Field should not show history of dates.
  1. Observe the checkbox for constraining users to use Github submissions only. Be sure that this checkbox is unchecked, so that a file can be submitted directly from a user's computer.
  • Instructor should be able to force a Github submission
  1. Click on the Chagrade logo in the top left corner of the window to return home.
  2. Click on Student View.
  3. Verify that the student's grade shows in this view.
  • P1 Grades should show in students’ views of class list
  1. Click View on the first class in the list. You should see a list of homeworks after clicking.
  2. Click Submit on the Test HW 1 homework.
  3. Use the direct file upload functionality and upload this file.
  • Allow direct file upload
    Because of the complications of navigating access to files on the web, we have not included the functionality of uploading a file from urls of arbitrary domains. We instead suggest that users whom desire to upload files that are not hosted on Github to download the files themselves and directly upload them through the new direct upload feature.
  1. After submitting, click the blue View Submissions button.
  2. Click the blue Details button on the most recent submission.
  3. Observe the logs associated with the submission.
  • Link student to chagrade bot logs for their submissions.
  • Able to see if submission failed or succeeded from Chagrade.

Submission Limits

In order to test the submission limits, there is a competition set up on production Codalab here.
You can see that the submission limits are set to 2 per user.
Screen Shot 2019-12-09 at 3 43 00 PM

We will create a homework definition on Chagrade with a submission limit two greater than the number on the Codalab competition. We will see that the Chagrade bot on Codalab has special privileges, and will not be limited like the other users. However, Chagrade will limit students to the max submission limit set on each homework.

  1. Navigate to the class, Deep Learning, as an instructor. Edit the homework definition ** Test HW 1 **. Set the maximum submission limit per student input to ** 4 **.
  2. Navigate to ** Test HW 1 ** as a student by returning to the homepage of Chagrade, clicking the student view, View on Deep Learning, and Submit on ** Test HW 1 **.

Notice that the Codalab challenge can be accessed from the submission page via the blue Codalab Challenge button.

  • Place Codalab challenge button on the submit homework page
  1. Submit a valid url to this homework 4 times. This is evidence that Codalab is not limiting the Chagrade bot.
  2. Now you should see that the Submission limit has been met.
  • Remove limit of submissions on Chagrade Bot on Codalab. Limit students on the Chagrade side.

Class Creation

  1. Return to the Chagrade home page by clicking the Chagrade logo in the top left of the navbar.
  2. Click Instructor View.
  3. Click the green Create a Class button.
  4. Be sure to use the Course Number, ML505. This will be used to prove that the course numbers are no longer required to be unique. The other details of this class do not matter. Fill out the rest of the form with dummy data.
  • Remove the uniqueness constraint on class numbers
  1. Create one homework definition.
  2. Click the Activate Class section of the class wizard.
  3. Click the yellow, View as Student button. This allows the instructor to test the class before activating. In order to do this, the instructor was automatically enrolled to the class as a student.
  • Automatically enroll instructor in his or her own class as a student
  • On Activate Class section of wizard, the Test-Your-Class button should point to the instructor’s automatically-created student profile’s student view

Metrics

  1. Navigate to the class, Deep Learning, as an instructor. Click the blue Metrics button. Here you should see grades and competition scores in the overall class chart as well as in the individual student chart.
  • On metrics, put grade in charts, rather than only competition score
  1. You will see a checkbox on the same vertical level as the Overview, Students, Teams tabs. You can check and uncheck this checkbox to see metrics filtering for questions-only homeworks.
  • Give the option to filter questions_only homework and competition homework in Chagrade Metrics