Appeals/reassessment - Planners

In this article, we will describe how the planner can set up reassessment/appeals in Inspera Assessment.

The following information is valid for tests that are not connected to external systems (like FS for Norwegian customers).

The reassessment workflow that is supported by Inspera can be summarized into five main points:

• The test is set up, the candidates submit their answers, and a committee-based first grading round starts.
• First grading round is approved.
• One or more candidates appeals, and should be reassessed.
• The planner creates an appeals committee, assigns grader for the reassessment, and moved the candidate to the appeals committee.
• The appeals grader completes a reassessment of the candidate's submission. 

The appeals grader does not have access to the results from the first assessment round. If an explanation is sent in the first assessment round, this is not available for the appeals grader. 

The grader from the first assessment round keeps access to the submission, results, private notes, explanations, and annotations.

Table of contents

1. Create committees
        Columns in the committee list
        Edit graders
        Edit assessment round
        Edit workflow
        Delete committee

2. Monitor / candidate list
        Using filters
        Individual grading deadline
        Move candidates to an appeals committee

1. Create committees

You can create appeals committees at any time in the test lifecycle, even after the first assessment round is completed. It is not necessary to create appeals committees together with regular committees, and it is not necessary to wait until the first appeal comes in from a candidate. 

If you add a committee before the test is graded, the new committee will be a regular committee by default. This can be changed, and more detailed instructions will follow.
After the test is graded, any new committee that is added will automatically become an appeals committee because at this time no more regular committees can be added. 

Anything you want to do with committees on a test starts out in the committee widget on the test front page. Click on "Manage" to add or change committees.

Committees are a requirement for appeals/reassessment, and there has to be at least one regular committee on the test. Add committees by clicking the button at the top right (1), name the committee (2), and click "Add" (3).

When you have added your committees, this is the view you will see. One of the committees in this image is selected to show the associated options in the action banner. Note that committee 3 is a regular committee at this time, we will change this in point 3.  

Columns in the committee list (1)

All available columns are visible in the image above.

• Committee name: It is not possible to change the name of the committee once it is created, and the content in this column is static.
• Committee grading status: The committee status will be updated in this column. When final grading is complete, the status will automatically be set to "Completed".
• Graders: Number of graders assigned to the committee.
• Candidates: Number of candidates assigned to the committee.
• Assessment round: Primary round or Appeals.
• General workflow: A summary of the workflow for the committee. This will be explained further later.

Edit graders (2)

To assign graders to a committee the graders must first be added as contributors to the test. You can read more about how to do that in Test settings - adding contributors to test.

Select the committee you want to assign graders to, and click on "Edit graders". This will show a dialgue where you can select from the graders who are added as contributors on the test. Choose the ones you want to assign, and click "Done".

Edit assessment round (3)

1. To change the assessment round for a committee, click Edit assessment round.
2. Select between Primary round or Appeals.

When a regular committee is changed to an appeals committee (or the other way around), this will also be shown in the assessment round column on the committee overview page.

Edit workflow (4)

All committees inherit the workflow settings from the test as default. We recommend changing the workflow for appeals committees to "Confirm by candidate". This enables you to add more candidates to the same committee later, even if candidates have been confirmed previously. 

Delete committee (5)

Committees can be deleted as long as they are not finished. If the committee you will delete has graders and/or candidates assigned, these must be reassigned to another committee. 

2. Monitor/candidate list

In Monitor, you will find a new column called "Assessment round". Click on the column selector and find the column in the list. You can search for it if it's not at the top of the list.

This column contains the following:

• 1 - Regular applies to candidates who have not been moved to an appeals committee.
• 2 - Appeals applies to candidates who have been moved to an appeals committee.
• If there are no committees on the test, this field will be empty.

If the candidate has several assessment rounds, the number in front of the Appeals will increment by one for each assessment round. A candidate who is in their third assessment round will have the value 3 - Appeals in this field.

Using filters

The current assessment round is identified with a number (as described above) and applying filters to this value will be a bit different because of this.

To set up a filter, click "Filters", "More filters", and then choose "Assessment round".

Click on "Assessment round" to view the filter options available.

Because the first assessment round has the number 1 associated, the second round is 2, third round is 3, and so on, the selection you do here is based on these numbers.

Examples:

• Assessment round is equal to 1 - this will show all candidates who are in the regular (first) round.
• Assessment round is greater than 1 - this will show all candidates who are in reassessment rounds.
• Assessment round is equal to 2 - this will show all candidates who are in their first reassessment round.

The most useful filter option is the values 1 and 2 for the regular grading and the first assessment round, but if you want to see all candidates who have had more than one reassessment you can select an assessment round greater than 2.

Individual grading deadline

You can add individual grading deadlines for candidates. This is not required but it will enable reminder e-mails to the grader(s) in the committee. The date will be visible to the grader, but it will not prevent the grader from continuing after the date has passed.

To set an individual grading deadline, select the candidate and choose "Grading deadline" from the bottom action banner.

Click on "Not set" to get a date picker. Click "Clear" to remove a date.

Move candidates to an appeals committee

The prerequisites for moving a candidate to an appeals committee are that the test is graded and that the candidate has a final grade from the regular grading. For the remainder of this section, we assume that all graders are finished and that the final grades are in place.

The first step is to find the candidate in the candidate list, select the candidate, and then choose "Edit grading committee" from the bottom action banner.

This will show the option of moving the candidate to a different committee. At this point, the only selectable option is an appeals committee. 

One important limitation is that an appeals grader cannot have graded the same candidate in regular grading (first assessment round). You will not be allowed to move the candidate to an appeals committee where the grader is the same one that did the first round for that candidate. 

This block also applies if you try to assign the first round grader to the appeals committee.