This is available for Planners.

The appeals/reassessment workflow allows candidates to appeal their grades, triggering a second round of grading. This process requires a committee based first grading round. The appeals Grader does not have access to the results or explanations from the first assessment round. 

This article shows you how to create appeals committees, define the workflow, and outlines important limitations.

See the article on Managing candidates in the Appeals workflow for more information on how to move candidates to an appeals committee.

Appeals workflow

The Appeals workflow can be summarized into five main points:

1. The test is set up, the candidates submit their answers, and a committee-based first grading round starts.
2. First grading round is approved.
3. One or more candidates appeals, and should be reassessed.
4. The Planner creates an appeals committee, assigns Graders for the reassessment, and moves the candidate to the appeals committee.
5. The appeals Grader completes a reassessment of the candidate's submission. 

Note: The Grader from the first assessment round keeps access to the submission, results, private notes, explanations, and annotations for audit purposes. The appeals Grader does not have access to the results from the first assessment round. If an explanation is sent in the first assessment round, this is not available for the appeals Grader. 

Create appeals committees

Committees are a requirement for appeals/reassessment, and there has to be at least one regular committee on the test.

You can create appeals committees at any time in the test lifecycle, even after the first assessment round is completed. It is not necessary to create appeals committees at the same time as regular committees, and it is not necessary to wait until the first appeal comes in from a candidate. 

• Before the test is graded: If you add a committee before the test is graded, the new committee will be a regular committee by default. This can be changed in the Edit assessment round2 settings, which are described later in the article.
• After the test is graded: Any new committee that is added after the test is graded will automatically become an appeals committee because at this time no more regular committees can be added. 

Create committees

1. Go to the test in Deliver, and click on Manage to add or change committees. 

   

2.  Add committees by clicking the button at the top right (1), name the committee (2), and click Add (3). 

   

3. When you have added your committees, you will be redirected to the Committees overview page. Here you get an overview of all the committees. Select a committee to open the action banner on the bottom of the page. See the next section for more information on the different options in the action banner.

Committees settings

In the Committees overview page you can edit the columns, Graders, assessment round, and workflow, and also delete committees.

1. All available columns are visible in the image above.
   • Committee name: It is not possible to change the name of the committee once it is created, and the content in this column is static.
   • Committee grading status: The committee status will be updated in this column. When final grading is complete, the status will automatically be set to Completed.
   • Graders: Number of graders assigned to the committee.
   • Candidates: Number of candidates assigned to the committee.
   • Assessment round: Primary round or Appeals.
   • General workflow: A summary of the workflow for the committee. This will be explained further later.
2. To assign Graders to a committee the Graders must first be added as contributors to the test. You can read more about how to do that in Test settings - adding contributors to test.
   1. Select the committee you want to assign Graders to, and click on Edit graders.
   2. This will show a dialgue where you can select from the graders who are added as contributors on the test.

   3. Choose the ones you want to assign, and click Done. 

      

3. Here you can change the committees to a regular or an appeals committee.

   When a regular committee is changed to an appeals committee (or the other way around), this will also be shown in the assessment round column on the committee overview page.

   1. To change the assessment round for a committee, click Edit assessment round.

   2. Select between Primary round or Appeals. 

      

4. All committees inherit the workflow settings from the test as default. We recommend changing the workflow for appeals committees to Confirm by candidate. This enables you to add more candidates to the same committee later, even if candidates have been confirmed previously. 
5. Committees can be deleted as long as they are not finished. If the committee you will delete has Graders and/or candidates assigned, these must be reassigned to another committee first.