Test settings - Grading workflow

Inspera offers different collaboration workflows for graders. The workflow settings are available when creating a test, but they can also be changed later. This article will explain the different workflows that are available under Grading workflows in the test settings.

Setting marks and grades

This setting applies to both tests that use committee based grading, and tests that don’t use committees at all. 

Private marking and results alignment 

The graders work individually in the first step of the grading process. The marks and grades that are set are private to the grader until the grader confirms own grades. The grade will then be shared with co-graders.

Require graders to align marks

This feature requires activation. 

Enabling this will require the graders to agree on marks per question in addition to the final grade. Find the guide here.

Shared marking 

The graders start in the workflow step final grading (and the grader contributors on the test will start with the status “Has confirmed”).

In this workflow all marks and grades are shared from the start, and when a grader sets a mark or a grade it will replace the previous value.

• Within Shared marking is the option for Question assignment. Question assignment allows you to individually assign questions within a test to specific graders. This function creates a more flexible way to let graders divide their workflow, for example, assigning all essays to a certain grader. Read more about this option and how to use it.
  

Sharing marks and grades with committee

This setting applies to tests that use committee based grading. If there are no committees, this setting has no impact on the grading workflow.

Allow completing own grades by committee

If a grader is a member of more than one committee, this setting will allow the grader to confirm own grades per individual committee.

Require own grades to be confirmed across all committees

If a grader is a member of more than one committee, confirming own grades will confirm for all committees, even if the grader hasn’t set marks or grades in all committees.

Note that this setting is not compatible with Marking 2.0, and if the test is set up to use marking 2.0 this option will be automatically disabled. 

Confirmation of marks and grades 

This setting applies to both tests that use committee based grading, and tests that don’t use committees at all. If there is only one grader assigned to grade, this setting has no practical effect. 

All graders must confirm

All graders must actively approve final grades before the test can change status to graded.

One grader can confirm

Once one of the graders on the test confirms, they do so on behalf of all graders and the test will change status to graded.

General workflow

This setting requires activation and is primarily used for committee based marking of appeals.

Changing this setting will apply to all committees in the test, but the setting is also available for single committees if different workflows are required for different committees.

Confirm all candidates at once is the standard setting. This will not change the behaviour of the settings described previously in this article.

Confirm each candidate individually will change the grader workflow and allow graders to confirm grades for students before the test ends. They will no longer have the option to confirm grades for a committee, but rather get the option to share grades for each candidate individually. The grade for a candidate must first be shared with the co-grader(s) before the final grading can be completed.

Note that if the test is set up to use automatic submission, the candidates will not be available for grading until their individual deadline or the test end time is reached.