Inspera offers different collaboration workflows for graders. The workflow settings are available when creating a test, but they can also be changed later. This article will explain the different workflows that are available under Grading workflows in the test settings.
This setting requires activation and is primarily used for committee based marking of appeals.
Changing this setting will apply to all committees in the test, but the setting is also available for single committees if different workflows are required for different committees. The default setting is to confirm all candidates at once:
- Confirm all candidates at once is the standard setting. This will not change the behaviour of the settings described previously in this article.
- Confirm each candidate individually will change the grader workflow and allow graders to confirm grades for students before the test ends. They will no longer have the option to confirm grades for a committee, but rather get the option to share grades for each candidate individually. The grade for a candidate must first be shared with the co-grader(s) before the final grading can be completed.
Note that if the test is set up to use automatic submission, the candidates will not be available for grading until their individual deadline or the test end time is reached.
Setting marks and grades
This setting applies to both tests that use committee-based grading, and tests that don’t use committees at all.
Inspera supports both private marking, sometimes referred to as 'double blind' marking, and shared marking where the process is more open and collaborative. It is important to decide which marking workflow you want to use before any grading takes place on the test. If you decide to switch from shared marking to private marking or visa versa, any marking that has already taken place on that test will be cleared.
Other types of workflow changes will not reset marks/grades.
Private marking and results alignment
Also referred to as "double-blind marking", the graders work individually in the first step of the grading process. The marks and grades that are set are private to the grader until the grader confirms own grades. The grade will then be shared with co-graders.
Require graders to align marks
This feature requires activation.
Enabling this will require the graders to agree on marks per question in addition to the final grade. Find the guide here.
The graders start in the workflow step final grading (and the grader contributors on the test will start with the status “Has confirmed”).
In this workflow all marks and grades are shared from the start, and when a grader sets a mark or a grade it will replace the previous value.
- Within Shared marking is the option for Question assignment. Question assignment allows you to individually assign questions within a test to specific graders. This function creates a more flexible way to let graders divide their workflow, for example, assigning all essays to a certain grader. Read more about this option and how to use it.
Sharing marks and grades with committee
This setting applies to tests that use committee based grading. If there are no committees, this setting has no impact on the grading workflow.
- Allow completing own grades by committee: If a grader is a member of more than one committee, this setting will allow the grader to confirm own grades per individual committee.
- Require own grades to be confirmed across all committees: If a grader is a member of more than one committee, confirming own grades will confirm for all committees, even if the grader hasn’t set marks or grades in all committees.
Note that this setting is not compatible with Marking 2.0, and if the test is set up to use marking 2.0 this option will be automatically disabled.
Confirmation of marks and grades
This setting applies to both tests that use committee based grading, and tests that don’t use committees at all. If there is only one grader assigned to grade, this setting has no practical effect.
- All graders must confirm: All graders must actively approve final grades before the test can change status to graded.
- One grader can confirm: Once one of the graders on the test confirms, they do so on behalf of all graders and the test will change status to graded.
Test settings explained
This presentation was a part of Inspera Seminar 2020. It walks you through all test settings in Inspera.