Random Distribution
To assign graders to their respective phases, click Edit grader grouping to launch the Edit grader group modal.
In the Edit grader group modal, you can select:
Number of group(s): Each group will be a collection of submissions with a specific grader(s) assigned to mark them.
Group name: These will be numbered groups by default but you can rename them to suit your needs. You do not need to include any information to identify the phase as the group will automatically have the phase name added to it (eg. Initial Marking Group 1, Initial Marking Group 2).
The character limit for Group names is 50.
Workload (%): The submissions will be split across the groups in the phase based on the stated workload percentage. The only requirement is the total distribution but equal 100% otherwise you won’t be able to click Save.
Workflow percentage can be up to 2 decimal places. In the event of it not being possible to distribute submissions exactly as per the workload percentage, standard rounding will be used to best reflect the desired workload split.
If rounding isn’t possible (eg. 4 evenly split groups and 3 submissions left to allocate), they will be distributed in group order (ie. Groups 1-3 will get one submission each)
Grader(s): The list of Graders added as contributors to the list will be listed, selecting them will add them as the grader(s) for the respective group. If Grader per submission is set as Single Grader in the workflow, only one selection will be possible per group.
Explicit Distribution
When a phase is set for Explicit distribution, the order of events is slightly different. Given it’s not possible to preempt which submissions will be present in each phase beyond the first, the allocation under explicit distribution only happens once the phase opens and the full submission list is known.
One the phase has opened:
- Go to Grader and Group Assignment for the test
- Click Edit grade grouping for the phase
- Click the Download CSV button in the top right corner.
Explicit distribution is achieved with a CSV file. Download the CSV file for the phase, add groups names to the submissions, then save and reupload the CSV. Groups are automatically created and the submissions are allocated to the relevant groups. All that’s left is to assign the graders to the group.
To reassign submissions to other groups, the process is the same.
The Explicit Distribution CSV
The CSV is made up of 3 columns
- Candidate ID
- This is the Candidate ID you are using within Inspera
- Group
- Blank by default. Enter in the group name the submissions should be in.
- If the group doesn’t exist, it will be automatically created.
- If the group already exists the submission will be added to it.
- Marking Status
- This column is informative only. If marking has started in the phase and you need to reassign submissions, the status column will help you identify which submissions have not been marked and can be reassigned. The 3 statuses are:
- Unmarked. The submissions does not have any marks awarded yet.
- Part-marked. One or more questions have been marked but all graders assigned to the submissions haven't completed and/or confirmed the marking
- Marked. All graders assigned to the submissions have completed their marking and confirmed it.
- This column is informative only. If marking has started in the phase and you need to reassign submissions, the status column will help you identify which submissions have not been marked and can be reassigned. The 3 statuses are:
For example, if double marking is taking place and one grader has marked and confirmed their marking, but the 2nd marker has not started marking or not yet finished, the status will show as ‘Part-marked’.
If using Microsoft Excel or Google Sheets
Microsoft Excel and Google Sheets (and perhaps other spreadsheet applications) makes the assumption a cell with numbers should be simplified by default. Therefore if you’re using numerical IDs such as Inspera’s default CandidateIDs (0001, 0002, 0003 etc), the numbers are simplified by removing all leading zeros (eg 1, 2, 3 etc). If you upload these simplified IDs, they will not be recognised as the 0s form part of the ID.
In Microsoft Excel, you can turn off this feature in the Options/Preferences under Automatic Data Conversion and uncheck Remove leading zeros and convert to a number.
Google Sheets does not have such an option, unfortunately.
Uploading the CSV
When you’re ready, select ‘Upload CSV from the edit grader group modal and upload your CSV. You will be presented with a summary of what’s going to happen next.
The Distribution Summary will cover:
- The number of submissions in the phase
- The number of submissions distributed to groups
- The number of submissions that are still without a group
- The number of submissions that will be added to:
- Existing Groups and their names
- Newly Created Groups and their names
- The number of submissions that will be moved to:
- Existing Groups and their names
- Newly Created Groups and their names
To proceed, click Confirm and the distribution will be complete. All that is left to do is to assign the graders to the relevant groups.
Reassigning Submissions to a different group
It is possible to move submissions between groups during the phase. Simply download the CSV, update the Group field, and reupload the file.
If a grader has already part-marked or marked a submission that needs to be reassigned to another group, the grader must be present in the new group for those marks to still be valid. If the grader is not in the new group, any marks from that grader will be ignored.
Related to