Guide - Multiple markers with Committees

This guide applies to you if you have co-graders and you are a member of several Committees.  

The guide's content will be based on marking the candidates one by one by first marking the questions in the submission for one candidate and then going to the next candidate. 

Table of content

• Sign in to Inspera Assessment
  • Brief explanation of the header
• Get an overview of the candidates
• Brief explanation of the Marking workspace and navigation
  
  • The Marking workspace
  • See and navigate between candidates and questions
• Start marking
  • Step 1 - Select a candidate and mark the first question
    • Automatically marked questions
    • Manually marked questions
    • Unanswered questions and attachments
  • Step 2 - Proceed to the next questions
  • Step 3 - Go to the next candidate and mark the questions
  • Step 4 - Review the marking
    • Get an overview of the marking in its entirety (workspace Overview)
    • Review the marking at candidate and question level (workspace Results)
  • Step 5 - Share the marking
  • Step 6 - Look at any conflicts in grades and align
  • Step 7 - Confirm the marking
  • Step 8 - Choose the next committee and continue marking
  • Step 9 - Private notes, explanations and comments in the submission

Sign in to Inspera Assessment

Sign in to Inspera Assessment the usual way. When you are invited as a grader on a test, you will receive an email about this, and the email also contains a link to the test which you are invited to mark. 

• Open the test from the link in the email, or
• After signing in, select and open the test you are going to mark from the list.
  If you are a member of several committees, you will start by choosing the committee which you are going to mark.
• The first workspace you encounter the first time you open the test is the workspace Overview. This is where you are going to start.

Brief explanation of the header

The header at the top of the panel shows the test name, your name, what user roles you have in the context of the test, and which committee(s) you belong to. 

If you are a member of only one committee, there are no more options here. However, if you are a member of several committees, you get some extra options. 

By clicking on Committee (committee name), you will get the committee selector in a new window that gives you more information about the committees. You can click on the committee that you want to start marking in, to get to the candidates. 

You can read more about the header in the article Header for grader.

Get an overview of the candidates

Select the workspace Overview under Workspaces if you are not already there.

The overview shows a list of all of the candidates. The list gives you an overview of the following:

• Flagged
• ID (Candidate ID)
• Attachment
• Your grade
• Grades
• Workflow status
• Final grade
• Marking status 
• Total marks
• Committee
• Marking deadline

Brief explanation of the Marking workspace and navigation

When you are going to start the marking, start by selecting the workspace Marking under Workspaces. 

The Marking workspace

In the workspace Marking, you can look at the candidates' submissions question by question and mark them. 

The tabs above the question give the following choices:

• 120369 / 2: The answer to the selected candidate and question. On automatically marked questions, correct answers are also displayed. 
• Question: Here you can see the question as it was given on the test. Correct answers to automatically marked questions will also be shown. 
• Attachment: If there is an attachment to the candidate's submission, you can see it here. PDF will be displayed directly, while other file types can be downloaded and opened in a suitable program. 
• Similarity: Question types such as Essay and Upload Assignment can be checked for plagiarism, and if plagiarism control is enabled the plagiarism report is accessed here. Read more about Plagiarism reports.  

The panel to right (see image below) shows, among other things, which question type and how many marks the candidate has been given on automatically marked questions. 

In the candidate's answer you can also do the following:

1. Write and view comments and annotations on the submission. If a co-grader or a planner on a test has written a comment or annotation, this will be indicated by a speech bubble next to the tab in the selected question.
   
   Read more about how to see and write comments and annotations.
   
   
2. Set marks on the question (this will be described in more detail in Step 1 - Select the candidate and mark the first question).
   
   
3. Mark scheme: If a mark scheme has been added to the question, it will appear here. 
   
   
4. Question private notes: Write a private note on the question. This is only visible to you and is not shared with anyone. 

See and navigate between candidates and questions

In the footer, you can choose to navigate between candidates and questions that you are going to mark. In the example below, candidate 120690 and question 2 are selected.

You can read more about how to navigate between candidates and questions in the article about the footer. 

Start marking

Step 1 - Select a candidate and mark the first question

1. Go to the workspace Marking.
2. Choose a candidate that you want to start marking. 
3. Start with marking question 1.

Automatically marked questions

Automatically marked questions are marked by Inspera Assessment once the candidate has submitted the test. These questions are marked with a lightning icon and have the text Automatically calculated in the upper right corner.  By filtering for Automatic marks in the footer, you can choose to only navigate through the automatically marked questions. 

As a grader, you can override the marking of the automatically marked questions. To do this, click Override. 

Manually marked questions

On manually marked questions, you will set marks yourself. 

Questions that have not been awarded marks are marked in the upper right corner with Not set. 

To the right of the question you will find the option to set marks. Select the number of marks by clicking the dropdown. It is also possible to set marks with up to two decimals. Instead of selecting marks from the list, type the number of marks, example 2.5 or 2,5.

Once you have set marks, the status of the question changes to "Set by you a few seconds ago".

By clicking Reset, you can reset the marks that you have given. 

Unanswered questions and attachments

An unanswered question contains no answers from the candidate. To be absolutely sure that a question is unanswered, you can check under the column Response in the candidate list on the workspace Results. 

In some cases, unanswered questions may still contain a response. If there is an attachment added to the submission, this will appear in the toolbar under Attachment. 

To view the attachment, click Attachment. If the attachment is a PDF, it will appear directly in the view, while other file types must be downloaded. A download link will then appear when you click Attachment. 

Step 2 - Proceed to the next questions

1. Proceed to the next question by navigation in the footer.
2. Mark the question according to the question type.
3. Repeat until you have marked all of the questions in the candidate's submission.
4. When you have gone through all of the questions and finished marking, you will receive a message that the grade is calculated and which grade the candidate received. 

If you choose to reset the marks on a manually marked question after you have marked all of the questions, you will receive the message "Calculated grade was removed. Marks are no longer complete for candidate/group (candidate ID)".

Step 3 - Go to the next candidate and mark the questions

• Navigate to the next candidate by using the footer.
  • Note: The first question that is displayed is the same question number as when you completed the previous candidate. If you want to start on question 1 again, navigate back to the question.
• Repeat step 1 and step 2. 
• Do this for all of the candidates.

During your marking, you will see a status bar at the top of the workspace that shows how far along your marking is. This is updated for each question that you have marked. 

Step 4 - Review the marking

When you have completed all of the questions, for all of the candidates, the status bar will show 100 % complete.

For graders that are in only one committee, the status bar will also show 100 % completed. 

To review the marking in its entirety, go to the workspace Overview. If you would like to review the marking candidate by candidate and question by question, go to the workspace Results. 

Get an overview of the marking in its entirety (workspace Overview)

The workspace Overview provides an overview of the candidates with the grades that have been set and the status of the marks. By clicking the list Grade not set, you filter the candidates by whether they have been given a grade or not. 

The fact that the workflow status is "private" means that you have not yet shared your marking. The workflow status will change once you have shared your marking. 

Review the marking at the candidate and question level (workspace Results)

The workspace Results gives you the following overview:

1. The candidate list: List of candidates with total marks and your grade.
2. Question list: List of all the questions for the selected candidate.
3. The question panel: The candidate's answer to the selected question. 

Click through each candidate in the candidate list and see if all of the questions have been marked in the question list. In the question panel, you can also view and write annotations and comments on the question using the annotation tool.

Step 5 - Share the marking

The next step in the marking process is to share your marking. To do this, click Share in the header.

After clicking this button, you will be presented with a window where you must confirm the sharing of the markings (blue button). 

The tabs at the top show you where you and your co-graders are in the marking process. After all the graders in the committee have shared their marking, the next step will be to look at any conflicts. 

In this window you also have the option to (1) change grades, (2) look at the submissions, download and print submissions, as well as write explanations at the candidate level. 

When you are ready to share your marking, click the blue button Share with co-graders now. 

Unshare

You can unshare and go back to private marking as long as not all co-graders have shared their results yet. To unshare, click on "Options", and Unshare - Back to private marking". Please note that you must select a committee for this option to be available.

Step 6 - Look at any conflicts in grades and align

When all graders have shared their private marking, the information in the header will show if grade alignment is required.

Click Align to see which candidates this applies to. 

Or if all other graders in the committee have already shared their marking when you share yours, you will automatically be taken to the Align tab if there are any grade conflicts.

Below in the window, the list Conflicts found will appear, giving you an overview of which candidates have a grade conflict and which grade you and the co-grader(s) have set. 

Look at your marking of the candidates in the list again, and align the grades with your co-grader(s). By clicking on the three dots next to the candidate, you can, among other things, open the candidates in the Overview, Marking, Results and Explanation workspaces. 

Step 7 - Confirm the marking

When all of the grades have been aligned, the marking is ready to be confirmed. This will the next primary action in the header.

When you have clicked Confirm, you will be sent to approve your confirmation. 

When you are ready to confirm your marking, click the blue button Confirm now. 

By confirming, marks and grades are locked and the grading protocol becomes available. You can still edit comments and explanations. 

When you have clicked Confirm now, you will receive confirmation that the marking is confirmed and the button for confirming will be disabled. 

Once all of the graders have confirmed, you will be able to download the grading protocol from the header. If one or more of the graders have not yet confirmed, you will see a status on this in the header.

Step 8 - Choose the next committee and continue marking

1. Select the next committee in the header.
2. Repeat step 1 to 5. 

Step 9 - Private notes, explanations and comments in the submission

You can write both private notes, explanations and comments in the submission throughout the marking process. Private note fields are available on each question, and you can choose to add them to the explanation field. 

For more information on writing and sending explanations, please see this guide:

Grader - Write and send explanations.

More information on how to comment on a submission and who can see the comments.