This is available for Graders in Marking 2.0.
The article will go through each workspace and explain what you, as a Grader, can do in these workspaces.
For detailed marking workflows, see our guides on marking candidates in test with one grader and for multiple markers with committees.
The Header
The global header at the top shows the test name and which committee you are operating in (if relevant). Clicking on the View or change committee button opens a overlay which allows you to:
- View details of a committee
- Switch to another committee you are part of (if applicable)
To learn more about the header, see the article Marking 2.0 header guide for Grader
Workspace side panel
Reflecting the common Grader workflows, the workspaces are organized to provide different vantage points that Graders take when evaluating the cohort/class, individual candidate, and that candidate’s response to a given question. This manifests in the menu indentation of two sub-level workspaces.
- Grading overview
- Candidate in focus
- Marking
- Candidate in focus
- Explanations
- Questions
- Candidate Report, if enabled for this test
To learn more about how the workspace side panel works, visit the Help Center article Workspace side panel.
- Grading overview
-
This is the behaviour if Mark by Question is activated. If you wish to activate it, please reach out to your account manager.
- Grading overview
- Candidate in focus
- Questions Overview
- Marking
- Explanations
- Candidate Report, if enabled for this test
To learn more about how the workspace side panel works, visit the Help Center article Workspace side panel.
- Grading overview
Workspace-relevant navigator
Some workspaces provide a navigation through the different candidates and/or questions.
- In Candidate in focus workspace, the user can navigate through candidates:
- switch to the previous and next candidate
- search a candidate via the dropdown menu
- use the dropdown filter menu to display a subset of candidates
- In Marking workspace, the user can navigate both trough candidates and questions
-
- switch to the previous and next candidate or question
- search a candidate or question via the dropdown menu
- use the dropdown filter menu to display a subset of candidates or questions
- switch on and off the auto navigation function to go to the next candidate or question when a mark has been set
You can read more about how to navigate between candidates and questions in Navigation in Marking workspace.
-
This is the behaviour if Mark by Question is activated. If you wish to activate it, please reach out to your account manager.
- choose between marky by candidate or mark by question
- Mark by Candidate is ideal when the Grader wants to mark all the questions of a candidate before moving to the next candidate.
- Mark by Question is ideal when the Grader wants to mark all the candidates of a question before moving to the next question.
- switch to the previous and next candidate or question
- Mark by Candidate: Moving to the next candidate automatically selects the first question.
- Mark by Question: Moving to the next question automatically selects the first candidate
- search a candidate or question via the dropdown menu
- use the dropdown filter menu to display a subset of candidates or questions
- switch on and off the auto navigation function:
- Mark by Candidate: when marking a question, automatically moves to the next question of the same candidate. At the end moves to the first question of the next candidate
- Mark by Question: when marking a candidate, automatically moves to the next candidate of the same question. At the end moves to the first candidate of the next question.
You can read more about how to navigate between candidates and questions in New Navigation in Marking workspace.
- choose between marky by candidate or mark by question
-
Grading overview
The workspace Grading overview gives you an overview of the marking status on the cohort level.
The Grading overview consists of two sections, shortcut cards and candidate data table.
-
1. Shortcut cards
- Marking shortcut card: Clicking on the shortcut card leads to the Marking workspace, defaulting to the candidate's first question or the first unmarked question of an ungraded candidate.
- Graded candidates shortcut card: The card displays the number of graded candidates and clicking on it switches the tab of the candidate data table below to ‘Ungraded candidates’.
-
2. Candidate data table
2.1 Tabs
- All candidates tab: Gives you an overview of all the candidates and the status of the marking.
- Ungraded candidates: Overview of the candidates who have not been given a grade by you.
- Flagged candidates: Displays the list candidates that have been flagged for review.
2.2 Table column headers
- Flagged: Ability to flag candidates and sort candidates that have been flagged.
- ID: Candidate number (of name if the test is not anonymous).
- Attachment: This column will appear if there is an attachment attached to the candidate's submission. Clicking on the file name will open the attachment in a new tab.
- Your grade: You can set grades directly within this column. This can be helpful if you choose not to mark parts of the questions.
- Grades: Shows the grades you have set. If you are part of a committee, the grades that all of the graders have set will appear when the marking is shared.
-
Workflow status: Shows where you and any other graders are in the marking process on each candidate. If you are a member of a committee, workflows may be marked by a number. Hover your mousepointer over to see which grader is in the current process. Workflows can have the following statuses:
- Not started: The marking of the candidate has not started.
- Private: You have started or completed the marking on the candidate, but have not yet confirmed or shared the marking.
- Conflicts (only for graders in committees): There are discrepancies in the grades given to the candidate.
- To confirm (only for graders in committees): You and the co-grader(s) have aligned on the final grade and must confirm the grades.
- Pending all to confirm (only for graders in committees): You have confirmed the final grade and are waiting for the remaining grader(s) to confirm.
- Confirmed: You have confirmed the marking. If you are a member of a committee, all graders have confirmed the marking.
- Final grade: Here the final grade is displayed. The final grade will not appear until the marking is confirmed. If you are a member of a committee, all the graders have to confirm the marking.
- Marking status: Status Completed and Not completed shows whether all questions have been marked or not for each candidate.
- Total marks: Displays the total marks given on the test. For automatically marked questions, the total marks will be displayed even before you start the marking. If you are in a committee, the total marks that all the graders have set will be displayed when the marking is shared.
-
Similarity: Similarity scores are displayed in order from highest to lowest. Hovering over the similarity score will give you the question number, question type, and candidate ID. Click the similarity score to open a report for the question.
- Displays 5 scores at a time.
- Click + to expand.
- Once the similarity scores have been expanded, it is not possible to collapse the view again.
- Committee: Shows which committee the candidates belong to.
- Marking deadline: If a marking deadline has been set at test level or at the candidate level, then this will be shown here.
- It is possible to create new lists by pressing the + button to the right of the lists. The columns in the lists can also be changed/edited.
2.3 Table rows
- Clicking on each row of candidate leads to Candidate in focus workspace where you will find the detail of the candidate's performance.
- Options for candidates
You can view candidate options by clicking
Options, next to the candidate. You can also right-click on the candidate to access the same options.
At the candidate level, you have the following:
- Open in: Open the candidate in the workflows
- Grading Overview
- Candidate in Focus
- Marking
- Explanations
- Quick view submission: See the candidate's submission question by question.
- View submission in new tab
- Download and print: Print the candidate's submission with the correct answers indicated on the questions.
-
Explanation
- View and edit: Shows the status of the explanation for the selected candidate in the candidate list. Here you can also write and possible send explanations.
We have our own guide for grader about write and send explanations, and this will cover the process itself.
-
3. Results view option
Results view option currently requires activation.
This view shows the candidate list (3.1) and the question list (3.2).
3.1 Candidate list
The candidate list is an overview of the candidates with total marks, grades, and final grade.
Four standard lists have been set up to filter candidates by: All candidates, Ungraded candidates, Flagged candidates and Incomplete marking. You can edit columns and get options at the candidate level. It is possible to search and filter the lists.3.2 Question list
The question list shows an overview of the questions for the selected candidate with question name, response (answered or unanswered), marking status, marks on the question, and the question type.
This list has three standard lists you can filter questions by:
- All questions
- Manually marked
- Answered questions
Candidate in focus
Similar to a cover page of a candidate’s submission, Candidate in focus workspace provides the grading results and the performance breakdown of a candidate. The workspace consists of two sections, Grade and candidate performance data table.
1. Grade section
1.1 Your grade
A drop down menu for you to assign a grade
1.2 Grading results
Displays grades, final grade and the total marks awarded to a candidate.
2. Candidate performance data table
The table shows an overview of the questions for the selected candidate with question name, response (answered or unanswered), marking status (marked or not marked), marks on the question, and the question type.
This list has three standard lists you can filter questions by:
- All questions: lists all the questions without any filter
- Manually marked: lists only the manually marked questions
- Answered questions: lists only the answered questions
- Not marked: lists only the questions that have not been marked. It will show the information to which the Grader has access, i.e., in private marking if another Grader has marked the question, the question will still be listed as not marked for the current Grader
Additional lists can be added by clicking the + icon and then selecting the filter icon.
- Section: the section of the assessment under which the question is
- Number: This is the number of the question.
- Marking Type: whether it's manually or automatically marked
- Response: whether the candidate has answered the question or not
- Question type: This is the type of question. For example, multiple choice, essay, text entry.
- Manual Marks: the value of the marks manually given to a question
- Automatic Marks: the value of the marks automatically given to a question
- Flagged: whether the question has been flagged while being graded
- Question Weight: the weight the question has in the overall grade of the assessment
- Maximum Marks: the maximum marks a candidate could obtain in the question
- Marking Status: Whether the question has been marked for this candidate or not
2.1 Table row
Clicking on a row of the table leads to the Marking workspace of the candidate's submission in response to the selected question.
Please note that the current 'Candidate in Focus' workspace is optimized for single-sit assessments only. It is not yet configured to accommodate multiple attempts or assessment path evaluations. We will collaborate with our customers to determine the most valuable candidate-level information for these types of assessments in the future.
Questions overview
The workspace Questions (or Questions Overview) will give an overview of Question weights and Question assignment, as well as whether or not each question has been completely marked for all candidates.
This is not dependent on any candidate and shows an overview of all the test questions that are viewable to the Grader.
-
Default Lists
The workspace consists of 3 default lists:
- All questions: lists all the questions without a filter
- Manually marked: lists only questions that are manually marked
-
Incomplete marking: lists only questions that have at least one candidate without a mark (requires activation)
- It will show the information to which the Grader has access, i.e., in private marking if another Grader has marked the question for all candidates, the question will still be listed as incomplete for the current Grader.
- It will only consider the candidates assigned to this question, i.e., if this question was not assigned to a candidate (random pulling of questions) or a candidate did not select this question (candidate selected questions), that candidate will not be considered and the marking status will be considered complete when all the assigned candidates have been marked.
Additional lists can be added by clicking the + icon and then selecting the filter icon.
The 3 filters that you can create additional lists from are:
- Number: This is the number of the question.
- Question type: This is the type of question. For example, multiple choice, essay, text entry.
- Marking Status: Whether the questions has been completely marked or not (requires activation)
-
Table
The workspace consists of the following columns:
- Number: the number of the question
- Question name: the name of the question
- Question type: the type of the question, e.g., essay, multiple choice
- Default weight: the weight this question has on the grade of the assessment
- Overridden weight: the actual weight of the question in case it has been changed (more details here)
- Maximum marks: the maximum marks a candidate may have on the question
- Marking Status: if the question has been marked for all candidates (complete) or not (incomplete) - requires activation
Marking
In the workspace Marking, you can look at the candidates' submission question by question and mark them.
Tabs
The tabs over the question give you the following choices:
- 120369 / 2: The answer to the selected candidate on the question. Correct answers are also displayed on automatically marked questions.
- Question: Here you can see the question as it is given on the test. Correct answers to automatically marked questions will also appear.
- Attachment: If there is an attachment attached to the candidate you will see this here. PDF will be displayed directly, while other file types can be downloaded and opened in your own application.
- Plagiarism: Question types as Essay and Upload Assignment can be checked for plagiarism, and if plagiarism is enabled you will access the plagiarism report here. Read more about plagiarism reports.
Sidepanel
The panel to the right (see image below) shows, among other things, which question type and how many marks the candidate has been given on the automatically marked questions.
In the candidate's answer you can also do the following:
-
Write and view comments and annotations on the submission: If a co-grader or a planner on a test has written a comment or annotation, this will be indicated by a speech bubble next to the tab in the selected question.
Read more about how to see and write comments and annotations. - Marks: Set marks on the question. On automatically marked questions, the marks are automatically calculated. It is possible to override the marks. For manually marked questions, you must set marks yourself (see below).
- Mark scheme: If a mark scheme has been added to the question, it will appear here.
- Question private notes: Write a private note on the question. This is only visible to you and is not shared with anyone.
Manually marked question
For manually marked questions, the marks must be set by you as a Grader.
- Grade/results: The marks you set will appear to the right of Results. In committees, the result will be displayed for all graders when the marking is shared.
- Marks/Grade: Select the number of marks by clicking the arrow pointing down. It is also possible to set a mark with up to two decimals. Instead of selecting marks from the list, type the mark, such as 2.5 or 2,5.
- Word count: For Essay question types, a word count is available. Word count is also available when viewing an essay submission from Monitor or downloading/printing submissions.
Once you have set the marks, the status of the question changes to "Set by you a few seconds ago".
By clicking Reset, you can reset the marks you have set.
For more on marking the different question types, see Step 1 of the guides:
Explanations
The workspace Explanations has the following lists/panels:
- The candidate list
- The question list
- Explanation for candidate: Shows the explanation status for the selected candidate in the candidate list. Here you can also write, record and send explanations.
Read more about writing, recording and sending explanations in the article Write and send explanation of grades.