New navigation in Marking

  • Updated

Available for Grader and Planner.

This requires activation. If not activated, then the navigation will work as described here.

The new navigation allows you to choose between two distinct marking workflows: marking by candidate or marking by question. 

This article explains the new navigation behavior in detail, including the structural layout of the navigation tools and how filters and auto-navigation behave depending on your chosen workflow.

What’s New in Navigation:

  • Workflow: The Grader can now choose whether to mark by candidate or by question. Previously, the only (default) option was mark by candidate.
  • Navigation: When the marking by candidate workflow is selected, switching to a new candidate automatically selects their first question; the same logic applies when marking by question is selected. Previously, navigating between candidates would not change the currently selected question.

Submitted vs Answered Questions

In order to fully understand this article, it is important to understand the difference between submitted and answered questions.

A submitted question is a question that a candidate submitted, regardless of being answered or not. In a normal assessment all candidates submit all questions. However, in assessments with candidate selected questions or with randomly pulled questions, not all questions are submitted by all candidates.

A submitted question may be answered or not, regardless of the type of assessment (except for mandatory questions).

Marking workflow

When clicking on the Marking Workflow, the Grader can choose to Mark by Candidate or Mark by Question. By default, Mark by Candidate is selected.

  • Mark by candidate should be selected when the Grader wants to focus on marking all the Questions of a Candidate before moving to the next Candidate.

    When marking by candidate, the Grader will:

    1. First select the candidate they want to mark
    2. Then navigate through the questions that candidate submitted

  • Mark by Question should be selected when the Grader wants to focus on marking all the Candidates who submitted a Question before moving to the next Question.

    When marking by question, the Grader will:

    1. First select the question they want to mark
    2. Then navigate through the candidates who submitted that question

Structure

It is possible to naviagte through the candidates and through the questions.

    1. Select the filter to be applied to the candidates
    2. Select a candidate manually from the list, or type their Candidate ID
    3. Use the arrow  buttons to move to the previous or next candidate
    1. Select the filter to be applied to the questions
    2. Select a question manually from the list, or type the question number
    3. Use the arrow  buttons to move to the previous or next question

The primary resource is always on the left and the secondary one is always on the right:

  • When marking by candidate, the candidate selection is on the left and the question selection is on the right.
  • When marking by question, the question selection is on the left and the candidate selection is on the right.

Navigation

The navigation is divided in two sections, depending on the selected marking workflow. The primary resource has no dependency on the secondary one. However, the secondary source is completely dependent on the primary:

  • Mark by Candidate: candidates are the primary source for the navigation, i.e., navigating through the candidates is not dependent on the selected question, and questions are the secondary, i.e., the Grader navigates among the questions of the selected candidate
  • Mark by Question: questions are the primary source for the navigation, i.e., navigating through the questions is not dependent on the selected candidate, and candidates are the secondary, i.e., the Grader navigates among the candidates of the selected candidate

  • When marking by candidate is selected:

    • All the candidates who submitted the assessment are listed
    • Only the questions that were submitted by the selected candidate are listed

    When marking by candidate, the Grader will first select the candidate they want to mark and then navigate through the questions that candidate submitted. 

    If the candidate 1 did not submit question 2 (only possible in assignments with candidate selected or randomly pulled questions), question 2 will not be listed if candidate 1 is selected.

    Applying a filter to the candidates will list the candidates who match that filter.

    Applying a filter to the questions will apply it only on the questions that were submitted by that candidate.

    Examples:

    • Flagged candidates - only lists the candidates who were flagged by the Grader
    • Answered questions - only lists the questions that were answered by the selected candidate

    Next/Previous Question

    In Marking by candidate, when clicking on next/previous question, the Grader will move to the next question that was submitted by the selected candidate and that matches the filter applied to the questions, if any.

    Next/Previous Candidate

    In Marking by candidate, when clicking on next/previous candidate, the Grader will move to the next candidate who matches the filter applied to the candidates, if any. The first question submitted by the newly selected candidate that matches the question filter is automatically selected. If no questions match the filter, the filter will be shown in red.

  • When marking by candidate is selected:

    • All the questions that were submitted by at least one candidate are listed
    • Only the candidates who submitted the selected question are listed

    When marking by question, the Grader will first select the question they want to mark and then navigate through the candidates who submitted that question. 

    If question 3 was not submitted by any candidate, then question 3 will not be shown but if only one candidate submitted question 2, then question 2 will be listed.

    If the Grader selects question 1 and only candidate 1 and 3 submitted that question, then only those candidates will be listed.

    Applying a filter to the questions will list the questions that match the selected filter and were submitted by at least one candidate.

    Applying a filter to the candidates will only apply it on the candidates who submitted the selected question.

    Examples:

    • Answered Questions - lists the questions that have been answered by at least one candidate
    • Flagged Candidates - lists the candidates who submitted the selected question (they may have answered it or not) and were flagged by the grader

    Next/Previous Candidate

    In marking by Question, when clicking on next/previous candidate, the Grader will move to the next candidate who submitted the selected question and that matches the filter applied to the candidates, if any.

    Next/Previous Question

    In marking by Question, when clicking on next/previous question, the Grader will move to the next question that was submitted by at least one candidate and matches the filter applied to the questions, if any. The first candidate who submitted the newly selected question and who matches the candidate filter is automatically selected. If no candidates match the filter, the filter will be shown in red.

Navigation Summary

The idea is always the same:

  • The navigation within the ones on the right side of the navigation bar depend on the one selected on the left side.
  • The navigation within the ones on the left side never depend on the ones on the right side. This will automatically select the first one on the right side.

Navigation logic and behavior

  • Within the Marking Workflow drop down, you can also choose whether auto navigation should be on or off. When it is on, the behaviour will depend on the selected Marking workflow:

    Mark by Candidate

    After marking a question of a specific candidate, the Grader is automatically moved to the next question of that candidate. After marking the last question of a candidate, the Grader will automatically moved to the next candidate and their first question will automatically be selected. 

    Mark by Question

    After marking a candidate on a specific question, the Grader is automatically moved to the next candidate who submitted that question. After marking the last candidate on that question, the Grader will be automatically moved to next question and the first candidate will be automatically selected. 

  • The meaning of the filters will depend on the marking workflow. 

    For more details on the different filters available, see this article.

    Candidate filters

    For candidates the following filters are available:

    • All Candidates
      • Mark by Candidate: lists all the candidates who submitted this assignment
      • Mark by Question: lists all the candidates who submitted the selected question
    • Flagged Candidates
      • Mark by Candidate: lists all the candidates who were flagged by the Grader
      • Mark by Question: lists all the candidates who submitted the selected question AND who were flagged by the Grader 
    • Incomplete Marking
      • Mark by Candidate: lists all candidates who have at least one not marked question
      • Mark by Question: lists all candidates who do not have a mark for a specific question

    Question filters

    For questions the following filters are available:

    • All Questions
      • Mark by Candidate: lists all the questions submitted by the selected candidate
      • Mark by Question: lists all the questions submitted by at least one candidate
    • Manually Marked
      • Mark by Candidate: lists all the questions submitted by the selected candidate and are of a manually marked question type
      • Mark by Question: lists all the questions submitted by at least one candidate and are of a manually marked question type
    • Automatic marks
      • Mark by Candidate: lists all the questions submitted by the selected candidate and which received an automatic mark
      • Mark by Question: lists all the questions submitted by at least one candidate and which received an automatic mark
    • Answered Questions
      • Mark by Candidate: lists all the questions answered by the selected candidate
      • Mark by Question: lists all the questions answered by at least one candidate
    • Unmarked Questions (only available for Graders)
      • Mark by Candidate: lists all the questions without a mark for the selected candidate
      • Mark by Question: lists all the questions that have at least one submission without a mark

  • The behaviour described in this article applies to all tests, including sections of candidate selected or randomly pulled questions:

    When marking by candidate

    • Next/previous question moves to the next/previous question submitted by the selected candidate
    • Next/previous candidate moves to the next/previous candidate and automatically selects the first question they submitted

    When marking by question

    • Next/previous candidate moves to the next/previous candidate that submitted that question
    • Next/previous question moves to the next/previous question and automatically selects the first candidate that submitted it

Display settings

mceclip3.png

The display settings contain the following icons:

  1. Options Gives access to help resources.
  2. Fullscreen Expands the Marking workspace.
  3. Expand marking Expands the Marking workspace and hides menus.

Was this article helpful?

0 out of 0 found this helpful