Inspera Assessment offers options to randomize the order of questions or pull a specific number of questions from a section, ensuring varied tests for candidates. 

This article explains different randomization and question pulling options, outlines the conditions for their use, and details their impact on grader navigation.

Accessing the Question Delivery Options page

• 1. When you are in the Question set, click the Question Delivery button next to the section. 

     

  2. The Question Delivery Options page will open.

     

  3. Here you can choose between Randomization, Question Pulling, or Candidate Selected Questions. The default setting is No randomization, pull, or selection from section.

• When your are in the Question set, click on the arrows icon located under the Section you want to randomize question pulling from.

  

Randomization and question pulling options

The options allow you to control how questions within a section are presented to candidates.

• No randomization, pull, or selection from section: This is the default setting. Questions will be displayed in the exact order they appear in the Question set.
• Randomize order of questions: This option presents all questions in the section in a random order for each candidate.

• Pull [number] of [total] total questions: This allows you to specify a number of questions to be randomly displayed in the test from a larger pool within the section (for example, 9 out of 20, or 3 out of 7).

  This option is only available if all questions in the section have the same maximum marks. See detailed explanation below.

• Allow candidates to select [number] of [total] questions from this section: This option enables candidates to choose which questions they want to respond to from the section's selection. 

  For more information on this option, refer to the Candidate-selected questions article.

Pull questions: Detailed explanation

To pull questions in a section, you can use the option to select a given number of questions from a larger pool. However, all questions in the section must have the same maximum marks; otherwise, this option won't be available.

For example, if you choose to pull 15 of 30 questions in a section, the system will present candidates with 15 random questions from the 30 available. This helps ensure that candidates are unlikely to receive the same questions on a test or that they will not receive them in a specific order.

The number of pulled questions must be equal to or, ideally, higher than the number of questions available in the section. Thus, you cannot remove a question from a section if doing so would make the number of questions in the section lower than the number of questions to be pulled.

Impact on Grader navigation

Enabling randomization and/or question pulling in sections will affect how graders navigate the test. When navigating between candidates, you will automatically default to the first question if that specific question is not available to the next candidate.

This helps avoid confusion, as some candidates may not have the same questions if random questions are pulled. If all questions are used and randomized, you will remain on the same question when navigating between candidates.