Data Considered for Calculation
The dashboard includes data for automatically marked questions only. Manually marked questions and their scores are excluded. Additionally, the submission data syncs to the dashboard once every 24 hours. This includes data from tests that are still ongoing. To ensure all submissions are reflected, please wait up to 24 hours after the test's official end time before considering the data complete.
Assessment Run ID
Note : By default, the first view of the dashboard shows the psychometrics for all tests. In this view, you may see an overwhelming number of data points, incorrect order of questions, etc. This may also happen if you reset your dashboard to its original settings.
We advise you to select a specific Assessment Run ID to view the data for a specific test as explained in this section. The next time you view the dashboard, QuickSight remembers your last selected ID and shows the the corresponding data.
The dashboard displays metrics for a single test at a time. To view a specific test on the dashboard, you must enter its Assessment Run ID into the designated input field. This field is primarily for quickly switching between tests where you already know the Assessment Run ID. It is not designed to search for unknown Assessment Run IDs.
Finding the Assessment Run ID
To find the Assessment Run ID:
- Navigate to the "Deliver" module within Inspera.
- Locate and open the specific test.
- The Assessment Run ID is the number at the end of the URL in your browser's address bar.
- Enter this number into the dashboard's input field.
Understanding Question Numbering
Many graphs in the dashboard visualise metrics (e.g., facility, average time spent) as a function of question number. However, the "question number" displayed might not always directly correspond to the question numbering you see within the Inspera assessment. This is because a single question can have more than one interaction.
Multiple Interactions within a Single Question
Inspera allows you to create a single question (of type "Multiple Choice," for example) that contains multiple interactions. An interaction is a single, answerable element within a question. See the image below for an example.
Example:
Consider a short test with three questions visible in the Inspera navigation bar. Question 2, however, is a question containing two multiple-choice interactions. This means:
- The student must answer four distinct questions in total.
- The Psychometrics dashboard will display data for four questions, treating each interaction as a separate question.
Important Note about Time Spent:
If multiple questions (interactions) are displayed on the same page within Inspera, they will always share the same average time spent. This is because the system cannot determine precisely which interaction a student is actively working on when multiple interactions are presented simultaneously. Therefore the time spent cannot be calculated per question.