Introduction
This dashboard was developed to provide Inspera customers with a clearer, data-driven perspective on the psychometric KPIs for existing marketplaces.
Built on Amazon QuickSight, it helps our customers precisely analyze data for each proposed assignment.
Access
Access to this dashboard can be requested by emailing service desk and/or ashok.kesari@inspera.no. Once access is granted, users can login using their credentials on the quicksight console.
Key Features
- Visualizations for psychometric data.
- Filters to segment data by individual question and individual student
- Data access restrictions to ensure clients see only their data
List of data items to be shown for the dashboard
This PRD aims to create a powerful and flexible data visualization tool using AWS Quicksight to meet the psychometric data needs of universities, professors, and students, enhancing their ability to analyze and understand performance metrics effectively while ensuring data privacy and security.
Item related data
| Use Case | Classical Metrics |
| The number of test takers that have seen this item for a single test and also across tests | N_exposed |
| The number of test takers that have answered this item | N_answered |
| The number of test takers that have omitted this item after seeing it | N_omitted |
| The number of students that have not been exposed to this item | N_unexposed |
| The mean score on this item across a cohort | Mean score |
| Standard error of mean score | Mean score std error |
| Std deviation of scores across cohort | Std deviation of score |
| Difficulty of item across cohort | Facility (P-value) |
| Std error of difficulty | Facility st error |
| Discrimination - how well does this item discriminate between low and high performing students | Pearson correlation between item score and total score |
| For each response, the number of test takers | Distractor response*, number |
| For each response, the percentage of test takers out of whole | Distractor response, percentage |
| The correlation of an indicator of a candidate giving a particular response with skill level | Distractor response, discrimination |
| The maximum score on the question | Max score |
| The position of the question in this test. | Question order |
| Most common wrong answers (possible correct answers) | Most common wrong answers |
Test related data
|
Use Case |
Classical Metrics |
| Number of submissions in a cohort | N_submissions |
| The number of test takers assigned this test | N_assigned |
| The mean score on the test across a cohort | Mean score_test |
| Standard error of mean score on the test across a cohort | Mean score std error_test |
| Std deviation of scores on a test across cohort | Std deviation of score_test |
| Highest score on a test | Highest score on a test |
| Lowest score on a test | Lowest score on a test |
| Mean score per question type | Mean score per question type |
| Frequency distribution by mark and grade | Frequency distribution by mark and grade |
| Reliability | Cronbach's alpha - Reliability or Internal consistency |