Blueprint based on a matrix

In a test matrix, a matrix is constructed based on content topics (learning objectives, test items) on the horizontal axis and criteria on the vertical axis. This makes it possible to indicate for each subject and criterion how many questions should be asked in the test.

A blueprint based on a matrix can be used as a blueprint (source matrix) for the administration of fixed tests, for example, but it is also possible to use the matrix to administer a random test.

Another advantage is that based on a matrix, new empty questions can be created. These 'empty' questions are then immediately placed in the relevant category and linked to the question properties indicated in the matrix. Authors can then fill these 'empty' questions and when the questions are approved, they will be included in the selection of the test matrix.

Creating a matrix

The following is an elaboration of a blueprint based on a matrix.

1. When adding a new blueprint, the choice must be made under "Type" between a rule-based blueprint and a Matrix-based blueprint. Choose "Matrix-based Test Matrix."

2. For the other information to be entered in this pop-up, see Add new blueprint.

3. When this data is saved, a new screen will appear. At "Adjust test matrix settings" a pop-up menu opens where three items can be set: criteria, learning objectives and validation criteria.

Criteria

Choose a criterion for the vertical axis. This can be a question type, the difficulty level or a question property. The question properties that can be chosen here must be based on drop-down lists (these can be set by the administrator in the administration environment at 'Manage question properties').

Learning Objectives

The vertical axis shows the learning objectives. These can be topics and/or themes. Enter the desired name and weight for calculating the score here. Then the category from which the questions are selected can be chosen. Again, an additional filter on question properties can be added.

These criteria are optional and are used to retrospectively test whether the matrix meets these criteria. This is useful, for example, when within the organization the matrix is used as a blueprint or source matrix. Before the test is delivered to the administration environment, it can be seen whether the test meets the validation criteria. A percentage can be specified for each value of the criterion. For example, 75% multiple choice and 25% open questions or, as shown in the figure below, based on the RTTI taxonomy: 25% for each level.

4. After the test matrix settings have been saved, the matrix is displayed.
   Each cell shows whether there are questions available that meet the criteria. If more questions need to be created than are available, the number of new questions to be created can be entered in the empty cell. When this has been filled in, the button "Generate empty questions" can be pressed after which via "Open questions (in new window)" the questions are directly shown in the question bank (there is therefore a filter on the question bank). There they can be edited.

Disclaimer: This text was automatically translated from the Dutch version.