Add new blueprint

Introduction

Composing a test is done using a blueprint. In practice, designing a test is often done at one of two times, either before the questions have been developed or after the questions have been developed. The moment at which the test is designed determines which blueprint is used.

From the 'Tests' menu, new test templates can be created per course.

RemindoTest has 2 forms, namely:

• Blueprint based on rules
• Blueprint based on a matrix

Blueprint based on rules

The rule based blueprint is mainly used when the questions have already been developed and there is a decent idea of what the test should look like. The rules help to define the conditions of the test.

For example:

• How many questions does the test consist of?
• In what order should the questions be shown?
• How is the selection of questions determined?

This test matrix indicates: what does the test look like and under what conditions will it be taken?

Blueprint based on matrix

The matrix based blueprint is mainly used when questions have not yet been developed. Using this test matrix, the broad outlines can be set out.

For example:

• Which learning objectives are being tested?
• What conditions must the questions meet?
• How many questions will be asked?

This test matrix clarifies: what is needed to set up the test? Blank questions can be generated with the help of this test matrix, which can then immediately be placed with the authors.

Add a new blueprint

1. To create a new test matrix, log in to the relevant test managemer environment.
2. Click on the 'Tests' button. Then select the study to which the test should be linked. It is also possible to select 'All studies'. This is the list of blueprints for all studies in the test manager.
3. After choosing the study, select 'Add a new blueprint' at the top left of the screen.
4. A screen with a large number of options opens, see also the article blueprint settings. The options that have an asterisk ( * ) behind them in RemindoTest are mandatory.
5. After going through the settings below, the blueprint can be saved.

General settings

• Insert the name and coding, if any.
• Select the type of blueprint:
  • A test matrix based on rules
  • A test based on a matrix
• Select whether the test is intended for a practice, graded practice or exam.

Add studies

• Select to which studies the blueprint should be added. The study selected at creation is automatically filled in.
• If 'All courses' was selected in step 2 of adding a new blueprint, a study must be entered manually.

Settings for exam

• There is a normal caesura and a composite caesura. The composite caesura requires that there be feedback reports, otherwise no composition can be made.
  
  For more explanation, see the article on normal caesura, or the article on composite caesura.
• There are three score types to choose from: grade, percentage and points. When using a grade, a range must be chosen. When using points, a maximum number of points must be entered.
• Apply correction for guessing can be used with any of the three scoring types. See the article Correction for guessing for an explanation of this function.
• Specify to how many decimal places the score should be rounded.
• There are several rounding methods to choose from. By default, normal rules for rounding will be applied.

Score distribution

The x-axis is the percentage of points, the y-axis the score percentage

Above is an example of a score distribution. By adding points on the graph, it is possible to set up the score distribution to your own liking. These points can be dragged manually, or they can be entered above the graph. With the scoring range in the example, if candidates get 25% of the questions correct, they get 30% of the points. If they get 50% correct, 45% of the points are awarded and at 75% correct it becomes 65% of the points. 100% of the answers correct always equals 100% of the points.

If a new point is added, an extra field will appear above the chart where the specific values are indicated. Two new fields for each point will also appear below the graph (see the image below). Name each score area there. Feedback can be entered at each area. If a candidate is in that score area after completing the (practice) test, the corresponding feedback will be displayed.

Caesura point

The caesura point indicated with these options is the limit for awarding or not awarding a pass. In the example shown below, the caesura has been set at 50%, which equals 45% of the points. The different score areas additionally have feedback that states in which score area the candidate falls.

Resit settings

Specify here how often a candidate may retake exercise or (practice) test. In the case of an exercise and a practice test, you can specify whether the candidate may start it himself/herself. For a test, this option is not available, therefore a candidate can never start this himself/herself.

Administration settings

• The duration can be unlimited or specified.
• Entering an instruction and closing text is optional.
• Test conditions can be added, this requires the candidate to agree to the conditions before starting the test.
• When setting up a calculator, there is an option to use the question settings. If this is selected, the settings filled in when creating the question will be adhered to. The option 'Never' will never allow a calculator to be used during the test, even if it is specified when creating the question.
• Text marking can be on or off, or it can be limited to the text in a case study.
• Indicate whether candidates can return to previously completed questions.

Evaluation settings

It is possible to add an evaluation at the end of the test, using a fill-in field or an external URL. The candidate can then provide feedback on the test.

Visibility of results for candidates

Delivery settings

• There is an option not to deliver a test matrix to a collection environment. Please note that, as a result, it cannot be taken in a (paper) test environment.
• There are three options related to the assessment environment: the cesura can be adjusted, there is the possibility to assign extra time and the visibility of the results can be adjusted.
• During the test, candidates can choose not to have the question text copied. Also, the menu accessible with the right mouse button can be switched off here.
• The last option is to enable full-screen protection. For an explanation, see the article Full-screen protection.

Disclaimer: This text was automatically translated from the Dutch version.