Adaptive testing

Description

It is possible to test adaptively within Remindo. Adaptive testing means that the test adapts to the candidate. This happens dynamically, during the test take the test adapts by always offering the 'most suitable' next question based on the score on the previous question.

A test can adapt to the candidate in several ways, including through the presentation, in the feedback (this is also possible in Remindo), but adaptive testing is often used based on difficulty. When a candidate scores high on a question, a more difficult question is offered, when the candidate scores low on a question, an easier question is offered.

Adaptive tests have been developed in particular to increase the efficiency or precision of test scores in relation to the test length. An adaptive test is either more efficient (shorter) with the same level of precision as a linear test or is more precise in determining the level compared to a linear test of the same length. It is often pleasant for candidates, especially those who score very low or very high, because conventional tests are normally aimed at the average candidate. At the same time, it is more difficult for candidates to estimate how they will score on the test because they are always offered items that adapt to their level, which means that there is an equal chance that they will answer the item correctly or incorrectly.

Conditions for adaptive testing within Remindo

In order to be able to test adaptively, a number of conditions must be met:

1. A calibrated question bank is required based on Item Response Theory (IRT): in order to be able to calibrate, questions must have been already offered several times in tests in order to determine, among other things, the difficulty of the question.
2. An engine is required that follows the ‘rules’ of the test, such as the start rule, the selection rule, the score rule and the stop rule. This engine is not integrated into Remindo, but Remindo can communicate with an external adaptive engine via a blueprint specifically for adaptive testing.
3. A configuration file containing the rules and ID codes of the questions from the question bank.

Several users of Remindo have developed their own engine and configuration file to make use of the fuctionality of adaptive testing within Remindo.

How does adaptive testing work within Remindo?

Within Remindo Test manager, there's a blueprint ​​available for adaptive testing. The configuration file that communicates with the external adaptive engine can be placed in this blueprint. By default, free navigation of questions will be disabled for an adaptive blueprint.

In the Remindo Test player, an adaptive test can be scheduled like other tests. The fact that the score on a question determines which question is offered next does have consequences for the test take:

• During the test take, there must be a continuous internet connection because the test cannot be fully ‘loaded’ in advance of the test since it continuously must determine after each question which question is offered next.
• During the test take, a candidate can only move forward, he cannot go back to adjust an earlier answer because the given answer influences the next question that has already been offered.

Disclaimer: This text was automatically translated from the Dutch version.