Versions Compared

Version Old Version 4 New Version 5
Changes made by

David Fairbank

Will Garnett

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Standard setting is the methodology used to determine the proficiency of candidates and the related cut scores for each exam.

Supported Standard Setting Methods 

Angoff 
Each item in the item-bank can be assigned an Angoff percentage, representing the percentage of minimally competent candidates that would be expected to know the correct answer to the item. 

...

Info
iconfalse

Related terms

Cronbach’s Alpha
For each of the standard setting methods the Cronbach’s Alpha reliability metric is also calculated for the exam. This is given for the whole exam as well as what it would be if each item in turn were omitted from the analysis. This allows items that are lowering the reliability of the exam to be excluded from the results. 

Standard Error of Measurement
The SEM is calculated from the Alpha and is multiplied by a user-input number (the SEM-multiplier) allowing a single-sided confidence interval to be added to the pass mark. For example an SEM-multiplier of 1.64 is equivalent to a 90% confidence that people given a pass should have passed (based on the reliability of the exam), and 1.96 corresponds to 95% confidence.


Score Normalisation

It is possible to normalise the marks for each item in an exam to a consistent number. You may want to do this so that each item in an exam is equally weighted, despite having an inconsistent number of marks for each item. Note that the normalisation is on an item basis, and not on an exam basis. It is possible to revert to non-normalised scores.

Filter by label (Content by label)
showLabelsfalse
max5
spacesPKB
showSpacefalse
sortmodified
reversetrue
typepage
cqllabel = "kb-how-to-article" and type = "page" and space = "PKB"
labelskb-how-to-article

Page Properties
hiddentrue
Related issues