Creating OSCE mark sheet

Each OSCE Item (Station) has a specific mark sheet which Examiner uses to mark Candidate performance. As part of the authoring process for an Item you will create this mark sheet according to your needs. This page documents necessary steps which you need to take.

OSCE mark sheet in Practique is divided into Sections which group Observation criteria together and form the mark sheet. These can be defined either globally as system wide Global observation criteria or specifically for the Item as Local observation criteria.

Each Observation criteria is defined by Section, Title/Text, Type and Mark scheme, see Adding observation criteria for more details.

Important

Before you start creating your mark sheets you must define Mark sheet Sections and Mark schemes, please refer to the relevant pages in the Settings and system configuration.

Global observation criteria

Mark sheet criteria can be defined globally to allow you feature standard feedback options on every single OSCE Item. This saves you time and can be very useful when you have certain criteria that examiners need to feed back on for every station.

Global criteria will appear on every single OSCE Item throughout the system. Use the Apply if feature to gain more granular control of which Items should use particular the global criteria.

Defining global observation criteria

  1. If you haven't already it is a good idea to setup mark sheet sections and mark schemes before defining your global criteria

  2. Access the global criteria from the dashboard, clicking Modify an existing item → Edit global criteria.

    Edit Global Criteria
    Global Criteria

  3. Follow Adding observation criteria steps to add new criteria

Local observation criteria

Each item can define observation criteria valid only for that particular item - local observation criteria. You specify local observation criteria during authoring of the Item using Marksheet tab.

Defining local observation criteria

  1. If you haven't already it is a good idea to setup mark sheet sections and mark schemes before you continue

  2. Access Marksheet tab for the Item you wish to define/update observation criteria



    Because there is a global criteria defined in the system Item in the screenshot does show those under the Global criteria where you can see Overall section with 4 observation criteria.
    The Item has also one local criteria (under Local Criteria) which is Examiner feedback free text in Critical section.

  3. Follow Adding observation criteria steps to add new criteria

Adding observation criteria

  1. If you haven't already it is a good idea to setup mark sheet sections and mark schemes before defining your global criteria
    1. Select a Section to attach the new criteria to from the first drop down box. This will display everything previously defined in the mark sheet sections.
    2. Type in a name for the criteria in the text box provided.
    3. Select the Type
    4. Select the Scheme from the drop down. This will display everything previously defined in the mark schemes section.
    5. (Global criteria only) Make a selection in the checkbox for whether to define this criteria as a Borderline marker or not.
      1. Borderline marker is the only criteria on the mark sheet Practique use for Borderline group & Borderline regression standard setting methods
      2. You can must define only one criteria as Borderline marker
      3. Criteria should have weight 0.0
    6. Assign a weight value
      1. use 0 to exclude criteria from marking
      2. use 1 to indicate that the criteria is marked according to the mark scheme
      3. use values such as 0.5 or 2.0 to adjust the the weight of the observation criteria
    7. Define whether this should be mandatory or not-mandatory, if ticked then examiners must provide a response in order to be able to submit their mark sheet.
    8. Click Add

  1. (Optional) Click Apply if to link a specific criteria to one or more blueprint categories. This will cause that criteria to only display on the mark sheets for Items that have those specific blueprint categories applied to them.

    Example

    This is useful when you use both Borderline regression and Borderline group standard setting methods for your exams.

    In order to create Items with different Borderline marker criteria (as marking schema will differ) you could create Marking method dimension in the Master blueprint with subcategories Borderline group and Borderline regression. Then, when defining your Global mark sheet criteria, you would create one Borderline marker criteria for each Marking method and use Apply if where you'd select appropriate blueprint category.

     

  2. (Optional) Click Count as to map individual feedback responses to a Blueprint dimension. This may be useful to track exactly which feedback relates to a certain curriculum area, for example.

Order of items on the mark sheet

Mark sheet is first ordered by sections. Sections order is set when you define your sections, see Defining mark sheet sections.

Please keep in mind that on the Item Marksheet screen (Defining local observation criteria screenshot) the order of the sections might not be displayed as defined. This is due to the fact that the screen always displays the Global criteria first and Local criteria follows. If you defined Overall section to appear after the Critical section, then the Examiner will see the Critical section first followed by the Overall section despite the screen displays different order.

Observation criteria within the section are in the same order as you add them to the section when defining global or local criteria.