8.12 How to mark Written Exams online

Owned by Pernille Marqvardsen
Last updated: Jun 21, 2024 by Maria Daigle
10 min read

risr/assess enables online marking. Online marking is available for individual SAQs (Single Answer Questions) and SAQs that form part of MWQs (Multiple Written Questions). This guide outlines the key features and includes step by step instructions to help you use them effectively.

Markers can be created and assigned in 2 ways:

  • Created manually in settings then assigned to items/questions and group/s (if required)

  • Marker details are imported - this creates and assigns them automatically 

Markers are created in risr/assess and then assigned to the item/s they are required to mark. There is also the option to create a Senior Marker role.

Markers can also be grouped, groups are used to divide marking between different markers; groups also facilitate double marking.

How to create and assign markers manually.

To create a new examiner, set up a new user and assign them to the appropriate user group in risr/assess. Instructions on how to do this, can be found here: How to create and manage risr/assess users and here: How to create and manage risr/assess user groups

Manual assignment of markers to questions/items

Setting the Marking Type

When creating a new Written Exam in the Edit exam details screen:

  • Click the dropdown menu for Written marking type

  • Select the required marking type

 

When the Exam has been created and ready to run, or has already run:

  • For the required Exam click View Sessions

  • Click View Markers

  • Using the checkboxes provided click and select the required Items that require marking

  • Using the dropdown menu select the required marking type for the selected Items

  • Click Apply

The system will provide warning messages as guidance stating the number of each role (if applicable) are required for each Item based on the marking type selected.

 

Assigning Individual Markers

This option should be used when specific markers need to be assigned to specific Items. This option is available for all marking types.

How to assign individual markers (when the exam has been created and ready to run, or has already run):

  • For the required Exam click View Sessions

  • Click View Markers

  • Using the checkboxes provided click and select the required Items that require marking

    • Items can be filtered using the filtering options available

  • Click Assign individual markers

Users can be filtered for selection. Only Users who satisfy the filter criteria and have the permission Exams - Mark Exams are able to be selected. If no filtering is used, all users with the permission Exams - Mark Exams are available for selection.

  • Select Markers as required

    • Single marked (one marker is required)

    • Double marked (two markers are required, one for each double marking group)

    • Bilingual exams must have a marker for each language variant. The same marker can be assigned to both variants.

Splitting Candidates into Cohorts (SAQ/MWQ Only)

When selecting markers:

  • Click the checkbox for Split candidates into cohorts

  • Identify the number of cohorts required

  • Select the required markers appropriate to the number of cohorts identified

Assigning Reviewers

How to assign reviewers (when the exam has been created and ready to run, or has already run):

  • For the required Exam click View Sessions

  • Click View Markers

  • Using the checkboxes provided click and select the required Items that require marking

    • Items can be filtered using the filtering options available

  • Click Assign reviewer

  • Select one reviewer per variant

Assigning Senior Markers

How to assign senior markers (when the exam has been created and ready to run, or has already run):

  • For the required Exam click View Sessions

  • Click View Markers

  • Using the checkboxes provided click and select the required Items that require marking

    • Items can be filtered using the filtering options available

  • Click Assign senior marker

  • Select one senior marker per variant

Assigning Marker Pools

How to assign senior markers (when the exam has been created and ready to run, or has already run):

  • For the required Exam click View Sessions

  • Click View Markers

  • Using the checkboxes provided click and select the required Items that require marking

    • Items can be filtered using the filtering options available

  • Click Assign marker pool

  • Either

    • Select an unlimited number of markers per marker pool

      • Single marked (one marker pool)

      • Double marked (two marker pools)

      • Single marked bilingual exams (two marker pools, one for each language variant)

      • Double marked bilingual exams (four marker pools, two pools for each language variant)

  • OR

    • Click Add all markers to add all eligible markers

  • Click Save the marker assignment

Importing Marker Assignment

How to upload a marker assignment import spreadsheet (when the exam has been created and ready to run, or has already run):

  • For the required Exam click View Sessions

  • Click View Markers

  • Click Upload marker assignment

  • Identify your upload file and click Upload file

  • Ensure the data is mapped correctly to the spreadsheet column headers

  • Click Confirm

 

 

Marking SAQ/MWQ items

When a marker logs in to risr/assess, their dashboard will display all marking assignments separated by exam. The following information is shown for each:

  • Exam / Block / Item - Exam information

  • Variant - Language variant used (where applicable)

  • Not started - the number of candidates for whom marking has not started

  • In progress - the number of candidates who are currently being marked

  • Completed  - the number of candidates who have been marked

For the exam the marker wishes to mark:

  • Click Mark

  • The first (random) candidate's marking sheet will display

  • Enter marks using the dropdown menu provided for each Marking area

  • The marker can then do any of the following:

    • Save marks (marker can access this candidate again)

    • Confirm marks (marker will not be able to modify marks)

    • Reassign to the other language marker (for bilingual exams only)

    • Enter notes that can be included on the candidate feedback report

    • Enter comments that candidates will never see. Only exam administrators, reviewers or senior markers (where applicable) will see these comments.

From the dashboard, the marker can click Overview to see a summary of all candidates and their status.

Marking VSAQ items

When a marker logs in to risr/assess, their dashboard will display all marking assignments separated by exam. The following information is shown for each:

  • Exam / Block / Item - Exam information

  • Variant - Language variant used (where applicable)

  • Not started - the number of responses expected

  • In progress - the number of responses still being marked

  • Completed  - the number of responses marked

For the exam the marker wishes to mark:

  • Click Mark

  • All responses will be displayed

  • Enter marks using the dropdown menu provided for each Marking area

  • The marker can then do any of the following:

    • Save (marks will remain editable)

    • Confirm (marker will not be able to modify marks)

    • Add (this will create a new version of the item and add the response and mark provided. The item will remain in draft state until approved)

    • Reassign to (for bilingual exams, the marker can reassign that response to the other language marker)

  • Click Save and Close (If the marker did not Save each individual response, this action will save them all before being brought back to the dashboard).

Reviewing items

When a reviewer logs in, the dashboard will display the following for all their assigned items:

  • Exam / Block / Item - Exam Information

  • Variant - Item variant (language) where applicable

  • In Progress - For SAQ/MWQ this shows the number of candidates being marked

  • Completed - For SAQ/MWQ this shows the number of candidates who are marked and confirmed

  • In Progress - For VSAQ this shows the number of responses being marked

  • Completed - For VSAQ this shows the number of marked and confirmed responses

Once the marker has confirmed marks, the reviewer can begin:

  • Click Review marks

For SAQ or MWQ, the reviewer can either:

  • Click Needs further review which will keep this candidate in progress. 

  • Click Review complete which will mark this candidate as complete.

The reviewer will be brought to the next random in progress candidate. The dashboard will show the reviewer’s progress across all assignments.

The reviewer can click Overview to see their progress for that specific assignment.

For VSAQ:

  • The reviewer can only click Review Complete beside each confirmed response

  • The status will indicate Confirmed Reviewed.

Marking as a Senior Marker

When a senior marker logs in, the dashboard will display the following information for all assigned items:

  • Exam / Block / Item - Exam information 

  • Variant - Language variant for the item, where applicable

  • In Progress - For SAQ/MWQ this shows the number of candidates being marked

  • Completed - For SAQ/MWQ this shows the number of candidates marked