8.11 How to mark Written Exams online
- Pernille Marqvardsen
risr/assess enables online marking. Online marking is available for individual SAQs (Single Answer Questions) and SAQs that form part of MWQs (Multiple Written Questions). This guide outlines the key features and includes step by step instructions to help you use them effectively.
Markers can be created and assigned in 2 ways:
Created manually in settings then assigned to items/questions and group/s (if required)
Marker details are imported - this creates and assigns them automatically
Markers are created in risr/assess and then assigned to the item/s they are required to mark. There is also the option to create a Senior Marker role.
Markers can also be grouped, groups are used to divide marking between different markers; groups also facilitate double marking.
How to create and assign markers manually.
To create a new examiner, set up a new user and assign them to the appropriate user group in risr/assess. Instructions on how to do this, can be found here: How to create and manage risr/assess users and here: How to create and manage risr/assess user groups
Manual assignment of markers to questions/items
Setting the Marking Type
When creating a new Written Exam in the Edit exam details screen:
Click the dropdown menu for Written marking type
Select the required marking type
When the Exam has been created and ready to run, or has already run:
For the required Exam click View Sessions
Click View Markers
Using the checkboxes provided click and select the required Items that require marking
Using the dropdown menu select the required marking type for the selected Items
Click Apply
The system will provide warning messages as guidance stating the number of each role (if applicable) are required for each Item based on the marking type selected.
Assigning Individual Markers
This option should be used when specific markers need to be assigned to specific Items. This option is available for all marking types.
How to assign individual markers (when the exam has been created and ready to run, or has already run):
For the required Exam click View Sessions
Click View Markers
Using the checkboxes provided click and select the required Items that require marking
Items can be filtered using the filtering options available
Click Assign individual markers
Users can be filtered for selection. Only Users who satisfy the filter criteria and have the permission Exams - Mark Exams are able to be selected. If no filtering is used, all users with the permission Exams - Mark Exams are available for selection.
Select Markers as required
Single marked (one marker is required)
Double marked (two markers are required, one for each double marking group)
Bilingual exams must have a marker for each language variant. The same marker can be assigned to both variants.
Splitting Candidates into Cohorts (SAQ/MWQ Only)
When selecting markers:
Click the checkbox for Split candidates into cohorts
Identify the number of cohorts required
Select the required markers appropriate to the number of cohorts identified
Assigning Reviewers
How to assign reviewers (when the exam has been created and ready to run, or has already run):
For the required Exam click View Sessions
Click View Markers
Using the checkboxes provided click and select the required Items that require marking
Items can be filtered using the filtering options available
Click Assign reviewer
Select one reviewer per variant
Assigning Senior Markers
How to assign senior markers (when the exam has been created and ready to run, or has already run):
For the required Exam click View Sessions
Click View Markers
Using the checkboxes provided click and select the required Items that require marking
Items can be filtered using the filtering options available
Click Assign senior marker
Select one senior marker per variant
Assigning Marker Pools
How to assign senior markers (when the exam has been created and ready to run, or has already run):
For the required Exam click View Sessions
Click View Markers
Using the checkboxes provided click and select the required Items that require marking
Items can be filtered using the filtering options available
Click Assign marker pool
Either
Select an unlimited number of markers per marker pool
Single marked (one marker pool)
Double marked (two marker pools)
Single marked bilingual exams (two marker pools, one for each language variant)
Double marked bilingual exams (four marker pools, two pools for each language variant)
OR
Click Add all markers to add all eligible markers
Click Save the marker assignment
Importing Marker Assignment
How to upload a marker assignment import spreadsheet (when the exam has been created and ready to run, or has already run):
For the required Exam click View Sessions
Click View Markers
Click Upload marker assignment
Identify your upload file and click Upload file
Ensure the data is mapped correctly to the spreadsheet column headers
Click Confirm
Marking SAQ/MWQ items
When a marker logs in to risr/assess, their dashboard will display all marking assignments separated by exam. The following information is shown for each:
Exam / Block / Item - Exam information
Variant - Language variant used (where applicable)
Not started - the number of candidates for whom marking has not started
In progress - the number of candidates who are currently being marked
Completed - the number of candidates who have been marked
For the exam the marker wishes to mark:
Click Mark
The first (random) candidate's marking sheet will display
Enter marks using the dropdown menu provided for each Marking area
The marker can then do any of the following:
Save marks (marker can access this candidate again)
Confirm marks (marker will not be able to modify marks)
Reassign to the other language marker (for bilingual exams only)
Enter notes that can be included on the candidate feedback report
Enter comments that candidates will never see. Only exam administrators, reviewers or senior markers (where applicable) will see these comments.
From the dashboard, the marker can click Overview to see a summary of all candidates and their status.
Marking VSAQ items
When a marker logs in to risr/assess, their dashboard will display all marking assignments separated by exam. The following information is shown for each:
Exam / Block / Item - Exam information
Variant - Language variant used (where applicable)
Not started - the number of responses expected
In progress - the number of responses still being marked
Completed - the number of responses marked
For the exam the marker wishes to mark:
Click Mark
All responses will be displayed
Enter marks using the dropdown menu provided for each Marking area
The marker can then do any of the following:
Save (marks will remain editable)
Confirm (marker will not be able to modify marks)
Add (this will create a new version of the item and add the response and mark provided. The item will remain in draft state until approved)
Reassign to (for bilingual exams, the marker can reassign that response to the other language marker)
Click Save and Close (If the marker did not Save each individual response, this action will save them all before being brought back to the dashboard).
Reviewing items
When a reviewer logs in, the dashboard will display the following for all their assigned items:
Exam / Block / Item - Exam Information
Variant - Item variant (language) where applicable
In Progress - For SAQ/MWQ this shows the number of candidates being marked
Completed - For SAQ/MWQ this shows the number of candidates who are marked and confirmed
In Progress - For VSAQ this shows the number of responses being marked
Completed - For VSAQ this shows the number of marked and confirmed responses
Once the marker has confirmed marks, the reviewer can begin:
Click Review marks
For SAQ or MWQ, the reviewer can either:
Click Needs further review which will keep this candidate in progress.
Click Review complete which will mark this candidate as complete.
The reviewer will be brought to the next random in progress candidate. The dashboard will show the reviewer’s progress across all assignments.
The reviewer can click Overview to see their progress for that specific assignment.
For VSAQ:
The reviewer can only click Review Complete beside each confirmed response
The status will indicate Confirmed Reviewed.
Marking as a Senior Marker
When a senior marker logs in, the dashboard will display the following information for all assigned items:
Exam / Block / Item - Exam information
Variant - Language variant for the item, where applicable
In Progress - For SAQ/MWQ this shows the number of candidates being marked
Completed - For SAQ/MWQ this shows the number of candidates marked