8.11 Exam Timing

Exam timing is the functionality that allows exam administrators to manage exams automatically with specific timing parameters. The functionality allows administrators to set the amount of time that a user has to sit the exam (including the ability to accommodate reasonable adjustments with the timing able to be configured on a per-user basis, if required), and therefore automatically end the exam for each user at exactly the correct time. With the implementation of exam control, administrators are also able to see more information related to the users that are sitting the exam. The information below details the functionality and how it should be used to control your exams in risr/assess.

Exam timing can be set as part of the Exam Blueprint.

For the exam controls and timing changes to take effect for the user, they must have an active internet connection.

Step by step how to activate and configure the exam timing functionality:

In the exam blueprint setting, enable the Exam timing option.
Click the configure exam timing button
A pop-up will appear for you configure the exam timing.
The pop-up has five fields:
1. ‘Exam start mode’ - this field has two options for written exams:
  1. 'Timer starts when session is started' will start the candidate's exam timer on session start, regardless whether the candidate is logged in or not. e.g. centrally controlling the time for all users, no matter the time of their login. More commonly used in situations where users are all in one location.
  2. 'Timer starts when the user enters exam' will allow the candidate the full exam time from the time they log in. The candidate will not lose time if logging in after the session has started. e.g. if you are using proctoring with the exam and users will be accessing risr/assess at different times over a specified time frame.
2. ‘Counting’ - this field has two options:
  1. ‘Count up from 0:00’ - select this option if you would like the timer that the user can see to count up from 0:00 to the number of hour/minutes set for the exam.
  2. ‘Count down to 0:00’ - select this option if you would like the timer that the user can see to count up from 0:00 to the number of hours/minutes set for the exam.
3. ‘Assessment duration (in minutes)' - enter the duration of the exam in minutes. e.g a 2-hour exam is 120 minutes. Note, this should not include the reading time for the exam if any is permitted, see the next field for instruction.
4. ‘Reading time (in minutes)’ - enter the duration of the reading time in minutes. Note, this is in addition to the exam duration defined in the field above. The reading time function will allow users to access the exam and navigate around the questions, they will not be able to answer any questions until the reading time has elapsed, automatically unlocking the exam for the user. This can be set to '0' for no reading time.
5. ‘Notification of the remaining time (in minutes)’ - define when users will see a warning to advise them how long left of the exam. The message ‘X minutes remaining’ will be displayed in a banner at the top of the P4B page.
Save any changes you have made.

For an OSCE exam, the starting options differ. Timing configuration is still done in the Exam Blueprint Settings and can be edited for an individual exam.
The pop-up has five fields:

‘Exam start mode’ - this field has two options for OSCE exams:
1. 'Timer starts when session is started' will start the candidate's exam timer on session start, regardless whether the candidate is logged in or not. e.g. centrally controlling the time for all users, no matter the time of their login.
2. 'Timer starts on admin command - Waiting Room access' will allow the users into the Waiting Room, however, exam timing will only start on admin command.
‘Reading time (in minutes)’ - enter the duration of the reading time in minutes. Reading time provides candidates with time to review station content before the assessment interaction. This can be set to '0' for no reading time.
‘Assessment duration (in minutes)' -Duration of time that is allotted to each station during the exam. Must be greater or equal to 1 minute.
‘Marking Time Duration' -Duration of time that is allotted for examiners to complete marking. If no marking time is required set as 0.
Save any changes you have made.

Controlling an exam that has been set up with the ‘Timer starts when the user enters exam’ option.

Method one: Starting all users at the same time (not shown in the video).

This method is for use if you would like to open the exam for all users in the session to be able to start the exam as soon as they log in.

Complete the setup of the exam, and publish it to devices from the exam preparation screen.
The exam will display on the dashboard.
Select ‘Start session’. This will immediately allow all users allocated to the session to log in and start the exam.
This will update the users status from ‘Pending’ to ‘Can start’. The user will then be able to log in and take the exam.
If a user has already logged into and therefore downloaded the exam and they are at the holding screen, they will be entered to start the exam when the session is started, providing they are connected to the internet.

Method two: Selected user starting (shown in the video).

This method is for use if you would like to enable a selection of the users in the session to start the exam, but not all at the same time.

Complete the setup of the exam, and publish it to devices from the exam preparation screen.
The exam will display on the dashboard. Do not start the session at this time.
Go to the ‘View logins’ page.
Use the selection field to choose which users you want to start the exam. Note you can use the select box at the top of the table to select all users in bulk. You have the ability to deselect certain users before carrying out any further actions.
Once you have the users selected, the exam timing controls at the top of the page will change from greyed out to be usable.
Select ‘Start’. This will update the users status from ‘Pending’ to ‘Can start’. The user will then be able to log in and take the exam.

Controlling an exam that has been set up with the 'Timer starts when session is started' option.

This method is used if you would like the exam start and end time to be exactly the same for all users. This method will most likely be used in the physical delivery of an exam when the users will be in one or multiple physical locations. The exam timing clock will run for the specified length of the exam, from the moment the session is started. Any users starting to take the exam after the start time will not receive the full time for the exam unless they have their time manually changed after the exam has begun.

Complete the setup of the exam, and publish it to devices from the exam preparation screen.
The exam will display on the dashboard.
Select ‘Start session’. This will immediately allow all users allocated to the session to log in and start the exam.
This will update the users status from ‘Pending’ to ‘Can start’. The user will then be able to log in and take the exam.
If a user has already logged into and therefore downloaded the exam and they are at the holding screen, they will be entered to start the exam when the session is started. If using this method of exam timing, we recommend that all users are logged in and being held at the screen telling them the exam has not started yet. As soon as the session is started they will be entered into the exam at the same time.
The exam will end for all users at the same time unless any specific users have been granted reductions or extensions to the time allowed for them to take the exam using the ‘Change time’ action.

USER SCREENS - IN PROGRESS.

Practique user login screen This is the screen that loads for users when they first access Practique on the P4B URL e.g. https://<organisation-name>.practique.net/html5
Practique user login screen with ID and Password fields filled (these are both case sensitive)
User holding screen A user will see this screen once they have logged into the exam, and the exam has downloaded to their device, but the exam has not begun yet. If the exam has begun already, the user will bypass this screen. If the user is held at this screen, they will start the exam when the session is started. If proctoring is enabled, and Examity is the chosen provider, users will be required to select the ‘Start proctoring’ option in order to start the proctoring process, and then be entered into the exam. The PIN field is available for the user so that an administrator can provide them with the PIN number to decrypt the exam, if the user is offline when the centrally controlled exam is started.
The candidate can see the timing information in the menu bar. Here they have 1 minute of reading time. In reading time they can review questions but not answer.
The exam time is shown and will now count down - if there is no reading time the counter will have started as the candidate accesses the exam. If a time warning has been set this will appear at the set time e.g. when there are 10 minutes remaining.
The Exam time is up and the candidate is instructed to submit their exam. At this point they can no longer access the exam / edit or add answers. The candidate is informed that their answers have been submitted to the server - this resolves previous issues where candidates were unsure of this. If the candidate is off line and they have answers which are not submitted they will be informed and should refer to the off line troubleshooting candidate guidance.
This candidate has clicked on finish exam before the exam time is up. They will see a prompt which will inform them of the status of their answers - have they been submitted, and how many questions are unanswered. They can continue and answer any outstanding questions by clicking on “continue exam” If they choose to leave they can click on “submit exam” - this will finish their session.

Exam timing has been set up with the ‘Timing starts when the user logs in’ option, this is how the user will start their exam.

When the user logs into the P4B interface through their web browser, the exam will download to their device, the user will be immediately taken into the exam, and the exam will start (provided the session has been started). If there is reading time, this will be added to the ‘Time remaining' information at the top of the screen. There will also be a banner at the top of the screen to let the user know how long the reading time is if this is used for the exam. Once the reading time has elapsed, the exam will be unlocked, a banner will show the user how long is allowed for the exam and they will then be able to submit answers.

If the user logs in but the exam session has not been started, they will be held at a screen

The exam will download to the user's device. The user will be held at a screen that informs them the exam has not been started yet, and they should wait.