Click Exams from the top menu bar
Click + Create then Exam
Fill out the basic exam details as required using the free text boxes or dropdown menus
Exam ID - the unique identifier used by risr/assess, this cannot be changed
Check the basic exam details as required using the free text boxes or dropdown menus
Exam Title - the name of your exam
Number of days - the number of days your exam will run on (if this number is more than one then you will need to specify that here as new fields are opened in exam creation)Exam Blueprint
Blocks - the template for your exam which will have been created at an earlier stage in Blueprints
Exam Venue Candidate Capacity - the number of rooms you are going to have in your circuits
Blocks - for OSCE this is equivalent to one Item Set (per block) within an exam, eg. Paper for OSCE this is equivalent to one Item Set (per block) within an exam, eg. Paper 1 in the morning and Paper 2 in the afternoon
Sessions - the method used for segregating candidates/examiners into different physical locations or different times in a day to enable easier control of your exam
Circuits - the number of parallel circuits running simultaneously
Exam Venue Candidate Capacity X Circuits = Candidates in a Session
Exam Venue Candidate Capacity - the number of rooms you are going to have in your circuits
Standard Setting Method - the method used for calculating cut scores and used in statistical analysis. This can be changed after the Exam is run.
Allowed Marking Discrepancy - this is only applicable to OSCEs where there are two examiners per station
Set as 20% - Item out of 10 - one marker 8/10 one marker 5/10 discrepancy is 3 which is above 20% - 2
Double marking is a back-end configuration and is only available upon request. Please get in touch with one of our team if you would like more information on this.
Click Create Exam
Select your exam blueprint. Any information that you have completed in your exam blueprint will automatically be used to create your exam. You can correct all parameters
Exam Preparation Screen
Click Edit Exam Details Some of the - All details are pulled from your selected exam blueprint.
If your exam blueprint is set up correctly, you will not need to make any changes and can simply click “Save changes” at the bottom of the screen.
If you wish to correct these for the individual diet, you can do so here. If you wish to correct it for all exams created from this blueprint, please go to the blueprint section to do so.
Some of the previous entered information can be edited here if required
Exam Title
Exam Venue Candidate Capacity
Dates Estimate (Number of days exam will be run on)
Allowed Marking Discrepancy
The following Exam Settings are only applicable to Remote OSCEs. If you are running an OSCE using iPads then these settings can be ignored.
Candidate anonymisation - Allows to hide candidate name from the Examiner or Simulated patient P4B view
Enable Resource Locking - If enabled, the candidate would not be able to access the resources until a video meeting with an Examiner is started
Hide Rest Stations from candidates - The candidate will not be shown any rest stations when they are hidden
Enable Copy/Paste - Enables candidate to copy information from the question/resource and paste into notes
Enable Calculator - enables the use of in-built calculator function
Enable Answer Elimination - not applicable to OSCE
Enable Resource Grid view - Enables multiple resources to be simultaneously displayed in a grid format
Exam PIN required - When required, candidates will need to enter the exam PIN before they can begin a started session. When not required, logged-in candidates will be started automatically when they are allowed to start
Enable Notes? - Enables the use of in-built mini text editor for candidate to make notes only visible to them
Enable screen-sharing of the Candidate’s screen - Requires candidate to share their the screen as an additional video feed and extra layer of security
Enable Highlighting - Enables highlighting function for candidate to highlight important information in the question text
Enable meeting recording - Enables recording of all connected video feeds. This is only configurable upon request and discussion with the risr/assess team. Please get in touch with us if this is something you are interested in
Please view our comprehensive Safe Exam Browser Guidance here
...
Require Safe Exam Browser (SEB) - If enabled, candidates will need SEB to take the exam. Additional security requirements can be enforced by using either Configuration Keys (CK) or the more stringent Browser Exam Keys (BEK). Even if no keys are entered in the key lists, SEB must be set up to send configuration and browser keys
SEB Configuration Key list - One key per line. If set, the candidate's SEB configuration will be verified against the keys
SEB Browser Exam Key List - One key per line. If set, both the candidate's SEB version and configuration will be verified against the keys. Keys are required for each combination of SEB and operating system
...
can be ignored. If you select iPad as delivery platform on your blueprint, you will only see settings relevant for iPad.
Exam PIN required -Control whether candidates need to enter the Exam PIN in order to be admitted to the exam. If disabled, logged-in candidates will be started automatically when they are allowed to start.
Name visibility - Allows to hide candidate name from the Examiner or Simulated patient P4B view and/or the examiner name from the candidate view.
Hide Rest Stations from candidates - The candidate will not be shown any rest stations when they are hidden
Resource Locking - If enabled, the candidate would not be able to access the resources until a video meeting with an Examiner is started
Copy/Paste - Enables candidate to copy information from the question/resource and paste into notes
Highlighting - Control the ability to highlight text. This does not apply to resources.
Calculator - enables the use of in-built calculator function
Notes - Enables the use of in-built mini text editor for candidate to make notes only visible to them
Resource Grid view - Enables multiple resources to be simultaneously displayed in a grid format
Share candidates’s screen - Control the requirement for candidates to share their screen as an additional video feed for Examiners / Observers / Simulated Patients to view
Image synchronisation -Control the ability for users to broadcast and observe in real time how another user is interacting with a resource.
Exam Timing - If enabled, the exam timing can be configured to specify the duration of the exam. If disabled, candidates have no time limits imposed.
Exam start mode -
Timer starts when Exam starts - this means that when participants log in to risr/assess and select the correct exam they will be held at a holding screen, as soon as the Exam is started by the administrator the participants will automatically enter the exam
Timer starts on Admin command - this means that when participants log in to risr/assess and select the correct exam they will automatically enter the exam and be held in a waiting room. This allows for any checks such as ID validations and visual/audio checks. The exam is then started by an administrator in the backend and the exam timer will begin. Participants can see this with the appearance of the yellow timer bar
Reading Time - Provides time before the start of the examination for the candidate and examiner to read any required information
Assessment time - The time during which the examination and assessment takes place. The candidate will carry out any tasks within the simulation
Marking Time - Time given for the examiner to mark the candidate against the marking criteria
Enable meeting recording - Enables recording of all connected video feeds. This is only configurable upon request and discussion with the risr/assess team. Please get in touch with us if this is something you are interested in.
Allow marking discrepancy [%] - Only applicable for double marked items. Provide allowed discrepancy value as % of item max score.
If required you can upload a cover document. Click Upload cover document to select a file from your device to appear as the first page for your exam. You can upload your customized cover document. Any existing one can be removed with the selection of the Clear checkbox when available. If you already have a cover document uploaded within the Exam Blueprint it will be replaced with this one. We also provide a template which can be customised using the text editor, you can access this by clicking Customise cover document.
...
| Note |
|---|
It is not possible to add more Candidates than there are available Rooms in the Rotation |
Clicking Manage Sessions - manage sessions is only for reporting purposes?
Clicking Notify Candidates will enable you to send an email from risr/assess to all candidates scheduled for the Exam
From the dropdown menus provided you can change the following settings:
Notify - notify everyone participating or only previously unnotified candidates
Session date - filter candidates to notify by Session date
Session - filter candidates to notify by Session
Circuit - filter candidates to notify by Circuit
Click Populate Recipients to generate a list of Candidates emails based on your filters
Using the Free text boxes provided you can then write:
Subject - the subject for the email
Message - the main body for the email
Recipients - these will have been populated by using the above filters or you can manually write candidates emails here (separated by a comma)
Attachment - click Choose file if you wish to add an attachment to the email
Redirect to - this can be used for testing purposes to redirect all emails to another email address before sending the confirmed message to candidates
Click Send notification emails to send the email
Clicking Download Candidate Data will give you a spreadsheet download of candidate information which includes:
ID
First Name
Last Name
E-mail
Password
Block
Date
Session
Room
Circuit
Last Change (to candidate user profile in the system)
Preferance (language preference)
Time Zone (candidate timezone)
...
Click Exams from the top menu bar and locate the Exam just created. A number of options and overviews are not available to view.
View Sessions
View Rotation - provides an overview of the rotation for the Exam
View Schedule - provides the same information as in View Rotation but in list format
View Rooms - provides you with the ability to change candidates if necessary
View Starting Rooms - where you can change the ordering of the stations - this is the place where clients can design where the rest stations go - has to be done for each individual circuit per exam - can also change examiners
View intersect report - downloads excel spreadsheet of everything
Masterplan is mostly Examiner allocation
Examiners Availability report
Download Candidate Allocation
Exam details
View
View Seating - list of students
View history - audit log of administration against Exam
Change date
Download Candidate Allocation - same as download candidate data
Continue Preparation - back to exam prep
Run session on paper - pushes exam to IN MARKING STATE. Downloads all content that you would need to run the session on paper, zip files
Gives pdfs of everything run
Publish to devices - this is the point that information is available on P4B to get into the Exam, if Exam PIN is applicable then candidate can use if they have the PIN. Otherwise Admin will click start and it will be ready. OUT risr management for candidates like emails etc
Available on Dashboard
Reset Exam Day
With admin secret code - will delete all data associated with that exam - all answers/responses will be removed