Page Comparison

...

1. Click on the Items tab.
2. Click on Create new Item. 
   The next screen creates the outline of the item.
   
   The Case number is automatically generated. 
3. In Item Title enter a name for your question.
4. For Item Type choose ‘OSCE Station’.
5. Click on Create Item. 
   The next screen lets you enter information about the station useful for record keeping. You can enter details such as patient name and age and a summary of what the station involves e.g. History examination and blood results. We will not change any for now.
   

6. Press Click Save Item. 
   The next screen shows a new set of tabs:
   
   

   • Item Information: The information you just entered and versioning
   • Item resources: Add images, examiner info documents, actor briefings, student briefings, videos etc. to a station
   • Blueprinting: Add ‘dimensions’ for automatic generation of exams
   • Marksheet: Here you specify what questions the examiners should answer and how. You are creating the mark sheet.
   • Item overview: Summary of the station
   • Item Performance: Shows reports of how the station has performed in previous exams
     
     
7. Go to the Item resources tab.
   Here you can upload any images or information packs you want to be visible on the ipad.
8. Click Add a resource. 
9. In Resource Type, choose Examiner Notes.
   
10. Press Click Choose File and select a PDF of examiner notes.
11. Press Click Add Resource. 
    
12. Click  on the Marksheet tab. 
13. Click on Add new criteria. 
    
    
    

14. You should get a popup allowing you to enter the question information. 

    This tutorial presumes that your local administrator has set up the system so that it contains a Section called "Marks". If a Section has not been set, please follow the instructions on how to set up Sections in the blue box.

    To set up a Marksheet Section: 1. Settings > Manage Sections > Provide a section name e.g. "Marks" > Add Section

    

    
    

15. In Section, choose ‘Marks’ – the section is the heading it will appear under.
16. In Text, type the question to be answered. For example: “How well did the candidate perform?”
17. The Type selection shows the ways in which the question can be answered, the ones you are likely to use are:
    
    
    • Discrete: Select from a choice of values, e.g. 1, 2, 3 or good, ok, poor.
    • Free text: A box in which to type whatever you like.
18. For now, choose ‘Free Text’
19. In Weight, type 0
    
    Weight indicates how much a question is worth relatively for automatic marking. 0 means the result has no bearing. 1 Would be a normal marking, 2 would be worth double etc. Having mandatory unchecked means the examiner does not have to fill in the question.
    
    
20. Make sure Mandatory is not ticked.
21. Press Click Save.
    
    However, what if we wanted a ‘Pass’, ‘Borderline’, ‘Fail’ option for the question?
    
    
22. At the top bar, click on the Settings tab, then Manage Schemas
    
    The schema page allows you to make custom mark types for questions.
    
    
23. Type a name into the ‘Add a new schema’ box and press click Add. 
24. Find the name you typed in the above list and press click Edit Answer. 
    
    Now you can see the list of answers you can select for this question.
25. In Title, type ‘Pass’ – This is the name that appears on the screen
26. In Value, type 2 – These are the points awarded to the candidate if the examiner chooses that answer.
27. Press Click Add. 
28. Repeat this process for ‘Borderline’ – 1 and ‘Fail’ – 0
    
    Now we can go back to our station.
    
    
29. Click the Items tab again
30. Find your earlier station and press click View. 
31. Click on the Marksheet tab
32. Repeat the process for making a question, but when it comes to Type, choose ‘Discrete’
33. A new ‘Schema’ box will appear. Choose the name you gave to your schema.
34. In Weight, type 1.
35. Tick Mandatory and then click Save. 
    
    Now we need to submit the station. We won’t be sending this question for review, we will approve it immediately:
    
    
36. Press Click Submit for Review. 
37. Leave the options as-is and press click Submit.
38. Press Click Approve.
39. Press Click Approve. 

Congratulations, that station is ready to go. Try repeating the whole process to make a second station. Give it a different name and questions.

...

In the item sets tab, you will be able to combine stations into an exam, or questions into a paper.

1. Click on the item sets Item Sets tab
2. Click on Create a new Item Set.

You are now presented with the ‘Create an item set’ screen.

1. In ‘Exam Blueprint’ select the name you gave to your OSCE at the beginning
2. In ‘Add Items Automatically’ choose No
3. PressClick Create Item Set.

In this screen, you can now add the stations to your OSCE.

1. ClickClick Add an Item. 

In the following page you can see all the stations created.

1. Find the two stations you have made and for each one, click Press Add.
2. Click Back to Item Set. 

The item set is now complete, as it only requires two stations, as we set in the earlier blueprint.

...

Now we need to approve the set.

1. PressClick Submit for Review
2. Leave the boxes blank and press
3. Press
4. Pressclick Submit
5. Click Approve (Green button).
6. Click Approve (Blue button). 

 Exams       

Exams       

In the exam screen, you will set up the detailed exam information such as rotations, examiners and students.

1. Press Click Create Exam. 
2. In ‘Number of Days’ enter 1 (if you had 3 days of exams you would enter 3 here)
3. In ‘Exam Blueprint’ select the exam you made earlier.
4. In ‘Exam Venue Capacity’ enter 2 (this is the number of students a circuit can take including rests)
5. In ‘Number of Blocks’ enter 1 –If you use a different set of questions in the AM and PM you would enter 2
6. In ‘Number of Sessions’ enter 1 – This is the number of sessions that happen in each block or day. For example, if there are three sessions before lunch and three after and you are using the same the questions all day (1 block) you would enter 6. If you had 2 blocks (different set of questions in the morning and afternoon, you would enter 3.
7. In ‘Number of Circuits’ enter 1 – this is the number of simultaneous exams (rotations) running, for example, if using two rooms of 10 stations each, with each candidate taking 10 stations you would enter 2.
8. Leave ‘Standard Setting Method’ as Angoff and ‘Randomize Questions’ as No
9. PressClick Create Exam.

Now the exam has been created you will be taken to a screen that shows an overview of what should be completed to fill in the detail.

1. Under ‘Candidates’ pressclick Specify exam dates. 
2. In ‘The first date in this exam will be’ select today’s date.
3. PressClick Save. 

Now the Candidates bar is half filled in, and an item set is available.

1. PressClick Pre-select Item Sets. 
2. The item set may have already been selected, if so, skip to number 17. If not, press  on click Remove on any existing item sets.
3. PressClick Add Item Sets to this list.
4. Find your item set and pressPressclick Add. 
5. Click Approve Item Set list. 

The item set bar is now complete.

1. Under item sets, pressPressclick Lock changes. 
2. Click Lock changes.
3. Under Candidates, pressclick Specify candidates. 

This screen will let you upload students. You can either assign them manually from students created previously or upload a whole allocation from excel, which we will do here. The excel book in this tutorial will be provided, but the format required is:

• ID – The students university number
• Last Name
• First Name
• Block – The full date, then a dash, then the block of the exam. E.g. “30 November 2016 – 1”
• Session – The Session for the student, e.g. “Session 1”
• Room – The station number the student starts at, e.g. “2”
• Circuit – The number of the rotation the student has been allocated to e.g. “1”

1. PressClick on Upload Candidate allocation. 
2. Under ‘Upload CSV/XLS file’ Pressclick choose file.
3. Select the provided excel book ‘Candidates Upload format’
4. PressClick Upload
5. Under Candidates, pressPressclick Lock changes.
6. Click Lock changes. 

Now we will input the examiners, marshals (invigilators) and who they are marking.

1. Under ‘Examiners’ Pressclick Allocate examiners. 

Like the students, we could do this manually, but here we will use the excel upload. The book will be provided for the tutorial, but the format required is:

• ID – an identifier for the examiner. You could use their GMC number or whatever you decide, but each examiner should keep the same ID between exams so it is worth agreeing a format beforehand
• First Name
• Surname
• Block – The full date, then a dash, then the block of the exam. E.g. “30 November 2016 – 1”
• Session – The Session for the examiner, e.g. “Session 1”
• Room – The station the examiner occupies, e.g. 3 (should be blank for marshals)
• Circuit – The number of the rotation the examiner is on e.g. “1”
• Role – Examiner or Marshall, should be “E” or “M”

1. PressClick Upload Examiner allocation
2. Under ‘Upload CSV/XLS file’ Pressclick Choose file
3. Select the provided excel book “Examiner Upload Format”
4. Press
5. PressClick Upload.
6. Click Allocate Examiners. 

Now we confirm the allocation looks OK.

1. PressClick Close allocation
2. Under Examiners, pressPressclick Lock changes
3. Click Lock changes

You could also allocate role players for our OSCE if you maintain a list of them, but you don’t need to, so we’ll skip that step.

1. Under Role Players, pressPressclick Lock changes.
2. Click Lock changes. 

Our Exam is now made and ready to go! Let’s try it out.

...

1. Click the Exams tab
2. Find your exam, and click on
3. Click on ‘View Sessions’
4. Pressclick

The exam will be loaded on to devices.  This should be done the night before at the latest. When you are ready, start the session:

1. Click on the ‘Dashboard’ tab
2. Find your exam and pressclick

The exam is ready to start. For examiners and marshals (invigilators) to log in, they use their ID, prefaced with the letter on this screen listed under ‘Pin / Exam Letter’. Give this a try and enter marks with your examiners.

Once you have finished the exam, you will need to close off the sessions

1. PressclickPress
2. click

Your exam is now complete! Results are available in the ‘Exams’ section, by pressingclicking