Creating a new Item Set

• Click Item Sets from the top menu bar

• Click + Create new Item set

• Using the free text box or arrows it is possible to change the automatically generated Item Set number if desired

• Using the free text box enter the title for your Item Set

• Using the dropdown menu select the Exam Blueprint applicable for your Item Set. This will be used to automatically populate the Item Set (if set to add Items automatically later)

• By default only Items in a state of Approved are selected to be used in the Item Set. It is possible to include Items in other states. An Exam can only run using Approved Items.

• It is possible to select whether or not to include Items used in existing Item Sets. You can choose to exclude Items that are used in other Item Sets by clicking No.

• It is possible to allow the system to automatically add Items to your Item Set based on the constraints set in the Exam Blueprint. If you do not wish for the system to populate the Item set then select No in response to Add Items automatically?

• [Optional] Variants are applicable to customers delivering multi-lingual exams. If an Item has more than one language variant set the Primary Variant language for the item set. The system will will be forced to the selected value, but it will be possible to add any other item manually later.

• [Optional] By selecting which Variants must feature in the Item Set all items assigned to the item set must exist in all the selected language variants. Otherwise it would not be possible to use the item set for an exam. Only language variants in this list can be added to the item set. If additional language variants are required, please contact the customer success team.

• Click Create Item Set

Editing Item Sets

While an Item Set is in Draft state it can be edited and further options available. Beyond Item Set Creation all following guidance is optional.

Warning Information

General

Hyperlinks to Items needing attention are provided within the warnings. Click the hyperlink provided for the Item to be taken directly to that item.

Language variants

Customers delivering exams in multiple languages have the option to download an XLSX spreadsheet providing high level information about the Items and related Item language variants in the Item Set. Download the XLSX spreadsheet by clicking the Download details link provided in the warnings banner at the top of the Item Set page.

Open

Download details for the Item Set

Item Set Details

Item set Preview

• Click Preview to access options to create a downloadable preview of your Item Set

• Choose between HTML, PDF or MS Word document types

• Choose the language variant

• Check the box to also include all relevant resources (if applicable)

• Click Download to download and view the Item Set Preview

Ebel Scoring

• Click Ebel Scoring

• Click Invite Judges to Ebel Scoring

• Using the free text boxes enter the usernames of who you would like to provide Ebel Scoring judgement for the Item Set

• Click Invite

Normalising Item Scores

• Click Normalize

• Using the free text box or arrows select a score for all Items in the Item Set to be normalised to

• Use the checkbox to retain original Item Scores and not normalise

Editing Item Set Details

• Click Edit Details

• This will allow you to edit any of the original details entered at Item Set Creation stage

Task Details

This shows all relevant background task details associated with the Item Set

• Click Task Details to open the overview

Assigned Items

Download Item List

• Click Download Item List to obtain an XLSX spreadsheet view of all Items included in the Item Set.

• For Item sets that contain multiple language variants, use the search functionality to select a language and click Apply filters. Click Download Item Set, then select Download Item List to export an XLSX spreadsheet of items for the selected language. This step can be repeated for each language in the item set.

Open

Download Item set for Multi-language

Add an Item

• Click + Add an Item to override the automatic generation (if used) and add an Item to the Item Set by manually searching, filtering and selecting the required Item(s). From this screen it is possible to create a new Item to be included.

• Click Add for any Item you want to include in the Item Set

• When finished adding click < Back to Item Set

Regenerate Item Set

Use this function if you wish to rerun the automatic Item Set generation

• Click Regenerate Item Set

Station Grouping

Please see the Station Grouping comprehensive guide here

Manage Items in Item Set list

For each Item in the Item Set list, Options to edit or view the item are available under the Options function.