/
8.12 How to import (and export) Items (including QTI import)

8.12 How to import (and export) Items (including QTI import)

Items exported from Practique 7.1+ can be imported back as new items. risr/assess currently supports the import and export of mixed item types in one file.

Item export

Item export is part of Batch operations for Items. On the item list, there is a Batch… button on the right side of the filtering panel. The batch operates on items currently filtered so select your preferred filtering criteria and click at Batch… button. Follow the instructions to export the items. Items are exported as CSV and XLSX file at the same time.

Item import

File header

The item import can be a XLSX (Excel), CSV or a ZIP file. If using a ZIP file, then only one Excel or CSV file can be in a ZIP file. The rules for preparing XLSX/CSV file are the same for both cases - even if it’s uploaded alone or as a part of the ZIP file.

The only difference between XLSX/CSV file uploaded separately is, it can't contain references to resources as file name but still can contain references to resources as Resource numbers (see below).

Each import file has to contain a header row. You can download an example file here:

 

The header column titles do not have to be exactly as defined in the example, you can use any wording in the header, but this recommended column titles allows us to create a correct mapping before the actual import.

The header is internally split into two parts:

  • Item related data

  • Criteria related data

To explain the difference between Item data and Criteria data, each item type in Practique contains item-data and criteria-data. For most of item types the criteria data are not available directly but are hidden on the item edit form. For example SBA, SAQ, VSAQ, MTF, EMQ, CPQ, PVSA. On the other side, some item types user can add/edit/remove the criteria directly. That’s for OSCE and MWQ (Multipart written question - available since Practique 7.1).

For example, an SBA item has item number, version, question text, etc and also a “hidden” sba type criterion that holds the possible answers and identifies the correct answer.

Another example could be a SAQ item whose criterion is a ‘text’ type criterion.

EMQ item is an example of a written item with more than one criterion. It has as many criteria as a number of stems.

The OSCE item type is based on user-defined criteria (a marksheet).

Similarly, a “Written question” type (MWQ) has a set of user defined criteria, like the OSCE item type.

Blueprinting, Count as

Any Dimensions applicable to OSCE or Written items can be specified in the header as well.

To be able to support both item-data dimensions (Blueprinting) and CountAs (for criteria) you have to partially keep the order of fields. Item data fields should be followed by the Criteria data fields.

The most important for support Blueprinting and Count as is any of the Criteria data fields:

“Type” OR “Available answers” OR “Correct answer”

As soon as the importer finds a field header with one of the titles specified above, all Dimension names found in the header after that column are considered as “Count as” fields and the tagging is attached to the marksheet criteria instead of the Item.

Data Rows

To be able to support a nested structure item → criteria it’s important to follow the structure of the data rows. Each imported item is defined on at least one row.

The following item types do not support multiple rows, because they contain exactly one criterion:

SBA, SAQ, VSAQ, ARQ, CPQ, MTF

The other item types can have one or more rows, depending on the number of criteria. For example, an EMQ item with 4 stems will be defined on 4 rows. The first row contains item data like item type, number, summary, blueprinting and includes the first Stem data as well. The other three rows define only the additional three stems.

Any data row with an empty Item type column is considered as a continuation row for the previous one and should not define any item-type data.

Required fields

The set of required fields depends on the item type and the row. For example, for an item-type row, the ITem type is required but for the continuation row, it has to be left empty.

Minimal example

There is a minimal example of importing two simple SBA items. These items get the first available item number for SBA item type because the Item number is not defined.

Item type

Question title

Available answers

Available answers

Available answers

Available answers

Available answers

Correct answer

Item type

Question title

Available answers

Available answers

Available answers

Available answers

Available answers

Correct answer

SBA

Select the largest animal

Dog

Elephant

Crocodile

Mouse

 

Elephant

SBA

Select the darkest colour

Yellow

Purple

Black

Green

Red

Black

Alternatively, the set of available answers could be defined in one column. Each answer is separated by a semicolon ; Please see Multivalued columns paragraph below for more details.

This applies to ALL columns marked as “Multivalued” in the field list table below.

Item type

Question title

Available answers

Correct answer

Item type

Question title

Available answers

Correct answer

SBA

Select the largest animal

Cat;Dog;Elephant;Crocodile;Mouse

Elephant

SBA

Select the darkest colour

White;Yellow;Purple;Black;Greed;Red

Black

There could be fewer columns defined if we include the “scoring” in the Available answers list. That could be used if the SBA item should not have a score of 0 or 1 but for example 1 for correct answer, -0.25 for an incorrect answer and 0 for “I do not know” answer. This version is used if you Export items from Practique because it’s the most general.

Item type

Question title

Available answers

Item type

Question title

Available answers

SBA

Select the largest animal

Dog;0;Elephant;1;Crocodile;0;Mouse;0

SBA

Select the darkest colour

Yellow;0;Purple;0;Black;1;Green;0;Red;0

Item types

Type code

Item type name

Type code

Item type name

ARQ

Assertion-Reasoning Question

CPQ

Clinical Prioritisation Question

EMQ

Extended matching question

MTF

Multiple True/False

MWQ

Written question (Multipart written question)

OSCE

OSCE Station

PVSA

Prescribing Question

SAQ

Short Answer Question

SBA

Single Best Answer Question

VSAQ

Very Short Answer Question

Criteria types

Written question (MWQ) type and OSCE station type can define different criteria types for the mark-sheet (Type column in the table below). Some item types, like SBA, SAQ, VSAQ, MTF, EMQ, CPQ etc., have the Type fixed and can't be changed. Only MWQ and OSCE should specify the “Type” column. It’s ignored for the other item types.

Type

Notes

OSCE/MWQ

Type

Notes

OSCE/MWQ

discrete

Single answer only - the possible answers could have a different scoring but the only one can be selected.

both

boolean

 

both

text

A free text. It cannot be automatically marked so the maximum score should be specified if it makes sense. Can be also used just as a comment field.

both

label

Criterion Stem field is rendered as a label only. It can be used to visually split the mark-sheet to different sections.

both

vsaq

One line answer is expected from the candidate. It allows defining a set of possible answers that can be automatically marked using the Levenshtein threshold value.

For example, accepted answer is Meprobamate

If the threshold is 1 and the candidate writes Mepromamate then the answer is accepted and marked with full score. because there is 1 letter difference between Meprobamate and Mepromamate

both

cpq

This is a default type for CPQ question type but it can be used for MWQ as well if needed. The possible answers associated with this criterion type defines a correct order of answers to the question Stem and the candidate is supposed to specify a correct order of the answers.

MWQ

mac

Multi answer criterion (multiple correct answers)

This allows defining a set of possible answers and the candidate can pick more than one.

MWQ

Field list

 

Field name

Item type

Multivalued

Notes

 

Field name

Item type

Multivalued

Notes

Item data

Item type

all

 

One of the available Item types or empty for a continuation row.

PVSA and OSCE are not supported at the time of writing.

Item number

all

 

Optional item number

Question title

all

 

Item title

Question text

all

 

Summary text

Variant

all

 

Item variant if the variant support is available. Contains a variant code, for example, ‘en’

Comments

all

 

The comments are displayed only on the item page

Examiner notes

all

 

These are examiner comments. Displayed on the marking page for the examiner and also on Candidate feedback report

Number of markers

all

 

Applicable to multi marking only

Marking method

all

 

Applicable to multi marking only. Supported values are:

criteria total

Marking resolution

all

 

Applicable to multi marking only. Supported values are:

manual avg sum

Resource

all

Yes

It can contain either file name (see Candidate resources below) or an existing resource number from the Resource library.

Resource title

all

Yes

Resource title. The title is assigned to the resource defined in the previous column

If multiple resources are defined in separate columns and at least one has a Resource title defined, this column must exist for each resource but could be empty if the title should not be defined.