Paperexam

The following training courses are currently planned:

• Testing with Paperexam | FR 01/03/2024 10:00 - 12:00 | Registration & Details
• Testing with Paperexam | FR 17.05.2024 10:00 - 12:00 | Registration & Details

If you require training beyond these times, please let us know at this e-mail address:e-schulungen-dmlt@uibk.ac.at

If you have any questions about the system or its operation, please write to eExams@uibk.ac.at

The following question types are available in Paperexam:

• Single choice question
• True-false question
• Multiple choice question
• Open question*
• Segmented open question (handwriting recognition)*
• Kprim question
• Matching question

*Only recommended to a limited extent

You can choose from two variants for the multiple choice questions. Either each answer option is assessed individually, or points are only awarded for correct combinations.

Open questions are suitable if you expect longer texts as answers. Paperexam only recognises open questions as answered when at least 0.3% of the field has been filled in by the examinee. If you expect short answers, please use the segmented open question. For open questions, indicate how long the answer should be (e.g. "Describe in three to five sentences ....").

If you have existing exam questions, you can import them using a .csv template. Questions can be saved and retrieved in a question library.

Definition of term

• Exam = An appointment for which an exam sheet is used.
• Examination sheet = One or more pages with exam questions.
  • An examination sheet is generated for each participant.
  • Different variants with different sequences of questions and/or answer options can be generated.

Procedure

1. Open http://paperexam.uibk.ac.at/ and log into the system using single sign-on (university user ID and password).
2. Move the mouse to the icons on the left-hand side of the screen. A menu will open.
3. Click on Fold out permanently to fix the menu.
4. Click on Create examination sheet. The examination sheet wizard opens.
5. Complete the properties of the examination form. Attention. These settings can no longer be adjusted once an exam has been generated with the exam sheet. Our recommendation is
   • Exam type: Paper exam
   • Paper format: A4
   • Procedure: Answers on the examination sheet
6. Click on Apply. The window closes and the examination sheet has been created.
7. Click on Question group in the left-hand menu under Add . The question group wizard opens.
8. Complete the properties of the question group and click on Apply. Information: At least one question group must be created. The name of the question group is specified on the examination sheet. Assigning a name is not mandatory.
9. Click on Question. The question assistant opens.
10. Select a question type and click Next. (Move the mouse over the small (i) to see an example of the question type).
11. Enter the question text, the answer option and the achievable points and click on Add answer.
    • Repeat this step to add multiple answer options.
    • Click on an existing answer option to edit it. Click Update answer to save the changes.
12. Click on Apply when you have completed your details.
13. Repeat steps 9 to 12 to fill the questionnaire with questions.
14. Click on Save and exit as soon as you have completed the questionnaire. You are now in the questionnaire administration.

Attention: Please check questions including points carefully: these cannot be removed from the evaluation after the examination!

Before creating an exam, you must create an examination sheet (see previous section).

It is generally possible:

• To display exam questions and answers together on the exam sheets.
• create separate question and answer sheets.
• to create pure answer sheets and map the questionnaires in an external programme.

After the exam has been created, the exam sheets are offered for printing as PDF files:

• The sheets can be printed on your own laser printer or in Studia.
• Print double-sided.
• Please only print one page per side of the sheet.
• Ensure a clear, strong print image.
• To be on the safe side, print 5-10% more sheets than the number of students registered for the exam.

Procedure

1. Click on Create exam.
2. Create a new folder or use an existing one. Click on Next.
3. Enter a name for your exam. Please note: this name will appear on the examination sheets. Click on Next.
4. Under Type of exam, select whether the question and answer sheets should be combined or separated. Click on Next. Information: Only those examination questionnaires that fulfil the criterion will be listed.
5. Select whether the test taker ID should be entered by the participants and click Next.
6. Select the desired examination form. If you cannot find your examination questionnaire in the list, you must either change the type of examination in step 4 or create a questionnaire with the desired type of examination. (For more information, see Creating an examination questionnaire with questions in step 5).
7. Select Create variants and enter the number of questionnaire variants (up to 10).
8. Select an option for the variants and click Next.
9. Specify how many exams should be printed. Calculate with approx. 10% more exam sheets than you expect participants and add the number of scramblings. Click on Next.
10. Finally, check your details and then click on Apply. The exam file will open.
    • You may need to allow pop-ups for evaexams.de to open in your browser and reload the page. (Reloading in Chrome closes the preview of the exam. In this case, follow step 12).
    • Attention: if you close the window, the exam sheets 1 to X are no longer accessible. The newly generated exam sheets will then be numbered X+1 to X+N.
    • Save the file immediately so that smudged sheets can be printed again in an emergency. Copies must not be used!
11. Print out the test sheets.
12. To create additional sets of sheets, proceed as follows:
    1. Click on Folder list in the main menu and select the appropriate folder and the desired exam.
    2. Enter the desired number under Generate additional examination sheet sets.
    3. Click on Retrieve. The preview of the test opens. (The numbering of the sheets is consecutive to the previously printed sheets).
    4. Print out the test sheets.

It makes sense to do a test run before the actual test:

• Create a test that is clearly labelled "Test".
• Create and print a few sheets.
• Fill these out (including corrected answers), scan them in and verify them.

This allows you to practice using the system and ensure that all steps are carried out correctly.

To gain access to the system, please complete the Application for the authorisation Paperexam form.

As soon as the account has been activated, you can log in with your university account.

A sub-area is created for each course in Paperexams. If you would like to add another person to a section, please contact eexams@uibk.ac.at.

Paperexam can be accessed via http://paperexam.uibk.ac.at.

We recommend that all examiners allow sufficient time (our recommendation: at least 7 days) to prepare the examination, especially before the first use:

• Creation of an examination concept before technical implementation
• Familiarisation with the user interface
• Using instructions, attending a training course if necessary
• Test run before the actual test

The examination concept should be well thought out before questions are created. Question types cannot be changed once the question has been created.

Tips for a successful examination concept:

1. Analyse the circumstances and framework conditions (group size, requirements of the examination regulations, etc.)
2. Design the individual tasks (consider transfer tasks as well as reproduction tasks):
   • Type of task
   • Level of difficulty
   • Formulate question
   • Possible answers
   • Assessment
3. Review: A review process among colleagues helps to improve the exam questions
4. Compilation of the entire exam
5. Check: Check the connection between the learning objective and the examination task
6. Formal design of the entire exam
7. Draft of the sample solution with the assessment criteria (based on the learning objectives)

Make the examination candidates aware of how to fill in the forms, ideally in advance, but at the latest on the day of the exam. Although there are brief instructions on the examination sheets, students easily overlook them in the tense examination situation.

• Crosses should be made with a blue or black pen (felt-tip pens are also possible, but must not be too thick). The crosses must be inside the boxes; they will not be recognized outside.
• Corrections can be made by cancelling a cross by colouring in the box and ticking another box.
• Open-ended answers may only be entered within the designated boxes.
• Marginal notes are not registered by the system.
• The matriculation number must be filled in carefully. For security reasons, the name should also be entered.
• Corner markings and barcodes must not be overwritten under any circumstances.

After the examination, the paper sheets are collected and scanned.

If open answers with the option Mark on exam sheet are included in the exam, these must first be marked so that the system can then grade them (if desired).

If the papers have been stapled, the staple must be removed by cutting off the edge. The corner markings (3 corner markings are required) must not be damaged in the process. Please also ensure that the system only recognises complete checks. If there is a page without questions, this is also part of the sheet set and must also be scanned.

Scanning via the FSS

Scanning is done by the Faculty Service Centre (Innrain 52a; 02N040). Form: Scan-Request

Please complete the form above and hand it in with the exam-papers.

The scans are uploaded directly to the account of the person responsible for the examination and are available there for verification.

Verification can start as soon as the questionnaires have been loaded into the system. The system only presents the answers that cannot be clearly recognized by the system (e.g. corrections, ambiguous crosses, missing answers). It is possible to call up the corresponding original form at any time.

Once all dubious answers have been checked, verification is complete.

Procedure

1. Open http://paperexam.uibk.ac.at/ and log into the system using single sign-on (university user ID and password).
2. Move the mouse to the icons on the left-hand side of the screen. A menu will open.
3. Click on Fold out permanently to fix the menu.
4. Click on Verification. You will now see the scanned test forms.
5. Click on the yellow pencil next to the desired batch to carry out the verification. You will now see all the details that could not be recognized during scanning.
6. Check the individual corrections and confirm them by clicking Next.
7. When you have finished the verification, click on Folder list and select the folder in which you have saved the check. The check now has the status Analysed.
8. You now have the following options for your check:
   • Display original scans of the test forms
   • Display report
   • Export as .csv: The files are labelled with the matriculation numbers. The total points and points per question are displayed.

Verification via the FSS

The Fakultätenservicestelle (Innrain 52a; 02N040) will take care of verification on request.

To do this, select the corresponding checkbox in the scan request form.

Please make the following settings in your user profile so that the FSS employees have the necessary rights for verification. Go to your “User profile” via the “Settings” area and set the checkbox for “Support” “... Verifiers may view examination results or original scans and verification is now possible.

If a grading key has been specified, the system carries out the evaluation after the verification process.

It is possible to adjust the evaluation or the grading key retrospectively.

It is also possible to export the raw data and carry out the assessment outside the system.

You can have an overall report or individual reports for each examination output in PDF format. The original forms can also be viewed, making it easy to inspect the examination.

The exam can be closed when all sheets have been scanned. Save Excel and PDF reports to your personal drive or that of the faculty. Also archive the original exams. To comply with data protection regulations, the exams are deleted at the end of the following semester.

The system makes it possible to identify the optimisation potential of individual examination questions based on the examination results. The selectivity and level of difficulty are calculated for each question. Those responsible for examinations can use these values to optimise the question catalogue for the next examination.

1. Click on Grading key in the Exams tab of the menu.
2. Click on Add new grading key.
3. Give the grading key a name and a description.
4. Give each grade a name and a value range in %, starting with the best grade. Please note: You must enter grades for the entire points range. The value range of the last grade should therefore start at 0.00.
5. Select the grade from which the examination is passed.
6. Click on Save.

You can perform various actions for the individual examination sheets in the exam sheet management (exam sheet list). To do this, click on the icons next to the respective exam sheet.

• Edit: yellow pen; confirm the message with OK.
  • Click on Settings [short name] to customize the properties of the examination sheet.
  • These settings can no longer be adjusted once an exam has been generated with the examination sheet.
• PDF view: (?) for exam sheet; (!) for answer sheet
• Copy: Double sheet symbol; please copy the examination sheet if you want to use it for a second exam.

In the Tests tab of the menu, click on the folder in which the desired test is saved. Here you can retrieve results as follows:

• Original scans: Display of all or individual examination sheets
• Report: contains summaries, overviews, small statistical analyses and the total score
• Export: Download a .csv file that shows the points per question and the total number of points (but does not contain the possible number of points)

You can set up further options for an exam. To do this, click on the folder in the Exams tab in the menu where you have stored the desired exam. Click on the name of the exam to open it. Some options for the selected exam are presented below:

• Assign grade key: select a previously selected grade key from the drop-down menu and confirm with OK.
• Customize grade key for exam: Here you can see not only the value range but also the point range of the individual grades and can customize these for the exam.
• Retrieve sample solution
• Release exam for scoring: Select the person for whom the scoring of the exam is to be released. Confirm with OK. You can then edit the points under Shared scoring.
• Award maximum points: tick the box next to the desired question and click Apply to award the maximum points for this question for all participants.
• Edit exam results: click on the yellow pencil next to the desired exam participant ID on the far right. You can now change individual answers of the participants.
• Completeness check: You can see whether all the examination pages are available for all participants.