Hybrid exams: on campus and remote
This page discusses how to create a hybrid exam and how to prevent issues. Hybrid exams are written exams that are administered both on campus and remotely (at home), at the same time. Both exam modes (on-campus and remote) have the same assessment method (written exam).
Why use hybrid exams?
Hybrid exams allow students who cannot come to campus to finish the course in a remote exam, at the same time as the students that take the exam on campus. It prevents study delays.
Hybrid exams are relevant for:
-
Students who cannot take the exam on campus during to a chronic illness or handicap (requires permission from their Board of Examiners)
-
Students who cannot take the exam on campus due to family care obligations or other special circumstances (requires permission from their Board of Examiners)
-
Students with an ‘elite athlete status’ (Dutch: topsportstatus) who are temporarily located elsewhere in the world (requires permission from their Board of Examiners)
-
Students who are located elsewhere in the world due to an education activity that is part of their TU Delft degree programme (requires permission from their Board of Examiners)
-
During a pandemic: students who have to quarantine but are fit to take the exam
-
Next to the eight guidelines for remote assessment, the following 6 points of attention are relevant to set-up a hybrid exam and manage your workload. More information is available below.
-
Closed-book or open-book
In case your original exam is a closed-book exam, the remote version needs to be online proctored. You need permission from the Board of Examiners for any online-proctored exam and take extra fraud prevention methods. Not all Board of Examiners will grant that permission, which makes it impossible to administer the exam hybrid. In that case, you can consider to change the exam to a remote oral exam for the individual student. This requires permission from the Board of Examiners as well (the student will request this via the academic counsellor).
In case of large groups of students requesting a remote exam (such as during a pandemic), consider making both exam modes fully open-book and open-internet (allowing internet access, but forbidding communication between students).
-
Open-internet exams: room requirements on-campus mode
In case of switching the entire exam to fully open-book (including open-internet), the on-campus students need access to internet via their own device (BYOD) or a TU Delft computer (in a computer room, which have limited availability). This has implications for the requirements for the exam room.
-
Exam tool
Choose an exam tool that is suitable for your exam.
-
Comparability
Make the on-campus and remote assessments as similar as possible. Administer the same exam questions remote as on-campus.
-
Fraud prevention
Take extra fraud prevention measures for the remote exam only.
-
Communication & technical support during exam
-
In case of large groups taking the exam remotely, arrange an examiner for both the online as the on-campus exam, to answer content-related questions.
- Communicate information about the content of the exam to both remote and on-campus students during the exam. Tip: Ans has a chat-function for announcements and individual questions.
-
Be available for all students during the exam.
-
-
-
-
Closed-book on-campus exams imply online-proctored exams
-
The remote exam should be online proctored and administered in a digital assessment tool. You need permission for online proctoring by the Board of Examiners and sometimes from the Director.
-
The on-campus exam can be handwritten or be taken in the TUD computer rooms. Digital exam rooms have a secure examination environment, which ensures that students cannot open certain programmes (like browsers).
-
-
Open-book exam implies access to internet
Students who take the on-campus exam should have the same recourses available as the remote students. This implies that students can bring their books and notes, as well as their laptop. They should have access to wifi and be able to charge their laptop in the room in which the exam takes place. Students cannot use communication tools (e.g., WhatsApp, email) during the exam in either mode.
-
-
Use the remote version of your exam as a starting point for practical reasons (also have a look at how to design a remote assessment). Essentially, there are five implementations.
Closed-internet methods (closed-book and open-book):
How do students answer (pen / keyboard)?
Situation on-campus
Situation remote
Tools
Specific exam room requirement on-campus exams
1. Closed-internet handwritten exam (requires online proctoring*)
Regular exam room:
Examiner hands out exam and exam paper. Students write their answers by hand on Ans exam booklets or exam paper which they hand in after finishing the exam.On-campus exam in Ans (print-scan): Students take the exam by answering individual questions in Ans. In case of handwritten answers, they take webcam pictures of their answers per question.
Classical on-campus exam: Create a digital Ans assignment with a single question and attach the pdf of the exam. Students upload their handwritten answers by adding multiple pictures with the webcam to the Ans question. They can use the chat function to communicate to the lecturers.Ans (print-scan), RPNow
no room requirements
2. Closed-internet digital exam (requires online proctoring*)
TU Delft digital exam room:
Examiner creates digital exam for students. Students take the exam by answering individual questions in the digital exam tool on a TUD device.On-campus exam in Ans (print-scan): Students take the exam by answering individual questions in Ans. They can use the chat function to communicate to the lecturers.
Ans,
Digital exam room
BYOD:
Same as above, but on the students’ own device (BYOD)Grasple** with Schoolyear
Wifi and charging points for laptops
Additional tooling and deliverable upload: In exams that require the use of other applications like Matlab, Python, Excel, SPSS, etc.
Ans:
Examiner publishes the pdf with the assignments in Ans. Students upload the requested deliverables (e.g. code, figures and/or report) in Ans. No plagiarism scan available.Ans
Digital exam room, or
Wifi and charging points for laptops* Requires permission from the Board of Examiners and Programme Director. Some Board of Examiners do not allow remote proctored exams by default.
** only for math service education.Open internet methods
How do students answer (pen / keyboard)?
Situation on-campus
Situation remote
Tools
Specific exam room requirement on-campus exams
3. Handwritten exam (open book including internet access)
Traditional exam:
Examiner hands out exam and exam paper. Students write their answers on exam paper which they hand in after finishing the exam.Brightspace: Examiner publishes the pdf of the exam in Brightspace Assignment as a pdf. Students give handwritten answers
Students scan their answers and upload as pdf in Brightspace Assignment before deadline (they will need 10 minutes extra to scan and upload the exam)
Wifi and charging points for laptops
Ans:
Examiner creates a digital Ans assignment with a single question and attach the pdf of the exam. Students upload their handwritten answers by adding multiple pictures with the webcam to the Ans question. Downside compared to Brightspace: quality of webcam pictures, currently no plagiarism scanner available in Ans. Upside: students can use the chat function to communicate to the lecturers.Ans
Wifi and charging points for laptops
Ans print-scan: Examiner creates digital exam for students and prints exam booklets for on-campus students. Students write answers in answer boxes and tick-boxes in the exam booklet. Examiners scan the exam booklets. Tick-box questions are automatically graded.
Ans:
Examiner copies print-scan exam to a digital exam. Students take the exam by answering individual questions in Ans. In case of handwritten answers, they take webcam pictures of their answers per question. They can use the chat function to communicate to the lecturers.Ans
Wifi and charging points for laptops
4. Digital exam (open book including internet access)
TU Delft computers:
Examiner creates a digital exam for students. Students take the exam by answering individual questions in the digital exam tool.Ans:
Students take same the exam as the on-campus students. They can use the chat function to communicate to the lecturers.
Ans
Computer room with internet access
Deliverable upload: Examiner hands out exam and/or examiner publishes the pdf of the exam in Brightspace Assignment. Students type their answers or in a document or produce other deliverables (e.g. using Python, Matlab, etc.) which they upload in Brightspace Assignment.
Brightspace Assignment:
Examiner publishes the pdf of the exam in Brightspace Assignment. Students type their answers in a document which they upload in Brightspace Assignment. Plagiarism scan available.Wifi and charging points for laptops
** only for math service education.
-
Make the content and circumstances on-campus and remote exam as comparable is possible, as well as the circumstances. The remote exam will be scheduled at the same time as the on-campus exam. Administer the same exam in both exam modes.
However, remote fraud prevention measure should only be applied to the on-campus exam.
-
The remote mode requires extra fraud prevention measures (see here). For the on-campus exam, no extra fraud-prevention measures need to be taken, as long as the on-campus students cannot communicate to the remote students. This implies the following:
-
No communication between students: In both exam modes, students are not allowed to communicate. On-campus, students are not allowed to use their mobile phone, nor to open communication tools (email, Teams, etc.) on their computer, unless explicated given permission. If they have a question, they can ask the examiner by raising their hand (in case of Ans they can use the chat function instead). Make sure to communicate this to students before the exam, and on the cover page of the exam.
Communicate this to students long before the exam via a Brightspace announcement. -
Unique exams: The on-campus exam can be the same version for all on-campus students, while the remote exam needs to have some extent of unique exams. Except if it is very easy to copy answers from your neighbour within the exam room, like is the case for exams in digital exam rooms with large screens and multiple choice or numerical questions.
-
Oral authenticity checks: are not necessary for on-campus students.
-
Timeslots: These can be used for open-internet remote exams as fraud prevention. They should not be applied to the on-campus exam. In case of large numbers of remote students: To prevent transmission of information from on-campus to remote students, you might require your on-campus students to stay in the exam room under exam conditions until after the last remote break for extra-time students, i.e., without permission to use mobile telephones or other communication platforms on their laptop. Ask them to bring something to read or do on paper.
-
Fraud detection: In case you suspect large-scale fraud by remote students, the exam results can be declared invalid for all remote students by the Board of Examiners. More information on how to detect fraud automatically or by hand can be found here.
-
-
It is important to be available to your students during the exam for stress reduction and fraud prevention:
-
Communication remote = communication on-campus: Communicate announcements on the content of the exam (for example “In question 3a, ‘v=15 km/h’ should read ‘v=150 km/h’”) both remote as well as on campus and minimize delay. Consider using the Ans chat function to make these kind of announcements, and to enable students to ask questions.
-
The following tips are relevant in case of large scale remote exams (e.g. quarantine obligations):
-
Extra examiner: One examiner takes care of the remote exam, and one examiner is available at the on-campus exam. This helps keeping your workload resulting from two simultaneous exam modes manageable.
-
Examination team communication channel: (in case of multiple examiners or remote examiners) Have a communication channel available to discuss issues during the exam for either exam mode within the examination team.
-
Mitigate technical issues on campus for BYOD: Just in case of individual technical difficulties, have a couple of print-outs of the exam available so that these students can answer the questions on paper. If students need to have access to for example a formula sheet or specific tables, print these too.
-
-