Appendices

Appendix A. Overviews

Click on the conditions to go to the explanation in the framework. The conditions are listen in the order in which they appear in the text.

Condition 1:

TU Delft, the faculties, the programme directors, and the examiners consciously consider the assessment values and quality requirements for assessments in their decisions about assessment.

Condition 2:

TU Delft, the faculties and the programme directors ensure that all assessment building blocks are of good quality and consistent with each other. The quality of these building blocks is systematically assessed and improved at least once every six years (see quality assurance plan).

Condition 3:

TU Delft ensures that the central quality assurance plan and the TU Delft assessment framework are aligned.

Condition 4:

The faculties ensure that their quality assurance handbook and their assessment policy comply with each other (including the evaluation frequency), and that both documents comply with the TU Delft framework.

Condition 5:

The TU Delft ensures that the available assessment tools support the goals of digital assessment tools (see ‘Goal of digital assessment tools’ in 1.4).

Condition 6:

The TU Delft and the faculties ensure that the owners of the assessment documents mentioned in Appendix B keep these up-to-date and congruent (consistent with each other).

Condition 7:

The TU Delft and the faculties ensure that students, teaching staff and other stakeholders are informed on their rights and obligations and in changes thereof (see Table 5).

Condition 8:

The TU Delft and the faculties ensure that the assessments comply with the legal framework as described in Appendix B of this framework.

Condition 9:

The TU Delft ensures that the assessment framework meets and operationalises the requirements of the institutional audit.

Condition 10:

The faculties ensure in the faculty’s assessment policy that their programmes live up to standard 3 (assessment) and 4 (achievement of the programme's final attainment levels) of the assessment framework of the NVAO.

Condition 11:

TU Delft and the faculties ensure that the assessments follow the TU Delft assessment agreements, listed in chapter 3.

Condition 12:

The directors of education ensure that their faculty has an up-to-date assessment policy which is in line with the TU Delft assessment framework and that operationalises the topics listed in 4.1.

Condition 13:

The programme directors ensure that their programme has an up-to-date programme assessment plan that is in line with their faculties’ assessment policy, and that operationalises the topics listed in 4.2.

Condition 14:

The course examiners ensure that their course has an up-to-date course assessment plan that shows how the learning objectives are assessed formatively and summatively. The course assessment plans are in line with the applicable programme assessment plan and faculty assessment policy, and operationalise at least the topics listed in 4.3.

Condition 15:

The programme directors ensure that their graduation projects have an up-to-date graduation manual that is in line with the programme assessment plan and with regulations. The manual contains the topics listed in 4.4.

Condition 16:

TU Delft, the faculties and the boards of examiners ensure that the tasks and responsibilities of the different stakeholders with respect to assessment are clear.

Condition 17:

The boards of examiners secure that graduates meet the final attainment levels of the programme by executing their legal tasks, listed in 5.9.

Condition 18:

TU Delft and the faculties support the programmes, and the courses in the process and execution of assessments.

Condition 19:

TU Delft ensures that educational and assessment quality are explicitly mentioned in both the HR recruitment and professional development policy.

Condition 20:

TU Delft ensures that the assessment training offer of Teaching and Learning Services (LS) is integrated in the HR training offer.

Condition 21:

TU Delft offers training opportunities on assessment to staff.

Condition 22:

The boards of examiners ensure that all appointed examiners have a UTQ qualification and that other assessors work under the responsibility of an examiner.

Condition 23:

The boards of examiners determine prerequisites on who may carry out key assessment tasks.

Condition 24:

The boards of examiners have regulations on the composition of the graduation committee to ensure assessment quality of graduation projects.

Condition 25:

TU Delft ensures that the HR system keeps track of at least the relevant assessment qualification of staff, listed in 6.5.

Condition 26:

TU Delft and the faculties ensure that new employees receive the required information and training in order to carry out their assessment tasks.

Condition 27:

TU Delft and the faculties make relevant assessment information available for stakeholders.

Condition 28:

Assessment experts within TLS and the faculties offer support and advice on assessment.

National regulations & guidelines

1 Wet op het hoger onderwijs en wetenschappelijk onderzoek (2021). https://wetten.overheid.nl/BWBR0005682/.

27 Selectielijst Universiteiten en Universitair Medische Centra 2020 (2020). Werkgroep Acquisitie Selectie en Waardering van het Universitaire Platform Informatiedienstverlening en Recordmanagement. https://www.nationaalarchief.nl/archiveren/kennisbank/selectielijst-universiteiten-en-universitair-medische-centra-2020.

31 Wet gelijke behandeling op grond van handicap of chronische ziekte (2020). https://wetten.overheid.nl/BWBR0014915/2020-01-01.

51 4TU UTQ regulations (2018). 4TU Education Management Committee. https://www.utwente.nl/en/ces/celt/utq/4tu-utq-regulation-def-uk-08-03-17.pdf.

TU Delft regulations

2 Model Teaching and Examination Regulations TU Delft (TER) (2023). Executive Board TU Delft. Model Onderwijs- en Examenregeling (OER) TU Delft https://filelist.tudelft.nl/TUDelft/Over_TU_Delft/Organisatie/regelingen/Studenten%20en%20onderwijs/2021/RG%20BoE%20model%20ENG%202023-2024.pdf.

18 Rules of Procedures for Examinations (2020). Joint chairs of the Board of Examiners TU Delft. Reglement van Orde bij tentamens. https://www.tudelft.nl/en/about-tu-delft/organisation/regulations/students-and-education.

19 Online Proctored Examination Regulation (2020). Executive Board TU Delft. Regeling online proctored tentamen TU Delft. https://www.tudelft.nl/en/student/my-study-me/education/courses-and-examinations/examinations/online-proctored-examination-regulation

22 Joint model BSc / MSc Rules and Guidelines of the Board of Examiners 2023/2024 (2023). Executive Board TU Delft. Model Regels en Richtlijnen van de Examencommissie. https://filelist.tudelft.nl/TUDelft/Over_TU_Delft/Organisatie/regelingen/Studenten%20en%20onderwijs/2021/RG%20BoE%20model%20ENG%202023-2024.pdf.

25 TU Delft Examination Appeals Board Regulations (2007). Examination Appeals Board TU Delft. Reglement College van beroep voor de examens TU Delft. https://filelist.tudelft.nl/TUDelft/Over_TU_Delft/Organisatie/regelingen/rechtsbescherming/CBE_reglement.pdf.

26 Binding guidelines on archiving educational data (2022). Maes, E. & Harting, L. P. https://www.tudelft.nl/teaching-support/didactics/assess/guidelines/archiving.

37 Executive and Management Regulations Delft University of Technology (2014). Executive Board TU Delft. Bestuurs- en beheers reglement TU Delft (BBR). https://www.tudelft.nl/en/about-tu-delft/organisation/regulations/executive-and-management-regulations.

38 Model faculteitsreglement (2017). Executive Board TU Delft. model faculty regulations.

64 Student Charter 2023-2024 (2023). Executive Board TU Delft. Studentenstatuut 2023-2024. https://www.tudelft.nl/en/student/legal-position/education-regulations.

TU Delft policy documents

3 Mulder, A., Baller, T. & Kos, T. (2017). TU Delft Vision on Education.

8 Evaluatiecommmissie Project Studiesucces TU Delft (2017). Onderwijssucces van structuur naar cultuur.

9 TU Delft (2022). TU Delft Vision on Teaching and Learning - 2030 (work in progress).https://www.tudelft.nl/teachingacademy/news/news/previous-newsletters/the-educator-november-2022/vision-on-teaching-and-learning

10 NVAO (2018). Assessment framework for the higher education accreditation system of The Netherlands. https://www.nvao.net/files/attachments/.139/Assessment_Framework_for_the_Higher_Education_Accreditation_System_of_the_Netherlands_2018.pdf.

14 Projectteam Kwaliteitsplan TU Delft (2009). Onderwijskwaliteitsplan TU Delft. https://intranet.tudelft.nl/documents/20147/86040/Onderwijskwaliteitsplan.pdf/d2e74aeb-7233-a39c-9373-870736cbbb00?version=1.0&t=1531315644181.

21 Werkgroep Didactiek (2011). Koersen op Studiesucces. https://docplayer.nl/5964307-Koersen-op-studiesucces.html.

23 Bos, M. & Kariman, F. (2015). Adviesrapport aanvullende fraudepreventie-maatregelen. (2015).

29 Roeser, S. & Copeland, S. (2020). TU Delft Code of Conduct. https://www.tudelft.nl/en/about-tu-delft/strategy/integrity-policy/tu-delft-code-of-conduct.

33 Werkgroep Performancecriteria WP (2008). Performancecriteria bij normal performance voor de Docent.

40 Raijmakers, W. (2022). Verslag Hoofdenoverleg OS d.d. 14 april 2022. (2022).

41 Executive Board TU Delft (2018). Long-term HR Agenda 2018-2024 Impact for and with people.

43 Teaching and Learning Services TU Delft (2023). UTQ Exemption Regulations, filelist.tudelft.nl/Calendar/2023/04 April/UTQExemptionRegulations.pdf.

46 Executive Board TU Delft (2019). Guidance document on career paths with the emphasis on teaching in the position of Associate Professor (UHD) and Full Professor (HL) https://intranet.tudelft.nl/documents/20147/86028/Guidance_document_on_career_paths_with_the_emphasis_on_teaching_in_the_position_of_Associate_and_Full_Professor.pdf/830f2afb-2528-26f2-8af9-7f4b207440a9?version=1.0&t=1565192224851&download=true.

65 Haslinger, I. (2019). TU Delft Strategic Plan Open Science 2020-2024 - Research and Education in the Open Era.

TU Delft manuals

16 Engelbrecht, E., Harting, L. P., Sies, P. & Van Bergen Bravenboer, B. (2022). TU Delft assessment manual. https://www.tudelft.nl/teaching-support/didactics/assess/guidelines/manual.

53 ESA Policy & Implementation TU Delft (2022). Handbook for boards of examiners.

Other

28 Teaching and Learning Services TU Delft (2021). How to create a remote assessment, https://teaching-support.tudelft.nl/remote-assessment/.

34 Harting, L. P., Apikian, G. & Dijkstra, W. P. (2019). Blooms revised taxonomy for learning objectives, https://surfdrive.surf.nl/files/index.php/s/zQ5WUWZ2OzAmWAJ.

42 HR Services TU Delft (2020). Training facilities TU Delft, https://intranet.tudelft.nl/en/group/guest/-/study-costs.

45 HR Services TU Delft (2022). Development days, https://intranet.tudelft.nl/en/-/development-days.

50 HR Services TU Delft (2022). The Learning Hub, https://intranet.tudelft.nl/-/the-learning-hub.

52 Teaching and Learning Services TU Delft (2022). University Teaching Qualification, https://www.tudelft.nl/teaching-support/training-events/university-teaching-qualification-utq-bko.

54 Graduate School TU Delft (2022). T3.A1 | Foundations of Educational Design - Intranet, https://intranet.tudelft.nl/-/t3-a1-foundations-of-educational-design.

56 Graduate School TU Delft (2021). T3.B1 | Coaching Individual Students - Intranet, https://intranet.tudelft.nl/-/t3b1-coaching-individual-students.

57 Teaching and Learning Services TU Delft (2022). Supervision and Assessment Principles, https://www.tudelft.nl/teaching-support/training-events/continuous-professional-development#c1244462.

58 Teaching and Learning Services TU Delft (2022). Teaching Assistant Training, tudelfttls.opleidingsportaal.nl/courses/Teaching Assistant Training.

59 Teaching and Learning Services TU Delft (2022). TLS Training Options, https://tudelfttls.opleidingsportaal.nl/Courses.

60 Teaching and Learning Services TU Delft (2022). Rubrics - Consistent grading of assignments and projects, tudelfttls.opleidingsportaal.nl/courses/Rubrics - Consistent grading of assignments and projects.

61 Centre for Education and Learning (2023). Leiden-Delft-Erasmus Center for Education and Learning, https://www.educationandlearning.nl/home.

62 Teaching and Learning Services TU Delft (2023). Teaching Support, https://teaching-support.tudelft.nl/.

Literature

4 Van Schilt-Mol, T., Sluijsmans, D., Peters, M., De Beer, F. & Jakobs, L. (2016). De touwtjes in handen: toetskwaliteit in het hbo. OnderwijsInnovatie 4, 15-24.

5 Joosten-ten Brinke, D. (2015). Kwaliteit van toetsing onder de loep - Handvatten om de kwaliteit van toetsing in het hoger onderwijs te analyseren, verbeteren en borgen (2 ed.). Garant.

6 Sluijsmans, D., Peeters, A., Jakobs, L. & Weijzen, S. (2012). De kwaliteit van toetsing onder de loep. Tijdschrift OnderwijsInnovatie 4, 17-25.

7 Van Berkel, H. (1999). Zicht op toetsen (1 ed.). Van Gorcum.

11 Erkens, T. (2017). Toetsen met open vragen. In Henk van Berkel, Anneke Bax, & Desirée Joosten-ten Brinke (Eds.), (pp. 145-159). Bohn Stafleu van Loghum. https://doi.org/10.1007/978-90-368-1679-3_12

13 Wikipedia contributors (2022). PDCA, https://en.wikipedia.org/w/index.php?title=PDCA&oldid=1118077402.

17 Van de Veen, E. (2017). How to assess students through assignments - a guide to creating assignments and rubrics in higher education (2 ed.). Communicatiereeks.

20 Bruijns, V. & Kok, M. (2015). Kwaliteit van toetsbeleid. In Dominique Sluijsmans, Desirée Joosten-ten Brinke, & Tamara van Schilt-Mol (Eds.), Kwaliteit van toetsing onder de loep (1 ed., pp. 93-111). Garant.

24 Murdock, T. B. & Anderman, E. M. (2006). Motivational Perspectives on Student Cheating: Toward an Integrated Model of Academic Dishonesty. Educational Psychologist 41, 129-145. https://www.tandfonline.com/doi/abs/10.1207/s15326985ep4103_1

35 van Zijl, E. & Jaspers, M. (2012). Rol examencommissie in de kwaliteitsborging van toetsing. Th&ma 5, 49-52.

36 Jaspers, M. & Zijl van, E. (2014). Samenwerken aan toetskwaliteit in het Hoger Onderwijs. https://edlab.nl/wp-content/uploads/2016/04/Samenwerken-aan-toetskwaliteit.pdf.

39 Carless, D., Salter, D., Yang, M. & Lam, J. (2011). Developing sustainable feedback practices. Studies in higher education 36, 395-407.

63 TU Delft (2018). Impact for a better society. TU Delft Strategic Framework 2018-2024. https://filelist.tudelft.nl/TUDelft/Over_TU_Delft/Strategie/TU%20Delft%20Strategic%20Framework%202018-2024%20%28EN%29.pdf.

Uncategorized References

12 Wijnen, W. H. F. W. et al. (1992). Te doen of niet te doen? Advies over de Studeerbaarheid van onderwijsprogramma's in het hoger onderwijs. http://docplayer.nl/61884849-Te-doen-of-niet-te-doen.html.

15 Expertgroep BKE/SKE in opdracht van de Vereniging Hogescholen (2013). Verantwoord Toetsen en Beslissen in het Hoger Beroeps Onderwijs - een voorstel voor een programma van eisen voor een basis- en seniorkwalificatie examinering (BKE/SKE). https://www.vereniginghogescholen.nl/system/knowledge_base/attachments/files/000/000/330/original/Voorstel_voor_programma_van_eisen_voor_BKE_SKE.pdf?1442920445.

30 Vliegenthart, A. M., Verstand-Bogaert, A. E., Hermans, L. M. L. H. A., Vries, K. G. d. & Korthals, A. H. (2001-2002). Gelijke behandeling op grond van handicap of chronische ziekte - memorie van toelichting. Tweede Kamer 28 169, 40-40.

32 ECIO (2023). 3-step model of accessible assessing and examination in higher education, https://ecio.nl/en/publications/3-step-model-of-accessible-assessing-and-examination-in-higher-education/.

44 (UNL), U. o. t. N. (2022). Collective Labour Agreement for Dutch Universities 1 April 2022–31 March 2023. https://www.caouniversiteiten.nl/en/.

47 Vsnu (2021). UFO/Indelingsinstrument Function family Education and Research - Lecturer / Assistant Professor (A-E).

48 Vsnu (2021). UFO/Indelingsinstrument Function family Education and Research - Lecturer / Senior Lecturer / Associate Professor.

49 Vsnu (2021). UFO/Indelingsinstrument Function family Education and Research - Teacher.

55 Graduate School, T. U. D. (2021). T3.A3 Assessing students and master thesis projects. In. T3.A3 Assessing students and master thesis projects.

Figure 1. Assessment building blocks at the TU Delft that determine the assessment quality.

Figure 2. Role of assessment in constructive alignment.

Figure 3. The three TU Delft assessment values and nine quality requirements for assessment.

Figure 4. Assessment building blocks at the TU Delft that determine the assessment quality.

Figure 5. Relation between the TU Delft assessment and quality assurance documents at central and faculty level.

Figure 6. General (summative) assessment cycle TU Delft.

Figure 7. Digital assessment tool landscape TU Delft.

Figure 8. Legal framework of the TU Delft assessment framework and its monitoring.

Figure 9. Schematic organisation at the TU Delft.

Figure 10. Assessment responsibilities - division of main assessment responsibilities between Executive Board, faculty’s educational management and boards of examiners.

Figure 11. Organogram of the central assessment support organisation per service.

Table 1. Reading guide

Table 2: Main assessment characteristics and values.

Table 3: Main timing and fraud prevention/detection characteristics per assessment type.

Table 4. Main required and desired assessment qualifications at TU Delft.

Table 5. Assessment information matrix

Table 6. Reading guide of version 0.9

Table 7. Global TU Delft assessment responsibilities RACI matrix.

Table 8. TU Delft responsibilities for the legal framework for assessment in a RACI matrix.

Table 9. TU Delft responsibilities for the education and assessment process in a RACI matrix.

Table 10. TU Delft assessment responsibilities for scheduled exams in a RACI matrix.

Table 11. TU Delft responsibilities for boards of examiners in a RACI matrix, divided into general, degrees and exemptions, and fraud related processes.

Appendix B. Overview of framework per level

Type	Name	Owner	Refresh rate/ current version
Law (binding)	Wet op het hoger onderwijs en wetenschappelijk onderzoek¹ (WHW). (Higher Education and Research Act)	Minister of Education, Culture and Research	No standard rate / 1 January 2023
Framework (binding)	Assessment framework for the higher education accreditation system of the Netherlands¹⁰	NVAO	- / 2018
Regulations (binding)	4TU UTQ regulations⁵¹	4TU Education Management Committee	- / 18 Nov 2018

Type	Name	Owner	Refresh rate / current version
Strategic plan (leading)	Impact for a better society. TU Delft Strategic Framework 2018-2024⁶³	Executive Board	6 years / 2018
Vision (leading)	TU Delft Vision on Education³	Executive Board	- / November 2017
Regulation (binding)	Executive and Management Regulations³⁷ Bestuurs- en beheers reglement TU Delft (BBR)	Executive Board	- / 2019
Model regulation (leading)	Model Teaching and Examination Regulations² Model Regels en Richtlijnen van de Examencommissie (RRvE) TU Delft	Executive Board	1 year, large update in 2023 / 2022
Model regulation (leading)	Joint model BSc / MSc Rules and Guidelines of the Board of Examiners²² Model Regels en Richtlijnen van de Examencommissie	Executive Board	1 year, large update in 2023 / 2022
Regulation (binding)	Online Proctored Examination Regulations¹⁹ Regeling online proctored tentamen TU Delft	Executive Board	- / November 2020
Regulation (binding)	Rules and Procedures for Examinations¹⁸ Reglement van Orde bij tentamens	Executive Board	- / November 2020
Regulation (binding)	Examination Appeals Board Regulations²⁵ Reglement College van beroep voor de examens TU Delft	Examination Appeals Board	- / 20 June 2007
Regulation (binding)	Student charter⁶⁴ Studentenstatuut	Executive Board	1 year / 2022
Policy (leading)	TU Delft Educational Quality Assurance Plan¹⁴ Onderwijskwaliteitsplan TU Delft	Executive Board	revision expected in 2023 / Fall 2009
Policy (leading)	TU Delft Assessment Framework	Executive Board	6 years / - (this document)
Policy (binding)	Binding guidelines for archiving educational data²⁶	Manager Document Management & Archive	- / 1 February 2023
Policy (leading)	TU Delft strategic plan Open Science 2020-2024⁶⁵	Executive Board	- / 2019
Format (leading)	Model Faculty Regulations³⁸ Model faculteitsreglement	Executive Board	- / July 2017
Format (leading)	Format annual report board of examiners (Appendix C.2)	Executive Board	Part of this Assessment Framework (see Appendix C.2)
Manual	Handbook boards of examiners⁵³ handbook examencommissies	Executive Board / ESA-P&I & Taskforce Regulations	- / 2022

Type	Name	Owner	Refresh rate
Regulation	Faculty Regulations Faculteitsregelement	Dean	-
Regulation	Rules and Guidelines of the Board of Examiners Regels en Richtlijnen van de Examencommissie (RRvE)	Board of examiners	1 year
Regulation	Teaching and Examination Regulations Onderwijs- en Examenregeling (OER)	Director of education / dean	1 year
Policy	Faculty assessment policy	Director of education	6 years
Policy/handbook	Faculty quality assurance handbook	Dean	0
Policy/procedure	Policy on and/or procedure for UTQ exemption	Director of education / dean	-
Annual report	Annual report of the board of examiners (to the dean)	Board of examiners	1 year
Annual report	Annual education report of the faculty ^sss (to the Executive Board)	Director of education / dean	1 year

Type	Name	Owner	Refresh rate
Regulation	Annex ti the Teaching and Examination Regulations	Progranne durectir	1 year

Type	Name	Owner	Refresh rate
Course information	Study guide	Responsible lecturer	1 year, 1 July
Course information	Learning Management System (LMS, Brightspace)	Responsible lecturer	1 year, updated during course

Appendix C. Assessment formats

This appendix gives an overview of the most common formats that faculties and programmes use to be in control of the consistency of the assessment on programme, course, and assessment level. The faculty’s assessment experts and educational advisors have access to formats. In addition, the Teaching Support pages offers examples of these formats.

Formats for programme assessment plans (see 4.2), including:
- Format LO-Final Attainment Levels overview on programme level
- Format to demonstrate the spread in deadlines and assessments
Formats for the course assessment plans (see 4.3), including:
- Format LO-Final Attainment Levels overview on course level
- Format for assessment matrices on course level (for indicating the assessment method per LO)
- Format for consistency check tables (for courses that consist of a project)
Formats for individual assessments
- Format for the cover page for exams^ttt
- Format for exams
- Format for assessment matrices on assessment level
- Format for rubrics
- Format for assessment forms
- Format for consistency check tables (for projects/assignments etc.)
- Format for an assignment/project description that includes minimum information for assignments and projects.

The boards of examiners use the format below^uuu for their annual reports to demonstrate that the board secures the assessment quality of the programme(s), and to extract and compare information between faculties. This enables the TU Delft to detect trends and act upon them. The format provides boards of examiners with some flexibility for their own context.

Format of the annual report of the board of examiners

Introduction
General information on the functioning of the Board of Examination
1. Composition of the Board of Examiners and, if applicable, of the sub-Boards of Examiners Including schedule of admission (terms of office) and the professionalisations, e.g. UTQ or BoE-training, per member. For example:
  
  Name member Role Board Term Length UTQ BoE-training
2. Meetings
  List of meeting dates / or number of meetings
3. Information on committees (if applicable), including composition and number of meetings
  Example: course assessment committee, graduation work committee
4. Mandates
  Complete list of mandates, or reference to mandate scheme, for e.g.:
  - signing degrees
  - signing course grade statements
  - approving individual exam programmes
  - approving composition of graduation assessment committees
  - decisions on allowing specific special facilities during exams by the academic councillor in specific cases (if applicable, this needs to be specified)
  - writing & signing letters on decisions that were discussed in the BoE meeting
  - etc.
5. Appointment of examiners
  Procedure(s) (or reference to procedures(s)) for the appointment, numbers of appointed examiners, number of exemptions on requirements, encountered issues, etc..
6. Approvement of composition of graduation assessment committees
  Procedure(s) (or reference to procedure(s)) for the approvement of graduation assessment committees.
7. Analysis of trends and consequences for policy / regulations
  Include recommendations, if necessary.
Quality of degrees
1. Number of degrees, preferably plotted over time
  1. Propedeuse degrees (if applicable, including the number of cum laude)
  2. Bachelor degrees (including the number of cum laude)
  3. Hounours' programme bachelor
  4. Master degrees (including the number of cum laude) per track, plus free programme
  5. Endorsements (if still applicable)
  6. Honours' programme master
2. Analysis of trends and consequences for policy / regulations
  (e.g. cum laude policy) Include recommendations, if necessary.
Quality of assessment programme
1. Structural activitities of the BoE to ensure the quality of the assessment programme
  Yearly analysis of each assessment programme, request for this overview, etc.
2. Analysis of trens and consequences for policy / regulations
  Include recommendations, if necessary.
Quality of graduation projects
1. Structural activities of the BoE to ensure quality of graduation projects
2. Analysis of trends and consequences for polocy / regulations
  Include recommendations, if necessary.
Quality of assessment in courses
1. Structural activities of the BoE to ensure quality of graduation projects
2. Analysis of trends and consequences for polocy / regulations
  Include recommendations, if necessary.
Fraud
1. Prevent, policy
2. Numbers per type of fraud (plagiarism, other)
3. Analysis of trends and consequences for policy / regulations
  Include recommendations, if necessary.
Individual requests
1. Numbers
  this includes number pres:
  1. Changes to the examination programme:
    1. Exemptions
    2. Free minors
  2. Requests for special facilities during examinations or for other assessment types
    Due to disabilities, chronic disease, special individual circumstances, or not being able to be physically present in the examination place.
  3. Electives
  4. Course abroad
  5. Requests by lecturers to change the assessment compared to the study guide description (during the academic year)
2. Analysis of trends and consequences for polocy / regulations
  Include recommendations, if necessary.
Appeal cases
1. Numbers per types
2. Analysis of trends and consequences for polocy / regulations
  Include recommendations, if necessary.
Regulations
1. Rules & Guidelines of the Board of Examination (establishment)
  Date of establishment of the Rules & Guidelines, list of changes compared to last year, including brief explanation
2. Teaching and Examination Regulations and their addenda (advice)
  List of advice on the TER and whether or not these advices have been processed.
Assessment policy
1. Advice on the faculty’s (or programme’s) assessment policy
2. Contribution/advice to specific assessment policy topics
  List of points to which the Board contributed or on which the Board wrote an advice, to whom it was given, and a description of the advice
Reflection on previous year and plans for the next year
1. Reflection on and list of plans of previous year
  List points of attention
2. Next year: Plans of the Board of Examiners
  An outline of points of attention
3. Next year: Recommendations and requests to the Dean
4. Conclusion

Appendix D. Assessment responsibilities (RACI)

In this appendix, so called RACI matrices (a responsibility assignment matrix) describe the assessment responsibilities. These matrices indicate per task who is accountable (finally responsible) for this task (indicated by ‘A’), who is responsible (R) for conducting task for the accountable person, who needs to be consulted on this task (C), and who should be informed of the outcome (I). If a letter is between brackets (), this means that this person is only responsible, consulted, or informed, in situations that require this (as opposed to always). Hence ‘R’ means that this person carries out a task related to the activity, not that they are responsible, since this is indicated by an ‘A’.
The right column indicates what the sources are of the accountability and of the consultancy requirements (if available). The responsible (R) and informed (I) people are based on current (or desired) processes. NB. ‘consulted’ can imply both that this body needs to give consent, or that they need to be consulted.

: Table 7. Global TU Delft assessment responsibilities RACI matrix Legend: A = accountable, R = carries out a task (responsible), C = consulted, I = informed. () = only if required.
: Table 8. TU Delft responsibilities for the legal framework for assessment in a RACI matrix. Legend: A = accountable, R = carries out a task (responsible), C = consulted, I = informed. () = only if required.
: Table 9. TU Delft responsibilities for the education and assessment process in a RACI matrix. Legend: A = accountable, R = carries out a task (responsible), C = consulted, I = informed. () = only if required.
: Table 10. TU Delft assessment responsibilities for scheduled exams in a RACI matrix. Legend: A = accountable, R = carries out a task (responsible), C = consulted, I = informed. () = only if required.
: Table 11. TU Delft responsibilities for boards of examiners in a RACI matrix, divided into general, degrees and exemptions, and fraud related processes. Legend: A = accountable, R = responsible, C = consulted, I = informed, () = only if required

Appendix E. Organisational differences between faculties

This appendix gives an overview of the main organisational differences between faculties that are relevant for assessment.

Depending on the faculty, ‘programme director’ can be called ‘director of studies’ in some faculties (e.g. AE, AS, EEMCS, CEG). See the assessment policy of the faculty for the actual organisation.

In addition, at IDE, AE and ME, an ‘educational management team’ (EMT, names may vary) is accountable for all programmes, instead of each individual programme director for their own programme. These EMTs consists of the following people (see the Faculty Regulations and WHW):
-   IDE: Director of Education, all programme directors, head of ESA, student. This is called the ‘Board of Education' (BoE, opleidingsdirectie).
-   AE: both programme directors (one of them is also Director of Education), student (EMT, opleidingsbestuur)
-   ME: Director of Education, programme directors, head of ESA, student
Other faculties may also have EMT’s, but they do not have the same power as the EMTs that are mentioned above.

Usually, it is the programme director who negotiates with the department heads on teaching staff. However, according to their Faculty Regulations, at IDE, EEMCS and ME, this responsibility is divided as follows:
1)   IDE:   the Director of Education has this responsibility
2)   EEMCS:   the educational management (Director of Education, programme directors, and the Director of Interfaculty Education) share this responsibility
3)   ME:   shared responsibility of the programme directors and Director of Education

Most faculties have a single board of examiners that are responsible for all programmes. At AE, AS and EEMCS, there are subboards of examiners per programme, in addition to the central board of examiners. In these faculties, the subboards of examiners appoint examiners, instead of the board of examiners.

- ME: RGBE	- CEG: R&G
- ABE: RGbE	- EEMCS: RRoBE
- AE: RRvE	- TPM: RGBoE
- AS: R&R	- IDE: RGofBE

In some faculties like TPM, ESA hires and trains student assistants (SAs) centrally to support lecturers in e.g. creating digital assessment. In other faculties like CEG, it is the department of the responsible lecturer of the course that hires SAs. Since TLS provides SA training per faculty, CEG’s ESA arranges the SA training.

Appendix F. Glossary, abbreviations & translations

Term	Description
adaptive assessment	Test that adapts the degree of difficulty and/or subject to the students’ individual abilities while the test is being taken.
adaptive question	Within a question, the next subquestion depends on the correctness of the answer to the previous subquestion. The lecturer can set the assessment tool to show the exact same subquestion for a limited number of times until the student gives the correct answer, or reaches the maximum number of tries, in which case the tool shows the student the correct answer, which the student can use in the next subquestion.
anonymous scoring	Assessors score student work without access to the student’s identity.
answer key	Correct answer to a closed-ended question. This can also be an equation, or a numerical answer, depending on the question type.
answer model	Combination of model answer plus scoring guide: indicates per partially correct answer and per part of a correct answer how many points will be awarded and indicates how many points will be subtracted for specific errors. Example for mcq: A: 1 point, B: ½ point, C: 0 points, D: 0 points. Example for open question: calculation step 1: +2 points, calculation step 2: +3 points, step 3: +1 point, no units: -1 point.
archiving	securely storing data until reaching the retention period. Securely implies restricting access, making the data findable, and ensuring that the data cannot be changed,
archived securely	Data and metadata are stored safely and is preferably no longer changeable so that later it is certain that this is the original version.
assessment	Educational activities during which individual students demonstrate how well they master the learning objectives of a course, and during which their performance is measured. This information is shared with students to steer and/or evaluate their learning. Examples: projects, exams.
assessment activity	Activity that a student does during an assessment. In constructively aligned courses, this matches the learning objectives.
assessment agreement	Part of the programme assessment plan that consists of agreements for all assessments in that specific programme.
assessment competence	To what extent an employee of the TU Delft who participates in an assessment process is able to perform their assessment tasks in such a way that it leads to good quality assessment.
assessment criteria	Aspects of a product or process on which a student are assessed on, for example during a project.
assessment matrix	Blueprint of an assessment for an exam: A matrix that indicates for all individual subquestions and their maximum scores what learning objective (rows) they assess on which level of the used taxonomy (columns).
assessment method	Examples: written exam, oral exam, project, report, presentation, etc.
assessment mode	Whether the assessment is administered under physical supervision of an examiner and/or invigilator (i.e., in an exam hall/room), whether the assessment is administered via the internet (i.e., remote), or whether the assessment is hybrid (a combination of on-campus and online).
course assessment plan	Overview of the assessments in a course. Its goal is to demonstrate how the learning objectives of a course are assessed in a valid, reliable, transparent way that stimulates learning. It includes the main characteristics of the course like contribution to final grade (0% - 100%), regulations for retake / addition, feedback on the assessment, what learning objectives are assessed per assessment, approximate week planning of deadlines and assessments, allowed use tools & information during the assessment, assessment tooling, how the final grade represents the performance of an individual student and how the learning objectives contribute to the programme’s intended learning outcomes.
programme assessment plan	Overview of the assessment in a programme. Its goal is to demonstrate how the final attainment levels (FALs) of the programme are assessed in the combination of the programme’s courses in a valid way. It includes an overview of what courses contribute to what FALs and what assessment forms are used to assess these.
assessment tool	Digital tool (e.g. software, online tool) in which parts of the assessment cycle are conducted or supported. Examples: designing assessments, administering assessments, doing exams as a student, proctoring/invigilating, handing in student work, scoring student work, providing feedback, test result analysis, grade calculating, grade communication, students reviewing and discussing graded work and grades, grade administration, evaluating assessment, plagiarism check, online proctoring, etc.
assessor	Person who scores or gives feedback to student work or student performance.
author	Someone who composes the test and who compiles/develops (sub)questions, either individually or in collaboration with other authors.
binding recommendation on the continuation of studies (BSA)	Binding advice to individual students on the continuation of whether they can continue their studies. Given at the end of the first year of the Bachelor. Dutch: Bindend studieadvies (BSA).
Bloom level	One of the following 6 levels in the adapted cognitive taxonomy of Bloom: understand, apply, analyse, evaluate, create (adapted cognitive taxonomy). See here³⁴.
blueprint	Schematic representation of an assessment in a matrix. For exams, this is an assessment matrix; for projects/assignments/etc. a consistency check table is more common. Etymology: a blueprint of a building was a white-on-blue technical drawing of e.g. a building in the early 20^th century.
bring-your-own-device assessment	Assessment in an exam room during which students perform the digital exam on their own laptop. Typically requires extra security measures. BYOD
calibration session	Session during which assessors who grade the same assignment proof-grade (example) student work and discuss differences in scores and feedback to improve the quality and consistency of their grading and feedback.
closed-ended question	Question to which the answer is given by selecting one or multiple items from a limited number of options. Examples: multiple choice, multiple select, matching, selecting a number from a limited range, selecting part of a picture, etc. Closed-ended questions could lead to a correct answer without prior knowledge by randomly choosing an answer option, which implies the need for guessing correction.
combination test	Test that is composed of two separate tests with a separate score. An example being one part of a test with closed questions and another part with open questions.
consistency check table	Overview of a project (or large assignment) which indicates per learning objective (rows) which related criteria (content of the cells) are assessed formatively and summatively per (intermediate or final) deliverable(s) or process(es) (columns).
constructive alignment	Design principle for courses and programmes to stimulates student learning. In constructively aligned courses, learning objectives, learning activities and assessment activities are aligned. In constructively aligned programmes, final attainments, learning objectives and assessment types are aligned.
course	Coherent unit of study within a programme that includes learning activities and formative assessments to help students master the learning objectives, and summative assessment(s) of which the results express how well individual students have succeeded in this. After passing the summative assessment, students receive the ECs that correspond to the course. Some courses consist fully or partially of a project. Other term used in some programmes: module.
course coordinator	The lecturer who is responsible for the course as a whole. Terminology used in study guide: ‘responsible lecturer’.
course grade	course grade
cover page	Front page of a paper exam that the student reads and that contains general information and general instructions.
criterion	Aspect on which students’ deliverables or the process of creating them will be graded.
cut-off score	Score, that a student needs for a grade of 6.0 (minimum pass score). Dutch: cesuur
degree audit	the test in which the BoEx determines whether the student as successfully completed all examinations in the courses of the degree programme (WHW art. 7.10). If so, the EB awards the student with the relevant BSc or MSc degree (WHW art. 7.10a sub 1). Dutch: examen (not to be confused with exam=tentamen).
degree program	List of courses that the board of examiners approved and that an individual student needs to complete in order to obtain the desired degree. There are standard degree programmes, and individual / free degree programmes, which the board of examiners explicitly has to approve.
descriptor	Description of how students’ deliverables or the process of creating them looks like at a specific level for a specific criterion in a rubric. See rubric.
device	Device on which a student takes the test (terms used in other places: computer, workstation).
digital exam	Written exam input type during which students answer exam questions with the help of a computer.
Digital Exams	TU Delft service that supports lecturers in the process of scheduled digital on-campus and remote written exams.
drawing tool	Tool within an assessment tool that allows to draw a picture, graph, or diagram. Some drawing tools may allow for automatic grading of student input in the tool.
educational period	Period during which courses run. The basic educational periods are four quarters (Q1 to Q4) and a summer period for retakes (Q5). See https://www.tudelft.nl/en/student/education/academic-calendar.
e-invigilator	Invigilator for a digital exam who helps examiners and students with administrative and technical issues. Examples: add unregistered students to the exam, help students to continue on another computer and provide compensatory time in case of computer issues.
EvaSys	System that administers questionnaires for course evaluations to students, and processes the outcome of these evaluations into reports.
exam	Scheduled summative written test that students take during a specific exam timeslot on a specific day. Examples: written exam, oral exam. NB1: in the TER and R&G, all types of summative assessments are called ‘examinations’ (tentamens), including assignments and projects. NB2: ‘exam’ should not be confused with the Dutch word ‘examen’, which is ‘degree audit’ (see ‘degree audit’).
exam timeslot	Timeslot during which students can take the test.
exam period	Period during which most exams take place. Every educational period has an exam period in week x.9 and x.10 (or only x.10, x being the number of the quarter, see ‘educational period’), and some programmes have an exam period for midterms around week x.5. See https://www.tudelft.nl/en/student/education/academic-calendar. Few tests take place outside these periods.
examination	Formal word for ‘assessment’. Can refer to any type of assessment.
Examination Appeals Board (EAB)	TU Delft appeals board that processes and decides on appeal cases by students on assessment (see WHW art. 7.61, sub 1). This includes course grades given by examiners (students cannot appeal against partial grades until the final course grade has been communicated) and decisions of the board of examiners. The BoEx can make decisions on e.g. complaints by individual or groups of students on an assessment, or on requests for an extra assessment opportunity. The working method of the EAB is described in the Examination Appeals Board Regulations. Dutch: College van Beroep voor de Examens, CBE.
examiner	Member of the teaching staff who is appointed examiner by the board of examiners and who is responsible (alone or with colleagues) for the content and process of the examination of a course, including the responsibility for grading the tests.
feedback	Structured information for students on their performance and possibilities for improvement, based on the quality of a student product or process. Feedback is structured per assessment criterion and/or learning objective and used in a follow-up learning activity or assessment. Feedback can be given by peers, teaching staff or by the student themself (via self-assessment).
final attainment (level)	List of achievements of graduates that describe what graduates of a programme are able to do after successfully completing the programme. Synonym 1 (used during accreditations): intended learning outcome / ILO. Synonym 2: exit qualification Abbreviation: FAL. See: intended learning outcome. Abbreviation: ILO.
final grade	The final grade of a course. Synonym: course grade.
formative assessment	Assessment that does not influence the grade of a course and is meant to give students feedback on how well they currently master the learning objectives and what steps they still need to take to improve before the summative assessment at end of the course. Formative assessment counts as such 1) if the assessment is at the level of the learning objectives, 2) if the performance of students during the activity does not count for the course grade or passing the course and if the activity is voluntary, 3) if students receive structured feedback on the assessment criteria or learning objectives, and 4) if students are able and stimulated to use the feedback in consecutive learning activities and summative assessment.
fraud	‘any act or omission by a student that makes it fully or partially impossible to properly assess the knowledge, insight and skill of that student or another student’²²
free riding	a form of fraud in group work where one student of the group is not contributing on terms of time investment or output. Synonym: ‘piggy backing’
functional application manager	A functional application manager is responsible within an organisation for the optimal functioning of one or more information systems. Not only do they ensure the continuity of the systems, but they also fulfil a supporting role regarding the users. In that sense, functional management forms the connection between ICT and business operations.
graduation	MSc or BSc graduation.
guessing correction	Average score by randomly guessing the answer to closed-ended questions.
GDPR	General Data Protection Regulation, see https://eur-lex.europa.eu/eli/reg/2016/679/oj.
GPA	Grade point average: Weighted average of all numerical grades of an individual student in a programme, rounded to two decimals, excluding results from Honours Programme courses.
grade	Description of student performance on a test, which is based on the score using a score-grade conversion (synonyms: mark (Australia, US)).
hybrid assessment	Test that consists of a digital part (via a device) and a paper-based, handwritten part.
inspection	Possibility for students to inspect/review their graded work and discuss objections to the score with the examiner. Also: student inspection.
institutional audit	“An institutional audit is a periodic, external, and independent assessment of the internal quality assurance in place at an institution. Internal quality assurance comprises both the quality culture and the internal quality assurance system of an institution. The audit serves to verify that the institution’s internal quality assurance system, in interconnection with its quality culture, safeguards the realisation of its individual vision of good education.”page 6 in ¹⁰
intended learning outcome	See final attainment level (FAL). Abbreviation: ILO.
invigilator	Someone who supervises the exam for the detection of irregularities and fraudulent behaviour on campus.
knock-out criterion	A criterion that has a minimum level that needs to be met in order for the student to receive feedback and/or a grade.
learning activities	Activities that a student performs during a course in order to train the learning objectives.
learning objectives	List of achievements that describe what students are able to do after successfully completing the course. They describe the ultimate but feasible level of the course. Synonym at other universities: learning outcome, intended learning outcome. Abbreviation: LOs. Singular: LO
LMS	Learning Management System. At TU Delft, this is currently Brightspace.
lockdown browser	Prevents students to access other applications than the browser needed to access the test, and that limits the access of the browser to the test, and to whitelisted pages. Also called secure browser.
mark	Noun: Can mean either score (points for an exam question) or grade (converted from the score), depending on country of origin. Not used at TU Delft to prevent confusion. Verb: evaluating student work as an assessor or examiner, while attributing points per question or assessment criterion and/or adding feedback. Synonyms: grade, score, evaluate, review.
meta data	Characteristics of (sub)questions in an assessment tool that either the lecturer attributes (for example learning objective, topic, difficulty, peer review status), or that the assessment tool attributes based on historical data (for example history of use in tests, parent, p-value, RiR-value).
midterm	in the context of exams: An exam in the middle of the educational period, which typically covers the first half of the course and counts for up to 50% of the course grade. in the context of graduation projects: an interim evaluation / feedback moment during the project, typically halfway the project. Depending on the faculty/programme, this can include a decision on continuation of the project. in the context of accreditation / quality assurance: an internal evaluation halfway between accreditations (3 years after the accreditation) to check the progress of the programme in terms of the NVAO standards.
model answer	Correct answer. In some cases, multiple correct answers exist. The one that is handed to the students is called the model answer. The model answer could also contain multiple correct answers or answer routes.
multiple choice question	Question type that requires students to pick one out of a number of proposed answers. See also: multiple select question, closed-ended question.
multiple select question	Question type that requires students to pick one or more out of a number of proposed answers. See also: multiple choice question, closed-ended question.
online proctoring	Online proctoring is only possible for closed-book tests if it is not possible to assess the course using open-book tests, i.e., in case of knowledge exams or exams on math questions for which the answers can be achieved using symbolic computation software (e.g., Maple, Mathematica, MATLAB) or online tools. Permission from the board of examiners is required^vvv
open book test	Historically, this meant that students could bring the course’s book (and sometimes a list of other books) to the exam hall. In case of remote tests, ‘open book’ implies access to the internet as well. Contact with other people is prohibited.
open-ended question	Question to which the set of correct answers is not given by selecting an answer from a limited number of options (see closed-ended question). In case the answer is not predictable, manual scoring requires the help of a rubric or answer model.
oral check	Fraud detection method conducted after an unsupervised assessment, during which examiners question individual student from a (quasi) random sample of the entire student population on their submitted work. The goal is to evaluate the likelihood that the student was the actual author of the submitted work.
Osiris	student information system in which student register for exams and in which lecturers communicate course grades and in some programmes also partial grades.
p-value	Normalized average score per subquestion or question. Formula: p-value = average score / maximum score. Example: p=1.0 implies all students received maximum score. p=0 scored on average 0 points. p can be negative if minus points are awarded. However, this is not recommended. The p-value is a measure for the ‘difficulty’ of a question, to which it is inversely proportional: the more difficult a question is, the lower it p-value. NB: This is a different p-value from the one in statistical context.
paper exam	Exam during which the student writes the answers to questions and/or assignments on paper.
parameterized question	(sub)question in which both the question and correct answer depend on defined parameters or variables (numerical and algebraic) that are stated in the question description. The parameter values are determined randomly for each realization of the question.
partial grade	Grade for an assessment within a course. The weighted average of al partial grades forms the course grade. In most faculties, partial grades have a minimum value in order to pass the course. Partial grades can consist of subgrades (see subgrade).
passing grade	The minimum grade that is required to pass a course. At TU Delft, this is 6.0 after rounding the final course grade to halves.
PDCA cycle	Plan-do-check-adjust cycle; a way of improving processes or products iteratively. For assessment, it implies that the examiner plans a good assessment (Plan), administers, and grades the assessment (Do), checks the quality of the assessment based on test result analysis and/or student input (Check), and adjusts the next assessment based on the findings (Adjust).
peer review	Process during which other lecturers review individual questions or entire tests and give feedback on the question-and-answer model.
peer reviewer	Lecturer who reviews questions or the test before the test is administered to students.
practice exercise	Questions like the ones that can be found in standard textbooks. Goal is to train students to master the level of the learning objectives. These questions help students to master the learning objectives by gradually increasing in complexity. Unlike formative assessments, they typically, are not (yet) at the level of the learning objectives. Also called ‘scaffolding questions’.
proctor	Invigilator who invigilates video recordings of remote exams.
programme	Educational programme (combination of courses and graduation project). Students receive a MSc degree or BSc degree after successful completion of a programme.
question	Single question to which the student needs to formulate or otherwise indicates an answer/answers. A question can consist of a coherent set of sub questions. (Terms used in other places: item, assignment)
question bank	Digital collection of questions (which can consist of sub questions) that can be used for a test. Questions can be labelled with characteristics, like metadata and keywords. (Term used in other places: item bank)
question pool	A set of similar questions of comparable difficulty, from which the assessment tool randomly selects a question to create unique exams.
RACI matrix	Matrix that indicates per tasks or process (rows) who (columns) is accountable (A) for this task/process, who is Responsible (i.e. who needs to take action), who can be held Accountable, who needs to be Consulted, and who needs to be Informed.
remote assessment	Assessment that would normally take place on campus that take place online due to exceptional circumstances such as corona. Requires special fraud prevention measures and possibly approval from the board of examiners and/or educational management.
repair option	Possibility for students who did not pass a course in one go, to pass the course that year. Only applicable for courses with other assessment forms than exams. Example: assignments, projects, lab work, etc. The repair option does not require redoing the entire assessment; This only requires delivering an updated version or doing a smaller repair assignment. Typically, a maximum grade applies.
result	Result of a test or course that is communicated to the student. The result typically is a grade between 1 and 10, rounded to decimals, but a result can also be ‘pass’ or ‘fail’. If a student does not show at an exam, the examinator can register ‘NV’ (no show), which is technically not a result.
responsible lecturer	See ‘course coordinator’
retake / resit	Second opportunity in a year to sit an exam. Primarily meant for students who missed the main exam due to circumstances, but open to all students.
retention period	How long e.g. a document should continue to exist. See also: archiving period.
random	Generate one or more (quasi)random values within a range that is predefined, striving for a uniform occurrence over the range. This promotes that all values will occur with about the same frequency, even in small groups.
Rir-value	Correlation between the student scores for a certain (sub)question, and the total student score for all other (sub)questions. Low Rir-values indicate that otherwise good performing students (on this assessment) score poorly on this question.
Rit-value	Correlation between the student scores for a certain (sub)question, and the total student scores. Low Rit-values indicate that otherwise good performing students (on this assessment) score poorly on this question. The Rir-value is more accurate.
rubric	Matrix used to determine the score per criterion that the students are assessed on. For all criteria (rows), the requirements for each level (columns) are described as descriptors in the cells of the matrix. Either the criteria are weighted and the points per level are the same for all criteria, or the points per level differ between criteria. Used to score essay-like questions as well as larger assignments/projects.
safeguarding	Making sure that something happens, without having to do it yourself. Synonym: securing, guaranteeing. Dutch: borgen.
score-grade transformation	Determining the grades from the students’ total scores. Typically implemented as a single linear equation (y = a∙x + b) or two linear equations (one for scores below the cut-off score and one for scores above the cut-off score).
scoring	Process of determining individual student scores on (sub)questions in a test (terms used in other places: marking, grading).
scoring guide	Indicates in an answer model how many points should be added for each correct part of the student answer and subtracted per error/omission.
section	Group of questions in a test that belong together. Sometimes used for dividing the test into different topics, or types of questions. Assessment tools typically can apply specific rules per section (terms used in other places: part, block).
secure browser	Software on the student’s device that limits the access to internet, other applications, or peripherals with the goal of preventing a student from accessing forbidden information during a test. Also called lockdown browser.
securing	Making sure that something happens, without having to do it yourself. Synonyms: safeguarding, guaranteeing. Dutch: borgen.
selection list	Official national document that dictates how long documents resulting from educational processes like assessment need to be archived and whether these need to be destroyed after this period. Most assessment related documents fall under process 54, which is abbreviated as ‘SL proc. 54’. Section 3.4 is dedicated to the archiving of assessment and degree related documents. Official name: ‘Selection List Universities and University Medical Centres 2020’ (Selectielijst Universiteiten en Universitair Medische Centra 2020).
standard feedback	Feedback to students that is connected to the answer model. In case of certain errors or correct steps, students receive standard feedback. Example: ‘You forgot to square c in E = m∙c².’
STEM	Science, Technology, Engineering, Mathematics.
stem	The stem of a question is the first part, that precedes the question and the instructions (in the case of open questions) or the answer options (in the case of multiple-choice questions).
structured feedback	Feedback that is structured per applicable LO or assessment criterion. The term is used as the opposite of ‘unstructured feedback’, in which not all LOs or criteria are systematically assessed.
student assistant (SA)	Student who has a job in a university where they assist employees. In case their job description is focussed on education, they are called ‘student assistants’. In case their job description is focussed on support (e.g. at TLS), they are called ‘support assistants’ (SAs), and otherwise ‘teaching assistants’ (TAs). However, the latter term is also in use for non-students like PhD students and postdocs.
student information system (SIS)	In SIS, students can register for assessments and view their study results. At the TU Delft: Osiris.
(student) review	Possibility for students to review/inspect their graded work and discuss objections to the score with the examiner.
student work	Something that was created by a student. Example: homework, assignments, report, exam, etc. Typically, teaching staff provides feedback to student work, and/or grades student work.
support assistant (SA)	student who has a job at TLS to support lecturers in their teaching, for example by providing help on the use of tools.
subgrade	One of the subgrades within a partial grade or within an assessment. Example 1: an exam can have a subgrade for open-ended questions and a subgrade for closed-ended questions, of which the weighted average is the exam grade. Example 2: a partial grade for lab work can consist of several subgrades per lab day. Subgrade should not be confused with partial grades of a course (see partial grade).
subquestion	Part of a question, e.g., question 1b, to which a student needs to formulate or otherwise indicate an answer.
summative assessments	Any assessment that contributes to the final result (grade or pass/fail) of a course. This includes mandatory activities in the course.
Teaching & Learning Services	Organization that supports lecturers of the entire TU Delft with training, advise, and support.
teaching assistant (TA)	Someone who has a job to assist a lecturer in their teaching. In the context of assessment, teaching assistants (TAs) can help entering questions in an assessment tool, review questions, monitor and help during the test, and help scoring student answers in the assessment tool. They do everything under close supervision of the examiner. Often used as a synonym of student assistant, although in some faculties like Applied Science, also PhD’s and postdocs can be teaching assistants.
teaching week	Teaching weeks are weeks during which educational activities take place. They are numbered p.w where p is the period number (periods 1-4 are the regular periods; period 5 is the summer period that is only used for resits which lasts either 9 or 10 weeks, depending on the year), and w is the week number (1-10). Week 1.1 is the first or second week of September. See https://www.tudelft.nl/en/student/education/academic-calendar
technical application manager	Employee who deals with the installation, approval, and the process of making the technical systems and infrastructure operational and keeping them that way.
test	An assessment of (a part of) the learning objectives of a course. It can have the form of a written exam, a try-out exam, a midterm, or homework assignments that can be summative or formative, but not a project or presentation. Practice exercises like in standard textbooks are not considered tests.
test duration	Allowed maximum duration during which students can take the test.
test result analysis	Overview of quality indicators on sub question, question, and test level (e.g., p-value, maximum score, correlation with rest score, Cronbach’s alpha). Goal: to determine learning objective achievement of the group, and to determine indicators to improve the answer model/scoring guide before publishing the grades.
total score	Sum of all scores in a test for a single student.
UTQ exemption	Exemption from the obligation to obtain UTQ qualification, based on an assessment to determine that the candidate has a level equivalent to the UTQ level. This can be based on an equivalent certificate, or an assessment of an educational portfolio. Each faculty has their own UTQ exemption procedure⁴³. See 6.1.

answer key	Correct answer to a closed-ended question. This can also be an equation, or a numerical answer, depending on the question type.
answer model	Combination of model answer plus scoring guide: indicates per partially correct answer and per part of a correct answer how many points will be awarded and indicates how many points will be subtracted for specific errors. Example for mcq: A: 1 point, B: ½ point, C: 0 points, D: 0 points. Example for open question: calculation step 1: +2 points, calculation step 2: +3 points, step 3: +1 point, no units: -1 point.
archiving	securely storing data until reaching the retention period. Securely implies restricting access, making the data findable, and ensuring that the data cannot be changed,
archived securely	Data and metadata are stored safely and is preferably no longer changeable so that later it is certain that this is the original version.
assessment	Educational activities during which individual students demonstrate how well they master the learning objectives of a course, and during which their performance is measured. This information is shared with students to steer and/or evaluate their learning. Examples: projects, exams.
assessment activity	Activity that a student does during an assessment. In constructively aligned courses, this matches the learning objectives.
assessment agreement	Part of the programme assessment plan that consists of agreements for all assessments in that specific programme.
assessment competence	To what extent an employee of the TU Delft who participates in an assessment process is able to perform their assessment tasks in such a way that it leads to good quality assessment.
assessment criteria	Aspects of a product or process on which a student are assessed on, for example during a project.
assessment matrix	Blueprint of an assessment for an exam: A matrix that indicates for all individual subquestions and their maximum scores what learning objective (rows) they assess on which level of the used taxonomy (columns).
assessment method	Examples: written exam, oral exam, project, report, presentation, etc.
assessment mode	Whether the assessment is administered under physical supervision of an examiner and/or invigilator (i.e., in an exam hall/room), whether the assessment is administered via the internet (i.e., remote), or whether the assessment is hybrid (a combination of on-campus and online).
course assessment plan	Overview of the assessments in a course. Its goal is to demonstrate how the learning objectives of a course are assessed in a valid, reliable, transparent way that stimulates learning. It includes the main characteristics of the course like contribution to final grade (0% - 100%), regulations for retake / addition, feedback on the assessment, what learning objectives are assessed per assessment, approximate week planning of deadlines and assessments, allowed use tools & information during the assessment, assessment tooling, how the final grade represents the performance of an individual student and how the learning objectives contribute to the programme’s intended learning outcomes.
programme assessment plan	Overview of the assessment in a programme. Its goal is to demonstrate how the final attainment levels (FALs) of the programme are assessed in the combination of the programme’s courses in a valid way. It includes an overview of what courses contribute to what FALs and what assessment forms are used to assess these.
assessment tool	Digital tool (e.g. software, online tool) in which parts of the assessment cycle are conducted or supported. Examples: designing assessments, administering assessments, doing exams as a student, proctoring/invigilating, handing in student work, scoring student work, providing feedback, test result analysis, grade calculating, grade communication, students reviewing and discussing graded work and grades, grade administration, evaluating assessment, plagiarism check, online proctoring, etc.
assessor	Person who scores or gives feedback to student work or student performance.
author	Someone who composes the test and who compiles/develops (sub)questions, either individually or in collaboration with other authors.
binding recommendation on the continuation of studies (BSA)	Binding advice to individual students on the continuation of whether they can continue their studies. Given at the end of the first year of the Bachelor. Dutch: Bindend studieadvies (BSA).
Bloom level	One of the following 6 levels in the adapted cognitive taxonomy of Bloom: understand, apply, analyse, evaluate, create (adapted cognitive taxonomy). See here³⁴.
blueprint	Schematic representation of an assessment in a matrix. For exams, this is an assessment matrix; for projects/assignments/etc. a consistency check table is more common. Etymology: a blueprint of a building was a white-on-blue technical drawing of e.g. a building in the early 20^th century.
bring-your-own-device assessment	Assessment in an exam room during which students perform the digital exam on their own laptop. Typically requires extra security measures. BYOD
calibration session	Session during which assessors who grade the same assignment proof-grade (example) student work and discuss differences in scores and feedback to improve the quality and consistency of their grading and feedback.
closed-ended question	Question to which the answer is given by selecting one or multiple items from a limited number of options. Examples: multiple choice, multiple select, matching, selecting a number from a limited range, selecting part of a picture, etc. Closed-ended questions could lead to a correct answer without prior knowledge by randomly choosing an answer option, which implies the need for guessing correction.
combination test	Test that is composed of two separate tests with a separate score. An example being one part of a test with closed questions and another part with open questions.
consistency check table	Overview of a project (or large assignment) which indicates per learning objective (rows) which related criteria (content of the cells) are assessed formatively and summatively per (intermediate or final) deliverable(s) or process(es) (columns).
constructive alignment	Design principle for courses and programmes to stimulates student learning. In constructively aligned courses, learning objectives, learning activities and assessment activities are aligned. In constructively aligned programmes, final attainments, learning objectives and assessment types are aligned.
course	Coherent unit of study within a programme that includes learning activities and formative assessments to help students master the learning objectives, and summative assessment(s) of which the results express how well individual students have succeeded in this. After passing the summative assessment, students receive the ECs that correspond to the course. Some courses consist fully or partially of a project. Other term used in some programmes: module.
course coordinator	The lecturer who is responsible for the course as a whole. Terminology used in study guide: ‘responsible lecturer’.
course grade	course grade
cover page	Front page of a paper exam that the student reads and that contains general information and general instructions.
criterion	Aspect on which students’ deliverables or the process of creating them will be graded.
cut-off score	Score, that a student needs for a grade of 6.0 (minimum pass score). Dutch: cesuur
degree audit	the test in which the BoEx determines whether the student as successfully completed all examinations in the courses of the degree programme (WHW art. 7.10). If so, the EB awards the student with the relevant BSc or MSc degree (WHW art. 7.10a sub 1). Dutch: examen (not to be confused with exam=tentamen).
degree program	List of courses that the board of examiners approved and that an individual student needs to complete in order to obtain the desired degree. There are standard degree programmes, and individual / free degree programmes, which the board of examiners explicitly has to approve.
descriptor	Description of how students’ deliverables or the process of creating them looks like at a specific level for a specific criterion in a rubric. See rubric.
device	Device on which a student takes the test (terms used in other places: computer, workstation).
digital exam	Written exam input type during which students answer exam questions with the help of a computer.
Digital Exams	TU Delft service that supports lecturers in the process of scheduled digital on-campus and remote written exams.
drawing tool	Tool within an assessment tool that allows to draw a picture, graph, or diagram. Some drawing tools may allow for automatic grading of student input in the tool.
educational period	Period during which courses run. The basic educational periods are four quarters (Q1 to Q4) and a summer period for retakes (Q5). See https://www.tudelft.nl/en/student/education/academic-calendar.
e-invigilator	Invigilator for a digital exam who helps examiners and students with administrative and technical issues. Examples: add unregistered students to the exam, help students to continue on another computer and provide compensatory time in case of computer issues.
EvaSys	System that administers questionnaires for course evaluations to students, and processes the outcome of these evaluations into reports.
exam	Scheduled summative written test that students take during a specific exam timeslot on a specific day. Examples: written exam, oral exam. NB1: in the TER and R&G, all types of summative assessments are called ‘examinations’ (tentamens), including assignments and projects. NB2: ‘exam’ should not be confused with the Dutch word ‘examen’, which is ‘degree audit’ (see ‘degree audit’).
exam timeslot	Timeslot during which students can take the test.
exam period	Period during which most exams take place. Every educational period has an exam period in week x.9 and x.10 (or only x.10, x being the number of the quarter, see ‘educational period’), and some programmes have an exam period for midterms around week x.5. See https://www.tudelft.nl/en/student/education/academic-calendar. Few tests take place outside these periods.
examination	Formal word for ‘assessment’. Can refer to any type of assessment.
Examination Appeals Board (EAB)	TU Delft appeals board that processes and decides on appeal cases by students on assessment (see WHW art. 7.61, sub 1). This includes course grades given by examiners (students cannot appeal against partial grades until the final course grade has been communicated) and decisions of the board of examiners. The BoEx can make decisions on e.g. complaints by individual or groups of students on an assessment, or on requests for an extra assessment opportunity. The working method of the EAB is described in the Examination Appeals Board Regulations. Dutch: College van Beroep voor de Examens, CBE.
examiner	Member of the teaching staff who is appointed examiner by the board of examiners and who is responsible (alone or with colleagues) for the content and process of the examination of a course, including the responsibility for grading the tests.
feedback	Structured information for students on their performance and possibilities for improvement, based on the quality of a student product or process. Feedback is structured per assessment criterion and/or learning objective and used in a follow-up learning activity or assessment. Feedback can be given by peers, teaching staff or by the student themself (via self-assessment).
final attainment (level)	List of achievements of graduates that describe what graduates of a programme are able to do after successfully completing the programme. Synonym 1 (used during accreditations): intended learning outcome / ILO. Synonym 2: exit qualification Abbreviation: FAL. See: intended learning outcome. Abbreviation: ILO.
final grade	The final grade of a course. Synonym: course grade.
formative assessment	Assessment that does not influence the grade of a course and is meant to give students feedback on how well they currently master the learning objectives and what steps they still need to take to improve before the summative assessment at end of the course. Formative assessment counts as such 1) if the assessment is at the level of the learning objectives, 2) if the performance of students during the activity does not count for the course grade or passing the course and if the activity is voluntary, 3) if students receive structured feedback on the assessment criteria or learning objectives, and 4) if students are able and stimulated to use the feedback in consecutive learning activities and summative assessment.
fraud	‘any act or omission by a student that makes it fully or partially impossible to properly assess the knowledge, insight and skill of that student or another student’²²
free riding	a form of fraud in group work where one student of the group is not contributing on terms of time investment or output. Synonym: ‘piggy backing’
functional application manager	A functional application manager is responsible within an organisation for the optimal functioning of one or more information systems. Not only do they ensure the continuity of the systems, but they also fulfil a supporting role regarding the users. In that sense, functional management forms the connection between ICT and business operations.
graduation	MSc or BSc graduation.
guessing correction	Average score by randomly guessing the answer to closed-ended questions.
GDPR	General Data Protection Regulation, see https://eur-lex.europa.eu/eli/reg/2016/679/oj.
GPA	Grade point average: Weighted average of all numerical grades of an individual student in a programme, rounded to two decimals, excluding results from Honours Programme courses.
grade	Description of student performance on a test, which is based on the score using a score-grade conversion (synonyms: mark (Australia, US)).
hybrid assessment	Test that consists of a digital part (via a device) and a paper-based, handwritten part.
inspection	Possibility for students to inspect/review their graded work and discuss objections to the score with the examiner. Also: student inspection.
institutional audit	“An institutional audit is a periodic, external, and independent assessment of the internal quality assurance in place at an institution. Internal quality assurance comprises both the quality culture and the internal quality assurance system of an institution. The audit serves to verify that the institution’s internal quality assurance system, in interconnection with its quality culture, safeguards the realisation of its individual vision of good education.”page 6 in ¹⁰
intended learning outcome	See final attainment level (FAL). Abbreviation: ILO.
invigilator	Someone who supervises the exam for the detection of irregularities and fraudulent behaviour on campus.
knock-out criterion	A criterion that has a minimum level that needs to be met in order for the student to receive feedback and/or a grade.
learning activities	Activities that a student performs during a course in order to train the learning objectives.
learning objectives	List of achievements that describe what students are able to do after successfully completing the course. They describe the ultimate but feasible level of the course. Synonym at other universities: learning outcome, intended learning outcome. Abbreviation: LOs. Singular: LO
LMS	Learning Management System. At TU Delft, this is currently Brightspace.
lockdown browser	Prevents students to access other applications than the browser needed to access the test, and that limits the access of the browser to the test, and to whitelisted pages. Also called secure browser.
mark	Noun: Can mean either score (points for an exam question) or grade (converted from the score), depending on country of origin. Not used at TU Delft to prevent confusion. Verb: evaluating student work as an assessor or examiner, while attributing points per question or assessment criterion and/or adding feedback. Synonyms: grade, score, evaluate, review.
meta data	Characteristics of (sub)questions in an assessment tool that either the lecturer attributes (for example learning objective, topic, difficulty, peer review status), or that the assessment tool attributes based on historical data (for example history of use in tests, parent, p-value, RiR-value).
midterm	in the context of exams: An exam in the middle of the educational period, which typically covers the first half of the course and counts for up to 50% of the course grade. in the context of graduation projects: an interim evaluation / feedback moment during the project, typically halfway the project. Depending on the faculty/programme, this can include a decision on continuation of the project. in the context of accreditation / quality assurance: an internal evaluation halfway between accreditations (3 years after the accreditation) to check the progress of the programme in terms of the NVAO standards.
model answer	Correct answer. In some cases, multiple correct answers exist. The one that is handed to the students is called the model answer. The model answer could also contain multiple correct answers or answer routes.
multiple choice question	Question type that requires students to pick one out of a number of proposed answers. See also: multiple select question, closed-ended question.
multiple select question	Question type that requires students to pick one or more out of a number of proposed answers. See also: multiple choice question, closed-ended question.
online proctoring	Online proctoring is only possible for closed-book tests if it is not possible to assess the course using open-book tests, i.e., in case of knowledge exams or exams on math questions for which the answers can be achieved using symbolic computation software (e.g., Maple, Mathematica, MATLAB) or online tools. Permission from the board of examiners is required^vvv
open book test	Historically, this meant that students could bring the course’s book (and sometimes a list of other books) to the exam hall. In case of remote tests, ‘open book’ implies access to the internet as well. Contact with other people is prohibited.
open-ended question	Question to which the set of correct answers is not given by selecting an answer from a limited number of options (see closed-ended question). In case the answer is not predictable, manual scoring requires the help of a rubric or answer model.
oral check	Fraud detection method conducted after an unsupervised assessment, during which examiners question individual student from a (quasi) random sample of the entire student population on their submitted work. The goal is to evaluate the likelihood that the student was the actual author of the submitted work.
Osiris	student information system in which student register for exams and in which lecturers communicate course grades and in some programmes also partial grades.
p-value	Normalized average score per subquestion or question. Formula: p-value = average score / maximum score. Example: p=1.0 implies all students received maximum score. p=0 scored on average 0 points. p can be negative if minus points are awarded. However, this is not recommended. The p-value is a measure for the ‘difficulty’ of a question, to which it is inversely proportional: the more difficult a question is, the lower it p-value. NB: This is a different p-value from the one in statistical context.
paper exam	Exam during which the student writes the answers to questions and/or assignments on paper.
parameterized question	(sub)question in which both the question and correct answer depend on defined parameters or variables (numerical and algebraic) that are stated in the question description. The parameter values are determined randomly for each realization of the question.
partial grade	Grade for an assessment within a course. The weighted average of al partial grades forms the course grade. In most faculties, partial grades have a minimum value in order to pass the course. Partial grades can consist of subgrades (see subgrade).
passing grade	The minimum grade that is required to pass a course. At TU Delft, this is 6.0 after rounding the final course grade to halves.
PDCA cycle	Plan-do-check-adjust cycle; a way of improving processes or products iteratively. For assessment, it implies that the examiner plans a good assessment (Plan), administers, and grades the assessment (Do), checks the quality of the assessment based on test result analysis and/or student input (Check), and adjusts the next assessment based on the findings (Adjust).
peer review	Process during which other lecturers review individual questions or entire tests and give feedback on the question-and-answer model.
peer reviewer	Lecturer who reviews questions or the test before the test is administered to students.
practice exercise	Questions like the ones that can be found in standard textbooks. Goal is to train students to master the level of the learning objectives. These questions help students to master the learning objectives by gradually increasing in complexity. Unlike formative assessments, they typically, are not (yet) at the level of the learning objectives. Also called ‘scaffolding questions’.
proctor	Invigilator who invigilates video recordings of remote exams.
programme	Educational programme (combination of courses and graduation project). Students receive a MSc degree or BSc degree after successful completion of a programme.
question	Single question to which the student needs to formulate or otherwise indicates an answer/answers. A question can consist of a coherent set of sub questions. (Terms used in other places: item, assignment)
question bank	Digital collection of questions (which can consist of sub questions) that can be used for a test. Questions can be labelled with characteristics, like metadata and keywords. (Term used in other places: item bank)
question pool	A set of similar questions of comparable difficulty, from which the assessment tool randomly selects a question to create unique exams.
RACI matrix	Matrix that indicates per tasks or process (rows) who (columns) is accountable (A) for this task/process, who is Responsible (i.e. who needs to take action), who can be held Accountable, who needs to be Consulted, and who needs to be Informed.
remote assessment	Assessment that would normally take place on campus that take place online due to exceptional circumstances such as corona. Requires special fraud prevention measures and possibly approval from the board of examiners and/or educational management.
repair option	Possibility for students who did not pass a course in one go, to pass the course that year. Only applicable for courses with other assessment forms than exams. Example: assignments, projects, lab work, etc. The repair option does not require redoing the entire assessment; This only requires delivering an updated version or doing a smaller repair assignment. Typically, a maximum grade applies.
result	Result of a test or course that is communicated to the student. The result typically is a grade between 1 and 10, rounded to decimals, but a result can also be ‘pass’ or ‘fail’. If a student does not show at an exam, the examinator can register ‘NV’ (no show), which is technically not a result.
responsible lecturer	See ‘course coordinator’
retake / resit	Second opportunity in a year to sit an exam. Primarily meant for students who missed the main exam due to circumstances, but open to all students.
retention period	How long e.g. a document should continue to exist. See also: archiving period.
random	Generate one or more (quasi)random values within a range that is predefined, striving for a uniform occurrence over the range. This promotes that all values will occur with about the same frequency, even in small groups.
Rir-value	Correlation between the student scores for a certain (sub)question, and the total student score for all other (sub)questions. Low Rir-values indicate that otherwise good performing students (on this assessment) score poorly on this question.
Rit-value	Correlation between the student scores for a certain (sub)question, and the total student scores. Low Rit-values indicate that otherwise good performing students (on this assessment) score poorly on this question. The Rir-value is more accurate.
rubric	Matrix used to determine the score per criterion that the students are assessed on. For all criteria (rows), the requirements for each level (columns) are described as descriptors in the cells of the matrix. Either the criteria are weighted and the points per level are the same for all criteria, or the points per level differ between criteria. Used to score essay-like questions as well as larger assignments/projects.
safeguarding	Making sure that something happens, without having to do it yourself. Synonym: securing, guaranteeing. Dutch: borgen.
score-grade transformation	Determining the grades from the students’ total scores. Typically implemented as a single linear equation (y = a∙x + b) or two linear equations (one for scores below the cut-off score and one for scores above the cut-off score).
scoring	Process of determining individual student scores on (sub)questions in a test (terms used in other places: marking, grading).
scoring guide	Indicates in an answer model how many points should be added for each correct part of the student answer and subtracted per error/omission.
section	Group of questions in a test that belong together. Sometimes used for dividing the test into different topics, or types of questions. Assessment tools typically can apply specific rules per section (terms used in other places: part, block).
secure browser	Software on the student’s device that limits the access to internet, other applications, or peripherals with the goal of preventing a student from accessing forbidden information during a test. Also called lockdown browser.
securing	Making sure that something happens, without having to do it yourself. Synonyms: safeguarding, guaranteeing. Dutch: borgen.
selection list	Official national document that dictates how long documents resulting from educational processes like assessment need to be archived and whether these need to be destroyed after this period. Most assessment related documents fall under process 54, which is abbreviated as ‘SL proc. 54’. Section 3.4 is dedicated to the archiving of assessment and degree related documents. Official name: ‘Selection List Universities and University Medical Centres 2020’ (Selectielijst Universiteiten en Universitair Medische Centra 2020).
standard feedback	Feedback to students that is connected to the answer model. In case of certain errors or correct steps, students receive standard feedback. Example: ‘You forgot to square c in E = m∙c².’
STEM	Science, Technology, Engineering, Mathematics.
stem	The stem of a question is the first part, that precedes the question and the instructions (in the case of open questions) or the answer options (in the case of multiple-choice questions).
structured feedback	Feedback that is structured per applicable LO or assessment criterion. The term is used as the opposite of ‘unstructured feedback’, in which not all LOs or criteria are systematically assessed.
student assistant (SA)	Student who has a job in a university where they assist employees. In case their job description is focussed on education, they are called ‘student assistants’. In case their job description is focussed on support (e.g. at TLS), they are called ‘support assistants’ (SAs), and otherwise ‘teaching assistants’ (TAs). However, the latter term is also in use for non-students like PhD students and postdocs.
student information system (SIS)	In SIS, students can register for assessments and view their study results. At the TU Delft: Osiris.
(student) review	Possibility for students to review/inspect their graded work and discuss objections to the score with the examiner.
student work	Something that was created by a student. Example: homework, assignments, report, exam, etc. Typically, teaching staff provides feedback to student work, and/or grades student work.
support assistant (SA)	student who has a job at TLS to support lecturers in their teaching, for example by providing help on the use of tools.
subgrade	One of the subgrades within a partial grade or within an assessment. Example 1: an exam can have a subgrade for open-ended questions and a subgrade for closed-ended questions, of which the weighted average is the exam grade. Example 2: a partial grade for lab work can consist of several subgrades per lab day. Subgrade should not be confused with partial grades of a course (see partial grade).
subquestion	Part of a question, e.g., question 1b, to which a student needs to formulate or otherwise indicate an answer.
summative assessments	Any assessment that contributes to the final result (grade or pass/fail) of a course. This includes mandatory activities in the course.
Teaching & Learning Services	Organization that supports lecturers of the entire TU Delft with training, advise, and support.
teaching assistant (TA)	Someone who has a job to assist a lecturer in their teaching. In the context of assessment, teaching assistants (TAs) can help entering questions in an assessment tool, review questions, monitor and help during the test, and help scoring student answers in the assessment tool. They do everything under close supervision of the examiner. Often used as a synonym of student assistant, although in some faculties like Applied Science, also PhD’s and postdocs can be teaching assistants.
teaching week	Teaching weeks are weeks during which educational activities take place. They are numbered p.w where p is the period number (periods 1-4 are the regular periods; period 5 is the summer period that is only used for resits which lasts either 9 or 10 weeks, depending on the year), and w is the week number (1-10). Week 1.1 is the first or second week of September. See https://www.tudelft.nl/en/student/education/academic-calendar
technical application manager	Employee who deals with the installation, approval, and the process of making the technical systems and infrastructure operational and keeping them that way.
test	An assessment of (a part of) the learning objectives of a course. It can have the form of a written exam, a try-out exam, a midterm, or homework assignments that can be summative or formative, but not a project or presentation. Practice exercises like in standard textbooks are not considered tests.
test duration	Allowed maximum duration during which students can take the test.
test result analysis	Overview of quality indicators on sub question, question, and test level (e.g., p-value, maximum score, correlation with rest score, Cronbach’s alpha). Goal: to determine learning objective achievement of the group, and to determine indicators to improve the answer model/scoring guide before publishing the grades.
total score	Sum of all scores in a test for a single student.
UTQ exemption	Exemption from the obligation to obtain UTQ qualification, based on an assessment to determine that the candidate has a level equivalent to the UTQ level. This can be based on an equivalent certificate, or an assessment of an educational portfolio. Each faculty has their own UTQ exemption procedure⁴³. See 6.1.

English	Dutch
assessment	toetsing of toets
assessment criteria	beoordelingscriteria
assignment	(grote) opdracht, vaak bestaande uit meerdere oefeningen.
board of education	opleidingsdirectie
board of examiners	examencommissie
board of studies	opleidingscommissie
cut-off score	cesuur
degree programme	examenprogramma
director of education	directeur onderwijs
director of studies	opleidingsdirecteur (also: programme director)
examiner	examinator
exercise	(kleine) opdracht/oefening
intended learning objective	eindterm
invigilator	surveillant
lecturer	docent
learning objective	leerdoel
programme	opleidingsprogramma
programme director	opleidingsdirecteur (also: director of studies)
Rules of Procedures for Examinations	reglement van orde bij tentamens (RvO)

Acronym	Description
ME	Faculty of Mechanical Engineering (Werktuigbouwkunde, ME)
4TU	federation of four Universities of Technology (TU) in the Netherlands
ABE	Architecture and the Built Environment (Bouwkunde, BK)
ACT	Academic Career Track
AE	Faculty of Aerospace Engineering (Luchtvaart- en Ruimtevaarttechniek, LR)
AS	Faculty of Applied Sciences (Technische Natuurwetenschappen, TNW)
AT	Assessment Taskforce
BBR	Bestuurs- en BeheersReglement (Executive and Management Regulations, EMR)
BoEd	Board of Education (opleidingsdirectie)
BoEx	Board of Examiners
BSc	Bachelor of Science
BSA	Binding recommendation on the continuation of studies
BYOD	Bring Your Own Device
CBE	Commissie voor Beroep van de Examens, Examination Appeal Board (EAB)
CEG	Civil Engineering and Geosciences (Civiele Techniek & Geowetenschappen, CiTG)
CvB	Executive Board (CvB)
DE	Digital Exams
DEE	Digital Excellence for Education
EAB	Examination Appeals Board (see CBE)
EB	Executive Board (CvB)
EC	European Credit (studiepunt)
ECTS	European Credit Transfer System (studiepuntuitwisselingssysteem), sometimes incorrectly instead of EC
ED	Exam Desk
EEMCS	Faculty of Electrical Engineering, Mathematics & Computer Science (Elektrotechniek, Wiskunde & Informatica, EWI)
EMR	Executive and Management Regulations (Bestuurs- en beheersreglement TU Delft, BBR)
EMT	Educational Management Team
ESA	Education & Student Affairs
ESA-SPA	Education & Student Affairs – Study Programme Administration
FA	Final attainment
FAB	Functional Application Manager
FAL	Final Attainment Level, also called ILO
FoA	Focus on Assessment
FR	Faculty Regulations
FSC	Faculty Student Council
FTE	full-time equivalent
GPA	Grade Point Average
HERA	Higher Education and Research Act (Wet op het Hoger onderwijs en Wetenschappelijk Onderzoek, WHW). We use ‘WHW’ because there is no English version available.
HOS	Meeting Heads of ESA (Hoofden Onderwijs & Studentenzaken)
HR	Human Resources
IDE	Faculty of Industrial Design Engineering (Industrieel Ontwerpen, IO)
ILO	Intended Learning Outcome, FAL is more common in Delft
IM	Information Management
IM-SPA	Information Management - Security, Privacy and Architecture
LO	Learning Objective
mcq	Multiple Choice Question
MSc	Master of Science
MT	Management Team
ODO	Meeting Directors of Education (Overleg Directeuren Onderwijs)
O&S	Education and Student Affairs, ESA (Onderwijs- & Studentenzaken)
PDCA	Plan-do-check-adjust or plan-do-check-act (see, PDCA cycle)
PhD	Doctoral student (promovendus)
P&I	Policy and Implementation (department of ESA)
R&D	Result & Development Cycle
R&G	Rules & Guidelines of the Board of Examiners
RACI	Responsible, accountable, communicate, inform
RPE	Rules of Procedures for Examinations (Reglement van Orde bij tentamens, RvO)
RvO	Reglement van Orde bij tentamens (see RPE)
SA	Student Assistant (general), or Support Assistant (at TLS)
SAP	Supervision and Assessment Principles (course)
SC	Student Council
SEQ	Senior Examination Qualification (course)
SL	Selection List Universities and University Medical Centers 2020 (Selectielijst Universiteiten en Universitair Medische Centra 202027)
SPA	Study Programme Administration
SSO	Single sign-on
T3.A1	Foundations of Educational Design (Graduate School course)
T3.A3	Assessing students and master thesis projects (Graduate School course)
T3.B1	Coaching Individual Students and Project Groups (Graduate School course)
TA	Teaching Assistant
TAB	Technical Application Manager
TER	Teaching and Examination Regulations
TIL	Transport, Infrastructure and Logistics
TLS	Teaching & Learning Services
TPM	Faculty of Technology, Policy, and Management (Techniek, Bestuur en management, TBM)
TLS	Teaching & Learning Services
UNL	Universities of The Netherlands (previously VSNU)
UTQ	University Teaching Qualification (training programme)
Wgbh/cz	Act on Equal Treatment of the grounds of Disability or Chronic Illness, Wet gelijke behandeling op grond van handicap of chronische ziekte
WHW	Higher Education and Research Act (Wet op het Hoger onderwijs en Wetenschappelijk Onderzoek, WHW). Sometimes abbreviated as ‘HERA’

Anchor Links Example

sss) Mentioned in model Faculty Regulations art. 7.8 sub 1 and art. 9.3 sub e
ttt) A checklist with required content of the cover page can be found in the TU Delft assessment manual¹⁶.
uuu) The format was improved by the Taskforce Regulations (werkgroep regelgeving) and P&I, after which the chairs of the boards of examiners were consulted in their meeting in May 2023.
vvv) See https://www.tudelft.nl/en/student/my-study-me/education/courses-and-examinations/examinations/online-proctored-examination-regulation

Name member	Role	Board	Term	Length	UTQ	BoE-training

<< Assessment

Assessment framework