Multimedia foundations – combining text and images
When implementing multimedia in your education, there are a number of evidence informed principles you can consider to make sure that multimedia is implemented effectively. This page will focus on some different forms of information processing, and (its implications for) Mayer’s multimedia principles. You can use some or all of these principles to shape the use of multimedia in your education. Please also find more information about creating a video and creating lecture slides.
Where these principles stem from
The cognitive theory of multimedia learning is based on the notion that words and pictures should be presented together (Mayer, 2014). The general idea is that two different pathways can process two different types of information:
- Visual / pictorial and
- Auditory / verbal.
There is consistent evidence that the combination of words and pictures results in the best results in information transfer in fields such as information retention (Cuevas et al., 2002; Fiore et al., 2003; Mayer, 1989; Mayer & Anderson, 1991, 1992)
Processing information
Mayer’s (2014) multimedia principles are linked to three main instructional goals, that relate to the processing capacity (i.e., the ‘cognitive load’) of a learner. Different forms of processing can impact that processing capacity: extraneous, essential, and generative processing.
- Firstly, extraneous processing is unrelated to the instruction's goal, and should therefore be minimised, which is the first main instructional goal. Mainly, extraneous overload is caused by poor design of the instruction.
- Secondly, essential processing is the processing related to forming a mental representation of the essential material as it is presented. Essential processing should be managed to avoid overload, which is the second main instructional goal. Unnecessary complex material could cause essential overload.
- Lastly, generative processing concerns making sense of the instructional material and should be fostered (third main instructional goal). This form of processing is related to the learners' motivation to learn.
Multimedia principles
Mayer (2014) describes fifteen multimedia principles, as listed in the table below. These principles are grouped per goal (linked to different forms of processing information), and per principle. A description is given to clarify the principle.
Goal | Representative principle | Short description | Application in education |
Minimize extraneous processing | Coherence principle | Eliminate extraneous material. | When you design learning materials, pay attention on how to simplify them. For instance when adding visual elements, ask yourself if they support learning or comprehension? If not, it is recommended to not add them. |
Signalling principle | Highlight essential material. | When you design learning materials, it is recommended to highlight important pieces of information. For example in your slides, use highlights or bold markings for key subjects. Another application is to have a slide to separate different topics; signalling that another topic is coming up. In using visuals, you can think of indicating important parts using arrows. | |
Redundancy principle | Do not add printed text to spoken text. | When you design slides for a lecture or knowledge clip, it is recommended to not use printed text that is similar to the spoken text. Alternatively, you might want to include a representative visual. | |
Spatial contiguity principle | Place printed text near corresponding graphic. | When you design learning materials, you can apply this principle by placing relevant text and visuals close together on the slide or page. In this way, students know where to look for information instead of having to look for it. | |
Temporal contiguity principle | Present narration and corresponding graphic simultaneously. | When you design slides for a lecture or knowledge clip, make sure the visual is shown at the same time as you are explaining it (not presenting it e.g. in consecutive order). | |
Segmenting principle | Break presentation into parts. | When you design learning materials, be aware to present information in segments. Ideally, students are allowed to 'control' their learning by for instance changing the speed of a video. | |
Manage essential processing | Pre-training principle | Describe names and characteristics of key elements before the lesson. | Before you start on the course, or even a certain learning activity, it is recommended to think of what basic information students need to know. By offering this information in e.g. the study guide, or by creating a cheat sheet, students can familiarise themselves with the basics before the course/learning activity. |
Modality principle | Use spoken rather than printed text. | When you design slides for a lecture or knowledge clip, it is recommended to rely on visuals more than text. Combining visuals and too much text might become overwhelming to students. | |
Multimedia principle | Use words and pictures rather than words alone. | When you design learning materials, try to incorporate meaningful visuals to further clarify information / a certain topic, rather than just using text. | |
Foster generative processing | Personalisation principle | Put words in conversational style. | When lecturing or in a knowledge clip, using a more informal tone of voice will improve the learning experience. Personalisation can also be enhanced by using the first person (e.g. you, I, our). |
Voice principle | Use human voice for spoken words. | A human voice is preferred over an automated (computer) voice. This can be considered when creating e.g. knowledge clips or animations. | |
Embodiment principle | Give on-screen characters humanlike gestures. | When you record a knowledge clip, video or animation, it is recommended to increase embodiment by e.g. making eye contact or using hand gestures. | |
Guided discovery principle | Provide hints and feedback as learner solves problems. | It is recommended to combine the discovery (learning) process with offering guidance to students, ideally integrated in the learning environment. Consider the option to add hints and/or feedback to your quizzes (e.g. Brightspace Quiz), or to integrate questions with feedback in your video (e.g. H5P). | |
Self-explanation principle | Ask learners to explain a lesson to themselves. | When you design a learning activity, it is recommended to prompt students to explain some parts, enhancing their learning process. You could implement this by asking students to self-explain some parts of the lecture (e.g. using Vevox). | |
Drawing principle | Ask learners to make drawings for the lesson. | As a(n) (additional) learning activity, you can have students create a drawing. It increases their learning process. Active engagement is needed in drawing to translate (spoken textual) information into a drawing representing (relationships between) elements included in the information. You could incorporate this as a closing activity at the end of a lecture. |
*Based on: Table 3.7, Three instructional goals in multimedia learning (Mayer, 2014)
How to get help
Do you have any questions about these principles? Reach out to the educational advisors at your faculty or contact teaching support for 1-on-1 guidance.
Relevant resources
- Enhance your course with multimedia: Discover different media types to tell your story.
- Opleidingsportaal – DIY Video self-paced: If you need to create lecture videos or podcasts for your classroom, this workshop teaches you the basics to get the best possible as quickly as possible. This course is self-paced and fully online.
- NewMedia Centre: TU Delft’s dynamic multimedia hub for media production, experimentation, research, education, live performance, and learning. Get in touch with the NewMedia Centre for more detailed information and an estimation of your media project.
- Opleidingsportaal – Presenting in the New Media Centre Studio: In this workshop, you experience what it is like to present in front of the camera and you will practice with different tips and tricks to keep the attention of your audience.
- Opleidingsportaal – Scriptwriting, Presenting, and Effective use of Media: In this self-paced online course, you will learn script-writing techniques that will help you tell your story in a natural way.
References
- Cuevas, H. M., Fiore, S. M., & Oser, R. L. (2002). Scaffolding cognitive and meta-cognitive Processes in low verbal ability learners: Use of diagrams in computer based training Environments. Instructional Science, 30(6), 433-464. https://doi.org/10.1023/A:1020516301541
- Fiore, S. M., Cuevas, H. M., & Oser, R. L. (2003). A picture is worth a thousand connections: The facilitative effects of diagrams on mental model development and task Performance. Computers in Human Behavior, 19(2), 185-199. https://doi.org/10.1016/S07475632(02)00054-7
- Mayer, R. E. (1989). Systematic thinking fostered by illustrations in scientific text. Journal of Educational Psychology, 81(2), 240-246. https://doi.org/10.1037/0022-0663.81.2.240
- Mayer, R. E. (2014). The Cambridge Handbook of Multimedia Learning (Cambridge Handbooks in Psychology) (2nd ed.). Cambridge University Press.
- Mayer, R. E., & Anderson, R. B. (1991). Animations need narrations: An experimental test of a dual- coding hypothesis. Journal of Educational Psychology, 83(4), 484-490. https://doi.org/10.1037/0022-0663.83.4.484
- Mayer, R. E., & Anderson, R. B. (1992). The instructive animation: Helping students build connections between words and pictures in multimedia learning, Journal of Educational Psychology, 84(4), 444-452. https://doi.org/10.1037/0022-0663.84.4.444