One of my course readings this week was Using multimedia for e-learning by Mayer (2017). In it, the author discussed 12 research-based principles for designing computer-based learning tools. As an ECE practitioner working with infants and toddlers, I initially had trouble relating it to my practice.
I do not use computer-based learning tools in my work, but as a practitioner living in the 21st century, it behooves me to have the skills and knowledge to evaluate tools as they become more and more a part of our lives. The reality is that children have digital technologies available to them at younger and younger ages. These technologies are a part of most childrenâs and familiesâ lives where I practice. So, while I do not use these technologies with the children I interact with, I canât predict the future and so should be able to make research-based decisions about what I include in my practice, as well as what I exclude from it. In the spirit of growth and understanding, I thought I would deepen my comprehension of the 12 principles that Mayer outlines by relating them to a multimedia tool that I am intimately familiar with â the picture book.
Multimedia
- Mayer describes multimedia as the combination of words and pictures to enhance learning. Words can be either spoken or written, and pictures can be either static or moving (such as animation).
- In a childrenâs picture book, both the written text of the story and the illustrations combine to enhance childrenâs learning. The varying degrees of quality in picture books can, in part, be explained by the following principles.
Reducing Extraneous Processing
Principles 2 through 6 all relate to increasing the efficiency of cognitive processing by reducing extra processing tasks. They are:
Coherence
- âPeople learn better when extraneous material is excludedâ (Mayer, 2017, Table 1).
- When an illustrator includes images not related to the words in the illustrations, these act as distractions for children who are trying to process the meaning of the words and pictures. For example, in a book on farm animals, on the page labeled âPigâ it would be distracting to have pictures of other animals alongside the pig.
Signalling
- âPeople learn better when essential material is highlightedâ (Mayer, 2017, Table 1).
- In Wild Berries by Julie Flett (2013), the vocabulary words in Swampy Cree n dialect are highlighted by the red colour of the text, indicating that this is important material.
Redundancy
- âPeople learn better from graphics and narration than from graphics, narration, and on-screen textâ (Mayer, 2017, Table 1).
- Honestly, I had trouble relating this to picture books, and the best I could come up with was comparing a felt-board story performance (no visible text) to a picture book narration. However, that crosses over into other principles like embodiment described further below. Perhaps there are limitations to using childrenâs picture books as a metaphor for everything. How disappointing. If you have ideas, Iâd love to hear them!
Spatial Contiguity
- âPeople learn better when on-screen words are placed next to the corresponding part of the graphicâ (Mayer, 2017, Table 1).
- For example, in a picture of a construction site, having the names of the machines and equipment next to the corresponding image helps to connect the written word to the object it is representing.
Temporal Contiguity
- âPeople learn better when corresponding narration and graphics are presented simultaneouslyâ (Mayer, 2017, Table 1).
- It is easier for children to integrate the illustrations with the story if they can see the pictures as they are hearing the words, rather than having the reader first read the text aloud and then show the picture.
Managing Essential Processing
The following 3 principles are related to managing the cognitive processing of complex or difficult learning. They are:
Segmenting
- âPeople learn better when a multimedia lesson is presented in small, user paced segmentsâ (Mayer, 2017, Table 2).
- For example, infant board books that depict a single word with only the corresponding image on each opening allow the user to absorb the material at their own pace before turning the page.
Pre-training
- âPeople learn better when they learn the key terms prior to receiving a multimedia lessonâ (Mayer, 2017, Table 2).
- Through daily practice and through their knowledge of the children, practitioners are able to select picture books that reflect and expand on childrenâs knowledge and interests rather than introducing new topics without preparation. This is scaffolding as I know it. Building on a foundation of prior knowledge.
Modality
- âPeople learn better from a multimedia presentation when the words are presented in spoken formâ (Mayer, 2017, Table 2).
- This is an obvious one for the children I work with since they do not yet read. Even for children who are able to read, if the material is complex, it is easier to understand if it narrated while you look at the illustration than if you are trying to reconcile the text with the illustration. This means that the child is processing the auditory information in conjunction with the visual information, rather than having two separate sources of visual information to reconcile.
Fostering Generative Processing
The following 3 principles discuss research-based methods for encouraging the learner to engage in greater depth with the material presented in a multimedia lesson.
Personalization
- âPeople learn better when the words in a multimedia lesson are presented in conversational style rather than formal styleâ (Mayer, 2017, Table 3).
- Some picture books draw the reader in by asking questions of the reader or making them part of the story. Books about body parts may talk about âyour belly-buttonâ or âyour toesâ. Or they may say something like âhereâs Teddyâs belly-button. Where is your belly-button?â. This draws children in and itâ more engaging to them than anybodyâs old belly-button.
Voice
- âPeople learn better from a human voice than from a machine-like voiceâ (Mayer, 2017, Table 3).
- There are many battery-operated picture books out there where the child can push a button and here the corresponding sound or word. My experience with these types of books is that they are great for Pavlovian cause and effect learning. The child pushes a button and hears a mechanical voice. They arenât however increasing the childâs understanding of the material presented in the book. Children seem to get more from books if someone reads the book to them, rather than just pushing a button over and over so that the mechanical voice continuously says âTriangle. Triangle. TriangleâŠâ
Embodiment
- âPeople learn better when an on-screen agent uses human-like gestures and movementâ (Mayer, 2017, Table 3).
- This point makes me wonder about the popularity of anthropomorphizing animals and inanimate objects in childrenâs books. Obviously, books are different from screens, but the idea of humanizing non-humans in order to teach concepts has been in practice from the earliest storytelling traditions. I have never liked the idea of vehicles having human-like faces and emotions, but they are ubiquitous in childrenâs literature (and toys). So, do children learn better with anthropomorphic animals and objects? Is this related to the principle of embodiment, or am I drawing a false correlation?
I am cognizant of the fact that the source article was specifically about e-learning, and by taking the tech out of the principles, I was sort of missing the point. I do feel that this exercise allowed me to engage more deeply with the concepts, even if it was a bit of a stretch. Yes, picture books are a multimedia learning tool, especially if they are narrated, as they frequently are in my practice. No, they are not computer-based. I could have examined all these principles through YouTube narrations of picture books, but since these are not part of my practice, it would have been disingenuous.
Did I learn something? Yes. Was it a bit of a stretch? Yes. Will I use the principles in my practice? Well, I have a new tool-set for choosing and reading books to my babies. Thatâs worthwhile. Maybe Iâll be able to use these principles for computer-based learning in the future. Who knows what infant practice will look like in 10 years!
I love that you threaded Mayer’s 12 principles of multimedia learning through your experience with picture books. As an early childhood educator working with children 2.5–5 years of age picture books are a huge part our day together and we carefully choose books that we think are a good fit for the children and program. Thinking with Mayer’s principles as you have applied them has given me a perspective on maybe why we (children and educators) are drawn to particular books over others. When reading the article I also wondered about the ‘Embodiment principle’ and the suggestion, “People learn better when an on-screen agent uses human-like gestures and movementâ (Mayer, 2017, Table 3). So many children’s books humanize non-human others and the children respond to this. Robin Wall Kimmerer when talking about the grammar of animacy, “children quite naturally speak of other beings as persons…Children speak at first with a universal grammar of animacy, until we teach them not to” (https://orionmagazine.org/article/speaking-of-nature/) . Maybe the embodiment principle needs a little more thought from this perspective đ
That looks like a fascinating article, thanks for the link!