The impact of linguistic audio-visual stimuli on verbal memory retention
DOI:
https://doi.org/10.64268/jllm.v1i02.10Keywords:
Linguistic Audio-Visual Stimuli, Verbal Memory Retention, Multimedia Learning, Language Learning, Higher EducationAbstract
Background: The increasing use of audio-visual media in language learning has transformed how linguistic input is delivered in higher education contexts. However, empirical evidence examining the impact of linguistic audio-visual stimuli on verbal memory retention, particularly beyond immediate learning outcomes, remains limited. Most prior studies have focused on short-term performance, leaving the stability of verbal memory over time underexplored.
Aim: This study aims to investigate the effect of linguistic audio-visual stimuli on verbal memory retention, both immediately after instruction and after a delayed interval, compared to non-audio-visual linguistic input.
Method: A quantitative experimental design was employed involving undergraduate students who were assigned to either an audio-visual linguistic condition or a comparison condition. Verbal memory performance was measured using a pretest, an immediate posttest, and a delayed posttest. Data were analyzed using analysis of covariance (ANCOVA) to control for baseline differences and mixed-design analysis of variance (mixed ANOVA) to examine changes in retention over time. Effect sizes were reported to indicate the magnitude of observed effects.
Result: The findings revealed that participants exposed to linguistic audio-visual stimuli achieved significantly higher verbal memory retention scores than those in the comparison condition on both immediate and delayed posttests. Moreover, the interaction between time and group indicated that the audio-visual group exhibited a smaller decline in retention over time, suggesting greater memory stability.
Conclusion: The study concludes that linguistic audio-visual stimuli enhance not only immediate verbal memory performance but also the durability of verbal memory retention. These findings highlight the pedagogical value of integrating well-designed audio-visual linguistic materials in language learning, particularly to support sustained memory outcomes in higher education contexts.
References
Al-Jumaily, I. H. A., & Alazzawi, I. T. J. (2025). The influence of multimodal visual methodologies on EFL University students' audio-visual comprehension, verbal and nonverbal communication. Journal of Language and Education, 11(2 (42)), 35-56. https://doi.org/10.17323/jle.2025.22731
Baars, M., & Viberg, O. (2023). Supporting metacognitive and cognitive processes during self-study through mobile learning. In Metacognition and Education: Future Trends (pp. 147–166). Routledge. https://doi.org/10.4324/9781003150602-9
Baddeley, A. (2000). The episodic buffer: A new component of working memory? Trends in Cognitive Sciences, 4(11), 417–423. https://doi.org/10.1016/S1364-6613(00)01538-2
Bedenlier, S., Bond, M., Buntins, K., Zawacki-Richter, O., & Kerres, M. (2020). Facilitating student engagement through educational technology in higher education: A systematic review in the field of arts and humanities. Australasian Journal of Educational Technology, 36(4), 126–150. https://doi.org/10.14742/ajet.5477
Bisson, M.-J., Van Heuven, W. J., Conklin, K., & Tunney, R. J. (2014). Processing of native and foreign language subtitles in films: An eye tracking study. Applied Psycholinguistics, 35(2), 399–418. https://doi.org/10.1017/S0142716412000434
Chun, D., Kern, R., & Smith, B. (2016). Technology in Language Use, Language Teaching, and Language Learning. The Modern Language Journal, 100(S1), 64–80. https://doi.org/10.1111/modl.12302
Cintrón-Valentín, M. C., & García-Amaya, L. (2021). Investigating textual enhancement and captions in L2 grammar and vocabulary: An experimental study. Studies in Second Language Acquisition, 43(5), 1068–1093. https://doi.org/10.1017/S0272263120000492
Ebbinghaus, H. (2013). [image] Memory: A Contribution to Experimental Psychology. Annals of Neurosciences, 20(4), 155. https://doi.org/10.5214/ans.0972.7531.200408
Feng, Y., & Webb, S. (2020). Learning vocabulary through reading, listening, and viewing: Which mode of input is most effective? Studies in Second Language Acquisition, 42(3), 499–523. https://doi.org/10.1017/S0272263119000494
Gao, J., Zhou, S., Yu, H., Li, C., & Hu, X. (2025). SCESS-Net: Semantic consistency enhancement and segment selection network for audio-visual event localization. Computer Vision and Image Understanding, 104551. https://doi.org/10.1016/j.cviu.2025.104551
Godfroid, A., & Hopp, H. (2023). The Routledge handbook of second language acquisition and psycholinguistics. Routledge, Taylor & Francis Group. https://doi.org/10.4324/9781003018872
Hwang, G.-H., Chen, B., & Chen, S.-P. (2024). Impacts of digital game-based flipped teaching approach on learning effectiveness of the students with different prior knowledge levels. Interactive Learning Environments, 32(9), 5156–5173. https://doi.org/10.1080/10494820.2023.2211630
Jung, Y., & Révész, A. (2024). Promoting grammatical development through multimodal digital recasts in video-conferencing tasks. https://doi.org/10.64152/10125/73601
Kim, D., Jo, I.-H., Song, D., Zheng, H., Li, J., Zhu, J., Huang, X., Yan, W., & Xu, Z. (2021). Self-regulated learning strategies and student video engagement trajectory in a video-based asynchronous online course: A Bayesian latent growth modeling approach. Asia Pacific Education Review, 22(2), 305–317. https://doi.org/10.1007/s12564-021-09690-0
Kormos, J. (2023). The role of cognitive factors in second language writing and writing to learn a second language. Studies in Second Language Acquisition, 45(3), 622–646. https://doi.org/10.1017/S0272263122000481
Li, M. (2023). A review of technology enhanced Chinese character teaching and learning in a digital context. https://doi.org/10.64152/10125/73532
Liu, C., Tu, Y., Lin, L.-J., Chen, H., Liu, T.-H., Lin, H.-L., & Chiou, W.-K. (2025). The effects of short video app–guided loving-kindness meditation on interpersonal mindfulness, empathy, collaboration, affect, and workplace well-being among working professionals. Frontiers in Public Health, 13, 1716315. https://doi.org/10.3389/fpubh.2025.1716315
Lv, Z., Poiesi, F., Dong, Q., Lloret, J., & Song, H. (2022). Deep learning for intelligent human–computer interaction. Applied Sciences, 12(22), 11457. https://doi.org/10.3390/app122211457
Mayer, R. E. (2021). Multimedia learning (the 3rd edition). New York: Cambridge University.
Mirriahi, N., Jovanović, J., Lim, L.-A., & Lodge, J. M. (2021). Two sides of the same coin: Video annotations and in-video questions for active learning. Educational Technology Research and Development, 69(5), 2571–2588. https://doi.org/10.1007/s11423-021-10041-4
Montag, C., Demetrovics, Z., Elhai, J. D., Grant, D., Koning, I., Rumpf, H.-J., Spada, M. M., Throuvala, M., & van den Eijnden, R. (2024). Social media use in childhood and adolescence: Minimizing its adverse effects through corporate social responsibility and European Union regulations. In Handbook of Children and Screens: Digital Media, Development, and Well-Being from Birth Through Adolescence (pp. 477–484). Springer Nature Switzerland Cham. https://doi.org/10.1007/978-3-031-69362-5_65
Pearson, H. C., & Wilbiks, J. M. (2021). Effects of audiovisual memory cues on working memory recall. Vision, 5(1), 14. https://doi.org/10.3390/vision5010014
Perez, M. M., & Pattemore, A. (2025). Effects of captioned video on L2 speech segmentation in intermediate learners of Spanish. Language Learning & Technology, 29(3), 205–225. https://doi.org/10.64152/10125/73653
Pishghadam, R., Boustani, N., Gerwien, J., Shayesteh, S., & Al Abdwani, T. (2024). Audio-visual entrainment, cranio-electro stimulation, and sensory involvement: rival effects on attention and L2 vocabulary retention. Applied psycholinguistics, 45(6), 1067-1085. https://doi.org/10.1017/S0142716424000419
Plonsky, L., Larsson, T., Sterling, S., Kytö, M., Yaw, K., & Wood, M. (2024). Chapter 1. A taxonomy of questionable research practices in quantitative humanities. In Ethical issues in applied linguistics scholarship (pp. 10–27). John Benjamins Publishing Company. https://doi.org/10.1075/rmal.7.01plo
Révész, A., Jeong, H., Suzuki, S., Cui, H., Matsuura, S., Saito, K., & Sugiura, M. (2024). Task-generated processes in second language speech production: Exploring the neural correlates of task complexity during silent pauses. Studies in Second Language Acquisition, 46(4), 1179–1205. https://doi.org/10.1017/S0272263124000421
Sweller, J. (2022). The role of evolutionary psychology in our understanding of human cognition: Consequences for cognitive load theory and instructional procedures. Educational Psychology Review, 34(4), 2229–2241. https://doi.org/10.1007/s10648-021-09647-0
Sydorenko, T., Cárdenas-Claros, M. S., Huntley, E., & Perez, M. M. (2024). Audiovisual input in language learning: Teachers’ perspectives. https://doi.org/10.64152/10125/73587
Teng, M. F. (2023). The effectiveness of multimedia input on vocabulary learning and retention. Innovation in Language Learning and Teaching, 17(3), 738–754. https://doi.org/10.1080/17501229.2022.2131791
Umino, T. (2023). Using multimodal language learning histories to understand learning experiences and beliefs of second language learners in Japan. The Modern Language Journal, 107(1), 308–327. https://doi.org/10.1111/modl.12828
Webb, S., Uchihara, T., & Yanagisawa, A. (2023). How effective is second language incidental vocabulary learning? A meta-analysis. Language Teaching, 56(2), 161–180. https://doi.org/10.1017/S0261444822000507
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Agus Setiawan, Wawan
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
