DOI: 10.3724/SP.J.1042.2018.01404

Advances in Psychological Science (心理科学进展) 2018/26:8 PP.1404-1416

Attention guidance and cognitive processing:The educational effects of eye movement modeling examples

For the past decades, researchers have paid much attention to exploring how cognitive processes influence eye movements. Recently, they have begun to directly look into the reciprocal relationship and test how eye movements might influence cognitive processes by using eye movement modeling examples (EMME). As a new kind of teaching examples, EMME proved to be effective to guide visual attention. It could facilitate the selection, organization, and integration of information, as well as improve the scanpath similarity. However, research examining the effects of EMME on learning performance reported mixed results. The information-reduction hypothesis, cognitive theory of multimedia learning, and cognitive apprenticeship have been used as theoretical foundations for predicting or explaining the positive effects of EMME. Future studies are highly needed to explore the effects of EMME from the perspectives of boundary conditions, functional mechanism, eye-movement pre-training, expertise development, cooperative learning, and the neural basis.

Key words:eye movement modeling examples,attention guidance,cognitive processing,education

ReleaseDate:2018-08-27 09:44:16

陈家刚. (2010). 认知学徒制二十年研究综述. 远程教育杂志, 28(5), 97-104.

王福兴, 段朝辉, 周宗奎. (2013). 线索在多媒体学习中的作用. 心理科学进展, 21(8), 1430-1440.

王福兴, 芦咏莉, 段朝辉, 周宗奎. (2013). 不同经验教师对学生课堂行为加工的眼动研究. 心理发展与教育, 29(4), 391-399.

谢和平, 王福兴, 周宗奎, 吴鹏. (2016). 多媒体学习中线索效应的元分析. 心理学报, 48(5), 540-555.

赵欢欢. (2013). 多媒体学习中图-文整合的经验效应:基于眼动的研究(硕士学位论文). 华中师范大学, 武汉.

Amunts, K., Schlaug, G., Jäncke, L., Steinmetz, H., Schleicher, A., Dabringhaus, A., & Zilles, K. (1997). Motor cortex and hand motor skills:Structural compliance in the human brain. Human Brain Mapping, 5(3), 206-215.

Atkinson, R. K., Derry, S. J., Renkl, A., & Wortham, D. (2000). Learning from examples:Instructional principles from the worked examples research. Review of Educational Research, 70(2), 181-214.

Bandura, A. (1977). Social learning theory. Englewood Cliffs, NJ:Prentice-Hall.

Bayliss, A. P., Frischen, A., Fenske, M. J., & Tipper, S. P. (2007). Affective evaluations of objects are influenced by observed gaze direction and emotional expression. Cognition, 104(3), 644-653.

Brennan, S. E., Chen, X., Dickinson, C. A., Neider, M. B., & Zelinsky, G. J. (2008). Coordinating cognition:The costs and benefits of shared gaze during collaborative search. Cognition, 106(3), 1465-1477.

Brucker, B., Ehlis, A. C., Häußinger, F. B., Fallgatter, A. J., & Gerjets, P. (2015). Watching corresponding gestures facilitates learning with animations by activating human mirror-neurons:An fNIRS study. Learning and Instruction, 36, 27-37.

Charness, N., Reingold, E. M., Pomplun, M., & Stampe, D. M. (2001). The perceptual aspect of skilled performance in chess:Evidence from eye movements. Memory & Cognition, 29(8), 1146-1152.

Chi, M. T. H. (2006). Laboratory methods for assessing experts' and novices' knowledge. In K. A. Ericsson, N. Charness, P. J. Feltovich, & R. R. Hoffman (Eds.), The Cambridge handbook of expertise and expert performance (pp. 167-184). Cambridge, UK:Cambridge University Press.

Collins, A., Brown, J. S., & Holum, A. (1991). Cognitive apprenticeship:Making thinking visible. American Educator, 15, 38-46.

Collins, A., Brown, J. S., & Newman, S. E. (1989). Cognitive apprenticeship:Teaching the crafts of reading, writing, and mathematics. In L. B. Resnick (Ed.), Knowing, learning, and instruction:Essays in honor of Robert Glaser (pp. 453-494). Hillsdale, NJ:Erlbaum.

De Koning, B. B., & Jarodzka, H. (2017). Attention guidance strategies for supporting learning from dynamic visualizations. In R. Lowe & R. Ploetzner (Eds.), Learning from dynamic visualizations:Innovations in research and practice (pp. 255-278). Switzerland:Springer.

De Koning, B. B., Tabbers, H. K., Rikers, R. M. J. P., & Paas, F. (2007). Attention cueing as a means to enhance learning from an animation. Applied Cognitive Psychology, 21(6), 731-746.

De Koning, B. B., Tabbers, H. K., Rikers, R. M. J. P., & Paas, F. (2009). Towards a framework for attention cueing in instructional animations:Guidelines for research and design. Educational Psychology Review, 21(2), 113-140.

Delon-Martin, C., Plailly, J., Fonlupt, P., Veyrac, A., & Royet, J. P. (2013). Perfumers' expertise induces structural reorganization in olfactory brain regions. NeuroImage, 68, 55-62.

Donovan, T., Manning, D. J., & Crawford, T. (2008). Performance changes in lung nodule detection following perceptual feedback of eye movements. In B. Sahiner & D. J. Manning (Eds.), Proceedings of SPIE Medical Imaging 2008:Image Perception, Observer Performance, and Technology Assessment (pp. 6917-03). San Diego, CA:SPIE.

Donovan, T., Manning, D. J., Phillips, P. W., Higham, S., & Crawford, T. (2005). The effect of feedback on performance in a fracture detection task. Proceedings of SPIE-The International Society for Optical Engineering. San Diego, California, United States:SPIE.

Gegenfurtner, A., Kok, E. M., van Geel, K., de Bruin, A. B. H., & Sorger, B. (2017). Neural correlates of visual perceptual expertise:Evidence from cognitive neuroscience using functional neuroimaging. Frontline Learning Research, 5(3), 14-30.

Gegenfurtner, A., Kok, E., van Geel, K., de Bruin, A., Jarodzka, H., Szulewski, A., & van Merriënboer, J. J. G. (2017). The challenges of studying visual expertise in medical image diagnosis. Medical Education, 51(1), 97-104.

Gegenfurtner, A., Lehtinen, E., Jarodzka, H., & Säljö, R. (2017). Effects of eye movement modeling examples on adaptive expertise in medical image diagnosis. Computers & Education, 113, 212-225.

Gegenfurtner, A., Lehtinen, E., & Säljö, R. (2011). Expertise differences in the comprehension of visualizations:A meta-analysis of eye-tracking research in professional domains. Educational Psychology Review, 23(4), 523-552.

Gegenfurtner, A., & Seppänen, M. (2013). Transfer of expertise:An eye tracking and think aloud study using dynamic medical visualizations. Computers & Education, 63, 393-403.

Grant, E. R., & Spivey, M. J. (2003). Eye movements and problem solving:Guiding attention guides thought. Psychological Science, 14(5), 462-466.

Haider, H., & Frensch, P. A. (1999). Eye movement during skill acquisition:More evidence for the information-reduction hypothesis. Journal of Experimental Psychology:Learning, Memory, and Cognition, 25(1), 172-190.

Hinds, P. J. (1999). The curse of expertise:The effects of expertise and debiasing methods on prediction of novice performance. Journal of Experimental Psychology:Applied, 5(2), 205-221.

Hostetter, A. B. (2011). When do gestures communicate? A meta-analysis. Psychological Bulletin, 137(2), 297-315.

Huang, R., Lu, M., Song, Z., & Wang, J. (2015). Long-term intensive training induced brain structural changes in world class gymnasts. Brain Structure and Function, 220(2), 625-644.

Jamet, E. (2014). An eye-tracking study of cueing effects in multimedia learning. Computers in Human Behavior, 32, 47-53.

Jarodzka, H., Holmqvist, K., & Gruber, H. (2017). Eye tracking in educational science:Theoretical frameworks and research agendas. Journal of Eye Movement Research, 10(1), doi:10.16910/jemr.10.1.3.

Jarodzka, H., Holmqvist, K., Nyström, M., Scheiter, K., Gerjets, P., & Eika, B. (2012). Conveying clinical reasoning based on visual observation via eye-movement modelling examples. Instructional Science, 40(5), 813-827.

Jarodzka, H., Scheiter, K., Gerjets, P., van Gog, T., & Dorr, M. (2010). How to convey perceptual skills by displaying experts' gaze data. In N. A. Taatgen & H. van Rijn (Eds.), Proceedings of the 31st annual conference of the cognitive science society (pp. 2920-2925). Austin, TX:Cognitive Science Society.

Jarodzka, H., van Gog, T., Dorr, M., Scheiter, K., & Gerjets, P. (2013). Learning to see:Guiding students' attention via a Model's eye movements fosters learning. Learning and Instruction, 25, 62-70.

Kok, E. M., & Jarodzka, H. (2017). Before your very eyes:The value and limitations of eye tracking in medical education. Medical Education, 51(1), 114-122.

Krupinski, E. A., Tillack, A. A., Richter, L., Henderson, J. T., Bhattacharyya, A. K., Scott, K. M.,... Weinstein, R. S. (2006). Eye-movement study and human performance using telepathology virtual slides:Implications for medical education and differences with experience. Human Pathology, 37(12), 1543-1556.

Kundel, H. L., Nodine, C. F., & Krupinski, E. A. (1990). Computer-displayed eye position as a visual aid to pulmonary nodule interpretation. Investigative Radiology, 25(8), 890-896.

Lin, L., & Atkinson, R. K. (2011). Using animations and visual cueing to support learning of scientific concepts and processes. Computers & Education, 56(3), 650-658.

Litchfield, D., Ball, L. J., Donovan, T., Manning, D. J., & Crawford, T. (2010). Viewing another person's eye movements improves identification of pulmonary nodules in chest x-ray inspection. Journal of Experimental Psychology:Applied, 16(3), 251-262.

Mason, L., Pluchino, P., & Tornatora, M. C. (2015). Eye-movement modeling of integrative reading of an illustrated text:Effects on processing and learning. Contemporary Educational Psychology, 41, 172-187.

Mason, L., Pluchino, P., & Tornatora, M. C. (2016). Using eye-tracking technology as an indirect instruction tool to improve text and picture processing and learning. British Journal of Educational Technology, 47(6), 1083-1095.

Mason, L., Scheiter, K., & Tornatora, M. C. (2017). Using eye movements to model the sequence of text-picture processing for multimedia comprehension. Journal of Computer Assisted Learning, 33(5), 443-460.

Mayer, R. E. (2009). Multimedia Learning (2nd ed.). New York:Cambridge University Press.

Nalanagula, D., Greenstein, J. S., & Gramopadhye, A. K. (2006). Evaluation of the effect of feedforward training displays of search strategy on visual search performance. International Journal of Industrial Ergonomics, 36(4), 289-300.

Neider, M. B., Chen, X., Dickinson, C. A., Brennan, S. E., & Zelinsky, G. J. (2010). Coordinating spatial referencing using shared gaze. Psychonomic Bulletin & Review, 17(5), 718-724.

O'Neill, E. C., Kong, Y. X. G., Connell, P. P., Ong, D. N., Haymes, S. A., Coote, M. A., & Crowston, J. G. (2001). Gaze behavior among experts and trainees during optic disc examination:Does how we look affect what we see? Investigative Ophthalmology & Visual Science, 52(7), 3976-3983.

Rayner, K. (1998). Eye movements in reading and information processing:20 years of research. Psychological Bulletin, 124(3), 372-422.

Rayner, K. (2009). The 35th sir frederick bartlett lecture:Eye movements and attention in reading, scene perception, and visual search. The Quarterly Journal of Experimental Psychology, 62(8), 1457-1506.

Reingold, E. M., Charness, N., Pomplun, M., & Stampe, D. M. (2001). Visual span in expert chess players:Evidence from eye movements. Psychological Science, 12(1), 48-55.

Renkl, A., & Scheiter, K. (2017). Studying visual displays:How to instructionally support learning. Educational Psychology Review, 29(3), 599-621.

Sadasivan, S., Greenstein, J. S., Gramopadhye, A. K., & Duchowski, A. T. (2005). Use of eye movements as feedforward training for a synthetic aircraft inspection task. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2005 (pp. 141-149). New York, NY:ACM Press.

Salmerón, L., Naumann, J., García, V., & Fajardo, I. (2017). Scanning and deep processing of information in hypertext:An eye tracking and cued retrospective think-aloud study. Journal of Computer Assisted Learning, 33(3), 222-233.

Scheiter, K., Schubert, C., & Schüler, A. (2018). Self-regulated learning from illustrated text:Eye movement modelling to support use and regulation of cognitive processes during learning from multimedia. British Journal of Educational Psychology, 88(1), 80-94.

Seppänen, M., & Gegenfurtner, A. (2012). Seeing through a teacher's eyes improves students' imaging interpretation. Medical Education, 46(11), 1113-1114.

Skuballa, I. T., Fortunski, C., & Renkl, A. (2015). An eye movement pre-training fosters the comprehension of processes and functions in technical systems. Frontiers in Psychology, 6, 598.

Stein, R., & Brennan, S. E. (2004). Another person's eye gaze as a cue in solving programming problems. Proceedings of ICMI 2004, Sixth International Conference on Multimodal Interfaces (pp. 9-15). New York, NY:ACM Press.

Sweller, J., van Merriënboer, J. J. G., & Paas, F. G. W. C. (1998). Cognitive architecture and instructional design. Educational Psychology Review, 10(3), 251-296.

Thomas, L. E., & Lleras, A. (2007). Moving eyes and moving thought:On the spatial compatibility between eye movements and cognition. Psychonomic Bulletin & Review, 14(4), 663-668.

van der Gijp, A., Ravesloot, C. J., Jarodzka, H., van der Schaaf, M. F., van der Schaaf, I. C., van Schaik, J. P. J., & ten Cate, T. J. (2017). How visual search relates to visual diagnostic performance:A narrative systematic review of eye-tracking research in radiology. Advances in Health Sciences Education, 22(3), 765-787.

van Gog, T., Jarodzka, H., Scheiter, K., Gerjets, P., & Paas, F. (2009). Attention guidance during example study via the model's eye movements. Computers in Human Behavior, 25(3), 785-791.

van Marlen, T., Van Wermeskerken, M., Jarodzka, H., & van Gog, T. (2016). Showing a model's eye movements in examples does not improve learning of problem-solving tasks. Computers in Human Behavior, 65, 448-459.

van Meeuwen, L. W., Jarodzka, H., Brand-Gruwel, S., Kirschner, P. A., de Bock, J. J. P. R., & van Merriënboer, J. J. G. (2014). Identification of effective visual problem solving strategies in a complex visual domain. Learning and Instruction, 32, 10-21.

van Merriënboer, J. J. G. (2013). Perspectives on problem solving and instruction. Computers & Education, 64, 153-160.

van Noord, S. (2016). Effects of eye movements in modelling examples with ambiguous verbal explanations on visual attention and learning (Unpublished bachelor's thesis). Utrecht University, Netherlands.

Velichkovsky, B. M. (1995). Communicating attention:Gaze position transfer in cooperative problem solving. Pragmatics & Cognition, 3(2), 199-223.

Vivianni, P. (1990). Eye movements in visual search:Cognitive, perceptual and motor control aspects. In E. Kowler (Ed.), Eye movements and their role in visual and cognitive processes (pp. 353-393). Amsterdam:Elsevier.

Vogt, S., & Magnussen, S. (2007). Expertise in pictorial perception:Eye-movement patterns and visual memory in artists and laymen. Perception, 36(1), 91-100.

Wang, F., Li, W., Mayer, R. E., & Liu, H. (2018). Animated pedagogical agents as aids in multimedia learning:Effects on eye-fixations during learning and learning outcomes. Journal of Educational Psychology, 110(2), 250-268.