doi:

DOI: 10.3724/SP.J.1042.2017.01656

Advances in Psychological Science (心理科学进展) 2017/25:10 PP.1656-1663

The neuroimaging studies with naturalistic reading paradigm and co-registration of eye movement and fMRI


Abstract:
The previous neuroimaging studies mainly used the serial visual presentation paradigm to investigate the neural mechanism of reading with words, sentences and paragraphs. Recently, some studies have begun to use the naturalistic reading paradigm in fMRI experiments, which are introduced and discussed. It has been revealed that the co-registration of eye movement and fMRI is a good way to record the data in the naturalistic reading task. In addition, a method using self-paced eye movements as markers for hemodynamic brain responses during naturalistic reading is also introduced. As a trend for future neuroimaging studies of reading, the utilization of new paradigms and new methods provide a high ecological validity to explore the neural mechanism of eye movements in reading. The further research needs to take advantage of experimental designs and other relevant methods to overcome the limitation of fMRI in low resolution of time. Moreover, the relationship between neural systems for reading and eye movements requires further investigation.

Key words:reading,eye movement,fMRI

ReleaseDate:2017-11-17 09:48:01



Altmann, U., Bohrn, I. C., Lubrich, O., Menninghaus, W., & Jacobs, A. M. (2014). Fact vs fiction-how paratextual information shapes our reading processes. Social Cognitive and Affective Neuroscience, 9, 22-29.

Birn, R. M., Cox, R. W., & Bandettini, P. A. (2002). Detection versus estimation in event-related fMRI:Choosing the optimal stimulus timing. NeuroImage, 15, 252-264.

Bonhage, C. E., Mueller, J. L., Friederici, A. D., & Fiebach, C. J. (2015). Combined eye tracking and fMRI reveals neural basis of linguistic predictions during sentence comprehension. Cortex, 68, 33-47.

Buckner, R. L. (1998). Event-related fMRI and the hemodynamic response. Human Brain Mapping, 6, 373-377.

Burock, M. A., Buckner, R. L., Woldorff, M. G., Rosen, B. R., & Dale, A. M. (1998). Randomized event-related experimental designs allow for extremely rapid presentation rates using functional MRI. Neuroreport, 9, 3735-3739.

Choi, W., Desai, R. H., & Henderson, J. M. (2014). The neural substrates of natural reading:A comparison of normal and nonword text using eyetracking and fMRI. Frontiers in Human Neuroscience, 8, 1024.

Choi, W., & Henderson, J. M. (2015). Neural correlates of active vision:An fMRI comparison of natural reading and scene viewing. Neuropsychologia, 75, 109-118.

Coltheart, M., Rastle, K., Perry, C., Langdon, R., & Ziegler, J. (2001). DRC:A dual route cascaded model of visual word recognition and reading aloud. Psychological Review, 108, 204-256.

Dale, A. M. (1999). Optimal experimental design for event-related fMRI. Human Brain Mapping, 8, 109-114.

Dale, A. M., & Buckner, R. L. (1997). Selective averaging of rapidly presented individual trials using fMRI. Human Brain Mapping, 5, 329-340.

Dambacher, M., Dimigen, O., Braun, M., Wille, K., Jacobs, A. M., & Kliegl, R. (2012). Stimulus onset asynchrony and the timeline of word recognition:Event-related potentials during sentence reading. Neuropsychologia, 50, 1852-1870.

Dehaene, S., & Cohen, L. (2011). The unique role of the visual word form area in reading. Trends in Cognitive Sciences, 15, 254-262.

Dimigen, O., Sommer, W., Hohlfeld, A., Jacobs, A. M., & Kliegl, R. (2011). Coregistration of eye movements and EEG in natural reading:Analyses and review. Journal of Experimental Psychology:General, 140, 552-572.

Ding, J. H., Powell, D., & Jiang, Y. (2009). Dissociable frontal controls during visible and memory-guided eye-tracking of moving targets. Human Brain Mapping, 30, 3541-3552.

Ferstl, E. C., & von Cramon, D. Y. (2001). The role of coherence and cohesion in text comprehension:An event-related fMRI study. Cognitive Brain Research, 11, 325-340.

Friston, K. J., Fletcher, P., Josephs, O., Holmes, A., Rugg, M. D., & Turner, R. (1998). Event-related fMRI:Characterizing differential responses. NeuroImage, 7, 30-40.

Glover, G. H. (1999). Deconvolution of impulse response in event-related BOLD fMRI. NeuroImage, 9, 416-429.

Gori, S., & Facoetti, A. (2015). How the visual aspects can be crucial in reading acquisition:The intriguing case of crowding and developmental dyslexia. Journal of Vision, 15, 8.

Henderson, J. M., Choi, W., Lowder, M. W., & Ferreira, F. (2016). Language structure in the brain:A fixation-related fMRI study of syntactic surprisal in reading. NeuroImage, 132, 293-300.

Henderson, J. M., Choi, W., Luke, S. G., & Desai, R. H. (2015). Neural correlates of fixation duration in natural reading:Evidence from fixation-related fMRI. NeuroImage, 119, 390-397.

Henderson, J. M., & Ferreira, M. F. (2012). The interface of language, vision, and action:Eye movements and the visual world. New York:Psychology Press.

Hillen, R., Günther, T., Kohlen, C., Eckers, C., van Ermingen-Marbach, M., Sass, K.,... Heim, S. (2013). Identifying brain systems for gaze orienting during reading:fMRI investigation of the Landolt paradigm. Frontiers in Human Neuroscience, 7, 384.

Hinrichs, H., Scholz, M., Tempelmann, C., Woldorff, M. G., Dale, A. M., & Heinze, H. J. (2000). Deconvolution of event-related fMRI responses in fast-rate experimental designs:Tracking amplitude variations. Journal of Cognitive Neuroscience, 12, 76-89.

Hofmann, M. J., Dambacher, M., Jacobs, A. M., Kliegl, R., Radach, R., Kuchinke, L.,... Herrmann, M. J. (2014). Occipital and orbitofrontal hemodynamics during naturally paced reading:An fNIRS study. NeuroImage, 94, 193-202.

Hsu, C. T., Jacobs, A. M., Altmann, U., & Conrad, M. (2015). The magical activation of left amygdala when reading harry potter:An fMRI study on how descriptions of supra-natural events entertain and enchant. PLoS One, 10, e0118179.

Jamadar, S. D., Fielding, J., & Egan, G. F. (2013). Quantitative meta-analysis of fMRI and PET studies reveals consistent activation in fronto-striatal-parietal regions and cerebellum during antisaccades and prosaccades. Frontiers in Psychology, 4, 749.

Leinenger, M., & Rayner, K. (2015). Eye movements and visual attention during reading. In J. M. Fawcett, E. F. Risko, & A. Kingstone (Eds.), The handbook of attention. Cambridge, MA:The MIT Press.

Liu, T. T., Frank, L. R., Wong, E. C., & Buxton, R. B. (2001). Detection power, estimation efficiency, and predictability in event-related fMRI. NeuroImage, 13, 759-773.

Marsman, J. B. C., Renken, R., Velichkovsky, B. M., Hooymans, J. M. M., & Cornelissen, F. W. (2012). Fixation based event-related fmri analysis:Using eye fixations as events in functional magnetic resonance imaging to reveal cortical processing during the free exploration of visual images. Human Brain Mapping, 33, 307-318.

Pallier, C., Devauchelle, A. D., & Dehaene, S. (2011). Cortical representation of the constituent structure of sentences. Proceedings of the National Academy of Sciences of the United States of America, 108, 2522-2527.

Peterburs, J., Cheng, D. T., & Desmond, J. E. (2016). The association between eye movements and cerebellar activation in a verbal working memory task. Cerebral Cortex, 26, 3802-3813.

Plaut, D. C., McClelland, J. L., Seidenberg, M. S., & Patterson, K. (1996). Understanding normal and impaired word reading:Computational principles in quasi-regular domains. Psychological Review, 103, 56-115.

Price, C. J. (2012). A review and synthesis of the first 20 years of PET and fMRI studies of heard speech, spoken language and reading. NeuroImage, 62, 816-847.

Rayner, K. (2009). Eye movements and attention in reading, scene perception, and visual search. The Quarterly Journal of Experimental Psychology, 62, 1457-1506.

Richlan, F., Gagl, B., Hawelka, S., Braun, M., Schurz, M., Kronbichler, M., & Hutzler, F. (2014). Fixation-related fmri analysis in the domain of reading research:Using self-paced eye movements as markers for hemodynamic brain responses during visual letter string processing. Cerebral Cortex, 24, 2647-2656.

Saad, Z. S., Ropella, K. M., DeYoe, E. A., & Bandettini, P. A. (2003). The spatial extent of the BOLD response. NeuroImage, 19, 132-144.

Schuster, S., Hawelka, S., Hutzler, F., Kronbichler, M., & Richlan, F. (2016). Words in context:The effects of length, frequency, and predictability on brain responses during natural reading. Cerebral Cortex, 26, 3889-3904.

Schuster, S., Hawelka, S., Richlan, F., Ludersdorfer, P., & Hutzler, F. (2015). Eyes on words:A fixation-related fMRI study of the left occipito-temporal cortex during self-paced silent reading of words and pseudowords. Scientific Reports, 5, 12686.

Temereanca, S., Hämäläinen, M. S., Kuperberg, G. R., Stufflebeam, S. M., Halgren, E., & Brown, E. N. (2012). Eye movements modulate the spatiotemporal dynamics of word processing. Journal of Neuroscience, 32, 4482-4494.

Wang, X. J., Yang, J. F., Jie, Y., Mencl, W. E., Shu, H., & Zevin, J. D. (2015). Language differences in the brain network for reading in naturalistic story reading and lexical decision. PLoS One, 10, e0124388.

Zhou, W., Wang, X. J., Xia, Z. C., Bi, Y. C., Li, P., & Shu, H. (2016). Neural mechanisms of dorsal and ventral visual regions during text reading. Frontiers in Psychology, 7, 1399.