doi:

DOI: 10.3724/SP.J.1041.2017.00853

Acta Psychologica Sinica (心理学报) 2017/49:7 PP.853-865

The characteristics of visual word encoding in preview and fixation frames during Chinese reading: Evidences from disappearing text


Abstract:
Encoding the visual information of text into a more permanent representation is necessary for text processing and comprehension. It was found that young English readers are able to encode all the visual information of a fixated word within 55 ms, but cannot encode word n+1 within this time in English reading. Evidence has shown that young Chinese adult readers could not only encapsulate a fixated word as soon as young adults English readers, but also encode the text of word n+1 within this time. It has also been found that the process of encoding a fixated word in Chinese reading is more susceptible to the effects of childhood development and age than English; thus, it may be language-related. With two disappearing text experiments, we explore the characteristics of text and visual encoding of words n and n+1 during Chinese reading. By doing so, we want to clarify whether the process of encoding visual information during Chinese reading is word-or character-based. If the encoding process is character-based, the impairment in reading performance from disappearing manipulations should be mediated by the number and locations of disappeared characters. On the contrary, a word-based hypothesis denies these results.
The sentences used in both experiments consisted of 7 or 8 two-character words. The first experiment was conducted to explore the visual encoding in preview frames. The experiment was a 4 (disappearing manipulations:no disappearing vs word n+1 disappearing vs character n+1 disappearing vs character n+2 disappearing)×2 (disappearing onset:0 ms vs 60 ms) mixed design. After word n was fixated for 0 or 60 ms in each condition, word n+1, the left character of word n+1, and the right character of word n+1 disappeared respectively. An immediate refixation on word n did not result in the reappearance of disappeared text. Reading time was the most important reference in the present study. The results showed that the disruption caused by disappearing manipulations was mediated by the number and locations of disappeared characters; thus, indicating that the encoding process in preview frames is character-based during Chinese reading.
The second experiment also had four disappearing manipulations and two disappearing onset times. This experiment was a 4 (disappearing manipulations:no disappearing vs word n disappearing vs fixated character disappearing vs no fixated character disappearing)×2 (disappearing onset:0 ms vs 60 ms) mixed design. In the word n disappearing condition, word n disappeared after it was fixated for 0 or 60 ms. In the fixated character disappearing condition, the fixated character disappeared after word n was fixated for 0 or 60 ms. In the no fixated character disappearing condition, the nonfixated character, which also belonged to word n, disappeared after word n was fixated for 0 or 60 ms. An immediate refixation on word n did not result in the reappearance of disappeared text. It was found that all of the disappearing manipulations disrupted reading performance equally when the disappearing onset time was 0 ms, and that not all of them prolonged reading time in the conditions with a 60 ms onset time. These results indicated that the encoding process in fixation frames is word-based during Chinese reading.
By integrating the two results mentioned above, it may be concluded that Chinese readers encode the visual information of word n and characters in word n+1 parallel. Further, the encoding process is character-based in preview frames and word-based in fixation frames.

Key words:Chinese reading,visual encoding,disappearing text,eye movements

ReleaseDate:2017-08-31 10:02:30



Baayen, R. H., Davidson, D. J., & Bates, D. M. (2008). Mixed-effects modeling with crossed random effects for subjects and items. Journal of Memory and Language, 59(4), 390-412.

Bai, X. J., Meng, H. X., Wang, J. X., Tian, J., Zang, C. L., & Yan, G. L. (2011). The landing positions of dyslexic, age-matched and ability-matched children during reading spaced text. Acta Psychologica Sinica, 43(8), 851-862.[白学军, 孟红霞, 王敬欣, 田静, 臧传丽, 闫国利. (2011). 阅读障碍儿童与其年龄和能力匹配儿童阅读空格文本的注视位置效应. 心理学报, 43(8), 851-862.]

Bai, X. J., Liang, F. F., Blythe, H, I., Zang, C. L., Yan, G. L., & Liversedge, S. P. (2013). Interword spacing effects on the acquisition of new vocabulary for readers of Chinese as a second language. Journal of Research in Reading, 36(S1), S4-S17.

Bai, X. J., Yan, G. L., Liversedge, S. P., Zang, C. L., & Rayner, K. (2008). Reading spaced and unspaced Chinese text:Evidence from eye movements. Journal of Experimental Psychology:Human Perception and Performance, 34(5), 1277-1287.

Barr, D. J., Levy, R., Scheepers, C., & Tily, H. J. (2013). Random effects structure for confirmatory hypothesis testing:Keep it maximal. Journal of Memory and Language, 68(3), 255-278.

Bates, D., Maechler, M., & Bolker, B. (2011). LME4:Linear mixed-effects models using S4 classes. R Package Version 0.999375-39. Retrieved from http://CRAN.R-project.org/package=lme4

Blythe, H. I., Häikiö, T., Bertam, R., Liversedge, S. P., & Hyönä, J. (2011). Reading disappearing text:Why do children refixate words? Vision Research, 51(1), 84-92.

Blythe, H. I., Liang, F. F., Zang, C. L., Wang, J. X., Yan, G. L., Bai, X. J., & Liversedge, S. P. (2012) Inserting spaces into Chinese text helps readers to learn new words:An eye movement study. Journal of Memory and Language, 67(2), 241-254.

Blythe, H. I., Liversedge, S. P., Joseph, H. S. S. L., White, S. J., & Rayner, K. (2009). Visual information capture during fixations in reading for children and adults. Vision Research, 49(12), 1583-1591.

Devlin, J. T., Jamison, H. L., Matthews, P. M., & Gonnerman, L. M. (2004). Morphology and the internal structure of words. Proceedings of the National Academy of Sciences of the United States of America, 101(41), 14984-14988.

Engbert, R., Longtin, A., & Kliegl, R. (2002). A dynamical model of saccade generation in reading based on spatially distributed lexical processing. Vision Research, 42(5), 621-636.

Engbert, R., Nuthmann, A., Richter, E. M., & Kliegl, R. (2005). SWIFT:A dynamical model of saccade generation during reading. Psychological Review, 112(4), 777-813.

Li, X. S., Bicknell, K., Liu, P. P., Wei, W., & Rayner, K. (2014). Reading is fundamentally similar across disparate writing systems:A systematic characterization of how words and characters influence eye movements in Chinese reading. Journal of Experimental Psychology:General, 143(2), 895-913.

Li, X. S., Gu, J. J., Liu, P. P., & Rayner, K. (2013). The advantage of word-based processing in Chinese reading:Evidence from eye movements. Journal of Experimental Psychology:Learning, Memory, and Cognition, 39(3), 879-889.

Li, X. S., Liu, P. P., & Ma, G. J. (2011). Advances in cognitive mechanisms of word segmentation during Chinese reading. Advances in Psychological Science, 19(4), 459-470.[李兴珊, 刘萍萍, 马国杰. (2011). 中文阅读中词切分的认知机理述评. 心理科学进展, 19(4), 459-470.]

Li, X. S., Rayner, K., & Cave, K. R. (2009). On the segmentation of Chinese words during reading. Cognitive Psychology, 58(4), 525-552.

Liu, Z. F., Wen, S. H., & Zhang, F. (2014). Analysis of age characteristics on visual coding in Chinese reading:Evidence from eye movements. Psychological Development and Education, 30(4), 411-419.[刘志方, 翁世华, 张锋. (2014). 中文阅读中词汇视觉编码的年龄特征:来自眼动研究的证据. 心理发展与教育, 30(4), 411-419.]

Liu, Z. F., Zhang, Z. J., & Yang, G. F. (2015). Test the activation model of transforming characters to words in Chinese reading:Evidence from delay word-boundary effects. Acta Psychologica Sinica, 48(9), 1082-1092.[刘志方, 张智君, 杨桂芳. (2015). 中文阅读中的字词激活模式:来自提示词边界延时效应的证据. 心理学报, 48(9), 1082-1092.]

Liu, Z. F., Zhang, Z. J., & Zhao, Y. J. (2011). The units saccade targeting based on and words procession style in Chinese reading:Evidences from disappearing text. Acta Psychologica Sinica, 43(6), 608-618.[刘志方, 张智君, 赵亚军. (2011). 汉语阅读中眼跳目标选择单元以及词汇加工方式:来自消失文本的实验证据. 心理学报, 43(6), 608-618.]

Liversedge, S. P., Rayner, K., White, S. J., Vergilino-Perez, D., Findlay, J. M., & Kentridge, R. W. (2004). Eye movements when reading disappearing text:Is there a gap effect in reading? Vision Research, 44(10), 1013-1024.

Ma, G. J., & Li, X. S. (2012). Attention allocation during reading:Sequential or parallel. Advances in Psychological Science, 20(11), 1755-1767.[马国杰, 李兴珊. (2012). 阅读中的注意分配:序列与平行之争. 心理科学进展, 20(11), 1755-1767.]

Ma, G. J., Li, X. S., & Rayner, K. (2015). Readers extract character frequency information from nonfixated-target word at long pretarget fixations during Chinese reading. Journal of Experimental Psychology:Human Perception and Performance, 41(5), 1409-1419.

Perfetti, C. A., Liu, Y., & Tan, L. H. (2005). The lexical constituency model:Some implications of research on Chinese for general theories of reading. Psychological Review, 112(1), 43-59.

Pollatsek, A., Reichle, E. D., & Rayner, K. (2006). Tests of the E-Z Reader model:Exploring the interface between cognition and eye-movement control. Cognitive Psychology, 52(1), 1-56.

Rayner, K. (1998). Eye movements in reading and information processing:20 years of research. Psychological Bulletin, 124(3), 372-422.

Rayner, K., Liversedge, S. P., & White, S. J. (2006). Eye movements when reading disappearing text:The importance of the word to the right of fixation. Vision Research, 46(3), 310-323.

Rayner, K., Liversedge, S. P., White, S. J., & Vergilino-Perez, D. (2003). Reading disappearing text:Cognitive control of eye movements. Psychological Science, 14(4), 385-388.

Rayner, K., Yang, J. M., Castelhano, M. S., & Liversedge, S. P. (2010). Eye movements of older and younger readers when reading disappearing text. Psychology and Aging, 26(1), 214-223.

Reichle, E. D., Liversedge, S. P., Pollatsek, A., & Rayner, K. (2009). Encoding multiple words simultaneously in reading is implausible. Trends in Cognitive Sciences, 13(3), 115-119.

Reichle, E. D., Pollatsek, A., & Rayner, K. (2006). E-Z Reader:A cognitive-control, serial-attention model of eye-movement behavior during reading. Cognitive Systems Research, 7(1), 4-22.

Reichle, E. D., Rayner, K., & Pollatsek, A. (2003). The E-Z reader model of eye-movement control in reading:Comparisons to other models. Behavioral and Brain Sciences, 26(4), 445-476.

Reilly, R. G., & Radach, R. (2006). Some empirical tests of an interactive activation model of eye movement control in reading. Cognitive System Research, 7(1), 34-55.

Schad, D. J., & Engbert, R. (2012). The zoom lens of attention:Simulating shuffled versus normal text reading using the SWIFT model. Visual Cognition, 20(4-5), 391-421.

Schotter, E. R., Reichle, E. D., & Rayner, R. (2014). Rethinking parafoveal processing in reading:Serial attention models can explain semantic preview benefit and N+2 preview effects. Visual Cognition, 22(3-4), 309-333.

Shen, D. L., Bai, X. J., Zang, C. L., Yan, G. L., Feng, B. C., & Fang, X. H. (2010). Effect of word segmentation on beginners' reading:Evidence from eye movement. Acta Psychologica Sinica, 42(2), 159-172.[沈德立, 白学军, 臧传丽, 闫国利, 冯本才, 范晓红. (2010). 词切分对初学者句子阅读影响的眼动研究. 心理学报, 42(2), 159-172.]

Shen, D. L., Liversedge, S. P., Tian, J., Zang, C. L., Cui, L., Bai, X. J., … Rayner, K. (2012). Eye movements of second language learners when reading spaced and unspaced Chinese text. Journal of Experimental Psychology:Applied, 18(2), 192-202.

Shen, W., & Li, X. S. (2012). The uniqueness of word superiority effect in Chinese reading. Chinese Science Bulletin, 57(35), 3414-3420.[申薇, 李兴珊. (2012). 中文阅读中词优效应的特异性. 科学通报, 57(35), 3414-3420.]

Su, H., Liu, Z. F., & Cao, L. R. (2016). The effects of word frequency and word predictability in preview and their implications for word segmentation in Chinese reading:Evidence from eye movements. Acta Psychologica Sinica, 48(6), 625-636.[苏衡, 刘志方, 曹立人. (2016). 中文阅读预视加工中的词频和预测性效应及其对词切分的启示:基于眼动的证据. 心理学报, 48(6), 625-636.]

Tan, L. H., Spinks, J. A., Eden, G. F., Perfetti, C. A., & Siok, W. T. (2005). Reading depends on writing, in Chinese. Proceedings of the National Academy of Sciences of the United States of America, 102(24), 8781-8785.

Yan, G. L., Liu, N. N., Liang, F. F., Liu, Z. F., & Bai, X. J. (2015). The comparison of eye movements between Chinese children and adults when reading disappearing text. Acta Psychologica Sinica, 47(3), 300-318.[闫国利, 刘妮娜, 梁菲菲, 刘志方, 白学军. (2015). 中文读者词汇视觉信息获取速度的发展——来自消失文本的证据. 心理学报, 47(3), 300-318.]

Yan, G. L., Tian, H. J., Bai, X. J., & Rayner, K. (2006). The effect of word and character frequency on the eye movements of Chinese readers. British Journal of Psychology, 97(2), 259-268.

Yan, M., Zhou, W., Shu, H., & Kliegl, R. (2015). Perceptual span depends on font size during the reading of Chinese sentences. Journal of Experimental Psychology:Learning, Memory, and Cognition, 41(1), 209-219.

Yang, S. N., & McConkie, G. W. (2004). Saccade generation during reading:Are words necessary? European Journal of Cognitive Psychology, 16(1-2), 226-261.

Zhang, X. X., Fang, Z., Du, Y. C., Kong, L. Y., Zhang, Q., & Xing, Q. (2012). Centro-parietal N200:An event-related potential component specific to Chinese visual word recognition. Chinese Science Bulletin, 57(13), 1516-1532.[张学新, 方卓, 杜英春, 孔令跃, 张钦, 邢强. (2012). 顶中区N200:一个中文视觉词汇识别特有的脑电反应. 科学通报, 57(5), 332-347.]

Zhou, X. L., & Marslen-Wilson, W. (2000). The relative time course of semantic and phonological activation in reading Chinese. Journal of Experimental Psychology:Learning, Memory, and Cognition, 26(5), 1245-1265.