DOI: 10.3724/SP.J.1042.2017.01289

Advances in Psychological Science (心理科学进展) 2017/25:8 PP.1289-1298

Emotion comprehension in discourse and its cognitive neural mechanism

Emotion comprehension is of great significance for discourse comprehension and it is widely studied in psycholinguistics. Previous studies demonstrated that readers infer emotional information in discourse on-line and automatically. What's more, readers can keep track of emotional change in discourse and update their situation model accordingly. Recently, some empirical ERP studies and related discourse comprehension theories showed that at least two processes are involved in emotion comprehension in discourse:one is the monitoring of emotional information and the other is the evaluation and updating of current emotional information. Related fMRI studies suggested that emotion comprehension in discourse activated not only emotion network, but also other networks, such as narrative comprehension network and theory of mind (ToM) network. In the future, more studies are needed to explore the influential factors of emotion comprehension and its cognitive neural mechanisms. The findings can be useful for the studies of emotion computing.

Key words:discourse,emotion comprehension,cognitive processes,neural mechanism

ReleaseDate:2017-08-31 10:17:31

鲁忠义, 马红霞. (2011). 主角情绪和时间信息对情境模型加工的影响. 心理学报, 43, 763-770.

张金璐, 吴莹莹, 杨晓虹, 杨玉芳. (2014a). 话题结构对语篇情绪更新的影响. 心理学报, 46, 1413-1425.

张金璐, 吴莹莹, 杨晓虹, 杨玉芳. (2014b). 话题结构对语篇情绪累加的影响. 心理科学, 37, 1282-1290.

Altmann, U., Bohrn, I. C., Lubrich, O., Menninghaus, W., & Jacobs, A. M. (2012). The power of emotional valence-from cognitive to affective processes in reading. Frontiers in Human Neuroscience, 6, 192.

Baetens, K., Ma, N., Steen, J., & van Overwalle, O. (2014). Involvement of the mentalizing network in social and non-social high construal. Social Cognitive and Affective Neuroscience, 9, 817-824.

Baetens, K., van der Cruyssen, L., Achtziger, A., Vandekerckhove, M., & van Overwalle, F. (2011). N400 and LPP in spontaneous trait inferences. Brain Research, 1418, 83-92.

Bartholow, B. D., Fabiani, M., Gratton, G., & Bettencourt, B. A. (2001). A psychophysiological examination of cognitive processing of and affective responses to social expectancy violations. Psychological Science, 12, 197-204.

Bartholow, B. D., Pearson, M. A., Gratton, G., & Fabiani, M. (2003). Effects of alcohol on person perception:A social cognitive neuroscience approach. Journal of Personality and Social Psychology, 85, 627-638.

Bašnáková, J., Weber, K., Petersson, K. M., van Berkum, J., & Hagoort, P. (2014). Beyond the language given:The neural correlates of inferring speaker meaning. Cerebral Cortex, 24, 2572-2578.

Burin, D. I., Acion, L., Kurczek, J., Duff, M. C., Tranel, D., & Jorge, R. E. (2014). The role of ventromedial prefrontal cortex in text comprehension inferences:Semantic coherence or socio-emotional perspective? Brain and Language, 129, 58-64.

Delaney-Busch, N., & Kuperberg, G. (2013). Friendly drug-dealers and terrifying puppies:Affective primacy can attenuate the N400 effect in emotional discourse contexts. Cognitive, Affective, & Behavioral Neuroscience, 13, 473-490.

Egidi, G., & Gerrig, R. J. (2009). How valence affects language processing:Negativity bias and mood congruence in narrative comprehension. Memory & Cognition, 37, 547-555.

Egidi, G., & Nusbaum, H. C. (2012). Emotional language processing:How mood affects integration processes during discourse comprehension. Brain and Language, 122, 199-210.

Ferstl, E. C., Neumann, J., Bogler, C., & von Cramon, D. Y. (2008). The extended language network:A meta-analysis of neuroimaging studies on text comprehension. Human Brain Mapping, 29, 581-593.

Ferstl, E. C., Rinck, M., & von Cramon, D. (2005). Emotional and temporal aspects of situation model processing during text comprehension:An event-related fMRI study. Journal of Cognitive Neuroscience, 17, 724-739.

Ferstl, E. C., & von Cramon, D. Y. (2007). Time, space and emotion:fMRI reveals content-specific activation during text comprehension. Neuroscience Letters, 427, 159-164.

Fields, E. C., & Kuperberg, G. R. (2012). It's all about you:An ERP study of emotion and self-relevance in discourse. NeuroImage, 62, 562-574.

Fields, E. C., & Kuperberg, R. G. (2015). Loving yourself more than your neighbor:ERPs reveal online effects of a self-positivity bias. Social Cognitive and Affective Neuroscience, 10, 1202-1209.

Fields, E. C., & Kuperberg, G. R. (2016). Dynamic effects of self-relevance and task on the neural processing of emotional words in context. Frontiers in Psychology, 6, 2003.

Gernsbacher, M. A. (1996). The structur building framework:What it is, what it might also be, and why. In B. K. Britton & A. C. Graesser (Eds.), Models of text understanding (pp. 289-311). Hillsdale, NJ:Erlbaum.

Gernsbacher, M. A., Goldsmith, H. H., & Robertson, R. R. W. (1992). Do readers mentally represent characters' emotional states? Cognition and Emotion, 6, 89-111.

Gernsbacher, M. A., Hallada, B. M., & Robertson, R. R. W. (1998). How automatically do readers infer fictional characters? emotional states? Scientific Studies of Reading, 2, 271-300.

Graesser, A. C., Singer, M., & Trabasso, T. (1994). Constructing inferences during narrative text comprehension. Psychological Review, 101, 371-395.

Gygax, P., Garnham, A., & Oakhill, J. (2004). Inferring characters' emotional states:Can readers infer specific emotions? Language and Cognitive Processes, 19, 613-639.

Gygax, P., Oakhill, J., & Garnham, A. (2003). The representation of characters' emotional responses:Do readers infer specific emotions? Cognition and Emotion, 17, 413-428.

Haviland, S. E., & Clark, H. H. (1974). What's new? Acquiring new information as a process in comprehension. Journal of Verbal Learning and Verbal Behavior, 13, 512-521.

Hsu, C. T., Conrad, M., & Jacobs, A. M. (2014). Fiction feelings in Harry Potter:Haemodynamic response in the mid-cingulate cortex correlates with immersive reading experience. Neuroreport, 25, 1356-1361.

Hsu, C. T., Jacobs, A. M., Citron, F. M., & Conrad, M. (2015). The emotion potential of words and passages in reading Harry Potter-An fMRI study. Brain and Language, 142, 96-114.

Hsu, C. T., Jacobs, A. M., & Conrad, M. (2015). Can Harry Potter still put a spell on us in a second language? An fMRI study on reading emotion-laden literature in late bilinguals. Cortex, 63, 282-295.

Hsu, C. T., Jacobs, A. M., Altmann, U., & Conrad, M. (2015). The magical activation of left amygdala when reading harry potter:An FMRI study on how descriptions of supra-nat?ural events entertain and enchant. PLoS One, 10, e0118179.

Isenberg, N., Silbersweig, D., Engelien, A., Emmerich, S., Malavade, K., Beattie, B.,... Stern, E. (1999). Linguistic threat activates the human amygdala. Proceedings of the National Academy of Sciences of the United States of America, 96, 10456-10459.

Jabbi, M., Bastiaansen, J., & Keysers, C. (2008). A common anterior insula representation of disgust observation, experience and imagination shows divergent functional connectivity pathways. PLoS One, 3, e2939.

Kintsch, W. (1988). The role of knowledge in discourse comprehension:A construction-integration model. Psychological Review, 95, 163-182.

Kintsch, W., & van Dijk, T. A. (1978). Toward a model of text comprehension and production. Psychological Review, 85, 363-394.

Kober, H., Barrett, L. F., Joseph, J., Bliss-Moreau, E., Lindquist, K., & Wager, T. D. (2008). Functional grouping and cortical-subcortical interactions in emotion:A meta-analysis of neuroimaging studies. NeuroImage, 42, 998-1031.

Komeda, H., & Kusumi, T. (2006). The effect of a protagonist's emotional shift on situation model construction. Memory & Cognition, 34, 1548-1556.

Kuchinke, L., Jacobs, A. M., Grubich, C., Võ, M. L. H., Conrad, M., & Herrmann, M. (2005). Incidental effects of emotional valence in single word processing:An fMRI study. NeuroImage, 28, 1022-1032.

Lai, V. T., & Huettig, F. (2016). When prediction is fulfilled:Insight from emotion processing. Neuropsychologia, 85, 110-117.

Lai, V. T., Willems, R. M., & Hagoort, P. (2015). Feel between the lines:Implied emotion in sentence comprehension. Journal of Cognitive Neuroscience, 27, 1528-1541.

Lang, P. J., Bradley, M. M., & Cuthbert, B. N. (1997). Motivated attention:Affect, activation, and action. In P. J. Lang, R. F. Simons, & M. T. Balaban (Eds.), Attention and orienting:Sensory and motivational processes (pp. 97-135). Mahwah, NJ:Erlbaum.

León, I., Díaz, J. M., de Vega, M., & Hernández, J. A. (2010). Discourse-based emotional consistency modulates early and middle components of event-related potentials. Emotion, 10, 863-873.

Leuthold, H., Filik, R., Murphy, K., & Mackenzie, I. G. (2012). The on-line processing of socio-emotional information in prototypical scenarios:Inferences from brain potentials. Social Cognitive and Affective Neuroscience, 7, 457-466.

Leuthold, H., Kunkel, A., Mackenzie, I. G., & Filik, R. (2015). Online processing of moral transgressions:ERP evidence for spontaneous evaluation. Social Cognitive and Affective Neuroscience, 10, 1021-1029.

Mano, Y., Harada, T., Sugiura, M., Saito, D. N., & Sadato, N. (2009). Perspective-taking as part of narrative comprehension:A functional MRI study. Neuropsychologia, 47, 813-824.

Marotto, C. M., Barreyro, J. P., Cevasco, J., & van den Broek, P. (2011). Generation of emotional inferences during text comprehension:Behavioral data and implementation through the landscape model. Escritos de Psicología, 4, 9-17.

Mason, R. A., & Just, M. A. (2009). The role of the theory-of-mind cortical network in the comprehension of narratives. Language and Linguistics Compass, 3, 157-174.

Molinari, C., Burin, D., Saux, G., Barreyro, J. P., Irrazabal, N., Bechis, M. S.,... Ramenzoni, V. (2009). Fictional characters' emotional state representation:What is its degree of specificity? Psicothema, 21, 9-14.

Moss, J., Schunn, C. D., Schneider, W., McNamara, D. S., & VanLehn, K. (2011). The neural correlates of strategic reading comprehension:Cognitive control and discourse comprehension. NeuroImage, 58, 675-686.

Mulcahy, M., & Gouldthorp, B. (2016). Positioning the reader:The effect of narrative point-of-view and familiarity of experience on situation model construction. Language and Cognition, 8, 96-123.

Phan, K. L., Wager, T. D., Taylor, S. F., & Liberzon, I. (2004). Functional neuroimaging studies of human emotions. CNS Spectrums, 9, 258-266.

Russell, J. A. (1980). A circumplex model of affect. Journal of Personality and Social Psychology, 39, 1161-1178.

Sperduti, M., Arcangeli, M., Makowski, D., Wantzen, P., Zalla, T., Lemaire, S.,... Piolino, P. (2016). The paradox of fiction:Emotional response toward fiction and the modulatory role of self-relevance. Acta Psychologica, 165, 53-59.

van Duynslaeger, M., Sterken, C., Van Overwalle, F., & Verstraeten, E. (2008). EEG components of spontaneous trait inferences. Social Neuroscience, 3, 164-177.

van Duynslaeger, M., van Overwalle, F., & Verstraeten, E. (2007). Electrophysiological time course and brain areas of spontaneous and intentional trait inferences. Social Cognitive and Affective Neuroscience, 2, 174-188.

van Overwalle, F., van den Eede, S., Baetens, K., & Vandekerckhove, M. (2009). Trait inferences in goal-directed behavior:ERP timing and localization under spontaneous and intentional processing. Social Cognitive and Affective Neuroscience, 4, 177-190.

Vega, M. (1996). The representation of changing emotions in reading comprehension. Cognition & Emotion, 10, 303-322.

Wallentin, M., Nielsen, A. H., Vuust, P., Dohn, A., Roepstorff, A., & Lund, T. E. (2011). Amygdala and heart rate variability responses from listening to emotionally intense parts of a story. NeuroImage, 58, 963-973.

Walter, H. (2012). Social cognitive neuroscience of empathy:Concepts, circuits, and genes. Emotion Review, 4, 9-17.

Wang, L., Bastiaansen, M., & Yang, Y. F. (2015). The influence of emotional salience on the integration of person names into context. Brain Research, 1609, 82-92.

Willems, R. M., Clevis, K., & Hagoort, P. (2011). Add a picture for suspense:Neural correlates of the interaction between language and visual information in the perception of fear. Social Cognitive and Affective Neuroscience, 6, 404-416.

Xu, J., Kemeny, S., Park, G., Frattali, C., & Braun, A., 2005. Language in context:Emergent features of word, sentence, and narrative comprehension. NeuroImage, 25, 1002-1015.

Zwaan, R. A., Langston, M. C., & Graesser, A. C. (1995). The construction of situation models in narrative comprehension:An event-indexing model. Psychological Science, 6, 292-297.

Zwaan, R. A., & Radvansky, G. A. (1998). Situation models in language comprehension and memory. Psychological Bulletin, 123, 162-185.