doi:

DOI: 10.3724/SP.J.1042.2020.00085

Advances in Psychological Science (心理科学进展) 2020/28:1 PP.85-97

The automatic processing of changes in emotion: Implications from EMMN


Abstract:
How does the human brain automatically process changing emotional information? Based on the theory of mismatch negativity (MMN), which is generated from our auditory system, a new concept named expression mismatch negativity (EMMN) has been developed by researchers. EMMN is regarded as the index of pre-attentive processing. EMMN is primarily responsible for detecting the variation of information that contains emotional details, and this is where it differs from the visual mismatch negativity (vMMN) that accounts for processing common visual information. Current review mainly discusses how EMMN differs in regard to different facial expression, gender, and fluid intelligence. We also focused on EMMN in aberrated populations such as autism, major depression, and schizophrenia. In addition, we sheds light on the mechanism of EMMN through a perspective based on the predictive-coding theory. In addition to further exploring the neural mechanism of EMMN, future studies should focus particularly on the application of EMMN in clinical diagnosis and therapy, as well as pay close attention to the feature of EMMN in different emotional cues.

Key words:facial expression,pre-attentive processing,mismatch negativity,N170,oddball paradigm

ReleaseDate:2019-12-28 14:18:56



丁小斌, 康铁君, 赵鑫. (2017). 情绪识别研究中被"冷落"的线索:躯体表情加工的特点、神经基础及加工机制. 心理科学, 40(5), 1084-1090.

丁小斌, 康铁君, 赵鑫, 付军军. (2018). 躯体表情与面部表情加工进程比较. 心理科学进展, 26(3), 423-432.

辛昕, 任桂琴, 李金彩, 唐晓雨. (2017). 早期视听整合加工——来自MMN的证据. 心理科学进展, 25(5), 757-768.

Alves, N. T., Fukusima, S. S., & Aznar-Casanova, J. A., (2008). Models of brain asymmetry in emotional processing. Psychology and Neuroscience, 1(1), 63-66.

Amihai, I., Deouell, L., & Bentin, S. (2011). Conscious awareness is necessary for processing race and gender information from faces. Consciousness and Cognition, 20(2), 269-279.

Arnal, L. H., & Giraud, A. L. (2012). Cortical oscillations and sensory predictions. Trends in Cognitive Sciences, 16(7), 390-398.

Astikainen, P., & Hietanen, J. K. (2009). Event-related potentials to task-irrelevant changes in facial expressions. Behavioral and Brain Functions, 5, 30.

Astikainen, P., Cong, F., Ristaniemi, T., & Hietanen, J. K. (2013). Event-related potentials to unattended changes in facial expressions:Detection of regularity violations or encoding of emotions? Frontiers in Human Neuroscience, 7, 557. doi:10.3389/fnhum.2013.00557

Auksztulewicz, R., & Friston K. (2015). Attentional enhancement of auditory mismatch responses:A DCM/MEG study. Cerebral Cortex, 25(11), 4273-4283.

Borod, J. C., Cicero, B. A., Obler, L. K., Welkowitz, J., Erhan, H. M., Santschi, C.,…Whalen, J. R., (1998). Right hemisphere emotional perception:Evidence across multiple channels. Neuropsychology, 12(3), 446-458.

Bruce, V., & Young, A. (2011). Understanding face recognition. British Journal of Psychology, 77(3), 305-327.

Chang, Y., Xu, J., Shi, N., Zhang, B., & Zhao, L. (2010). Dysfunction of processing task-irrelevant emotional faces in major depressive disorder patients revealed by expression-related visual MMN. Neuroscience Letters, 472(1), 33-37. doi:10.1016/j.neulet. 2010.01.050

Chennu, S., Noreika V., Gueorguiev, D., Shtyrov, Y., Bekinschtein, T. A., & Henson, R. (2016) Silent expectations:dynamic causal modeling of cortical prediction and attention to sounds that weren't. Journal of Neuroscience, 36(32), 8305-8316.

Clark, A. (2015) Surfing uncertainty:prediction, action, and the embodied mind. Oxford:Oxford UP.

Clark, A. (2013). Whatever next? Predictive brains, situated agents, and the future of cognitive science. Behavioral and Brain Sciences, 36(3), 181-204. doi:10.1017/S0140525X12000477

Corcoran, C. M., Stoops, A., Lee, M., Martinez, A., Sehatpour, P., Dias, E. C., & Javitt, D. C. (2017). Developmental trajectory of mismatch negativity and visual event-related potentials in healthy controls:Implications for neurodevelopmental vs. neurodegenerative models of schizophrenia. Schizophrenia Research, 191, 101-108.

Cross, C. P., & Campbell, A. (2011). Women's aggression, Aggression and Violent Behavior, 16(5), 390-398.

Csukly, G., Stefanics, G., Komlosi, S., Czigler, I., & Czobor, P. (2013). Emotion-related visual mismatch responses in schizophrenia:Impairments and correlations with emotion recognition. Plos One, 8(10), e75444. doi:10.1371/journal. pone.0075444

Czigler, I. (2013). Visual mismatch negativity and categorization. Brain Topography, 27(4), 590-598. doi:10.1007/s10548-013-0316-8

Czigler, I., & Pató, L. (2009). Unnoticed regularity violation elicits change-related brain activity. Biological Psychology, 80(3), 339-347. doi:10.1016/j.biopsycho.2008.12.001

Ding, X. B., Liu, J. Y., Kang, T. J., Wang, R., & Kret, M. E. (2019) Automatic Change Detection of Emotional and Neutral Body Expressions:Evidence From Visual Mismatch Negativity. Frontiners in Psychology, 10:1909. doi:10.3389/fpsyg.2019.01909

Farkas, K., Stefanics, G., Marosi, C., & Csukly, G. (2015). Elementary sensory deficits in schizophrenia indexed by impaired visual mismatch negativity. Schizophrenia Research, 166(1-3), 164-170.

Franken, I. H. A., Muris, P., Nijs, I., & Strien, J. W. (2008). Processing of pleasant information can be as fast and strong as unpleasant information:implications for the negativity bias. Netherlands Journal of Psychology, 64(4), 168-176.

Friston, K. (2005). A theory of cortical responses. Philosophical Transactions of the Royal Society B-Biological Sciences, 360(1456), 815-836. doi:10.1098/rstb.2005.1622

Friston, K. (2008). Hierarchical models in the brain. Plos Computational Biology, 4(11), e1000211. doi:10.1371/journal.pcbi.1000211

Friston, K. (2010). The free-energy principle:A unified brain theory. Nature Reviews Neuroscience, 11, 127-138. doi:10.1038/nrn2787

Garrido, M. I., Kilner, J. M., Kiebel, S. J., & Friston, K. J. (2009) Dynamic causal modeling of the response to frequency deviants. Jouranl of Neurophysiology, 101(5), 2620-2631.

Garrido, M. I., Rowe, E. G., Halász, V., & Mattingley, J. B. (2017) Bayesian mapping reveals that attention boosts neural responses to predicted and unpredicted stimuli. Cerebral Cortex, 28(5), 1771-1782.

Gayle, L. C., Gal, D. E., & Kieffaber, P. D. (2012). Measuring affective reactivity in individuals with autism spectrum personality traits using the visual mismatch negativity event-related brain potential. Frontiners in Human Neuroscience, 6, 334. doi:10.3389/fnhum.2012.00334

Iglesias, S., Mathys, C., Brodersen, K. H., Kasper, L., Piccirelli, M., den Ouden, H. E., & Stephan, K. E. (2013) Hierarchical prediction errors in midbrain and basal forebrain during sensory learning. Neuron, 80(2), 519-530.

Jacobsen, T., & Schröger, E. (2001). Is there pre-attentive memory-based comparison of pitch? Psychophysiology, 38(4), 723-727. doi:10.1111/1469-8986.3840723

Jepma, M., Murphy, P. R., Nassar, M. R., Rangel-Gomez, M., Meeter, M., & Nieuwenhuis, S. (2016) Catecholaminergic regulation of learning rate in a dynamic environment. Plos Computational Biology, 12(10), e1005171.

Kiebel, S. J., Daunizeau, J., & Friston, K. (2008). A hierarchy of time-scales and the brain. Plos Computational Biology, 4(11):e1000209. doi:10.1371/journal.pcbi.1000209

Kimura, M., Kondo, H., Ohira, H., & Schröger, E. (2012). Unintentional temporal context-based prediction of emotional faces:an electrophysiological study. Cerebral Cortex, 22(8), 1774-1785. doi:10.1093/cercor/bhr244

Kimura, M., Schröger, E., & Czigler, I. (2011). Visual mismatch negativity and its importance in visual cognitive sciences. Neuroreport, 22(14), 669-673. doi:10.1097/WNR. 0b013e32834973ba

Kohler, C. G., Walker, J. B., Martin, E. A., Healey, K. M., & Moberg, P. J. (2010) Facial emotion perception in schizophrenia:A meta-analytic review. Schizophrenia Bulletin, 36(5), 1009-1019.

Kolossa, A., Kopp, B., & Fingscheidt, T. (2015) A computational analysis of the neural bases of Bayesian inference. Neuroimage, 106, 222-237.

Kovarski, K., Latinus, M., Charpentier, J., Cléry, H., Roux, S., Houy-Durand, E., … Gomot, M. (2017). Facial expression related vMMN:Disentangling emotional from neutral change detection. Frontiers in Human Neuroscience, 11, 18. doi:10.3389/fnhum.2017.00018

Kreegipuu, K., Kuldkepp, N., Sibolt, O., Toom, M., Allik, J., & Näätänen, R. (2013). vMMN for schematic faces:Automatic detection of change in emotional expression. Frontiers in Human Neuroscience, 7, 714. doi:10.3389/fnhum.2013.00714

Kremlácek, J., Kreegipuu, K., Tales, A., Astikainen, P., Põldver, N., Näätänen, R., & Stefanics, G. (2016). Visual mismatch negativity (vMMN):A review and meta-analysis of studies in psychiatric and neurological disorders. Cortex, 80, 76-112. doi:10.1016/j.cortex.2016.03.017

Large, M. E., Cavina-Pratesi, C., Vilis, T., & Culham, J. C. (2008). The neural correlates of change detection in the face perception network. Neuropsychologia, 46(8), 2169-2176.

Lawson, R. P., Mathys, C., & Rees, G. (2017) Adults with autism overestimate the volatility of the sensory environment. Nature Neuroscience, 20, 1293-1299.

Leppanen, J. M. (2006). Emotional information processing in mood disorders:A review of behavioral and neuroimaging findings. Current Opinion in Psychiatry, 19(1), 34-39.

Li, H., Yuan, J., & Lin, C. (2008) The neural mechanism underlying the female advantage in identifying negative emotions:An event-related potential study. Neuroimage, 40(4), 1921-1929

Li, Q., Zhou, S., Zheng, Y., Liu, X., & Zheng, Y. (2018). Female advantage in automatic change detection of facial expressions during a happy-neutral context:An erp study. Frontiers in Human Neuroscience, 12(12), 146.

Li, X., Lu, Y., Sun, G., Gao, L., & Zhao, L. (2012). Visual mismatch negativity elicited by facial expressions:New evidence from the equiprobable paradigm. Behavioral and Brain Functions, 8, 7. doi:10.1186/1744-9081-8-7

Light, G. A., & Braff, D. L. (2005). Mismatch negativity deficits are associated with poor functioning in schizophrenia patients. Archives of General Psychiatry, 62(2), 127-136.

Lithari, C., Frantzidis, C., Papadelis, C., Vivas, A., Klados, M., KourtidouPapadeli, C., & Bamidis, P. (2010) Are females more responsive to emotional stimuli? A neurophysiological study across arousal and valence dimensions. Brain Topography, 23(1), 27-40. doi:10.1007/s10548-009-0130-5

Liu, T., Xiao, T., & Shi, J. (2016). Automatic change detection to facial expressions in adolescents:Evidence from visual mismatch negativity responses. Frontiners in Psychology, 7, 462. doi:10.3389/fpsyg.2016.00462

Liu, T., Xiao, T., Li, X., & Shi, J. (2015). Fluid intelligence and automatic neural processes in facial expression perception:An event-related potential study. Plos One, 10(9):e0138199. doi:10.1371/journal.pone.0138199

Luo, W., Feng, W., He, W., Wang, N. Y., & Luo, Y. J. (2010). Three stages of facial expression processing:ERP study with rapid serial visual presentation. Neuroimage, 49(2), 1857-1867.

Mathys, C. D., Lomakina, E. I., Daunizeau, J., Iglesias, S., Brodersen, K. H., Friston, K. J., & Stephan, K. E. (2014) Uncertainty in perception and the hierarchical gaussian filter. Frontiners Human Neuroscience, 8, 825.

May, P. J. C., & Tiitinen, H. (2010). Mismatch negativity (MMN), the deviance-elicited auditory deflection, explained. Psychophysiology, 47(1), 66-122. doi:10.1111/j. 1469-8986.2009.00856.x

May, P., Tiitinen, H., Ilmoniemi, R. J., Nyman, G., Taylor, J. G., & Näätänen, R. (1999). Frequency change detection in human auditory cortex. Journal of Computational Neuroscience, 6(2), 99-120.

Müller, D., Widmann, A., & Schröger, E. (2013). Object-related regularities are processed automatically:Evidence from the visual mismatch negativity. Frontiners in Human Neuroscience, 7, 259. doi:10.3389/fnhum.2013.00259

Näätänen, R., Paavilainen, P., Rinne, T., & Alho, K. (2007). The mismatch negativity (MMN) in basic research of central auditory processing:A review. Clinical Neurophysiology, 118(12), 2544-2590. doi:10.1016/j.clinph.2007.04.026

Näätänen, R., Tervaniemi, M., Sussman, E., Paavilainen, P., & Winkler, I. (2001). "Primitive intelligence" in the auditory cortex. Trends in Neurosciences, 24(5), 283-288. doi:10.1016/S0166-2236(00)01790-2

Persad, S. M., & Polivy, J. (1993). Differences between depressed and nondepressed individuals in the recognition of and response to facial emotional cues. Journal of Abnormal Psychology, 102(3), 358-368.

Phillips, H. N., Blenkmann, A., Hughes, L. E., Bekinschtein, T. A., & Rowe, J. B. (2015). Hierarchical organization of frontotemporal networks for the prediction of stimuli across multiple dimensions. Journal of Neuroscience, 35(25), 9255-9264.

Powers, A. R., Mathys, C., & Corlett, P. R. (2017). Pavlovian conditioning-induced hallucinations result from overweighting of perceptual priors. Science, 357(6351), 596-600.

Rao, R. P., & Ballard, D. H. (1999). Predictive coding in the visual cortex:A functional interpretation of some extra-classical receptive-field effects. Nature Neuroscience, 2, 79-87.

Schwartenbeck, P., FitzGerald, T. H., Mathys, C., Dolan, R., & Friston, K. (2015). The dopaminergic midbrain encodes the expected certainty about desired outcomes. Cerebral Cortex, 25(10), 3434-3445.

Shtyrov, Y., Goryainova, G., Tugin, S., Ossadtchi, A., & Shestakova, A. (2013). Automatic processing of unattended lexical information in visual oddball presentation:neurophysiological evidence. Frontiners in Human Neuroscience, 7, 421. doi:10.3389/fnhum.2013.00421

Simons, D. J., & Levin, D. T. (1997). Change blindness. Trends in Cognitive Sciences, 1(7), 261-267.

Simons, D. J., & Rensink, R. A. (2005). Change blindness:past, present, and future. Trends in Cognitive Sciences, 9(1), 16-20. doi:10.1016/j.tics.2004.11.006

Soshi, T., Noda, T., Ando, K., Nakazawa, K., Tsumura, H., & Okada, T. (2015). Neurophysiological modulation of rapid emotional face processing is associated with impulsivity traits. BMC Neuroscience, 16, 87. doi:10.1186/s12868-015-0223-x

Stefanics, G., Csukly, G., Komlósi, S., Czobor, P., & Czigler, I. (2012). Processing of unattended facial emotions:a visual mismatch negativity study. Neuroimage, 59(3), 3042-3049. doi:10.1016/j.neuroimage.2011.10.041

Stefanics, G., Heinzle, J., Horváth, A. A., & Stephan, K. E. (2018). Visual mismatch and predictive coding:A computational single-trial erp study. The Journal of Neuroscience, 38(16), 4020-4030.

Stefanics, G., Kremlácek, J., & Czigler, I. (2014). Visual mismatch negativity:A predictive coding view. Frontiers in Human Neuroscience, 8, 666. doi:10.3389/fnhum.2014.00666

Stephan, K. E., Baldeweg, T., & Friston, K. J. (2006) Synaptic plasticity and dysconnection in schizophrenia. Biological Psychiat, 59(10), 929-939.

Sulykos, I., & Czigler, I. (2011). One plus one is less than two:Visual features elicit non-additive mismatch-related brain activity. Brain Research, 1398, 64-71. doi:10.1016/j. brainres. 2011.05.009

Susac, A., Ilmoniemi, R. J., Pihko, E., & Supek, S. (2004). Neurodynamic studies on emotional and inverted faces in an oddball paradigm. Brain Topography, 16(4), 265-268. doi:10.1023/B:BRAT.0000032863.39907.cb

Susac, A., Ilmoniemi, R. J., Pihko, E., Ranken, D., & Supek, S. (2010). Early cortical responses are sensitive to changes in face stimuli. Brain Research, 1346, 155-164. doi:10.1016/j.brainres.2010.05.049

Tang, D., Xu, J., Chang, Y., Zheng, Y., Shi, N., Pang, X., & Zhang, B. (2013). Visual mismatch negativity in the detection of facial emotions in patients with panic disorder. Neuroreport, 24(5), 207-211. doi:10.1097/WNR.0b013e32835eb63a

Thierry, G., Athanasopoulos, P., Wiggett, A., Dering, B., & Kuipers, J. R. (2009). Unconscious effects of language-specific terminology on preattentive color perception. Proceedings of the National Academy of Sciences of the United States of America, 106(11), 4567-4570. doi:10.1073/pnas.0811155106

Todorovic, A., & de Lange, F. P. (2012). Repetition suppression and expectation suppression are dissociable in time in early auditory evoked fields. Journal of Neuroscience, 32(39), 13389-13395. doi:10.1523/JNEUROSCI.2227-12.2012

Vogel, B. O., Shen, C., & Neuhaus, A. H. (2015). Emotional context facilitates cortical prediction error responses. Human Brain Mapping, 36(9), 3641-3652. doi:10.1002/hbm.22868

Vossel, S., Mathys, C., Stephan, K. E., & Friston, K. J. (2015). Cortical coupling reflects Bayesian belief updating in the deployment of spatial attention. Jouranl of Neuroscience, 35(33), 11532-11542.

Wacongne, C., Labyt, E., van Wassenhove, V., Bekinschtein, T., Naccache, L., & Dehaene, S. (2011). Evidence for a hierarchy of predictions and prediction errors in human cortex. Proceedings of the National Academy of Sciences of the United States of America, 108(51), 20754-20759.

Wang, S., Li, W., Lv, B., Chen, X., Liu, Y., & Jiang, Z. (2016). ERP comparison study of face gender and expression processing in unattended condition. Neuroscience Letters, 618, 39-44. doi:10.1016/j.neulet. 2016.02.039

Wang, X. J. (2010). Neurophysiological and computational principles of cortical rhythms in cognition. Physiological Reviews, 90(3), 1195-1268. doi:10.1152/physrev.00035.2008

Wei, J. H., Chan, T. C., & Luo, Y. J. (2002). A modified oddball paradigm "cross-modal delayed response" and the research on mismatch negativity. Brain Research Bulletin, 57(2), 221-230. doi:10.1016/S0361-9230(01)00742-0

Winkler, I., & Czigler, I. (2012). Evidence from auditory and visual event-related potential (ERP) studies of deviance detection (MMN and vMMN) linking predictive coding theories and perceptual object representations. International Journal of Psychophysiology, 83(2), 132-143. doi:10.1016/j.ijpsycho.2011.10.001

Wu, Z., Zhong, X., Peng, Q., Chen, B., Mai, N., & Ning, Y. (2017). Negative bias in expression-related mismatch negativity (mmn) in remitted late-life depression:an event-related potential study. Journal of Psychiatric Research, 95, 224-230.

Xu, Q., Yang, Y., Wang, P., Sun, G., & Zhao, L. (2013). Gender differences in preattentive processing of facial expressions:An ERP study. Brain Topography, 26(3), 488-500. doi:10.1007/s10548-013-0275-0

Yin, G. M., She, S. L., Zhao, L., & Zheng, Y. J. (2018). The dysfunction of processing emotional faces in schizophrenia revealed by expression-related visual mismatch negativity. Neuroreport, 29(10), 814-818.

Zhao, L., & Li, J. (2006). Visual mismatch negativity elicited by facial expressions under non-attentional condition. Neuroscience Letters, 410(2), 126-131. doi:10.1016/j. neulet. 2006.09.081