DOI: 10.3724/SP.J.1042.2017.00933

Advances in Psychological Science (心理科学进展) 2017/25:6 PP.933-942

Application of virtual reality technology in assessment of executive function

Executive function reflects an individual's ability to regulate and introspect on his/her cognitive processes. The assessment of executive function plays an important role in the evaluation of cognitive development in children and cognitive impairment in special groups. Although assessment of executive function has been studied and developed since the early 20th century, traditional measuring tools remain unsatisfactory in many aspects such as poor ecological validity and uncontrollable environments and participants' arousal levels. Virtual reality (VR) technology demonstrated remarkable advantages in generating high ecological validity testing scenario with limited cost and has been developed very fast in recent years. This paper reviews recent progress in applying VR to the assessment of executive function and discusses the future trends in improving VR-based executive function assessments.

Key words:executive function,virtual reality,neuropsychological assessment,ecological validity

ReleaseDate:2017-08-07 10:18:52

陈雁飞, 马建民, 高丽. (2004). 虚拟现实技术综述. 机械制造与自动化, 33, 5-7, 10.

李红, 高山, 王乃弋. (2004). 执行功能研究方法评述. 心理科学进展, 12, 693-705.

路海涛, 李刚, 罗晶. (2011). 基于虚拟现实的海军飞行员动态视觉能力测试系统研究. 医疗卫生装备, 32, 23-24, 31.

栾悉道, 谢毓湘, 吴玲达, 宋玉强, 农海斌. (2003). 虚拟现实技术在军事中的新应用. 系统仿真学报, 15, 604-607.

徐芬, 王卫星, 高山, Sabbagh, M. (2003). 幼儿心理理论水平及其与抑制控制发展的关系. 心理发展与教育, 19, 7-11.

赵沁平. (2009). 虚拟现实综述. 中国科学 F辑:信息科学, 39, 2-46.

郑霞, Sauseon, H., 周明全, N'kaoua, B. (2010). 虚拟现实技术应用于神经心理评估的研究概述. 心理科学进展, 18, 511-521.

周晓林. (2004). 执行控制:一个具有广阔理论前途和应用前景的研究领域. 心理科学进展, 12, 641-642.

Adams, R., Finn, P., Moes, E., Flannery, K., & Rizzo, A. S. (2009). Distractibility in attention/deficit/hyperactivity disorder (ADHD):The virtual reality classroom. Child Neuropsychology, 15, 120-135.

Anderson, P. L., Price, M., Edwards, S. M., Obasaju, M. A., Schmertz, S. K., Zimand, E., & Calamaras, M. R. (2013). Virtual reality exposure therapy for social anxiety disorder:A randomized controlled trial. Journal of Consulting and Clinical Psychology, 81, 751-760.

Armstrong, C. M., Reger, G. M., Edwards, J., Rizzo, A. A., Courtney, C. G., & Parsons, T. D. (2013). Validity of the virtual reality stroop task (VRST) in active duty military. Journal of Clinical and Experimental Neuropsychology, 35, 113-123.

Aubin, G., Béliveau, M.-F., & Klinger, E. (2015). An exploration of the ecological validity of the virtual action planning-supermarket (VAP-S) with people with schizophrenia. Neuropsychological Rehabilitation, doi:10.1080/09602011.2015.1074083

Bekele, E., Zheng, Z., Swanson, A., Crittendon, J., Warren, Z., & Sarkar, N. (2013). Understanding how adolescents with autism respond to facial expressions in virtual reality environments. IEEE Transactions on Visualization and Computer Graphics, 19, 711-720.

Besnard, J., Richard, P., Banville, F., Nolin, P., Aubin, G., Le Gall, D.,... Allain, P. (2016). Virtual reality and neuropsychological assessment:The reliability of a virtual kitchen to assess daily-life activities in victims of traumatic brain injury. Applied Neuropsychology:Adult, 23, 223-235.

Bioulac, S., Lallemand, S., Rizzo, A., Philip, P., Fabrigoule, C., & Bouvard, M. P. (2012). Impact of time on task on ADHD patient's performances in a virtual classroom. European Journal of Paediatric Neurology, 16, 514-521.

Burdea, G. C. (1999). Invited review:The synergy between virtual reality and robotics. IEEE Transactions on Robotics and Automation, 15, 400-410.

Burdea, G. C., & Coiffet, P. (2003). Virtual reality technology. Hoboken, N.J.:John Wiley & Sons Publication.

Burgess, P. W. (2003). Assessment of executive function. In Handbook of clinical neuropsychology (pp. 302-321). Oxford, Britain:Oxford University Press.

Burgess, P. W., Alderman, N., Evans, J., Emslie, H., & Wilson, B. A. (1998). The ecological validity of tests of executive function. Journal of the international neuropsychological society, 4, 547-558.

Canty, A. L., Fleming, J., Patterson, F., Green, H. J., Man, D., & Shum, D. H. (2014). Evaluation of a virtual reality prospective memory task for use with individuals with severe traumatic brain injury. Neuropsychological Rehabilitation, 24, 238-265.

Cao, X., Douguet, A. S., Fuchs, P., & Klinger, E. (2010, August). Designing an ecological virtual task in the context of executive functions:Preliminary study. In Proceedings of the 8th international conference on disability, virtual reality and associated technologies, (pp. 71-77). Viña del Mar/Valparaíso, Chile:IEEE.

Cipresso, P., La Paglia, F., La Cascia, C., Riva, G., Albani, G., & La Barbera, D. (2013). Break in volition:A virtual reality study in patients with obsessive-compulsive disorder. Experimental Brain Research, 229, 443-449.

Cohen, J. R., Asarnow, R. F., Sabb, F. W., Bilder, R. M., Bookheimer, S. Y., Knowlton, B. J., & Poldrack, R. A. (2011). Decoding continuous variables from neuroimaging data:Basic and clinical applications. Frontiers in Neuroscience, 5, 75.

Diaz-Orueta, U., Iriarte, Y., Climent, G., & Banterla, F. (2012). AULA:An ecological virtual reality test with distractors for evaluating attention in children and adolescents. Virtual Reality and Scientific Visualization Journal, 5, 1-20.

Elkind, J. S., Rubin, E., Rosenthal, S., Skoff, B., & Prather, P. (2001). A simulated reality scenario compared with the computerized Wisconsin card sorting test:An analysis of preliminary results. CyberPsychology & Behavior, 4, 489-496.

Fimm, B., Willmes, K., & Spijkers, W. (2015). Differential effects of lowered arousal on covert and overt shifts of attention. Journal of the International Neuropsychological Society, 21, 545-557.

Gorini, A., Pallavicini, F., Algeri, D., Repetto, C., Gaggioli, A., & Riva, G. (2010). Virtual reality in the treatment of generalized anxiety disorders. Studies in Health Technology and Informatics, 154, 39-43.

Guez, J., Saar-Ashkenazy, R., Mualem, L., Efrati, M., & Keha, E. (2015). Negative emotional arousal impairs associative memory performance for emotionally neutral content in healthy participants. PLoS One, 10, e0132405.

Gutiérrez-Maldonado, J., Rus-Calafell, M., & González-Conde, J. (2014). Creation of a new set of dynamic virtual reality faces for the assessment and training of facial emotion recognition ability. Virtual Reality, 18, 61-71.

Han, K., Kim, I. Y., & Kim, J.-J. (2012). Assessment of cognitive flexibility in real life using virtual reality:A comparison of healthy individuals and schizophrenia patients. Computers in Biology and Medicine, 42, 841-847.

Hanten, G., Cook, L., Orsten, K., Chapman, S. B., Li, X. Q., Wilde, E. A.,... Levin, H. S. (2011). Effects of traumatic brain injury on a virtual reality social problem solving task and relations to cortical thickness in adolescence. Neuropsychologia, 49, 486-497.

Henry, M., Joyal, C. C., & Nolin, P. (2012). Development and initial assessment of a new paradigm for assessing cognitive and motor inhibition:The bimodal virtual-reality Stroop. Journal of Neuroscience Methods, 210, 125-131.

Isquith, P. K., Crawford, J. S., Espy, K. A., & Gioia, G. A. (2005). Assessment of executive function in preschool-aged children. Mental Retardation and Developmental Disabilities Research Reviews, 11, 209-215.

Jacoby, M., Averbuch, S., Sachar, Y., Weiss, P. L., Kizony, R., Katz, N., Kizony, R. (2011, June). Effectiveness of executive functions training within a virtual supermarket for adults with traumatic brain injury. In Proceedings of 2011 international conference on virtual rehabilitation (pp. 1-7). Zurich, Switzerland:IEEE.

Jansari, A. S., Devlin, A., Agnew, R., Akesson, K., Murphy, L., & Leadbetter, T. (2014). Ecological assessment of executive functions:A new virtual reality paradigm. Brain Impairment, 15, 71-87.

Josman, N., Kizony, R., Hof, E., Goldenberg, K., Weiss, P. L., & Klinger, E. (2014). Using the virtual action planning-supermarket for evaluating executive functions in people with stroke. Journal of Stroke and Cerebrovascular Diseases, 23, 879-887.

Josman, N., Schenirderman, A. E., Klinger, E., & Shevil, E. (2009). Using virtual reality to evaluate executive functioning among persons with schizophrenia:A validity study. Schizophrenia Research, 115, 270-277.

Jovanovski, D., Zakzanis, K., Campbell, Z., Erb, S., & Nussbaum, D. (2012). Development of a novel, ecologically oriented virtual reality measure of executive function:The Multitasking in the City Test. Applied Neuropsychology:Adult, 19, 171-182.

Kandalaft, M. R., Didehbani, N., Krawczyk, D. C., Allen, T. T., & Chapman, S. B. (2013). Virtual reality social cognition training for young adults with high-functioning autism. Journal of Autism and Developmental Disorders, 43, 34-44.

Klinger, E., Chemin, I., Lebreton, S., & Marié, R.-M. (2006). Virtual action planning in Parkinson's disease:A control study. Cyberpsychology & Behavior, 9, 342-347.

Knight, C., Alderman, N., & Burgess, P. W. (2002). Development of a simplified version of the multiple errands test for use in hospital settings. Neuropsychological Rehabilitation, 12, 231-255.

Kochanska, G., Murray, K., Jacques, T. Y., Koenig, A. L., & Vandegeest, K. A. (1996). Inhibitory control in young children and its role in emerging internalization. Child Development, 67, 490-507.

Krch, D., Nikelshpur, O., Lavrador, S., Chiaravalloti, N. D., Koenig, S., & Rizzo, A. (2013, August). Pilot results from a virtual reality executive function task. In Proceedings of the 2013 international conference on virtual rehabilitation (ICVR) (pp. 15-21). Philadelphia, PA:IEEE.

Lahiri, U., Bekele, E., Dohrmann, E., Warren, Z., & Sarkar, N. (2013). Design of a virtual reality based adaptive response technology for children with autism. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 21, 55-64.

Lalonde, G., Henry, M., Drouin-Germain, A., Nolin, P., & Beauchamp, M. H. (2013). Assessment of executive function in adolescence:A comparison of traditional and virtual reality tools. Journal of Neuroscience Methods, 219, 76-82.

Law, A. S., Trawley, S. L., Brown, L. A., Stephens, A. N., & Logie, R. H. (2013). The impact of working memory load on task execution and online plan adjustment during multitasking in a virtual environment. The Quarterly Journal of Experimental Psychology, 66, 1241-1258.

Logan, G. D. (1994). On the ability to inhibit thought and action:A users' guide to the stop signal paradigm. In D. Dagenbach & T. H. Carr (Eds.), Inhibitory processes in attention, memory, and language (pp. 189-239). San Diego, CA, US:Academic Press.

Motraghi, T. E., Seim, R. W., Meyer, E. C., & Morissette, S. B. (2014). Virtual reality exposure therapy for the treatment of posttraumatic stress disorder:A methodological review using CONSORT guidelines. Journal of Clinical Psychology, 70, 197-208.

Negut, A., Matu, S.-A., Sava, F. A., & David, D. (2015). Convergent validity of virtual reality neurocognitive assessment:A meta-analytic approach. Transylvanian Journal of Psychology, 16, 31-55.

Neguţ, A., Matu, S.-A., Sava, F. A., & David, D. (2016a). Task difficulty of virtual reality-based assessment tools compared to classical paper-and-pencil or computerized measures:A meta-analytic approach. Computers in Human Behavior, 54, 414-424.

Neguț, A., Matu, S.-A., Sava, F. A., & David, D. (2016b). Virtual reality measures in neuropsychological assessment:A meta-analytic review. Clinical Neuropsychologist, 30, 165-184.

Nolin, P., Stipanicic, A., Henry, M., Lachapelle, Y., Lussier-Desrochers, D., Rizzo, A., & Allain, P. (2016). ClinicaVR:Classroom-CPT:A virtual reality tool for assessing attention and inhibition in children and adolescents. Computers in Human Behavior, 59, 327-333.

Parsons, T. D., Bowerly, T., Buckwalter, J. G., & Rizzo, A. A. (2007). A controlled clinical comparison of attention performance in children with ADHD in a virtual reality classroom compared to standard neuropsychological methods. Child Neuropsychology, 13, 363-381.

Parsons, T. D., Carlew, A. R., Magtoto, J., & Stonecipher, K. (2015). The potential of function-led virtual environments for ecologically valid measures of executive function in experimental and clinical neuropsychology. Neuropsychological Rehabilitation, doi:10.1080/09602011.2015.1109524

Parsons, T. D., Courtney, C. G., & Dawson, M. E. (2013). Virtual reality Stroop task for assessment of supervisory attentional processing. Journal of Clinical and Experimental Neuropsychology, 35, 812-826.

Parsons, T. D., & Reinebold, J. L. (2012). Adaptive virtual environments for neuropsychological assessment in serious games. IEEE Transactions on Consumer Electronics, 58, 197-204.

Pollak, Y., Shomaly, H. B., Weiss, P. L., Rizzo, A. A., & Gross-Tsur, V. (2010). Methylphenidate effect in children with ADHD can be measured by an ecologically valid continuous performance test embedded in virtual reality. CNS Spectrums, 15, 125-130.

Price, M., Mehta, N., Tone, E. B., & Anderson, P. L. (2011). Does engagement with exposure yield better outcomes? Components of presence as a predictor of treatment response for virtual reality exposure therapy for social phobia. Journal of Anxiety Disorders, 25, 763-770.

Rajendran, G., Law, A. S., Logie, R. H., van Der Meulen, M., Fraser, D., & Corley, M. (2011). Investigating multitasking in high-functioning adolescents with autism spectrum disorders using the Virtual Errands Task. Journal of Autism and Developmental Disorders, 41, 1445-1454.

Ready, D. J., Geradi, R. J., Backscheider, A. G., Mascaro, N., & Rothbaum, B. O. (2010). Comparing virtual reality exposure therapy to present-centered therapy with 11 U.S. Vietnam veterans with PTSD. Cyberpsychology, Behavior, and Social Networking, 13, 49-54.

Reger, G. M., Gahm, G. A., Rizzo, A. A., Swanson, R., & Duma, S. (2009). Soldier evaluation of the virtual reality Iraq. Telemedicine and e-Health, 15, 101-104.

Renison, B., Ponsford, J., Testa, R., Richardson, B., & Brownfield, K. (2012). The ecological and construct validity of a newly developed measure of executive function:The Virtual Library Task. Journal of the International Neuropsychological Society, 18, 440-450.

Repetto, C., & Riva, G. (2011). From virtual reality to interreality in the treatment of anxiety disorders. Neuropsychiatry, 1, 31-43.

Rizzo, A., Difede, J., Rothbaum, B. O., Reger, G., Spitalnick, J., Cukor, J., & Mclay, R. (2010). Development and early evaluation of the Virtual Iraq/Afghanistan exposure therapy system for combat-related PTSD. Annals of the New York Academy of Sciences, 1208, 114-125.

Shallice, T. I. M., & Burgess, P. W. (1991). Deficits in strategy application following frontal lobe damage in man. Brain, 114, 727-741.

Shine, J. M., Matar, E., Ward, P. B., Bolitho, S. J., Pearson, M., Naismith, S. L., & Lewis, S. J. G. (2013). Differential neural activation patterns in patients with Parkinson's disease and freezing of gait in response to concurrent cognitive and motor load. PLoS One, 8, e52602.

Soranzo, A., & Wilson, C. J. (2014). A case for the development and use of virtual reality measures for assessment of executive function. In P. Cipresso & S. Serino (Eds.), Virtual reality:Technologies, medical applications and challenges (pp. 117-193). New York:Nova Science Publishers, Inc..

Stroop, J. R. (1935). Studies of interference in serial verbal reactions. Journal of Experimental Psychology, 18, 643-662.

Sweeney, S., Kersel, D., Morris, R. G., Manly, T., & Evans, J. J. (2010). The sensitivity of a virtual reality task to planning and prospective memory impairments:Group differences and the efficacy of periodic alerts on performance. Neuropsychological Rehabilitation, 20, 239-263.

Walton, J., Bonner, D., Walker, K., Mater, S., Dorneich, M., Gilbert, S., & West, R. (2015, February). The team multiple errands test:A platform to evaluate distributed teams. In Proceedings of the 18th ACM conference companion on computer supported cooperative work & social computing (pp. 247-250). New York, NY, USA:ACM.

Werner, P., Rabinowitz, S., Klinger, E., Korczyn, A. D., & Josman, N. (2009). Use of the virtual action planning supermarket for the diagnosis of mild cognitive impairment. Dementia and Geriatric Cognitive Disorders, 27, 301-309.

Wu, D. R., Courtney, C. G., Lance, B. J., Narayanan, S. S., Dawson, M. E., Oie, K. S., & Parsons, T. D. (2010). Optimal arousal identification and classification for affective computing using physiological signals:Virtual reality Stroop task. IEEE Transactions on Affective Computing, 1, 109-118.