DOI: 10.3724/SP.J.1042.2019.00611

Advances in Psychological Science (心理科学进展) 2019/27:4 PP.611-622

The cognitive mechanism of haptic recognition of two-dimension images

The two-dimension tactile image is the main approach of translating visual information into haptic information. It plays an important role in helping visually impaired people perceive the external world. The recognition of haptic two-dimension image is considered to be based on the "visual translation" process where the haptic input is translated into the visual image. This process is influenced by the graphic geometric feature, perspective, visual experience, capability of visual representation, the process of tactile exploration, training and age. Exploration of the cognitive neural mechanism of two-dimension images haptic recognition is significant for improving the design and usability of two-dimension tactile images.

Key words:two-dimension tactile images,touch,haptic perception,visually impaired people

ReleaseDate:2019-04-26 01:27:54

谌小猛, 李闻戈. (2016). 触觉地图辅助盲人建构陌生环境空间表征的研究. 中国特殊教育, (9), 36-42.

龚江涛, 於文苑, 曲同, 刘烨, 傅小兰, 徐迎庆. (2018). 影响触觉图像识别因素的量化分析. 计算机辅助设计与图形学学报, 30(8), 1438-1445.

焦阳, 龚江涛, 史元春, 徐迎庆. (2016). 盲人触觉图形显示器的交互体验研究. 计算机辅助设计与图形学学报, 28(9), 1571-1576.

焦阳, 龚江涛, 徐迎庆. (2016). 盲人触觉图像显示器Graille设计研究. 装饰, (1), 94-96.

杨光, 钟经华, 董晶. (2017). 浅谈视障教学中触觉图形的认知. 现代特殊教育, (23), 59-61.

张蕾, 刘建英. (2014). 盲校地理课程触觉地图的开发与应用研究. 中国特殊教育, (3), 24-29.

周丽丽, 姚欣茹, 汤征宇, 任巧悦, 吕雪靖, 胡理. (2017). 触觉信息处理及其脑机制. 科技导报, 35(19), 37-43.

Amedi, A., Jacobson, G., Hendler, T., Malach, R., & Zohary, E. (2002). Convergence of visual and tactile shape processing in the human lateral occipital complex. Cerebral Cortex, 12(11), 1202-1212.

Barros, P., Maciel-Junior, N. T., Fernandes, B. J. T., Bezerra, B. L. D., & Fernandes, S. M. M. (2017). A dynamic gesture recognition and prediction system using the convexity approach. Computer Vision and Image Understanding, 155, 139-149.

Bauer, C., Yazzolino, L., Hirsch, G., Cattaneo, Z., Vecchi, T., & Merabet, L. B. (2015). Neural correlates associated with superior tactile symmetry perception in the early blind. Cortex, 63, 104-117.

Baumgartner, E., Wiebel, C. B., & Gegenfurtner, K. R. (2015). A comparison of haptic material perception in blind and sighted individuals. Vision Research, 115, 238-245.

Behrmann, M., & Ewell, C. (2003). Expertise in tactile pattern recognition. Psychological Science, 14(5), 480-486.

Bellik, Y., & Clavel, C. (2017). Geometrical shapes rendering on a dot-matrix display. International Conference on Intelligent Human Computer Interaction (pp. 8-18). Springer, Cham.

Bouaziz, S., Russier, S., & Magnan, A. (2005). The copying of complex geometric drawings by sighted and visually impaired children. Journal of Visual Impairment & Blindness, 99(12), 765-774.

Brock, A. M., Truillet, P., Oriola, B., Picard, D., & Jouffrais, C. (2015). Interactivity improves usability of geographic maps for visually impaired people. Human-Computer Interaction, 30(2), 156-194.

Cattaneo, Z., Vecchi, T., Cornoldi, C., Mammarella, I., Bonino, D., Ricciardi, E., & Pietrini, P. (2008). Imagery and spatial processes in blindness and visual impairment. Neuroscience and Biobehavioral Reviews, 32(8), 1346-1360.

Cattaneo, Z., Vecchi, T., Monegato, M., Pece, A., & Cornoldi, C. (2007). Effects of late visual impairment on mental representations activated by visual and tactile stimuli. Brain Research, 1148, 170-176.

Cecchetto, S., & Lawson, R. (2017). Regularity detection by haptics and vision. Journal of Experimental Psychology Human Perception & Performance, 43(1), 103.

Chang, D., Nesbitt, K. V., & Wilkins, K. (2007). The Gestalt principles of similarity and proximity apply to both the haptic and visual grouping of elements. Paper presented at the Eight Australasian User Interface Conference (AUIC2007), Ballarat, Australia.

Cornoldi, C., Tinti, C., Mammarella, I. C., Re, A. M., & Varotto, D. (2009). Memory for an imagined pathway and strategy effects in sighted and in totally congenitally blind individuals. Acta Psychologica, 130(1), 11-16.

Gallace, A., & Spence, C. (2011). To what extent do gestalt grouping principles influence tactile perception? Psychological Bulletin, 137(4), 538-561.

Grunwald, M., Muniyandi, M., Kim, H., Kim, J., Krause, F., Mueller, S., & Srinivasan, M. A. (2014). Human haptic perception is interrupted by explorative stops of milliseconds. Front Psychol, 5(4), 292.

Gual, J., Puyuelo, M., & Lloveras, J. (2015). The effect of volumetric (3D) tactile symbols within inclusive tactile maps. Applied Ergonomics, 48, 1-10.

Hatwell, Y., Streri, A., & Gentaz, E. (2003). Touching for knowing:Cognitive psychology of haptic manual perception, John Benjamins Pub.

Heller, M. A., Brackett, D. D., Scroggs, E., Steffen, H., Heatherly, K., & Salik, S. (2002). Tangible pictures:Viewpoint effects and linear perspective in visually impaired people. Perception, 31(6), 747-769.

Heller, M. A., Kennedy, J. M., Clark, A., McCarthy, M., Borgert, A., Wemple, L.,... Riddle, T. (2006). Viewpoint and orientation influence picture recognition in the blind. Perception, 35(10), 1397-1420.

Heller, M. A., McCarthy, M., & Clark, A. (2005). Pattern perception and pictures for the blind. Psicologica, 26(1),161-171.

Heller, M. A., Riddle, T., Fulkerson, E., Wemple, L., Walk, A. M., Guthrie, S.,... Klaus, P. (2009). The influence of viewpoint and object detail in blind people when matching pictures to complex objects. Perception, 38(8), 1234-1250.

Kaas, A. L., van Mier, H., Visser, M., & Goebel, R. (2013). The neural substrate for working memory of tactile surface texture. Human Brain Mapping, 34(5), 1148-1162.

Kalia, A., Hopkins, R., Jin, D., Yazzolino, L., Verma, S., Merabet, L.,... Sinha, P. (2014). Perception of tactile graphics:Embossings versus cutouts. Multisensory Research, 27(2), 111-125.

Kalia, A. A., & Sinha, P. (2012). Tactile Picture Recognition:Errors are in shape acquisition or object matching? Seeing and Perceiving, 25(3-4), 287-302.

Kappers, A. M. L., & Tiest, W. M. B. (2013). Haptic perception. Wiley Interdisciplinary Reviews-Cognitive Science, 4(4), 357-374.

Kennedy, J. M., & Juricevic, I. (2006). Foreshortening, convergence and drawings from a blind adult. Perception, 35(6), 847-851.

Klatzky, R. L., & Lederman, S. J. (1988). The intelligent hand. Psychology of Learning & Motivation, 21, 121-151.

Ku, Y., Zhao, D., Bodner, M., & Zhou, Y-D. (2015). Cooperative processing in primary somatosensory cortex and posterior parietal cortex during tactile working memory. European Journal of Neuroscience, 42(3), 1905-1911.

Lacey, S., & Lawson, R. (2013). Multisensory Imagery. Springer.

Lacey, S., & Sathian, K. (2014). Visuo-haptic multisensory object recognition, categorization, and representation. Frontiers in Psychology, 5.

Lacey, S., Stilla, R., Sreenivasan, K., Deshpande, G., & Sathian, K. (2014). Spatial imagery in haptic shape perception. Neuropsychologia, 60, 144-158.

Lebaz, S., Jouffrais, C., & Picard, D. (2012). Haptic identification of raised-line drawings:High visuospatial imagers outperform low visuospatial imagers. Psychological Research-Psychologische Forschung, 76(5), 667-675.

Lebaz, S., Picard, D., & Jouffrais, C. (2010). Haptic recognition of non-figurative tactile pictures in the blind:Does life-time proportion without visual experience matter? Haptics:Generating and Perceiving Tangible Sensations, Pt Ii, Proceedings, 65(5), 412-417.

Lederman, S. J., Klatzky, R. L., Chataway, C., & Summers, C. D. (1990). Visual mediation and the haptic recognition of 2-dimensional pictures of common objects. Perception & Psychophysics, 47(1), 54-64.

Longo, M. R., & Golubova, O. (2017). Mapping the internal geometry of tactile space. Journal of Experimental Psychology-Human Perception and Performance, 43(10), 1815-1827.

Loomis, J. M., Klatzky, R. L., & Lederman, S. J. (1991). Similarity of tactual and visual picture recognition with limited field of view. Perception, 20(2), 167-177.

Mazella, A., Albaret, J. M., & Picard, D. (2014). Haptic tests for use with children and adults with visual impairments:A literature review. Journal of Visual Impairment & Blindness, 108(108), 227-237.

Mazella, A., Albaret, J-M., & Picard, D. (2016). Haptic-2D:A new haptic test battery assessing the tactual abilities of sighted and visually impaired children and adolescents with two-dimensional raised materials. Research in Developmental Disabilities, 48, 103-123.

Mazella, A., Albaret, J-M., & Picard, D. (2018). The development of haptic processing skills from childhood to adulthood by means of two-dimensional materials. Canadian Journal of Experimental Psychology-Revue Canadienne De Psychologie Experimentale, 72(1), 48-57.

Memeo, M., Campus, C., & Brayda, L. (2014). Do blind subjects differ from sighted subjects when exploring virtual tactile maps? Computers Helping People with Special Needs, Icchp 2014, 8548, 12-17.

Morash, V. S., Pensky, A. E. C., Tseng, S. T. W., & Miele, J. A. (2014). Effects of using multiple hands and fingers on haptic performance in individuals who are blind. Perception, 43(6), 569-588.

Overvliet, K. E., & Krampe, R. T. (2018). Haptic two-dimensional shape identification in children, adolescents, and young adults. Journal of Experimental Child Psychology, 166, 567-580.

Overvliet, K. E., Krampe, R. T., & Wagemans, J. (2012). Perceptual grouping in haptic search:The influence of proximity, similarity, and good continuation. Journal of Experimental Psychology-Human Perception and Performance, 38(4), 817-821.

Overvliet, K. E., Wagemans, J., & Krampe, R. T. (2013). The effects of aging on haptic 2D shape recognition. Psychology and Aging, 28(4), 1057-1069.

Pawluk, D. T., Adams, R. J., & Kitada, R. (2015). Designing haptic assistive technology for individuals who are blind or visually impaired. Ieee Transactions on Haptics, 8(3), 258-278.

Picard, D., Albaret, J. M., & Mazella, A. (2013). Haptic identification of raised-line drawings by children, adolescents and young adults. Haptics-e, 5(2), 24-28.

Picard, D., Albaret, J-M., & Mazella, A. (2014). Haptic identification of raised-line drawings when categorical information is given:A comparison between visually impaired and sighted children. Psicologica, 35(2), 277-290.

Picard, D., Lebaz, S., Jouffrais, C., & Monnier, C. (2010). Haptic recognition of two-dimensional raised-line patterns by early-blind, late-blind, and blindfolded sighted adults. Perception, 39(2), 224-235.

Picard, D., & Monnier, C. (2009). Short-term memory for spatial configurations in the tactile modality:A comparison with vision. Memory, 17(8), 789-801.

Rastogi, R., Pawluk, T. V. D., & Ketchum, J. (2013). Intuitive tactile zooming for graphics accessed by individuals who are blind and visually impaired. Ieee Transactions on Neural Systems and Rehabilitation Engineering, 21(4), 655-663.

Saal, H. P., & Bensmaia, S. J. (2014). Touch is a team effort:Interplay of submodalities in cutaneous sensibility. Trends in Neurosciences, 37(12), 689-697.

Sathian, K. (2016). Analysis of haptic information in the cerebral cortex. Journal of Neurophysiology, 116(4), 1795-1806.

Segond, H., Weiss, D., Kawalec, M., & Sampaio, E. (2013). Perceiving space and optical cues via a visuo-tactile sensory substitution system:A methodological approach for training of blind subjects for navigation. Perception, 42(5), 508-528.

Snow, J. C., Goodale, M. A., & Culham, J. C. (2015). Preserved haptic shape processing after bilateral LOC lesions. Journal of Neuroscience, 35(40), 13745-13760.

Stilla, R., & Sathian, K. (2008). Selective visuo-haptic processing of shape and texture. Human Brain Mapping, 29(10), 1123-1138.

Symmons, M., & Richardson, B. (2000). Raised line drawings are spontaneously explored with a single finger. Perception, 29(5), 621-626.

Theurel, A., Witt, A., Claudet, P., Hatwell, Y., & Gentaz, E. (2013). Tactile picture recognition by early blind children:The effect of illustration technique. Journal of Experimental Psychology-Applied, 19(3), 233-240.

Toderita, I., Bourgeon, S., Voisin, J. I. A., & Chapman, C. E. (2014). Haptic two-dimensional angle categorization and discrimination. Experimental Brain Research, 232(2), 369-383.

Trief, E., Cascella, P. W., & Bruce, S. M. (2013). A field study of a standardized tangible symbol system for learners who are visually impaired and have multiple disabilities. Journal of Visual Impairment & Blindness, 107(3), 180-191.

Van Aarsen, V., & Overvliet, K. E. (2016). Perceptual grouping by similarity of surface roughness in haptics:The influence of task difficulty. Experimental Brain Research, 234(8), 2227-2234.

Vidal-Verdu, F., & Hafez, M. (2007). Graphical tactile displays for visually-impaired people. IEEE Transactions on Neural Systems & Rehabilitation Engineering, 15(1), 119-130.

Vinter, A., Fernandes, V., Orlandi, O., & Morgan, P. (2012). Exploratory procedures of tactile images in visually impaired and blindfolded sighted children:How they relate to their consequent performance in drawing. Research in Developmental Disabilities, 33(6), 1819-1831.

Wijntjes, M. W. A., & Kappers, A. M. L. (2007). Angle discrimination in raised-line drawings. Perception, 36(6), 865-879.

Wijntjes, M. W. A., van Lienen, T., Verstijnen, I. M., & Kappers, A. M. L. (2008). The influence of picture size on recognition and exploratory behaviour in raised-line drawings. Perception, 37(4), 602-614.

Wnuczko, M., & Kennedy, J. M. (2014). Pointing to azimuths and elevations of targets:Blind and blindfolded-sighted. Perception, 43(2-3), 117-128.

Yang, J., Kitada, R., Kochiyama, T., Yu, Y., Kai, M., Araki, Y.,... Sadato, N. (2017). Brain networks involved in tactile speed classification of moving dot patterns:The effects of speed and dot periodicity. Scientific Reports, 7(40931).

Yang, J., Yu, Y., Kunita, A., Qiang, H., Wu, J., Sawamoto, N., & Fukuyama, H. (2014). Tactile priming modulates the activation of the fronto-parietal circuit during tactile angle match and non-match processing:An fMRI study. Frontiers in Human Neuroscience, 8(926), 926.

Yau, J. M., Kim, S. S., Thakur, P. H., & Bensmaia, S. J. (2016). Feeling form:the neural basis of haptic shape perception. Journal of Neurophysiology, 115(2), 631-642.

Yoshida, T., Yamaguchi, A., Tsutsui, H., & Wake, T. (2015). Tactile search for change has less memory than visual search for change. Attention Perception & Psychophysics, 77(4), 1200-1211.

Yu, J., Wu, Q., Yang, J., Takahashi, S., Ejima, Y., & Wu, J. (2017). A study of shape discrimination for tactile guide maps. IEEE International Conference on Mechatronics and Automation (pp.565-570). IEEE.