Correspondence between representations in visual cortices and neural networks
A research group led by Nobuhiko Wagatsuma, Lecturer at Toho University, Akinori Hidaka, Associate Professor at Tokyo Denki University, and Hiroshi Tamura, Associate Professor at Osaka University, found that the neural network structure of attention prediction, based on deep learning used in the development of artificial intelligence, has similar characteristics to the cerebral mechanism of primates.
This discovery was made possible by applying the research method for the comparison of the brain activity between monkeys and humans to artificial neural networks. This finding might be helpful not only to understand the cortical mechanism of attentional selection but also to develop artificial intelligence.
Deep neural networks (DNNs), which are used in the development of artificial intelligence, are mathematical models for obtaining appropriate mechanisms to solve specific problems from the training with a large-scale dataset. However, the detailed mechanisms underlying DNNs through this learning process have not yet been clarified.
A research group led by Nobuhiko Wagatsuma, Lecturer at the Faculty of Science, Toho University, Akinori Hidaka, Associate Professor at the Faculty of Science and Engineering, Tokyo Denki University, and Hiroshi Tamura, Associate Professor at the Graduate School of Frontiers Biosciences, Osaka University, found that the characteristics of responses in DNNs for predicting the attention to the most important location in images were consistent with those of the neural representation in the primary visual cortex (V1) of primates. The discovery was made possible by applying the analysis method designed for comparing the characteristics of the neuronal activity in monkeys with that in humans to DNNs.
The result of this study provides important insight into the neural mechanism of attention. Additionally, the application of the attentional mechanism in the primates including human may accelerate the development of artificial intelligence.
- The correspondence between primate visual cortices and deep neural networks has been revealed by applying the research method for comparing the neural activity between different species, such as humans and monkeys, to artificial neural networks.
- Recently, deep neural networks are utilized as the main methods for developing artificial intelligence. Wagatsuma et al. have reported the similar properties between deep neural networks for predicting attention and the primary visual cortex (V1) of primates. Additionally, their findings implied that the mechanism of the deep neural networks for attention prediction might be distinct from that for object classification such as VGG 16.
- Attention is a function that enables us to attend the most important information at the moment, which is the most critical keyword in the recent development of artificial intelligence. The results of this research might provide contributions not only for understanding the neural mechanisms for attention selection of primates including human but also for developing artificial intelligence.
More information: Nobuhiko Wagatsuma et al, Correspondence between monkey visual cortices and layers of a saliency map model based on a deep convolutional neural network for representations of natural images, eNeuro (2020). DOI: 10.1523/ENEURO.0200-20.2020