本书为《视听觉信息的认知计算》的英文版。本书从人类的视听觉认知与神经机理出发，围绕认知过程的“表达”与“计算”的基本科学问题，重点开展“感知的基本特征、表达与整合”“感知数据的机器学习与理解”“多模态信息协同计算”等三个核心科学问题的研究，发展和构建新的计算模型与算法，为提高计算机对非结构化感知信息和海量异构信息的理解能力及计算效率提供科学支撑。

Chapter 1 Program Overview
1.1 Program Introduction
1.1.1 Overall Scientific Objectives
1.1.2 Core Scientific Issues
1.2 Program Layout
1.2.1 Project Deployment
1.2.2 Comprehensive Integration
1.2.3 Situation of Interaction Between Disciplines
1.3 Significant Progress
Chapter 2 Research Status
2.1 Research Status at Home and Abroad
2.2 Development Tendency
2.2.1 Cognitive Computing Theories and Methods for Visual and Auditory Information Based on Neuromorphic Computing
2.2.2 Enhancing Perception of Visual and Auditory Information in Cognitive Computing Systems
2.2.3 Improved Ability of Discovering Knowledge in Big Data
2.2.4 Enhanced Ability of Natural Language Comprehension
2.2.5 Man-in-the-Loop, Human-Computer-Cooperation and Hybrid Augmented Intelligence
2.2.6 Development of More Powerful and Reliable Autonomous Smart Cars (Robots)
2.2.7 Study of Driving Brain with Selective Attention Memory Mechanism
2.2.8 Theoretical Capabilities and Limitations of Cognitive Computing for Visual and Auditory Information
2.2.9 Advances in Hardware Architecture Design for Cognitive Computing of Visual and Auditory Information
2.3 Trend of Field Development
Chapter 3 Major Research Achievements
3.1 Leaping Development of Basic Theories of Cognitive Computing
3.1.1 Creation and Development of"Global-First" Object-Based Attention Theory
3.1.2 Research on Visual Computing Models and Methods Inspired by Biological Cognitive Mechanism and Characteristics
3.2 Breakthroughs in Key Technologies of the Brain-Computer Interface
3.2.1 Research on Key Technologies and Applications of the Bidirectional Multidimensional Brain-Computer Interface
3.2.2 Research on Theory and Key Technology of Intuitive Bionic Manipulation of Intelligent Prostheses Based on the Brain Computer Interface
3.3 Breakthroughs in Visual Information Processing
3.3.1 Statistical Learning Method for Visual Attention Based on Scene Understanding
3.3.2 Supporting the Recognition and Understanding of Traffic Signs for Driverless Vehicles
3.3.3 Graphics and Text Detection, Recognition and Understanding of Traffic Signs Under Complex Conditions
3.4 Leaping Development of Natural Language Processing
3.4.1 Research on Semantic Calculation Methods for Chinese Text Comprehension
3.4.2 Theoretical and Methodological Research on Integration Between Human-Like Hearing Mechanism and Deep Learning
3.4.3 Research on Theory and Technology of Speech Separation,Content Analysis and Understanding in Multi-Person and Multi-Party Dialogue
3.5 Breakthroughs in Theory and Technology Research of Multi-Modal Information Processing
3.6 Breakthroughs in Key Technology and Platform of Autonomous Vehicles
3.6.1 Theory, Method and Integration and Comprehensive Experimental Platform of Autonomous Vehicle
3.6.2 Key Technology Integration and Comprehensive Verification Platform for Driverless Vehicles Based on Visual and Auditory Cognitive Mechanism
3.6.3 Intelligent Test Evaluation and Environment Design of Driverless Vehicles
Chapter 4 Outlook
4.1 Domestic Deficiencies and Strategic Needs
4.1.1 Domestic Deficiencies
4.1.2 Strategic Needs
4.2 Ideas and Suggestions for In-Depth Study
4.2.1 The Idea of In-Depth Research
4.2.2 Suggestions for the Next Step
References