A MULTIMODAL SELF-ORGANIZING NETWORK FOR SENSORY INTEGRATION OF LETTERS AND PHONEMES

Integration of signals from sensory receptors of different modalities is known to enhance perception. Integration takes place in bimodal and multimodal association areas of neocortex and results in robust bimodal or multimodal per-cepts as well as in feedback mediated enhanced unimodal perception. A Multimodal Self-Organizing Network, Mu-SON, is presented as a tool for simulating sensory integra-tion. This MuSON is a development of an earlier version in that it takes into account also the degree of recognition of stimuli in the various maps of the network. The simula-tion results show the same characteristics as corresponding results from psychology and neuroscience