We present a bimodal model able to internally simulate expected sequences of perceptions within a modality likely to follow the last sensory experience. Simultaneously reasonable perceptual expectations are elicited in the other modality. Our model is based on the novel Associative Self-Organizing Map (A-SOM), which develops a representation of the input space as well as learns to associate its activity with the (possibly time delayed) activities of an arbitrary number of other neural networks. The model was trained on sequences of inputs and the trained model was able to simulate appropriate sequences of activity patterns in the absence of sensory input for several epochs in both modalities. The simulation results are very encouraging and confirms the abilities of the A-SOM to serve in a multimodal system capable of internal simulation of perceptions and of cross-modal expectations.
IOS Press, Inc.
6751 Tepper Drive
Clifton, VA 20124
Tel.: +1 703 830 6300
Fax: +1 703 830 2300 firstname.lastname@example.org
(Corporate matters and books only) IOS Press c/o Accucoms US, Inc.
For North America Sales and Customer Service
West Point Commons
Lansdale PA 19446
Tel.: +1 866 855 8967
Fax: +1 215 660 5042 email@example.com