Vision, Emotion and Memory: from Neurophysiology to Computation

ET Rolls

DOI: https://doi.org/10.1016/s0531-5131(03)00981-6

2003-01-01

International Congress Series

Abstract:The inferior temporal visual cortex provides invariant representations of objects. The computations underlying this can be understood in the framework of a hierarchical series of competitive networks in the ventral visual stream which learn invariant representations by using a short-term memory trace to extract properties of the visual input that are invariant over short periods and are thus statistically likely to be from the same object. One set of outputs from the inferior temporal cortex is to the orbitofrontal cortex and amygdala, which are involved in representing primary rewards and punishers (such as taste, pleasant touch, and pain), and in associating previously neutral visual stimuli with these primary reinforcers. In that emotions can be defined as states elicited by reinforcers, these functions of the orbitofrontal cortex and amygdala provide a basis for understanding how emotion is implemented in the brain. A second output of the inferior temporal cortex is to the hippocampal system, which is implicated in episodic memory and in spatial function. A third output of the inferior temporal visual cortex is to the prefrontal cortex, which is involved in short-term memory and attentional processes. The combined neurophysiological and computational approach taken to these issues provides a way of understanding how these systems actually operate in the brain to implement object perception, emotion, and long- and short-term memory.