Abstract:Pioneering studies demonstrating that the contents of visual working memory (WM) can be decoded from the patterns of multivoxel activity in early visual cortex transformed not only how we study WM, but theories of how memories are stored. For instance, the ability to decode the orientation of memorized gratings is hypothesized to depend on the recruitment of the same neural encoding machinery used for perceiving orientations. However, decoding evidence cannot be used to test the so-called without understanding the underlying nature of what is being decoded. Although unknown during WM, during perception decoding the orientation of gratings does not simply depend on activities of orientation tuned neurons. Rather, it depends on complex interactions between the orientation of the grating, the aperture edges, and the topographic structure of the visual map. Here, our goals are to 1) test how these aperture biases described during perception may affect WM decoding, and 2) leverage carefully manipulated visual stimulus properties of gratings to test how sensory-like are WM codes. For memoranda, we used gratings multiplied by radial and angular modulators to generate orthogonal aperture biases despite having identical orientations. Therefore, if WM representations are simply maintained sensory representations, they would have similar aperture biases. If they are abstractions of sensory features, they would be unbiased and the modulator would have no effect on orientation decoding. Results indicated that fMRI patterns of delay period activity while maintaining the orientation of a grating with one modulator (eg, radial) were interchangeable with patterns while maintaining a grating with the other modulator (eg, angular). We found significant cross-classification in visual and parietal cortex, suggesting that WM representations are insensitive to aperture biases during perception. Then, we visualized memory abstractions of stimuli using a population receptive field model of the visual field maps. Regardless of aperture biases, WM representations of both modulated gratings were recoded into a single oriented line. These results provide strong evidence that visual WM representations are abstractions of percepts, immune to perceptual aperture biases, and compel revisions of WM theory.

Experience-dependent alteration of mnemonic representation in early visual cortex and intraparietal sulcus

Perceptual Learning beyond Perception: Mnemonic Representation in Early Visual Cortex and Intraparietal Sulcus

The Neural Mechanism Underlying Visual Working Memory Training and Its Limited Transfer Effect

Dissociated roles of the parietal and frontal cortices in the scope and control of attention during visual working memory.

Tracking Stimulus Representation Across a 2-Back Visual Working Memory Task

Discrimination Training Enhances the Fidelity of Visual Working Memory

Perceptual Learning Modifies the Functional Specializations of Visual Cortical Areas

Perceptual Learning As a Result of Concerted Changes in Prefrontal and Visual Cortex

Dissociating the Causal Roles of V1, Intraparietal Sulcus, and Dorsolateral Prefrontal Cortex in Visual Working Memory

Spatiotopic Perceptual Learning Mediated By Retinotopic Processing And Attentional Remapping

Experience dependent plasticity of higher visual cortical areas in the mouse

Visual working memories are abstractions of percepts

Long-term learning transforms prefrontal cortex selectivity during working memory

Learning Acts On Distinct Processes For Visual Form Perception In The Human Brain

Different states of priority recruit different neural representations in visual working memory

Contrasting Cortical and Subcortical Activations Produced by Attentional-Set Shifting and Reversal Learning in Humans

Orientation Discrimination Training Refines the Stimulus Comparison, Rather Than the Perceptual Encoding Process in the Primary Visual Cortex

A gradual transition toward categorical representations along the visual hierarchy during working memory, but not perception.

One-trial perceptual learning in the absence of conscious remembering and independent of the medial temporal lobe

Divergent roles of early visual cortex and inferior frontal junction in visual working memory

BOLD Signal Changes Associated with Orientation Learning and Transfer at Different Brain Areas