Abstract:Handling imperfect information problems is fundamental to perception, learning, decision-making, and other processes in the environment with omnipresent incompleteness. Ensemble perception, or the ability to extract statistical properties of stimulus clusters at a glance to condense information, has been proposed as a way to partially overcome the imperfect information problem by providing global clues. However, ensemble perception itself suffers from the imperfect information problem: Due to capacity and environmental constraints, not all elements in a cluster are readily accessible, resulting in incomplete data that is required for computing statistical features. In this case, the internal correlations of those clusters could serve as an effective clue (i.e., regularity) to shed light on the missing pieces. To test this hypothesis, we investigated the role of spatial regularity in ensemble perception under imperfect information situations. We created imperfect information scenarios by using partially occluded stimulus clusters. In two experiments, we manipulated stimulus size in a cluster to linearly vary with its location. Therefore, the spatial regularity supplied clues for inferring the statistics of the parts that were not visible. The participants were instructed to estimate the average size of the entire cluster, including both the visible and invisible parts hidden behind an occlusion. We observed robust biases toward the overall cluster in the participants’ estimation, implying that the invisible parts were considered during ensemble perception. We proposed that this effect could be understood as a result of Bayesian inference, assessing evidence from the visible parts to construct the missing parts required for ensemble perception. We built a generative model, the Regularity Based Model, to simulate the Bayesian inference, which performed better in capturing the pattern of human outcomes than the comparative models. These findings indicate that the visual system could use high-level structural information to infer scenes with incomplete information, thus, producing more accurate ensemble representations.

A Population Response Model of Ensemble Perception

Ensemble Size Perception: Its Neural Signature and the Role of Global Interaction over Individual Items

How Strong is Automaticity of Ensemble Encoding? Empirical Evidence from Ensemble Orientation and Facial Emotion

Completeness Out of Incompleteness Inferences and Employment Regarding Regularities in Imperfect Information Ensembles

Integration of Ensemble Representations Stored in Visual Working Memory

Completeness out of Incompleteness: Inferences from Regularities in Imperfect Information Ensembles.

What is the basis of ensemble subset selection?

Population encoding of stimulus features along the visual hierarchy

Outlier rejection in the process of pooling

Decoding time-resolved neural representations of orientation ensemble perception

Conscious and unconscious processing of ensemble statistics oppositely modulate perceptual decision-making.

Ensemble perception and focused attention: Two different modes of visual processing to cope with limited capacity

Spatial ensemble statistics are efficient codes that can be represented with reduced attention

The perceptual and mnemonic effects of ensemble representation on individual size representation

Percept formation from neural populations in sensory decision-making tasks

Personalized visual encoding model construction with small data

The functional role of spatial anisotropies in ensemble perception

Seeing in crowds: Averaging first, then max

Attentional Modulation of Visual Spatial Integration: Psychophysical Evidence Supported by Population Coding Modeling

Effect of attention on ensemble perception: Comparison between exogenous attention, endogenous attention, and depth

Ensemble memory of a scene interacts with current perception regardless of attentional requirements.