Abstract:Perception is a complex process that involves brain activities at different levels. The availability of models for the representation and interpretation of the sensory information opens up new research avenues that cut across neuroscience, imaging, information engineering, and modern robotics. The goal of the multidisciplinary field of perceptual signal processing is to identify the features of the stimuli that determine their “perception,” namely “a single unified awareness derived from sensory processes while a stimulus is present,” and to establish associated computational models that can be generalized and exploited for designing a human-centered approach to imaging. In the case of vision, the stimuli go through a complex analysis chain of visual pathways, starting with the encoding by the photoreceptors in the retina (low-level processing) and ending with cognitive mechanisms (high-level processes) that depend on the task being performed. Accordingly, low-level models are concerned with image representation and aim at emulating the way that the visual stimulus is encoded by the early stages of the visual system, as well as at capturing the varying sensitivity to the features of the input stimuli, whereas high-level models are related to image interpretation and allow to predict the performance of a human observer in a predefined task. A global model that accounts for both such bottom-up and top-down approaches would enable an automatic interpretation of the visual stimuli based on both low-level features and semantic contents. In image processing, methods that take advantage of such models include feature extraction, content-based image description and retrieval, model-based coding, and the emergent domain of medical image perception. This special issue gives a flavor of the scope and potential of perception-based image and video processing by providing an overview of the way that visual mechanisms at different levels can be modeled and exploited. In particular, the eleven selected papers span the following fields:

Editorial: The operationalization of cognitive systems in the comprehension of visual structures

Editorial: Understanding the Operation of Visual Working Memory in Rich Complex Visual Context

The Perceptual Root of Object-Based Storage: an Interactive Model of Perception and Visual Working Memory.

Editorial: Cognitive Mechanisms of Visual Attention, Working Memory, Emotion, and Their Interactions

On the control of attentional processes in vision

Attentional Mechanism for Organization in Visual Working Memory

Exploring Comprehension Strategies of Modular Process Models: A Combined Eye-Tracking and Concurrent Think-Aloud Study

Toward robust visual cognition through brain-inspired computing

Representation and computation in visual working memory

How 'visual' is the visual cortex? The interactions between the visual cortex and other sensory, motivational and motor systems as enabling factors for visual perception

Attentional Modulation of Visual Spatial Integration: Psychophysical Evidence Supported by Population Coding Modeling

Representation and computation in working memory

Visual Attention and its Intimate Links to Spatial Cognition

Reading visually embodied meaning from the brain: Visually grounded computational models decode visual-object mental imagery induced by written text

Understanding the computational demands underlying visual reasoning

Representational structures as a unifying framework for attention

Editorial: image perception

Amodal completion across the brain: The impact of structure and knowledge

The interplay of attention and consciousness in visual search, attentional blink and working memory consolidation

A Functional Cartography of Cognitive Systems

Revealing the neural networks that extract conceptual gestalts from continuously evolving or changing semantic contexts