Abstract:Perception based rendering becomes a hot research topic recently in Computer Graphics. It not only can promote the understanding of an image by attracting the attention of the specified user to his focusing area, but also has the potential to reduce the rendering computation. In this talk, we present three research works on how to benefit the perception of an image based on the characteristics of HVS. Firstly, we introduce a novel foveation filtering to simulate the gaze effect of the human eye on a 2D image by using the Mipmap pyramid to replace traditional Gaussian filtering. By using nonlinear Mipmap interpolation under the Bilateral Filtering scheme, we are able to achieve more accurate and effective foveation viewing results. Furthermore, a detail enhancement method based on the Cornsweet Illusion is incorporated into our framework. Compared with previous work, our approach can generate the same quality results with higher performance. Secondly, we present a novel foveation rendering algorithm based on distributed ray tracing to simulate the gaze contingent vision of a 3D scene. An image-space adaptive sampling mask is designed adhering to the Contrast Sensitivity Function (CSF) of the HVS. Then, an irregular layered representation for the 3D scene is constructed by depth peeling technique. Based on this novel data structure, we propose an efficient Depth Interval Refinement (DIR) technique to reduce quickly the Potential Intersection Object Set, and accelerate the ray tracing process dramatically. Finally, we apply the perception characteristic of the HVS to detail enhancement of 3D models. Based on a series of experiments, a novel adaptive exaggeration function is developed which is capable of modulating the extent of detail enhancement to obtain satisfactory shape exaggeration result. Meanwhile, a local refinement algorithm is also conducted to allow users to freely enhance any detail at their desire.

Perceptual Image Preview

Previewer for Multi-Scale Object Detector.

An Adaptive Weight Value-Based Multi-Scale Retinex Algorithm for Color Image Enhancement

An Overview of Perceptual Processing for Digital Pictures

Perceptually optimized image rendering

Fast PET Preview Image Reconstruction, Streaming, and Visualization During Data Acquisition: A Preliminary Study

Computer-aided Diagnosis Based on Enhancement of Degraded Fundus Photographs.

The Preview Effect in Pattern Recognition

Acquisition of Vision Adaptability Image

Perceptually Guided Contrast Enhancement Based on Viewing Distance

Single image dehazing enhancement based on retinal mechanism

Image Contrast Enhancement Method Based on Display and Human Visual System Characteristics.

Preview Benefits and the Perception of Color Salience in Preview Search

Progressive Image Enhancement under Aesthetic Guidance.

Perceptual Video Coding: Challenges and Approaches

The Mechanisms of Preview Benefit in the Perspective of Inhibition of Old Items and Attention Capture by New Items

Modeling Visual Attention's Modulatory Aftereffects on Visual Sensitivity and Quality Evaluation.

Visual Attention Based Image Browsing on Mobile Devices

The Effect Of Color Salient On Preview Search

Perceptual Quality Assessment of Immersive Images Considering Peripheral Vision Impact

Expressive Rendering Based on the Physiology and Perception of the Human Visual System