Abstract:For people who ardently love painting but unfortunately have visual impairments, holding a paintbrush to create a work is a very difficult task. People in this special group are eager to pick up the paintbrush, like Leonardo da Vinci, to create and make full use of their own talents. Therefore, to maximally bridge this gap, we propose a painting navigation system called “Angle’s Eyes” to assist blind people in artistic creation. The proposed system is composed of cognitive system and guidance system. The system adopts drawing board positioning based on QR code, brush navigation based on target detection and bush real-time positioning. Meanwhile, we design a simple yet efficient position information coding rule to remind the user of the current brush tip position. In addition, we design a criterion to efficiently judge whether the brush reaches the target or not. The numerous experiments are conducted to optimize and test the performance of the system. The results of real-world scenario experiments demonstrate that the developed system has great potential to help blind people with painting. This work also demonstrates that it is practicable for the blind people to feel the world through the brush in their hands. In the future, we plan to deploy “Angle’s Eyes” on the phone to make it more portable. The demo video of the proposed painting navigation system is available at https://doi.org/10.6084/m9.figshare.9760004.v1.

A tabletop multi-touch dalí's painting appreciation system

InterestPainter: A Painting Support Tool to Promote Children's Interest in Painting

Large area interactive browsing for high resolution digitized dunhuang murals

Real-time browsing of high-precision frescos

Interactively Painting by Shu-Kong Facsimile Based on Motion Sensors

COMTIS: Customizable Touchless Interaction System for Large Screen Visualization

EasyPainter: Customizing Your Own Paintings

A Remote Interactive Exhibition Method

A Comparative Study of Map Exploration Interfaces for Multi-Touch Tabletops.

Exploitation of Multiplayer Interaction and Development of Virtual Puppetry Storytelling Using Gesture Control and Stereoscopic Devices.

A Dynamic, Flexible & Interactive Display Method of Paintings for Communicative Art Appreciation among Students

Eye-Controlled Painting System for Disabled

Design and Implementation of Exhibition System for Interaction Chinese Painting

Designing a Smart VR Painting System with Multisensory Interaction for Immersive Experience

Animating and Interacting with Ancient Chinese Painting - Qingming Festival by the Riverside

Interaction with Paintings by Augmented Reality and High Resolution Visualization. A Real Case Exhibition

Angel’s Girl for Blind Painters: an Efficient Painting Navigation System Validated by Multimodal Evaluation Approach

Multi-user collaborative exploration of map and decision-making on a multi-touch tabletop

Doodle Space

Angel Girl of Visually Impaired Artists - Painting Navigation System for Blind or Visually Impaired Painters.

Research and Practice of Hierarchical Painting-Based Digital Design Method