Visual Flow-based Programming Plugin for Brain Computer Interface in Computer-Aided Design

Tong Bill Xu,Saleh Kalantari

2023-07-21

Abstract:Over the last half century, the main application of Brain Computer Interfaces, BCIs has been controlling wheelchairs and neural prostheses or generating text or commands for people with restricted mobility. There has been very limited attention in the field to applications for computer aided design, despite the potential of BCIs to provide a new form of environmental interaction. In this paper we introduce the development and application of Neuron, a novel BCI tool that enables designers with little experience in neuroscience or computer programming to gain access to neurological data, along with established metrics relevant to design, create BCI interaction prototypes, both with digital onscreen objects and physical devices, and evaluate designs based on neurological information and record measurements for further analysis. After discussing the BCI tool development, the article presents its capabilities through two case studies, along with a brief evaluation of the tool performance and a discussion of implications, limitations, and future improvement.

Human-Computer Interaction,Software Engineering

What problem does this paper attempt to address?

The problem this paper attempts to address is the inadequacy of applying Brain-Computer Interface (BCI) technology in the field of Computer-Aided Design (CAD). Specifically, although BCI technology has made significant progress in helping people with mobility impairments control wheelchairs, neuroprosthetics, or generate text, its application in the CAD field is very limited. The paper proposes a new tool called Neuron, which aims to enable designers without neuroscience or programming experience to:

1. **Acquire neural data**: Including band power measurements for each electrode channel and established signal pattern indicators reflecting states such as attention and relaxation.
2. **Create BCI interaction prototypes**: Both through digital objects on the screen and through actual physical devices.
3. **Evaluate designs based on neural information**: Recording these measurements for further analysis.

The goal of the Neuron tool is not to replace existing design workflows but to expand the possibilities of early design ideation, particularly as a new input method in parametric and generative design approaches. Additionally, Neuron can help designers access neural data in a real-time, interactive format to evaluate human responses to designs, thereby improving the practicality and supportiveness of the designs.