Abstract:Abstract Generating designs via machine learning has been an on-going challenge in computer-aided design. Recently, deep learning methods have been applied to randomly generate images in fashion, furniture and product design. However, such deep generative methods usually require a large number of training images and human aspects are not taken into account in the design process. In this work, we seek a way to involve human cognitive factors through brain activity indicated by electroencephalographic measurements (EEG) in the generative process. We propose a neuroscience-inspired design with a machine learning method where EEG is used to capture preferred design features. Such signals are used as a condition in generative adversarial networks (GAN). First, we employ a recurrent neural network Long Short-Term Memory as an encoder to extract EEG features from raw EEG signals; this data are recorded from subjects viewing several categories of images from ImageNet. Second, we train a GAN model conditioned on the encoded EEG features to generate design images. Third, we use the model to generate design images from a subject’s EEG measured brain activity. To verify our proposed generative design method, we present a case study, in which the subjects imagine the products they prefer, and the corresponding EEG signals are recorded and reconstructed by our model for evaluation. The results indicate that a generated product image with preference EEG signals gains more preference than those generated without EEG signals. Overall, we propose a neuroscience-inspired artificial intelligence design method for generating a design taking into account human preference. The method could help improve communication between designers and clients where clients might not be able to express design requests clearly.

Neurocognition-inspired Design with Machine Learning

Human-in-the-loop design with machine learning

Verifying Design through Generative Visualization of Neural Activities

Generative Creativity: Adversarial Learning For Bionic Design

Unveiling Designers' Cognitive States in Early Engineering Design Stages: an Autoencoder-DNN Approach Based on EEG Data*

Product innovation concept generation based on deep learning and Kansei engineering

Application of EEG and Interactive Evolutionary Design Method in Cultural and Creative Product Design

BrainDreamer: Reasoning-Coherent and Controllable Image Generation from EEG Brain Signals via Language Guidance

EEG-Based Evaluation of Aesthetic Experience Using BiLSTM Network

Design Meets Neuroscience: An Electroencephalogram Study of Design Thinking in Concept Generation Phase

MindCeive: Perceiving human imagination using CNN-GRU and GANs

Neuroscience Based Design: Fundamentals and Applications

A Visual Characteristic Land-Scape Design for EEG Signal Based on LSTM-GAN

GAN-ACNN: a design decision-making algorithm based on EEG signals from different brain regions

Product Design Using Generative Adversarial Network: Incorporating Consumer Preference and External Data

Decoding human brain activity with deep learning

Cross-Subject EEG Feedback for Implicit Image Generation

A GAN model encoded by CapsEEGNet for visual EEG encoding and image reproduction

Multi-Class Image Generation from EEG Features with Conditional Generative Adversarial Networks

An Eeg-Based Emotion Recognition Model Using An Interaction Design Framework And Deep Learning

Using neuroscience techniques to understand and improve design cognition