Abstract:Abstract Generating designs via machine learning has been an on-going challenge in computer-aided design. Recently, deep learning methods have been applied to randomly generate images in fashion, furniture and product design. However, such deep generative methods usually require a large number of training images and human aspects are not taken into account in the design process. In this work, we seek a way to involve human cognitive factors through brain activity indicated by electroencephalographic measurements (EEG) in the generative process. We propose a neuroscience-inspired design with a machine learning method where EEG is used to capture preferred design features. Such signals are used as a condition in generative adversarial networks (GAN). First, we employ a recurrent neural network Long Short-Term Memory as an encoder to extract EEG features from raw EEG signals; this data are recorded from subjects viewing several categories of images from ImageNet. Second, we train a GAN model conditioned on the encoded EEG features to generate design images. Third, we use the model to generate design images from a subject’s EEG measured brain activity. To verify our proposed generative design method, we present a case study, in which the subjects imagine the products they prefer, and the corresponding EEG signals are recorded and reconstructed by our model for evaluation. The results indicate that a generated product image with preference EEG signals gains more preference than those generated without EEG signals. Overall, we propose a neuroscience-inspired artificial intelligence design method for generating a design taking into account human preference. The method could help improve communication between designers and clients where clients might not be able to express design requests clearly.

Human-in-the-loop design with machine learning

Neurocognition-inspired Design with Machine Learning

Generative Creativity: Adversarial Learning For Bionic Design

Verifying Design through Generative Visualization of Neural Activities

A Human-Machine Joint Learning Framework to Boost Endogenous BCI Training

Learning to design from humans: Imitating human designers through deep learning

Decoding human brain activity with deep learning

Unveiling Designers' Cognitive States in Early Engineering Design Stages: an Autoencoder-DNN Approach Based on EEG Data*

A Visual Characteristic Land-Scape Design for EEG Signal Based on LSTM-GAN

BrainDreamer: Reasoning-Coherent and Controllable Image Generation from EEG Brain Signals via Language Guidance

Product innovation concept generation based on deep learning and Kansei engineering

Design Exploration Predicts Designer Creativity: a Deep Learning Approach

A General Framework for Revealing Human Mind with auto-encoding GANs

Cross-Subject EEG Feedback for Implicit Image Generation

EEG-Based Evaluation of Aesthetic Experience Using BiLSTM Network

GAN-ACNN: a design decision-making algorithm based on EEG signals from different brain regions

A Tool to Facilitate the Cross-Cultural Design Process Using Deep Learning

A GAN model encoded by CapsEEGNet for visual EEG encoding and image reproduction

Design Meets Neuroscience: An Electroencephalogram Study of Design Thinking in Concept Generation Phase

An Eeg-Based Emotion Recognition Model Using An Interaction Design Framework And Deep Learning

Neuroscience Based Design: Fundamentals and Applications