Abstract:Abstract Generating designs via machine learning has been an on-going challenge in computer-aided design. Recently, deep learning methods have been applied to randomly generate images in fashion, furniture and product design. However, such deep generative methods usually require a large number of training images and human aspects are not taken into account in the design process. In this work, we seek a way to involve human cognitive factors through brain activity indicated by electroencephalographic measurements (EEG) in the generative process. We propose a neuroscience-inspired design with a machine learning method where EEG is used to capture preferred design features. Such signals are used as a condition in generative adversarial networks (GAN). First, we employ a recurrent neural network Long Short-Term Memory as an encoder to extract EEG features from raw EEG signals; this data are recorded from subjects viewing several categories of images from ImageNet. Second, we train a GAN model conditioned on the encoded EEG features to generate design images. Third, we use the model to generate design images from a subject’s EEG measured brain activity. To verify our proposed generative design method, we present a case study, in which the subjects imagine the products they prefer, and the corresponding EEG signals are recorded and reconstructed by our model for evaluation. The results indicate that a generated product image with preference EEG signals gains more preference than those generated without EEG signals. Overall, we propose a neuroscience-inspired artificial intelligence design method for generating a design taking into account human preference. The method could help improve communication between designers and clients where clients might not be able to express design requests clearly.

A framework for studying design thinking through measuring designers’ minds, bodies and brains

Using neuroscience techniques to understand and improve design cognition

Exploring Optimal Combinations: the Impact of Sequential Multimodal Inspirational Stimuli in Design Concepts on Creativity.

Design Meets Neuroscience: An Electroencephalogram Study of Design Thinking in Concept Generation Phase

Neurocognition-inspired Design with Machine Learning

Research on intelligent product conceptual design based on cognitive process

A Computer-Aided Design Based Research Platform for Design Thinking Studies

The future of design cognition analysis

Measuring Human Perception of Biophilically-Driven Design with Facial Micro-expressions Analysis and EEG Biosensor

Crowd Intelligence Driven Design Framework Based on Perception-Retrieval Cognitive Mechanism

An EEG Study of the Relationship Between Design Problem Statements and Cognitive Behaviors During Conceptual Design

Implementing design thinking to drive innovation in technical design

Functional magnetic resonance imaging (fMRI) in design studies: Methodological considerations, challenges, and recommendations

A Framework of Artificial Intelligence Augmented Design Support

Neuroscience Based Design: Fundamentals and Applications

Design Thinking and Organizational Culture: A Review and Framework for Future Research

Designing Implicit Interfaces for Physiological Computing

Capturing Mental Models: an Analysis of Designers Actions, Ideas, and Intentions

A Framework to Study Human-AI Collaborative Design Space Exploration

Do Creativity Metrics from Design Research Correlate with Those from Psychology?

The Evolution, Framework, and Future of Cognitive Intelligence-enabled Product Design