Abstract:Objective Facial images have been shown to convey mental conditions as clinical symptoms. This study aimed to use facial images to detect patients with drug-naive schizophrenia (DN-SCZ) or chronic schizophrenia (C-SCZ) from healthy controls (HCs), and to investigate differences in facial expressions among these 3 groups, as well as relationships between facial expressions and psychiatric symptoms. Methods We recruited 45 DN-SCZ patients, 106 C-SCZ patients and 101 HCs for the study, and videotaped their facial expressions through a fixed experimental paradigm. The video data was converted to facial images and divided into two sets: one for training a group classification- convolutional neural network (CNN) with the classification of DN-SCZ patient, C-SCZ patient and HC as output, and the other for evaluating classification results of the group classification-CNN. Subsequently, we extracted and evaluated 300 labeled facial images for each basic facial expression. These labeled images were employed to train separate facial expression-CNNs for each group (DN-SCZ, C-SCZ, and HCs). All facial images from the videos were then processed by their facial expression-CNNs to output the most probable facial expressions. The psychiatric symptoms were assessed using the Positive and Negative Syndrome Scale. Statistical analyses were conducted on the predicted facial expressions to identify differences among the groups, and to examine relationships between the predicted facial expressions and the clinical data of DN/C-SCZ patients. Results The group classification-CNN achieved an accuracy of 90.99% in correctly classifying participants based on facial images. The 3 facial expression-CNNs achieved accuracies of 95.95%, 87.23%, and 92.11% in predicting 8 basic facial expressions within the 3 groups. Facial images of HCs were rated higher in valence, arousal and attractiveness, but lower in deviation from normal face than those of DN/C-SCZ patients. Happy images of DN-SCZ patients were rated lower in valence and arousal than those of C-SCZ patients, while their angry images were rated higher in arousal, attractiveness and deviation from normal images than those of C-SCZ patients. Within the fixed experimental paradigm, DN-SCZ patients exhibited sadder, more surprised expressions, while displaying fewer happy, angry and disgusted expressions, statistical metrics of their fearful and angry expressions were correlated with their total positive symptom score and total general psychopathology score, respectively. C-SCZ patients exhibited happier, more content, angry and neutral expressions, while showing fewer surprised expressions, no significant relationships were observed between their facial expressions and clinical data. Conclusions Facial expressions can potentially serve as indicative signs for detecting DN-SCZ and C-SCZ patients. There are objective differences in certain facial expressions among the 3 groups, and certain facial expressions in DN-SCZ patients are associated with some of their psychiatric symptoms.

Genetic Variations in the Dopamine System and Facial Expression Recognition in Healthy Chinese College Students

Investigating the Genetic Basis of Social Conformity: the Role of the Dopamine Receptor 3 (drd3) Gene

Interaction Effects of 5-Httlpr,gender,and Family Socioeconomic Status on Facial Expression Recognition in Chinese College Students

COMT-Polymorphisms Modulated Functional Profile of the Fusiform Face Area Contributes to Face-Specific Recognition Ability.

A genome-wide association study of facial morphology identifies novel genetic loci in Han Chinese

Association Between Dystonia-Related Genetic Loci and Parkinson's Disease in Eastern China

Influence of monoamine oxidase A gene and brain function in the dynamic facial expression recognition in depressed patients

Patterns of neural activity in response to threatening faces are predictive of autistic traits: modulatory effects of oxytocin receptor genotype

Different Levels of Facial Expression Recognition in Patients with First-Episode Schizophrenia: A Functional MRI Study

Facial expression analysis using convolutional neural network for drug-naive and chronic schizophrenia

Effect of Genetic Polymorphisms on Neural Circuits of Emotion Regulation

Influence of DARPP-32 genetic variation on BOLD activation to happy faces

Gene expression associated with human brain activations in facial expression recognition

Genetic variations in the serotoninergic system and environmental factors contribute to aggressive behavior in Chinese adolescents

Deficits in emotion recognition and processing in children with high callous-unemotional traits: the role of the MAOA gene

Contributions of Dopamine-Related Genes and Environmental Factors to Highly Sensitive Personality: A Multi-Step Neuronal System-Level Approach

A quantitative association study between schizotypal traits and COMT, PRODH and BDNF genes in a healthy Chinese population.

The Classification of Facial Expressions with Multi-Cultural Backgrounds: an Event-Related Fmri Study

Neural correlates of facial emotion recognition impairment in blepharospasm: a functional magnetic resonance imaging study

[Associations Between Six Functional Genes and Schizophrenia].

647 Genome-wide Scans Identified Genetic Variants Associated with Facial Aging Traits Quantified by Deep Learning Methods