Learning Personal Representations from fMRIby Predicting Neurofeedback Performance

Jhonathan Osin,Lior Wolf,Guy Gurevitch,Jackob Nimrod Keynan,Tom Fruchtman-Steinbok,Ayelet Or-Borichev,Shira Reznik Balter,Talma Hendler
DOI: https://doi.org/10.1007/978-3-030-59728-3_46
2021-12-06
Abstract:We present a deep neural network method for learning a personal representation for individuals that are performing a self neuromodulation task, guided by functional MRI (fMRI). This neurofeedback task (watch vs. regulate) provides the subjects with a continuous feedback contingent on down regulation of their Amygdala signal and the learning algorithm focuses on this region's time-course of activity. The representation is learned by a self-supervised recurrent neural network, that predicts the Amygdala activity in the next fMRI frame given recent fMRI frames and is conditioned on the learned individual representation. It is shown that the individuals' representation improves the next-frame prediction considerably. Moreover, this personal representation, learned solely from fMRI images, yields good performance in linear prediction of psychiatric traits, which is better than performing such a prediction based on clinical data and personality tests. Our code is attached as supplementary and the data would be shared subject to ethical approvals.
Machine Learning,Computer Vision and Pattern Recognition,Image and Video Processing
What problem does this paper attempt to address?