Investigating the changes in BOLD responses during viewing of images with varied complexity: An fMRI time-series based analysis on human vision

Naveen Kanigiri,Manohar Suggula,Debanjali Bhattacharya,Neelam Sinha
2023-09-27
Abstract:Functional MRI (fMRI) is widely used to examine brain functionality by detecting alteration in oxygenated blood flow that arises with brain activity. This work aims to investigate the neurological variation of human brain responses during viewing of images with varied complexity using fMRI time series (TS) analysis. Publicly available BOLD5000 dataset is used for this purpose which contains fMRI scans while viewing 5254 distinct images of diverse categories, drawn from three standard computer vision datasets: COCO, Imagenet and SUN. To understand vision, it is important to study how brain functions while looking at images of diverse complexities. Our first study employs classical machine learning and deep learning strategies to classify image complexity-specific fMRI TS, represents instances when images from COCO, Imagenet and SUN datasets are seen. The implementation of this classification across visual datasets holds great significance, as it provides valuable insights into the fluctuations in BOLD signals when perceiving images of varying complexities. Subsequently, temporal semantic segmentation is also performed on whole fMRI TS to segment these time instances. The obtained result of this analysis has established a baseline in studying how differently human brain functions while looking into images of diverse complexities. Therefore, accurate identification and distinguishing of variations in BOLD signals from fMRI TS data serves as a critical initial step in vision studies, providing insightful explanations for how static images with diverse complexities are perceived.
Computer Vision and Pattern Recognition,Signal Processing
What problem does this paper attempt to address?
The problem this paper attempts to address is the study of neural response changes in the human brain when viewing images of varying complexity by analyzing functional magnetic resonance imaging (fMRI) time series data. Specifically, the authors utilize the publicly available BOLD5000 dataset, which contains 5254 images from three standard computer vision datasets: COCO, Imagenet, and SUN. The aims are: 1. **Classifying Image Complexity**: Using classical machine learning and deep learning methods to classify fMRI time series corresponding to images of different complexities, in order to understand the functional differences in the brain when processing images of varying complexity. 2. **Temporal Semantic Segmentation**: Performing temporal semantic segmentation on the entire fMRI time series to label the specific image complexity category corresponding to each time point, further revealing the brain's response to image complexity at different time points. Through these studies, the authors hope to provide valuable insights into human visual perception and establish a benchmark for future research.