Abstract:Brain tumors present a formidable diagnostic challenge due to their aberrant cell growth. Accurate determination of tumor location and size is paramount for effective diagnosis. Magnetic Resonance Imaging (MRI) and Positron Emission Tomography (PET) are pivotal tools in clinical diagnosis, yet tumor segmentation within their images remains challenging, particularly at boundary pixels, owing to limited sensitivity. Recent endeavors have introduced fusion-based strategies to refine segmentation accuracy, yet these methods often prove inadequate. In response, we introduce the Parallel-Way framework to surmount these obstacles. Our approach integrates MRI and PET data for a holistic analysis. Initially, we enhance image quality by employing noise reduction, bias field correction, and adaptive thresholding, leveraging Improved Kalman Filter (IKF), Expectation Maximization (EM), and Improved Vibe Algorithm (IVib), respectively. Subsequently, we conduct multi-modality image fusion through the Dual-Tree Complex Wavelet Transform (DTWCT) to amalgamate data from both modalities. Following fusion, we extract pertinent features using the Advanced Capsule Network (ACN) and reduce feature dimensionality via Multi-objective Diverse Evolution-based selection. Tumor segmentation is then executed utilizing the Twin Vision Transformer with dual attention mechanism. Implemented our Parallel-Way framework which exhibits heightened model performance. Evaluation across multiple metrics, including accuracy, sensitivity, specificity, F1-Score, and AUC, underscores its superiority over existing methodologies. Diagnosing brain tumors is challenging due to their abnormal growth. Accurately determining the tumor's location and size is crucial for effective treatment. Magnetic Resonance Imaging (MRI) and Positron Emission Tomography (PET) are important tools in clinical diagnosis, but accurately segmenting tumors in their images, especially at the edges, is difficult due to limited sensitivity. To address this, we propose the Parallel-Way framework, which integrates MRI and PET data for a comprehensive analysis. First, we enhance image quality using noise reduction, bias field correction, and adaptive thresholding techniques like the Improved Kalman Filter (IKF), Expectation Maximization (EM), and Improved Vibe Algorithm (IVib). Next, we merge the MRI and PET data using the Dual-Tree Complex Wavelet Transform (DTWCT) to combine information from both modalities. After fusion, we extract relevant features using the Advanced Capsule Network (ACN) and reduce their complexity with Multi-objective Diverse Evolution-based selection. Tumor segmentation is then performed using the Twin Vision Transformer with a dual attention mechanism. Our Parallel-Way framework aims to improve the accuracy of brain tumor segmentation, overcoming limitations of existing methods. By integrating data from MRI and PET and applying advanced image processing and machine learning techniques, we believe our approach will provide a more reliable and accurate method for diagnosing and treating brain tumors. Evaluations using metrics such as accuracy, sensitivity, specificity, F1-Score, and AUC demonstrate that our method is superior to existing approaches, providing a more reliable and accurate way to diagnose brain tumors.

A graph-based approach for the retrieval of multi-modality medical images

Mutual Information-Based Graph Co-Attention Networks for Multimodal Prior-Guided Magnetic Resonance Imaging Segmentation

Multimodal Priors Guided Segmentation of Liver Lesions in MRI Using Mutual Information Based Graph Co-Attention Networks.

A Retrieval System For 3d Multi-Phase Contrast-Enhanced Ct Images Of Focal Liver Lesions Based On Combined Bags Of Visual Words And Texture Words

MAL: Multi-modal Attention Learning for Tumor Diagnosis Based on Bipartite Graph and Multiple Branches

Multi-Modality Medical Case Retrieval Using Heterogeneous Information

Deep Graph-Based Multimodal Feature Embedding for Endomicroscopy Image Retrieval

A New Way for Multidimensional Medical Data Management: Volume of Interest (VOI)-Based Retrieval of Medical Images With Visual and Functional Features

Parallel-way: Multi-modality-based brain tumor segmentation using parallel capsule network

Semi supervised multi kernel (SeSMiK) graph embedding: identifying aggressive prostate cancer via magnetic resonance imaging and spectroscopy

Graph Convolutional Networks for Multi-modality Medical Imaging: Methods, Architectures, and Clinical Applications

Brain Tumor Segmentation via Multi-Modalities Interactive Feature Learning

Improved Mammographic Mass Retrieval Performance Using Multi-View Information

A Graph-Based Multi-kernel Feature Weight Learning Framework for Detection and Grading of Prostate Lesions Using Multi-parametric MR Images

Finding Frequent Approximate Subgraphs in Medical Image Database

Brain tumor classification: a novel approach integrating GLCM, LBP and composite features

Heterogeneous Graph Learning for Multi-modal Medical Data Analysis

Cross-modality Synthesis Aiding Lung Tumor Segmentation on Multi-Modal MRI Images

Retrieval Of Brain Tumors By Adaptive Spatial Pooling And Fisher Vector Representation

A Mapping Modelling of Visual Feature and Knowledge Representation Approach for Medical Image Retrieval

Clique Identification And Propagation For Multimodal Brain Tumor Image Segmentation