4D SlingBAG: spatial-temporal coupled Gaussian ball for large-scale dynamic 3D photoacoustic iterative reconstruction

Shuang Li,Yibing Wang,Jian Gao,Chulhong Kim,Seongwook Choi,Yu Zhang,Qian Chen,Yao Yao,Changhui Li

2024-12-05

Abstract:Large-scale dynamic three-dimensional (3D) photoacoustic imaging (PAI) is significantly important in clinical applications. In practical implementations, large-scale 3D real-time PAI systems typically utilize sparse two-dimensional (2D) sensor arrays with certain angular deficiencies, necessitating advanced iterative reconstruction (IR) algorithms to achieve quantitative PAI and reduce reconstruction artifacts. However, for existing IR algorithms, multi-frame 3D reconstruction leads to extremely high memory consumption and prolonged computation time, with limited consideration of the spatial-temporal continuity between data frames. Here, we propose a novel method, named the 4D sliding Gaussian ball adaptive growth (4D SlingBAG) algorithm, based on the current point cloud-based IR algorithm sliding Gaussian ball adaptive growth (SlingBAG), which has minimal memory consumption among IR methods. Our 4D SlingBAG method applies spatial-temporal coupled deformation functions to each Gaussian sphere in point cloud, thus explicitly learning the deformations features of the dynamic 3D PA scene. This allows for the efficient representation of various physiological processes (such as pulsation) or external pressures (e.g., blood perfusion experiments) contributing to changes in vessel morphology and blood flow during dynamic 3D PAI, enabling highly efficient IR for dynamic 3D PAI. Simulation experiments demonstrate that 4D SlingBAG achieves high-quality dynamic 3D PA reconstruction. Compared to performing reconstructions by using SlingBAG algorithm individually for each frame, our method significantly reduces computational time and keeps a extremely low memory consumption. The project for 4D SlingBAG can be found in the following GitHub repository: \href{<a class="link-external link-https" href="https://github.com/JaegerCQ/4D-SlingBAG" rel="external noopener nofollow">this https URL</a>}{<a class="link-external link-https" href="https://github.com/JaegerCQ/4D-SlingBAG" rel="external noopener nofollow">this https URL</a>}.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the efficient reconstruction in large - scale dynamic three - dimensional (3D) photoacoustic imaging (PAI). Specifically, existing methods face the following challenges when dealing with multi - frame 3D reconstruction:

1. **High memory consumption**: Multi - frame 3D reconstruction leads to extremely high memory consumption, especially when processing large - scale data, exceeding the processing capabilities of most GPUs.
2. **Long - time calculation**: Traditional iterative reconstruction (IR) algorithms require a large amount of time when dealing with multi - frame data and are inefficient.
3. **Lack of consideration of spatio - temporal continuity**: Existing IR algorithms usually ignore the spatio - temporal continuity between different frames, resulting in a decline in reconstruction quality.

To solve these problems, the author proposes a new method - the **4D Sliding Gaussian Ball Adaptive Growth (4D SlingBAG) algorithm**. This method is based on the existing SlingBAG algorithm. By introducing a spatio - temporal coupling deformation function, it explicitly learns the temporal and spatial deformation characteristics of each Gaussian ball, thereby achieving efficient dynamic 3D PAI reconstruction. Specific improvements include:

- **Low memory consumption**: 4D SlingBAG inherits the low - memory - consumption feature of SlingBAG and further optimizes the efficiency of multi - frame reconstruction through the spatio - temporal coupling deformation function.
- **Fast reconstruction speed**: Compared with frame - by - frame reconstruction, 4D SlingBAG significantly reduces the calculation time.
- **Consideration of spatio - temporal continuity**: By explicitly modeling spatio - temporal coupling deformation, the quality of the reconstructed image is improved, especially when dealing with physiological processes such as vascular morphological changes and hemodynamics.

In summary, this paper aims to improve the reconstruction efficiency and quality of large - scale dynamic 3D photoacoustic imaging through the 4D SlingBAG algorithm, reduce memory consumption and calculation time, and better capture spatio - temporal continuity.