Detection and tracking of gas plumes in LWIR hyperspectral video sequence data

Torin Gerhart,Justin Sunu,Ekaterina Merkurjev,Jen-Mei Chang,Jerome Gilles,Andrea L. Bertozzi
DOI: https://doi.org/10.1117/12.2015155
2024-11-01
Abstract:Automated detection of chemical plumes presents a segmentation challenge. The segmentation problem for gas plumes is difficult due to the diffusive nature of the cloud. The advantage of considering hyperspectral images in the gas plume detection problem over the conventional RGB imagery is the presence of non-visual data, allowing for a richer representation of information. In this paper we present an effective method of visualizing hyperspectral video sequences containing chemical plumes and investigate the effectiveness of segmentation techniques on these post-processed videos. Our approach uses a combination of dimension reduction and histogram equalization to prepare the hyperspectral videos for segmentation. First, Principal Components Analysis (PCA) is used to reduce the dimension of the entire video sequence. This is done by projecting each pixel onto the first few Principal Components resulting in a type of spectral filter. Next, a Midway method for histogram equalization is used. These methods redistribute the intensity values in order to reduce flicker between frames. This properly prepares these high-dimensional video sequences for more traditional segmentation techniques. We compare the ability of various clustering techniques to properly segment the chemical plume. These include K-means, spectral clustering, and the Ginzburg-Landau functional.
Computer Vision and Pattern Recognition,Image and Video Processing
What problem does this paper attempt to address?
The problem that this paper attempts to solve is **how to detect and track gas plumes in long - wave infrared (LWIR) hyperspectral video sequences**. Specifically, the researchers are concerned with: 1. **The problem of automatic detection of gas plumes**: Standard RGB images cannot capture potentially invisible gas plumes, so an alternative data representation method is required to accurately identify these gases. 2. **The segmentation challenge**: Gas plumes have a diffusive nature, which makes their segmentation very difficult. Traditional image processing techniques have difficulty effectively distinguishing between the background and gas plumes. 3. **Balancing computational efficiency and effectiveness**: Although hyperspectral images provide rich information, their high - dimensional characteristics also pose computational challenges. Researchers need to find a method that can both retain important information and reduce computational complexity. To solve the above problems, the authors proposed a method that combines dimensionality reduction and histogram equalization to prepare hyperspectral video sequences for segmentation, and compared the effectiveness of different clustering techniques (such as K - means, spectral clustering, and the MBO scheme based on the Ginzburg - Landau functional). ### The specific steps are as follows: 1. **Data pre - processing**: - Use principal component analysis (PCA) to reduce the dimension of the hyperspectral video, thereby reducing the computational burden. - Smooth the inter - frame transition through the Midway histogram equalization method to reduce the flicker phenomenon. 2. **Feature extraction**: - Select three principal component projections as RGB intensity values to generate a pseudo - color video. - Utilize feature vectors to contain information of surrounding pixels to improve spatial consistency. 3. **Clustering analysis**: - Apply K - means, spectral clustering, and the modified MBO scheme to segment the processed video frames. - Compare the effects of different distance metrics (cosine distance and Euclidean distance). 4. **Experimental verification**: - Test the proposed method on an actual hyperspectral video data set and evaluate its performance. Through these steps, the researchers hope to be able to more accurately detect and track chemical gas plumes in the atmosphere, which is of great significance for fields such as national defense, security, and environmental protection.