Abstract:Multispectral imaging captures spatial information across a set of discrete spectral channels and is widely utilized across diverse applications such as remote sensing, industrial inspection, and biomedical imaging. Multispectral filter arrays (MSFAs) are filter mosaics integrated atop image sensors that facilitate cost-effective, compact, snapshot multispectral imaging. MSFAs are pre-configured based on application-where filter channels are selected corresponding to targeted absorption spectra-making the design of optimal MSFAs vital for a given application. Despite the availability of many design and optimization approaches for spectral channel selection and spatial arrangement, major limitations remain. There are few robust approaches for joint spectral-spatial optimization, techniques are typically only applicable to limited datasets and most critically, are not available for general use and improvement by the wider community. Here, we reconcile current MSFA design techniques and present Opti-MSFA: a Python-based open-access toolbox for the centralized design and optimization of MSFAs. Opti-MSFA incorporates established spectral-spatial optimization algorithms, such as gradient descent and simulated annealing, multispectral-RGB image reconstruction, and is applicable to user-defined input of spatial-spectral datasets or imagery. We demonstrate the utility of the toolbox by comparing against other published MSFAs using the standard hyperspectral datasets Samson and Jasper Ridge, and further show application on experimentally acquired fluorescence imaging data. In conjunction with end-user input and collaboration, we foresee the continued development of Opti-MSFA for the benefit of the wider research community.

Optimal Spectral Sensitivity of Multispectral Filter Array for Pathological Images

Joint optimization of multispectral filter arrays and demosaicking for pathological images

Single-pixel Multispectral Imaging Based on Macropixel Segmentation Method

Targeted multispectral filter array design for the optimization of endoscopic cancer detection in the gastrointestinal tract

Targeted Multispectral Filter Array Design for Endoscopic Cancer Detection in the Gastrointestinal Tract

Design of a Dual-Mode Multispectral Filter Array

Opti-MSFA: a toolbox for generalized design and optimization of multispectral filter arrays

Snapshot multispectral imaging using a filter array

Physics-Driven Multispectral Filter Array Pattern Optimization and Hyperspectral Image Reconstruction

Hybrid-resolution multispectral imaging using color filter array

PPI Edge Infused Spatial-Spectral Adaptive Residual Network for Multispectral Filter Array Image Demosaicing

A Programmable Optical Filter with Arbitrary Transmittance for Fast Spectroscopic Imaging and Spectral Data Post-Processing.

Speeded-Up Robust Features-based image mosaic method for large-scale microscopic hyperspectral pathological imaging

Fast Multispectral Imaging by Spatial Pixel-Binning and Spectral Unmixing

Design of multispectral array imaging system based on depth-guided network

Hyperspectral pathology image classification using dimension-driven multi-path attention residual network

Melanoma and Melanocyte Identification from Hyperspectral Pathology Images Using Object-Based Multiscale Analysis

Generalized MSFA Engineering with Structural and Adaptive Nonlocal Demosaicing.

Mosaicked multispectral image compression based on inter- and intra-band correlation

Mosaic Convolution-Attention Network for Demosaicing Multispectral Filter Array Images

Optimized High-Frequency Based Interpolation for Multispectral Demosaicking