Hyperspectral image classification via integrated metasystem

Zi Wang,Lorry Chang,Feifan Wang,Tiantian Li,Wanzhao Yang,Bo Yuan,Tingyi Gu

DOI: https://doi.org/10.1364/cleo_at.2022.jw3b.24

2022-01-01

Abstract:On silicon photonic platform, we demonstrate a spatial-spectral pattern classifier and a three-channel wavelength demultiplexer in few-layer metasystems.

What problem does this paper attempt to address?

Integrated Photonic Metasystem for Image Classifications at Telecommunication Wavelength.

Zi Wang,Lorry Chang,Feifan Wang,Tiantian Li,Tingyi Gu

DOI: https://doi.org/10.1038/s41467-022-29856-7

IF: 16.6

2022-01-01

Nature Communications

Abstract:Miniaturized image classifiers are potential for revolutionizing their applications in optical communication, autonomous vehicles, and healthcare. With subwavelength structure enabled directional diffraction and dispersion engineering, the light propagation through multi-layer metasurfaces achieves wavelength-selective image recognitions on a silicon photonic platform at telecommunication wavelength. The metasystems implement high-throughput vector-by-matrix multiplications, enabled by near 103 nanoscale phase shifters as weight elements within 0.135 mm2 footprints. The diffraction manifested computing capability incorporates the fabrication and measurement related phase fluctuations, and thus the pre-trained metasystem can handle uncertainties in inputs without post-tuning. Here we demonstrate three functional metasystems: a 15-pixel spatial pattern classifier that reaches near 90% accuracy with femtosecond inputs, a multi-channel wavelength demultiplexer, and a hyperspectral image classifier. The diffractive metasystem provides an alternative machine learning architecture for photonic integrated circuits, with densely integrated phase shifters, spatially multiplexed throughput, and data processing capabilities.
Bi-channel Compressive Hyperspectral Imager Based on Polarization Conversion Metasurface

Yang Zhang,Chang Wang,Xinyu Liu,Zeqing Yu,Qiangbo Zhang,Bingliang Chen,Zhou Xu,Zhenrong Zheng

DOI: https://doi.org/10.1016/j.optcom.2023.129942

IF: 2.4

2023-01-01

Optics Communications

Abstract:Metasurfaces have demonstrated remarkable capabilities in manipulating light fields and reducing the size of conventional optical elements to ultrathin devices, and compressive hyperspectral imaging systems can effectively utilize the spectral modulations of metasurfaces through spectral transmission tuning. In this paper, a bichannel compressive hyperspectral imager based on polarization conversion metasurfaces is proposed. The metasurface layer of this device is able to modulate and convert the polarized incidence into two outputs of different transmission spectra with orthogonal polarizations, providing two channels of hyperspectral information that can be detected by a polarization image sensor in one snapshot. Additionally, this design offers a compact size, high speed, and accurate reconstruction through the utilization of a macro-pixel segmentation method for compressive sensing algorithms, and it is firmly demonstrated that the proposed hyperspectral imaging technology surpasses other traditional compressive hyperspectral image recovery methods in terms of improved reconstruction quality. Therefore, it is envisioned that this technology will find significant applications in various fields, including food safety, biomedical imaging, precision agriculture, object detection and so on.
A Compact Compressive Hyperspectral Imaging System Based on Metasurface

Xinyu Liu,Chang Wang,Yang Zhang,Qiangbo Zhang,Yu Zeqing,Yan Sun,Zhenrong Zheng

DOI: https://doi.org/10.1117/12.2643871

2023-01-01

Abstract:Traditional hyperspectral imagers rely on scanning either the spectral or spatial dimension of the hyperspectral cube with spectral filters or line-scanning which can be time consuming and generally require precise moving parts, increasing the complexity. More recently, snapshot techniques have emerged, enabling capture of the full hyperspectral datacube in a single shot. However, some types of these snapshot system are bulky and complicated, which is difficult to apply to the real world. Therefore, this paper proposes a compact snapshot hyperspectral imaging system based on compressive theory, which consists of the imaging lens, light splitter, micro lens array, a metasurface-covered sensor and an RGB camera. The light of the object first passes through the imaging lens, and then a splitter divides the light equally into two directions. The light in one direction pass through the microlens array and then the light modulation is achieved by using a metasurface on the imaging sensor. Meanwhile, the light in another direction is received directly by an RGB camera. This system has the following advantages: first, the metasurface supercell can be well designed and arranged to optimize the transfer matrix of the system; second, the microlens array guarantee that the light incident on the metasurface at a small angle, which eliminate the transmittance error introduced by the incidence angle; third, the RGB camera is able to provide side information and help to ease the reconstruction.
Machine Learning with Integrated Metasystem

Zi Wang,Lorry Chang,Feifan Wang,Tiantian Li,Tingyi Gu

DOI: https://doi.org/10.1364/cleo_si.2020.sf2o.8

2020-01-01

Abstract:We utilize machine learning algorithm to design integrated photonic meta-systems, and experimentally demonstrated the device performance.
Fabry-Perot Multilayer for Spectral Imaging Applications

Guan Wang,Zeqian Gan,Chengyi Zhu,Hongfei Zhang,Paul Beckett,Yang Lim,Shuwen Pan,Jiantao Yuan,Xu Liu,Rui Yin,Xin He

DOI: https://doi.org/10.1364/josab.539977

2024-01-01

Abstract:Multispectral imaging is an emerging technology that captures multiple images across a wide range of wavelengths, including UV, visible, and IR, and even further into the electromagnetic spectrum well beyond the capabilities of the human eye. Hyperspectral imaging expands this idea to capture hundreds of bands of continuous spectra of objects with better spectral resolution but requires expensive optical components and complicated systems such as diffraction gratings, prisms, etc. The optical system for multispectral imaging technology can be made simpler and more compact. This paper presents a simple six-band multispectral imaging system based on the Fabry-Perot multilayer, which can not only generate color images but also reconstruct the spectrum data, showing promise in applications such as precision agriculture, color imaging, and remote sensing. (c) 2024 Optica Publishing Group. All rights, including for text and data mining (TDM), Artificial Intelligence (AI) training, and similar technologies, are reserved.
Metasurface on integrated photonic platform: from mode converters to machine learning

Zi Wang,Yahui Xiao,Kun Liao,Tiantian Li,Hao Song,Haoshuo Chen,S. M. Zia Uddin,Dun Mao,Feifan Wang,Zhiping Zhou,Bo Yuan,Wei Jiang,Nicolas K. Fontaine,Amit Agrawal,Alan E. Willner,Xiaoyong Hu,Tingyi Gu

DOI: https://doi.org/10.1515/nanoph-2022-0294

IF: 7.5

2022-07-21

Nanophotonics

Abstract:Integrated photonic circuits are created as a stable and small form factor analogue of fiber-based optical systems, from wavelength-division multiplication transceivers to more recent mode-division multiplexing components. Silicon nanowire waveguides guide the light in a way that single and few mode fibers define the direction of signal flow. Beyond communication tasks, on-chip cascaded interferometers and photonic meshes are also sought for optical computing and advanced signal processing technology. Here we review an alternative way of defining the light flow in the integrated photonic platform, using arrays of subwavelength meta-atoms or metalines for guiding the diffraction and interference of light. The integrated metasurface system mimics free-space optics, where on-chip analogues of basic optical components are developed with foundry compatible geometry, such as low-loss lens, spatial-light modulator, and other wavefront shapers. We discuss the role of metasurface in integrated photonic signal processing systems, introduce the design principles of such metasurface systems for low loss compact mode conversion, mathematical operation, diffractive optical systems for hyperspectral imaging, and tuning schemes of metasurface systems. Then we perceive reconfigurability schemes for metasurface framework, toward optical neural networks and analog photonic accelerators.

optics,physics, applied,materials science, multidisciplinary,nanoscience & nanotechnology
3D Convolutional Siamese Network for Few-Shot Hyperspectral Classification

Zeyu Cao,Xiaorun Li,Jiang Jianfeng,Liaoying Zhao

DOI: https://doi.org/10.1117/1.jrs.14.048504

IF: 1.568

2020-01-01

Journal of Applied Remote Sensing

Abstract:Hyperspectral classification is a widely discussed problem in the remote sensing field. Many researchers have reported good results of hyperspectral classification. However, when applied to the real world, the strong demand for labeled data for hyperspectral classification will be a big obstacle. To address this problem, researchers have explored few-shot learning and semisupervised methods in a variety of papers. We propose a siamese network composed of three-dimensional convolutional neural networks named 3DCSN. We design a structure for 3DCSN that combines contrast information with label information and get a satisfying classification result. With only a few labeled samples, it performs better than the baseline methods. Moreover, it is an end-to-end network that can use joint training. The experiments indicate the great potential of our method. (C) 2020 Society of Photo-Optical Instrumentation Engineers (SPIE)
Shortwave Infrared Single-Pixel Spectral Imaging Based on a GSST Phase-Change Metasurface

Chenning Tao,Huanzheng Zhu,Yusheng Zhang,Si Luo,Qiang Ling,Bin Zhang,Zhangwei Yu,Xiao Tao,Daru Chen,Qiang LI,Zhenrong Zheng

DOI: https://doi.org/10.1364/oe.467994

IF: 3.8

2022-01-01

Optics Express

Abstract:Shortwave infrared (SWIR) spectral imaging obtains spectral fingerprints corresponding to overtones of molecular vibrations invisible to conventional silicon-based imagers. However, SWIR imaging is challenged by the excessive cost of detectors. Single-pixel imaging based on compressive sensing can alleviate the problem but meanwhile presents new difficulties in spectral modulations, which are prerequisite in compressive sampling. In this work, we theoretically propose a SWIR single-pixel spectral imaging system with spectral modulations based on a Ge2Sb2Se4Te1 (GSST) phase-change metasurface. The transmittance spectra of the phase-change metasurface are tuned through wavelength shifts of multipole resonances by varying crystallinities of GSST, validated by the multipole decompositions and electromagnetic field distributions. The spectral modulations constituted by the transmittance spectra corresponding to the 11 phases of GSST are sufficient for the compressive sampling on the spectral domain of SWIR hyperspectral images, indicated by the reconstruction in false color and point spectra. Moreover, the feasibility of optimization on phase-change metasurface via coherence minimization is demonstrated through the designing of the GSST pillar height. The concept of spectral modulation with phase-change metasurface overcomes the static limitation in conventional modulators, whose integratable and reconfigurable features may pave the way for high-efficient, low-cost, and miniaturized computational imaging based on nanophotonics.
A broadband hyperspectral image sensor with high spatio-temporal resolution

Liheng Bian,Zhen Wang,Yuzhe Zhang,Lianjie Li,Yinuo Zhang,Chen Yang,Wen Fang,Jiajun Zhao,Chunli Zhu,Qinghao Meng,Xuan Peng,Jun Zhang

DOI: https://doi.org/10.1038/s41586-024-08109-1

IF: 64.8

2024-11-07

Nature

Abstract:Hyperspectral imaging provides high-dimensional spatial–temporal–spectral information showing intrinsic matter characteristics 1,2,3,4,5 . Here we report an on-chip computational hyperspectral imaging framework with high spatial and temporal resolution. By integrating different broadband modulation materials on the image sensor chip, the target spectral information is non-uniformly and intrinsically coupled to each pixel with high light throughput. Using intelligent reconstruction algorithms, multi-channel images can be recovered from each frame, realizing real-time hyperspectral imaging. Following this framework, we fabricated a broadband visible–near-infrared (400–1,700 nm) hyperspectral image sensor using photolithography, with an average light throughput of 74.8% and 96 wavelength channels. The demonstrated resolution is 1,024 × 1,024 pixels at 124 fps. We demonstrated its wide applications, including chlorophyll and sugar quantification for intelligent agriculture, blood oxygen and water quality monitoring for human health, textile classification and apple bruise detection for industrial automation, and remote lunar detection for astronomy. The integrated hyperspectral image sensor weighs only tens of grams and can be assembled on various resource-limited platforms or equipped with off-the-shelf optical systems. The technique transforms the challenge of high-dimensional imaging from a high-cost manufacturing and cumbersome system to one that is solvable through on-chip compression and agile computation.

multidisciplinary sciences
Metasurface-enabled broadband multidimensional photodetectors

Hao Jiang,Yinzhu Chen,Wenyu Guo,Yan Zhang,Rigui Zhou,Mile Gu,Fan Zhong,Zhenhua Ni,Junpeng Lu,Cheng-Wei Qiu,Weibo Gao

DOI: https://doi.org/10.1038/s41467-024-52632-8

2024-09-27

Abstract:Light encodes multidimensional information, such as intensity, polarization, and spectrum. Traditional extraction of this light information requires discrete optical components by subdividing the detection area into many "one-to-one" functional pixels. The broadband photodetection of high-dimensional optical information with a single integrated on-chip detector is highly sought after, yet it poses significant challenges. In this study, we employ a metasurface-assisted graphene photodetector, enabling to simultaneously detect and differentiate various polarization states and wavelengths of broadband light (1-8 μm) at the wavelength prediction accuracy of 0.5 μm. The bipolar polarizability empowered by this design allows to decouple multidimensional information (encompassing polarization and wavelength), which can be achieved by encoding vectorial photocurrents with varying polarities and amplitudes. Furthermore, cooperative multiport metasurfaces are adopted and boosted by machine learning techniques. It enables precise spin-wavelength differentiation over an extremely broad wavelength range (1-8 μm). Our innovation offers a recipe for highly compact and high-dimensional spectral-polarization co-detection.
On-chip integrated metasystem for spin-dependent multi-channel color holography

Zhan-Ying Ma,Xian-Jin Liu,Yu-Qi Peng,Da-Sen Zhang,Zhen-Zhen Liu,Jun-Jun Xiao

DOI: https://doi.org/10.1364/ol.520289

IF: 3.6

2024-05-30

Optics Letters

Abstract:Zhan-Ying Ma, Xian-Jin Liu, Yu-Qi Peng, Da-Sen Zhang, Zhen-Zhen Liu, Jun-Jun Xiao On-chip integrated metasurface driven by in-plane guided waves is of great interests in various light-field manipulation applications such ... [Opt. Lett. 49, 3114-3117 (2024)]

optics
A low-cost integrated hyperspectral imaging sensor with full temporal and spatial resolution at VIS-NIR wide range

Liheng Bian,Zhen Wang,Yuzhe Zhang,Yinuo Zhang,Chen Yang,Lianjie Li,Wen Fang,Jiajun Zhao,Chunli Zhu,Dezhi Zheng,Jun Zhang

2023-07-17

Abstract:Hyperspectral imaging provides optical information with high-dimensional spatial-temporal-spectral data cubes revealing intrinsic matter characteristics. It has been widely applied in various intelligent inspection applications. The existing hyperspectral imaging systems employ individual optical prism or grating to separate different spectra, which require complicated optical design that takes a heavy load for integration. The emerging multispectral imaging sensor integrates narrow-band filters on each pixel element, wasting most light throughput and trapped in the rigorous tradeoff between spatial and spectral resolution. In this work, we report an on-chip computational hyperspectral imaging framework with full spatial and temporal resolution. By integrating different broadband filtering materials on the imaging sensor, the target spectral information is non-uniformly and intrinsically coupled on each pixel with high light throughput. Using intelligent reconstruction algorithms, multi-channel images can be recovered from each frame, realizing real-time hyperspectral imaging. Following such a framework, we for the first time fabricated a broadband (400-1700 nm) hyperspectral imaging sensor with an average light throughput of 71.8$\%$ (enabling 32.5 dB peak signal-to-noise ratio of spectral reconstruction on ColorChecker Classic chart) and 89 wavelength channels (10 nm interval within 400-1000 nm and 25 nm interval within 1000-1700 nm). The average spectral resolution achieves 2.65 nm at 400-1000 nm and 8.59 nm at 1000-1700 nm. The demonstrated spatial resolution is 2048x2048 pixels at 47 fps, with $\sim$3.43 arc minute resolving ability at a 39-degree field of view. We employed the prototype sensor to collect a large-scale hyperspectral image dataset (210 scenes over 8 categories), and demonstrated the sensor's wide application potentials on a series of experiments ...

Optics
Random broadband filters based on combination of metasurface and multilayer thin films for hyperspectral imaging

Kai Guo,Duo Yang,Bingyi Liu,Zhongyi Guo

DOI: https://doi.org/10.1088/1361-6463/ad4370

2024-04-27

Journal of Physics D Applied Physics

Abstract:Metasurface based micro-spectrometer presents a promising avenue for achieving compact, lightweight, and cost-effective solutions for miniaturization of hyperspectral imaging systems. Nevertheless, this type of design encounter limitations primarily due to constrained manipulation mechanism of light field, resulting in high cross-correlation among transmission spectra and imperfect reconstructed images. In this paper, we propose and numerically demonstrate a micro-spectrometer based on metasurface combined with multilayer thin films, whose spectral response improves performance for application, i.e. achieving low spectral cross-correlation. Additionally, we incorporate particle swarm optimization with compressed sensing algorithm to optimize the proposed micro-spectrometer. This approach effectively reconstructs both narrowband and broadband hyperspectral signals with minimal error, achieving an impressive 2nm spectral resolution. The simulation results of hyperspectral imaging demonstrated that the proposed methodology successfully reconstructs broadband hyperspectral images with an average spectral fidelity of 91.42%. This method holds significant potential for integrating into smartphones and other portable spectrometers, advancing the design of compact hyperspectral imaging systems.

physics, applied
Multimodal In‐Sensor Computing System Using Integrated Silicon Photonic Convolutional Processor

Zian Xiao,Zhihao Ren,Yangyang Zhuge,Zixuan Zhang,Jingkai Zhou,Siyu Xu,Cheng Xu,Bowei Dong,Chengkuo Lee

DOI: https://doi.org/10.1002/advs.202408597

IF: 15.1

2024-10-29

Advanced Science

Abstract:The work demonstrates a photonic multimodal in‐sensor computing system by combining a photonic sensor and a photonic processor. By integrating the photonic sensor with a photonic processor performing convolutional operation, the complex spectroscopic data is convolved for classification with a high accuracy, proving the feasibility of photonic in‐sensor computing. Photonic integrated circuits offer miniaturized solutions for multimodal spectroscopic sensory systems by leveraging the simultaneous interaction of light with temperature, chemicals, and biomolecules, among others. The multimodal spectroscopic sensory data is complex and has huge data volume with high redundancy, thus requiring high communication bandwidth associated with high communication power consumption to transfer the sensory data. To circumvent this high communication cost, the photonic sensor and processor are brought into intimacy and propose a photonic multimodal in‐sensor computing system using an integrated silicon photonic convolutional processor. A microring resonator crossbar array is used as the photonic processor to implement convolutional operation with 5‐bit accuracy, validated through image edge detection tasks. Further integrating the processor with a photonic spectroscopic sensor, the in situ processing of multimodal spectroscopic sensory data is demonstrated, achieving the classification of protein species of different types and concentrations at various temperatures. A classification accuracy of 97.58% across 45 different classes is achieved. The multimodal in‐sensor computing system demonstrates the feasibility of integrating photonic processors and photonic sensors to enhance the data processing capability of photonic devices at the edge.

materials science, multidisciplinary,nanoscience & nanotechnology,chemistry
Metasurface-empowered snapshot hyperspectral imaging with convex/deep (CODE) small-data learning theory

Chia-Hsiang Lin,Shih-Hsiu Huang,Ting-Hsuan Lin,Pin Chieh Wu

DOI: https://doi.org/10.1038/s41467-023-42381-5

2023-11-02

Guangxue Jishu/Optical Technique

Abstract:Abstract Hyperspectral imaging is vital for material identification but traditional systems are bulky, hindering the development of compact systems. While previous metasurfaces address volume issues, the requirements of complicated fabrication processes and significant footprint still limit their applications. This work reports a compact snapshot hyperspectral imager by incorporating the meta-optics with a small-data convex/deep (CODE) deep learning theory. Our snapshot hyperspectral imager comprises only one single multi-wavelength metasurface chip working in the visible window (500-650 nm), significantly reducing the device area. To demonstrate the high performance of our hyperspectral imager, a 4-band multispectral imaging dataset is used as the input. Through the CODE-driven imaging system, it efficiently generates an 18-band hyperspectral data cube with high fidelity using only 18 training data points. We expect the elegant integration of multi-resonant metasurfaces with small-data learning theory will enable low-profile advanced instruments for fundamental science studies and real-world applications.
A 3-stage Spectral-spatial Method for Hyperspectral Image Classification

Raymond H. Chan,Ruoning Li

DOI: https://doi.org/10.48550/arXiv.2204.09294

2022-04-20

Abstract:Hyperspectral images often have hundreds of spectral bands of different wavelengths captured by aircraft or satellites that record land coverage. Identifying detailed classes of pixels becomes feasible due to the enhancement in spectral and spatial resolution of hyperspectral images. In this work, we propose a novel framework that utilizes both spatial and spectral information for classifying pixels in hyperspectral images. The method consists of three stages. In the first stage, the pre-processing stage, Nested Sliding Window algorithm is used to reconstruct the original data by {enhancing the consistency of neighboring pixels} and then Principal Component Analysis is used to reduce the dimension of data. In the second stage, Support Vector Machines are trained to estimate the pixel-wise probability map of each class using the spectral information from the images. Finally, a smoothed total variation model is applied to smooth the class probability vectors by {ensuring spatial connectivity} in the images. We demonstrate the superiority of our method against three state-of-the-art algorithms on six benchmark hyperspectral data sets with 10 to 50 training labels for each class. The results show that our method gives the overall best performance in accuracy. Especially, our gain in accuracy increases when the number of labeled pixels decreases and therefore our method is more advantageous to be applied to problems with small training set. Hence it is of great practical significance since expert annotations are often expensive and difficult to collect.

Computer Vision and Pattern Recognition,Machine Learning
Spectrometer‐Less Remote Sensing Image Classification Based on Gate‐Tunable van der Waals Heterostructures

Yali Yu,Mianzeng Zhong,Tao Xiong,Jian Yang,Pengwei Hu,Haoran Long,Ziqi Zhou,Kaiyao Xin,Yue‐Yang Liu,Juehan Yang,Jianzhong Qiao,Duanyang Liu,Zhongming Wei

DOI: https://doi.org/10.1002/advs.202309781

IF: 15.1

2024-04-13

Advanced Science

Abstract:Artificial designed gate‐tunable wide‐spectral 2D‐vdWH GaTe0.5Se0.5/WSe2‐based photodetector, requiring no additional auxiliary components, can achieve an average UV‐Vis‐NIR remote sensing image classification accuracy of 87.00% on 6 prevalent hyperspectral datasets, which is competitive with the accuracy of 250–1000 nm hyperspectral data (88.72%). It presents a promising pathway for the development of miniaturized and cost‐effective remote sensing classification technology. Remote sensing technology, which conventionally employs spectrometers to capture hyperspectral images, allowing for the classification and unmixing based on the reflectance spectrum, has been extensively applied in diverse fields, including environmental monitoring, land resource management, and agriculture. However, miniaturization of remote sensing systems remains a challenge due to the complicated and dispersive optical components of spectrometers. Here, m‐phase GaTe0.5Se0.5 with wide‐spectral photoresponses (250–1064 nm) and stack it with WSe2 are utilizes to construct a two‐dimensional van der Waals heterojunction (2D‐vdWH), enabling the design of a gate‐tunable wide‐spectral photodetector. By utilizing the multi‐photoresponses under varying gate voltages, high accuracy recognition can be achieved aided by deep learning algorithms without the original hyperspectral reflectance data. The proof‐of‐concept device, featuring dozens of tunable gate voltages, achieves an average classification accuracy of 87.00% on 6 prevalent hyperspectral datasets, which is competitive with the accuracy of 250–1000 nm hyperspectral data (88.72%) and far superior to the accuracy of non‐tunable photoresponse (71.17%). Artificially designed gate‐tunable wide‐spectral 2D‐vdWHs GaTe0.5Se0.5/WSe2‐based photodetector present a promising pathway for the development of miniaturized and cost‐effective remote sensing classification technology.

materials science, multidisciplinary,nanoscience & nanotechnology,chemistry
Deep Convolutional Neural Networks for Hyperspectral Image Classification

Wei Hu,Yangyu Huang,Li Wei,Fan Zhang,Hengchao Li

DOI: https://doi.org/10.1155/2015/258619

IF: 2.336

2015-01-01

Journal of Sensors

Abstract:Recently, convolutional neural networks have demonstrated excellent performance on various visual tasks, including the classification of common two-dimensional images. In this paper, deep convolutional neural networks are employed to classify hyperspectral images directly in spectral domain. More specifically, the architecture of the proposed classifier contains five layers with weights which are the input layer, the convolutional layer, the max pooling layer, the full connection layer, and the output layer. These five layers are implemented on each spectral signature to discriminate against others. Experimental results based on several hyperspectral image data sets demonstrate that the proposed method can achieve better classification performance than some traditional methods, such as support vector machines and the conventional deep learning-based methods.

engineering, electrical & electronic,instruments & instrumentation
Hyperspectral imaging via a multiplexing digital micromirror device

Wen Chen,Ming-Jie Sun,Wei-Jie Deng,Hai-Xiang Hu,Li-Jing Li,Xue-Jun Zhang

DOI: https://doi.org/10.1016/j.optlaseng.2021.106889

IF: 5.666

2022-04-01

Optics and Lasers in Engineering

Abstract:Spectral imaging technique, which retrieves both spatial and spectral information of a scene or an object, is an important tool in applications such as food inspection, vegetation monitoring and geographic remote sensing. Most spectral imaging systems have a complex system architecture, in which different components are used for different functions, limiting the efficiency of information retrieval. Here, we propose a hyperspectral imaging system with a simple architecture, where a multiplexing digital micromirror device functions both as a spatial light modulator for spatial imaging and a diffractive grating for spectral measuring simultaneously. The proof-of-principle system contains a group of lenses, a digital micromirror device and a one-dimensional detector array, and is capable of performing 128 × 128 pixel resolution hyperspectral imaging over the visible spectrum with an experimental 3.73 nm spectral resolution. Furthermore, by using a compressive sampling strategy, continuous real-time spectral video is performed with a frame-rate up to 10 Hz. The concise architecture of the proposed system, with the potential to be easily extended to both ultraviolet and infrared, offers an alternative scheme to manufacture low-cost, compact, hyperspectral imagers.

optics
Hyperspectral Image Classification Using Band Selection and Morphological Profile

Kun Tan,Erzhu Li,Qian Du,Peijun Du

DOI: https://doi.org/10.1109/jstars.2013.2265697

IF: 4.715

2013-01-01

IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing

Abstract:In this paper, we propose a new methodology to combine spectral information and spatial features for Support Vector Machine (SVM)-based classification. The novelty of the proposed work is in the combination of band selection (i.e., linear prediction (LP)-based method), spatial feature extraction (i.e., morphology profiles (MP)), and spectral transformation (i.e., principal component analysis (PCA)) to build a computationally tractable system. The preliminary result with ROSIS data shows that using the selected bands and MP features extracted from principal components (PCs) can yield the highest accuracy. We believe such finding is instructive to feature extraction/selection for spectral/spatial-based hyperspectral image classification.

Hyperspectral image classification via integrated metasystem

Integrated Photonic Metasystem for Image Classifications at Telecommunication Wavelength.

Bi-channel Compressive Hyperspectral Imager Based on Polarization Conversion Metasurface

A Compact Compressive Hyperspectral Imaging System Based on Metasurface

Machine Learning with Integrated Metasystem

Fabry-Perot Multilayer for Spectral Imaging Applications

Metasurface on integrated photonic platform: from mode converters to machine learning

3D Convolutional Siamese Network for Few-Shot Hyperspectral Classification

Shortwave Infrared Single-Pixel Spectral Imaging Based on a GSST Phase-Change Metasurface

A broadband hyperspectral image sensor with high spatio-temporal resolution

Metasurface-enabled broadband multidimensional photodetectors

On-chip integrated metasystem for spin-dependent multi-channel color holography

A low-cost integrated hyperspectral imaging sensor with full temporal and spatial resolution at VIS-NIR wide range

Random broadband filters based on combination of metasurface and multilayer thin films for hyperspectral imaging

Multimodal In‐Sensor Computing System Using Integrated Silicon Photonic Convolutional Processor

Metasurface-empowered snapshot hyperspectral imaging with convex/deep (CODE) small-data learning theory

A 3-stage Spectral-spatial Method for Hyperspectral Image Classification

Spectrometer‐Less Remote Sensing Image Classification Based on Gate‐Tunable van der Waals Heterostructures

Deep Convolutional Neural Networks for Hyperspectral Image Classification

Hyperspectral imaging via a multiplexing digital micromirror device

Hyperspectral Image Classification Using Band Selection and Morphological Profile