Abstract:In recent years, many image-based approaches have been proposed to classify plant species. Most methods utilized red green blue (RGB) imaging materials and designed custom features to classify the plant images using machine learning algorithms. Those works primarily focused on analyzing single-leaf images instead of live-crown images. Without considering the additional features of the leaves’ color and spatial pattern, they failed to handle cases that contained leaves similar in appearance due to the limited spectral information of RGB imaging. To tackle this dilemma, this study proposes a novel framework that combines hyperspectral imaging (HSI) and deep learning techniques for plant image classification. We built a plant image dataset containing 1,500 images of 30 different plant species taken by a 470–900 nm hyperspectral camera and designed a lightweight conventional neural network (CNN) model (LtCNN) to perform image classification. Several state-of-art CNN classifiers are chosen for comparison. The impact of using different band combinations as the network input is also investigated. Results show that using simulated RGB images achieves a kappa coefficient of nearly 0.90 while using the combination of 3-band RGB and 3-band near-infrared images can improve to 0.95. It is also found that the proposed LtCNN can obtain a satisfactory performance of plant classification (kappa = 0.95) using critical spectral features of the green edge (591 nm), red-edge (682 nm), and near-infrared (762 nm) bands. This study also demonstrates the excellent adaptability of the LtCNN model in recognizing leaf features of plant live-crown images while using a relatively smaller number of training samples than complex CNN models such as AlexNet, GoogLeNet, and VGGNet.

Plant Taxonomy-Guided Path-Based Tree Classifier for Large-Scale Plant Species Identification

Deep Learning of Path-Based Tree Classifiers for Large-Scale Plant Species Identification

Plant Species Identification by Bi-channel Deep Convolutional Networks

Aggregating Diverse Deep Attention Networks for Large-Scale Plant Species Identification

Hierarchical Learning of Tree Classifiers for Large-Scale Plant Species Identification

Research on the Fine-Grained Plant Image Classification

An Improved Res-UNet Model for Tree Species Classification Using Airborne High-Resolution Images

Plant Taxonomy In Hainan Based On Deep Convolutional Neural Network And Transfer Learning

Central Attention and a Dual Path Convolutional Neural Network in Real-World Tree Species Recognition

Deep Learning with Taxonomic Loss for Plant Identification

Plant identification based on very deep convolutional neural networks

Real-world plant species identification based on deep convolutional neural networks and visual attention

Deep Learning for Plant Identification in Natural Environment

Plant Identification Based on Multi-branch Convolutional Neural Network with Attention.

Transfer Learning with Deep Convolutional Neural Network for Automated Plant Identification

Plant Leaf Recognition Based On Small Datasets Using Deep Learning Algorithm

Deep Learning for Plant Species Classification Using Leaf Vein Morphometric

: Recognizing Leaf Images Like Human Botanists.

Method of plant leaf recognition based on improved deep convolutional neural network.

Forest Representation Learning with Multiscale Contour Feature Learning for Leaf Cultivar Classification.

Plant Species Classification Based on Hyperspectral Imaging via a Lightweight Convolutional Neural Network Model