New Dimension Reduction Approach

WU Ling-da,HE Ling,CAI Yi-chao

DOI: https://doi.org/10.3969/j.issn.1001-3695.2007.03.025

2007-01-01

Abstract:Aiming at the 72-dimensional HSV feature of image color,this paper made a significant improvement to the intrinsic dimensionality of data set at first.Then it proposed a new dimension reduction approach.Experiments show that this method is efficient.

What problem does this paper attempt to address?

A New Dimension Reduction Index Method for Large Image Databases

HE Ling,WU Lingda,CAI Yichao

DOI: https://doi.org/10.3969/j.issn.1000-3428.2006.22.007

2006-01-01

Abstract:Aiming at the 72-dimensional HSV color feature in content-based image retrieval(CBIR),this paper proposes a new dimension reduction idea.It preserves the intrinsic merits of the original image color feature.Based on dimension reduction,it puts forward a new indexing structure to improve the performance of content-based retrieval of large image databases.Experiments show that this method is effective.
Research on High-dimensional Indexing Scheme for Large Image Database

HE Ling,WU Ling-da,CAI Yi-chao

DOI: https://doi.org/10.3969/j.issn.1000-1220.2007.01.030

2007-01-01

Abstract:Aiming at the 72-dimensional HSV feature of image color, this paper proposes a new dimension reduction indexing method. Compared with other dimension reduction schemes, this method can not only retain the important information of the whole data space, but also preserve the important merits of high-dimensional individuals. The experiments on a large image database show both a remarkable reduction of I/O overhead of the data accesses which dominates the query time in the searches and a remarkable improvement performance in the searching.
Image Dimensionality Reduction Based on the HSV Feature

Liang Lei,Xue Wang,Bo Yang,Jun Peng

DOI: https://doi.org/10.1109/coginf.2010.5599753

2010-01-01

Abstract:How to reduce more of the image dimensions without losing the main features of the image is highlighted in the research of Web content-based image retrieval. This paper started by analysis of commonly used methods for the dimension reduction of Web images, followed by proposing dimensionality reduction method that is based on HSV features, where the HSV color histogram intersection was used as the function of similarity judgments. And the concept of intrinsic dimension was referenced to reduce the amount of calculation on the image dimensionality reduction. Finally, some improvements were made on the traditional genetic algorithm by use of the image similarity function as the self-adaptive judgment function to improve the genetic operators, thus achieving a Web image dimensionality reduction and similarity retrieval. The results showed that this method has greatly improved the image retrieval in time and precision rates.
A New Nonlinear Dimensionality Reduction for Color Image

徐志节,杨杰,王猛

DOI: https://doi.org/10.3321/j.issn:1006-2467.2004.12.024

2004-01-01

Shanghai Jiaotong Daxue Xuebao/Journal of Shanghai Jiaotong University

Abstract:Content Based Image Retrieval (CBIR) is an important component in the context of image, and the color based feature extraction is often used in CBIR. Large number of image features is an obstacle for fast image matching. The chromaticity histogram was extracted as the input features and then the locally linear embedding (LLE) algorithm was used to reduce the dimensionality. At last, the color images in four color spaces was classified by simple classifiers. The results prove that the LLE outperforms the principal component analysis (PCA) while dealing with nonlinear data in the task of dimensionality reduction.
Dimensionality reduction based on spectral graph and its application

WAN Hai-ping,HE Hua-can

2006-01-01

Abstract:Most machine learning tasks confront the problem of dimensionality reduction for extracting meaningful features and processing convenience.In these topological spaces,it usually adopts Euclidean distance to measure similarity between objects.It is argued that in many learning tasks the path from one object to another will also be a proper alternative.Also the relationship between local and global information is discussed when selecting features.A dimensionality reduction method incorporating both path and distance feature is proposed based on spectral graph theory which aims at preserving local meaningful neighborhood structures in the original data.In the experiments of both face recognition and information retrieval,it achieves positive results.
Comparative Study on Dimensionality Reduction in Large-Scale Image Retrieval

Bo Cheng,Li Zhuo,Jing Zhang

DOI: https://doi.org/10.1109/ISM.2013.86

2013-01-01

Multimedia

Abstract:Dimensionality reduction plays a significant role for the performance of large-scale image retrieval. In this paper, various dimensionality reduction methods are compared to validate their own performance in image retrieval. For this purpose, first, the Scale Invariant Feature Transform (SIFT) features and HSV (Hue, Saturation, Value) histogram are extracted as image features. Second, the Principal Component Analysis (PCA), Fisher Linear Discriminant Analysis (FLDA), Local Fisher Discriminant Analysis (LFDA), Isometric Mapping (ISOMAP), Locally Linear Embedding (LLE), and Locality Preserving Projections (LPP) are respectively applied to reduce the dimensions of SIFT feature descriptors and color information, which can be used to generate vocabulary trees. Finally, through setting the match weights of vocabulary trees, large-scale image retrieval scheme is implemented. By comparing multiple sets of experimental data from several platforms, it can be concluded that dimensionality reduction method of LLE and LPP can effectively reduce the computational cost of image features, and maintain the high retrieval performance as well.
Dimension Reduction of Hyperspectral Images with Sparse Linear Discriminant Analysis

Jiming Li,Yuntao Qian

DOI: https://doi.org/10.1109/igarss.2011.6049828

2011-01-01

Abstract:Hyperspectral imagery generally contains enormous amounts of data due to hundreds of spectral bands. Classification for these high-dimensional data often requires a large set of training samples and enormous processing time. Therefore, dimension reduction methods for hyperspectral data are catching the attention of researchers lately. In this paper, a dimension reduction method based on sparse penalty regularized linear discriminant analysis was experimented on hyperspectral data. Through imposing sparsity regularization penalty on the Fisher's discriminant analysis projection matrix via the optimal scoring technique, sparse linear discriminant vectors can be achieved. Therefore, interpretability of the spectral bands' physical meaning and effective low dimensional data transforming can be achieved simultaneously in the same model. Experimental analysis on the sparsity and efficacy of low dimensional outputs showed that, sparse linear discriminant analysis can yield good classification results and interpretability in spectral domain.
Multi-Spectral Color Data Dimension Reduction Model Research Based on Sparse Representation

Fang Xinyi,Wan Xiaoxia,Shi Shuo,Teng Xiao,Yu Junyan

DOI: https://doi.org/10.3788/lop202158.2230003

2021-01-01

Laser & Optoelectronics Progress

Abstract:In order to solve the problem of real color reproduction in real three-dimensional images of multispectral lidar system, a dimensionality reduction method of multi-spectral color data based on sparse signal representation is proposed in this paper. This method utilizes dictionary learning and alternate update of sparse coding to correct spectral errors in an iterative way. Root mean square error of the experimental results show that the proposed method is the principal component analysis is reduced by 35.29%, the average of spectrum fitting coefficient reaches more than 99.8 %, and the average of chromaticity accuracy than principal component analysis on average increases by 70. 23%, under different light source observation conditions still can maintain the stability of color, its reconstruction precision is better than that of the principal component analysis. The sparse representation can recover high-dimensional sparse signals through low-dimensional observation vectors. This method can accurately recover a large number of test samples from a relatively small number of training samples, which improves the cost efficiency of data processing and is of great help to truly reflect the ground object information of remote sensing multi-spectral images.
Image Dimensionality Reduction Based on the Intrinsic Dimension and Parallel Genetic Algorithm

Liang Lei,TongQing Wang,Jun Peng,Bo Yang

DOI: https://doi.org/10.4018/jcini.2011040106

2011-01-01

Abstract:In the research of Web content-based image retrieval, how to reduce more of the image dimensions without losing the main features of the image is highlighted. Many features of dimensional reduction schemes are determined by the breaking of higher dimensional general covariance associated with the selection of a particular subset of coordinates. This paper starts with analysis of commonly used methods for the dimension reduction of Web images, followed by a new algorithm for nonlinear dimensionality reduction based on the HSV image features. The approach obtains intrinsic dimension estimation by similarity calculation of two images. Finally, some improvements were made on the Parallel Genetic Algorithm APGA by use of the image similarity function as the self-adaptive judgment function to improve the genetic operators, thus achieving a Web image dimensionality reduction and similarity retrieval. Experimental results illustrate the validity of the algorithm.
Data Dimension Reduction Based on Concept Lattices in Image Mining

罗伟,王莉,艾丽,王月行

DOI: https://doi.org/10.1109/fskd.2009.685

2009-01-01

Abstract:High-dimensional image feature data is an obstacle for image mining. In order to reduce the image feature data dimension, this paper introduces a method based on concept lattices. After introducing the basic concepts of formal context theory and the attribute reduction of concept lattices, the feature attribute set produce algorithm and the dimension reduction algorithm are put forward. In the algorithm, the image formal context, which is transformed from the HSV color feature, and then the attributes of the concept lattices are reduced. The experiment results prove that this method is efficient, and it outperforms the principal component analysis (PCA).
Dimensionality Reduction Via Preserving Local Information

Shangguang Wang,Chuntao Ding,Ching-Hsien Hsu,Fangchun Yang

DOI: https://doi.org/10.1016/j.future.2018.01.016

IF: 7.307

2018-01-01

Future Generation Computer Systems

Abstract:Dimensionality reduction is an important technique for multimedia data in smart cities. As a significant type of multimedia data, images are being processed frequently using such technique. It is worth noting that finding neighbors is an integral part of graph embedding algorithms in dimensionality reduction. In this paper, we present an effective and efficient metric function, named local similarity preserving (LSP), which can preserve the similarity information of each sample to its homogeneous and heterogeneous neighbors. The proposed LSP function is helpful to enhance the discriminative capability of subsequent feature extractors. Based on LSP function, we also propose two novel algorithms, local similarity preserving discriminant (LSPD) algorithm, which can preserve the local similarity information and LSPD+ algorithm, which can preserve the local similarity and geometric structure information, respectively. The experimental results on digit visualization and face recognition demonstrate the effectiveness and efficiency of the proposed algorithms.
Dimensionally Reduction: An Experimental Study

Xin Song,Zhihua Cai,Wei Xu

DOI: https://doi.org/10.1007/978-3-319-14717-8_30

2014-01-01

Abstract:Dimensionality reduction as the available method to overcome the “curses of dimensionality” has attracted wide attention. However, the pervious studies treat the visualization and the subsequent classification performance separately. In this case, we do not know whether there is a underlying relationship (i.e., direct proportion) between visualization and the followed classification performance.
Research on Dimensionality Reduction Technology of Hyperspectral Data

WANG Xu-hong,XIAO-ping,GUO Jian-ming

DOI: https://doi.org/10.3969/j.issn.1000-288x.2006.06.022

2006-01-01

Abstract:Hyperspectral data have a high spectral resolution for the objects of the earth. However,many analysis approaches of hyperspectral data do not provide a promising result because of its great data volume and strong correlation between its neighboring bands.Consequently,it restricts the efficiency and broad application of high resolution data.The research indicates that feature extraction is the highly effective theory and method to optimize hyperspectral data and information.The result of experiment shows that with a given precision of classification,the reduction in dimensionality without loss of information improves the classifier performance,and helps to achieve the aims of optimal process and effective utilization of hyperspectral remote sensing data.
A Comparative Study of Dimensionality Reduction Methods for Large-Scale Image Retrieval.

Li Zhuo,Bo Cheng,Jing Zhang

DOI: https://doi.org/10.1016/j.neucom.2014.03.014

IF: 6

2014-01-01

Neurocomputing

Abstract:“Curse of Dimensionality” is one of the important problems that Content-Based Image Retrieval (CBIR) confronts. Dimensionality reduction is an effective method to overcome it. In this paper, six commonly-used dimensionality reduction methods are compared and analyzed to examine their respective performance in image retrieval. The six methods include Principal Component Analysis (PCA), Fisher Linear Discriminant Analysis (FLDA), Local Fisher Discriminant Analysis (LFDA), Isometric Mapping (ISOMAP), Locally Linear Embedding (LLE), and Locality Preserving Projections (LPP). For comparison, Scale Invariant Feature Transform (SIFT) and color histogram in Hue, Saturation, Value (HSV) color space are firstly extracted as image features, meanwhile SIFT feature extraction procedure is optimized to reduce the number of SIFT features. Then, PCA, FLDA, LFDA, ISOMAP, LLE, and LPP are respectively applied to reduce the dimensions of feature vectors, which can be used to generate vocabulary trees. Finally, we can process large-scale image retrieval based on the inverted index built by vocabulary trees. In the experiments, the performance of various dimensionality reduction methods are analyzed comprehensively by comparing the retrieval performance, advantages and disadvantages, computational complexity and time-consuming of image retrieval. Through a series of experiments, we can conclude that dimensionality reduction method of LLE and LPP can effectively reduce computational complexity of image retrieval, while maintaining high retrieval performance.
Transferred Dimensionality Reduction

Zheng Wang,Yangqiu Song,Changshui Zhang

DOI: https://doi.org/10.1007/978-3-540-87481-2_36

2008-01-01

Abstract:Dimensionality reduction is one of the widely used techniques for data analysis. However, it is often hard to get a demanded low-dimensional representation with only the unlabeled data, especially for the discriminative task. In this paper, we put forward a novel problem of Transferred Dimensionality Reduction, which is to do unsupervised discriminative dimensionality reduction with the help of related prior knowledge from other classes in the same type of concept. We propose an algorithm named Transferred Discriminative Analysis to tackle this problem. It uses clustering to generate class labels for the target unlabeled data, and use dimensionality reduction for them joint with prior labeled data to do subspace selection. This two steps run adaptively to find a better discriminative subspace, and get better clustering results simultaneously. The experimental results on both constrained and unconstrained face recognition demonstrate significant improvements of our algorithm over the state-of-the-art methods.
Dimensionality reduction for histogram features: A distance-adaptive approach.

Miaomiao Cui,Jiangtao Cui,Hui Li

DOI: https://doi.org/10.1016/j.neucom.2015.03.123

IF: 6

2016-01-01

Neurocomputing

Abstract:Histogram representations of visual features, such as high dimensional Bag-of-Features (BOF) and Spatial Pyramid Matching (SPM) representation, have been widely studied and adopted in image classification and retrieval due to their simplicity and performance. Problems involving high dimensional feature vectors usually require much computational cost and huge storage space. Moreover, it may additionally suffer from low accuracy because of the noise in data. In this paper we propose a novel distance-adaptive dimensionality reduction framework, namely generalized Multidimensional Scaling, with linear coding time to create compact and discriminative BOF or SPM representations. Comparing with traditional MDS, our approach exhibits two advantages, on one hand it is adaptive to many measures; on the other hand, it is able to map arbitrary query points into the new space. Exhaustive experimental results show that a very low dimension of BOF or SPM is sufficient for the retrieval task without losing accuracy. Comparatively, the state-of-the-art methods cannot achieve high accuracy on the low dimension. Aside from image retrieval task, we also show that our approach is much more effective than the original histogram representations when applied in image classification task.
Discriminant Analysis-Based Dimension Reduction for Hyperspectral Image Classification: A Survey of the Most Recent Advances and an Experimental Comparison of Different Techniques

Wei Li,Fubiao Feng,Hengchao Li,Qian Du

DOI: https://doi.org/10.1109/mgrs.2018.2793873

IF: 14.6

2018-01-01

IEEE Geoscience and Remote Sensing Magazine

Abstract:Hyperspectral imagery contains hundreds of contiguous bands with a wealth of spectral signatures, making it possible to distinguish materials through subtle spectral discrepancies. Because these spectral bands are highly correlated, dimensionality reduction, as the name suggests, seeks to reduce data dimensionality without losing desirable information. This article reviews discriminant analysisbased dimensionality-reduction approaches for hyperspectral imagery, including typical linear discriminant analysis (LDA), state-of-the-art sparse graph-based discriminant analysis (SGDA), and their extensions.
Dimension reduction method based on spectral regression and graph regularization least square regression

Qian WENG,Zhengyuan MAO,Jiawen LIN,Cairen JIAN

DOI: https://doi.org/10.3778/j.issn.1002-8331.1507-0300

2017-01-01

Abstract:Data dimension reduction is significant to research high-dimensional data. Sparse concept coding receives widespread attention, but the sparse representation coefficients fail to maintain the essential structure of the data. In re-sponse to this discovery, a method based on spectral regression and graph regularization least square regression for data di-mension reduction is proposed. The experiments on two image data sets and two gene expression data sets show the pro-posed method is better than the unimproved sparse concept coding.
Dimensionality Reduction By Using Sparse Reconstruction Embedding

Shaoli Huang,Cheng Cai,Yang Zhang

DOI: https://doi.org/10.1007/978-3-642-15696-0_16

2010-01-01

Abstract:Traditional algorithms for dimensionality reduction attempt to preserve the intrinsic geometric properties from high-dimensional space to low-dimensional space. However, these algorithms have poor discrimination on intersecting data and poorly sampled data for classification tasks, because the distance metric methods used for describing the geometric properties are meaningless when processing under-sampled or intersection data. In this paper, we provide a new perspective on solving the problem of dimensionality reduction and propose a novel and parameter-free algorithm called Sparse Reconstruction Embedding(SRE). In SRE, each point is first reconstructed from all the other points by minimizing the reconstruction errors and L-0 norm, and then mapped into low-dimensional coordinates by preserving the minimum of reconstruction errors. Experimental results show that our approach is much more discriminant and insensitive to under-sampled and intersecting data. We also demonstrate that SEE outperforms the state-of-art algorithms both on artificial datasets and natural datasets in classification tasks.
Feature dimensionality reduction: a review

Weikuan Jia,Meili Sun,Jian Lian,Sujuan Hou

DOI: https://doi.org/10.1007/s40747-021-00637-x

2022-01-21

Abstract:Abstract As basic research, it has also received increasing attention from people that the “curse of dimensionality” will lead to increase the cost of data storage and computing; it also influences the efficiency and accuracy of dealing with problems. Feature dimensionality reduction as a key link in the process of pattern recognition has become one hot and difficulty spot in the field of pattern recognition, machine learning and data mining. It is one of the most challenging research fields, which has been favored by most of the scholars’ attention. How to implement “low loss” in the process of feature dimension reduction, keep the nature of the original data, find out the best mapping and get the optimal low dimensional data are the keys aims of the research. In this paper, two-dimensionality reduction methods, feature selection and feature extraction, are introduced; the current mainstream dimensionality reduction algorithms are analyzed, including the method for small sample and method based on deep learning. For each algorithm, examples of their application are given and the advantages and disadvantages of these methods are evaluated.

computer science, artificial intelligence

New Dimension Reduction Approach

A New Dimension Reduction Index Method for Large Image Databases

Research on High-dimensional Indexing Scheme for Large Image Database

Image Dimensionality Reduction Based on the HSV Feature

A New Nonlinear Dimensionality Reduction for Color Image

Dimensionality reduction based on spectral graph and its application

Comparative Study on Dimensionality Reduction in Large-Scale Image Retrieval

Dimension Reduction of Hyperspectral Images with Sparse Linear Discriminant Analysis

Multi-Spectral Color Data Dimension Reduction Model Research Based on Sparse Representation

Image Dimensionality Reduction Based on the Intrinsic Dimension and Parallel Genetic Algorithm

Data Dimension Reduction Based on Concept Lattices in Image Mining

Dimensionality Reduction Via Preserving Local Information

Dimensionally Reduction: An Experimental Study

Research on Dimensionality Reduction Technology of Hyperspectral Data

A Comparative Study of Dimensionality Reduction Methods for Large-Scale Image Retrieval.

Transferred Dimensionality Reduction

Dimensionality reduction for histogram features: A distance-adaptive approach.

Discriminant Analysis-Based Dimension Reduction for Hyperspectral Image Classification: A Survey of the Most Recent Advances and an Experimental Comparison of Different Techniques

Dimension reduction method based on spectral regression and graph regularization least square regression

Dimensionality Reduction By Using Sparse Reconstruction Embedding

Feature dimensionality reduction: a review