Abstract:The data's dimensionality had already risen sharply in the last several decades. The "Dimensionality Curse" (DC) is a problem for conventional learning techniques when dealing with "Big Data (BD)" with a higher level of dimensionality. A learning model's performance degrades when there is a numerous range of features present. "Dimensionality Reduction (DR)" approaches are used to solve the DC issue, and the field of "Machine Learning (ML)" research is significant in this regard. It is a prominent procedure to use "Feature Selection (FS)" to reduce dimensions. Improved learning effectiveness such as greater classification precision, cheaper processing costs, and improved model comprehensibility are all typical outcomes of this approach that selects an optimal portion of the original features based on some relevant assessment criteria. An "Adaptive Firefly Optimization (AFO)" technique based on the "Map Reduce (MR)" platform is developed in this research. During the initial phase (mapping stage) the whole large "DataSet (DS)" is first subdivided into blocks of contexts. The AFO technique is then used to choose features from its large DS. In the final phase (reduction stage), every one of the fragmentary findings is combined into a single feature vector. Then the "Multi Kernel Support Vector Machine (MKSVM)" classifier is used as classification in this research to classify the data for appropriate class from the optimal features obtained from AFO for DR purposes. We found that the suggested algorithm AFO combined with MKSVM (AFO-MKSVM) scales very well to high-dimensional DSs which outperforms the existing approach "Linear Discriminant Analysis-Support Vector Machine (LDA-SVM)" in terms of performance. The evaluation metrics such as Information-Ratio for Dimension-Reduction, Accuracy, and Recall, indicate that the AFO-MKSVM method established a better outcome than the LDA-SVM method.

An Adaptive And Efficient Dimensionality Reduction Algorithm For High-Dimensional Indexing

An Adaptive and Dynamic Dimensionality Reduction Method for High-Dimensional Indexing.

A High Dimensional Index Based on Relative Distance Hashing Method

Survey of Dimension Reduction Methods in High-dimensional Indexing Schemes

High-dimensional Learned Index Based on Space Division and Dimension Reduction

Dimensionality reduction for histogram features: A distance-adaptive approach.

Neighbourhood-preserving Dimension Reduction Via Localised Multidimensional Scaling

An Adaptive Class Pairwise Dimensionality Reduction Algorithm

Adaptive Dimension Reduction for Clustering High Dimensional Data

Hypercube-Based High-Dimensional Index Using Co-clustering

Novel High-Dimensional Indexing Structure Based on Dual-Distance Metric

An Adaptive Firefly Optimization (AFO) with Multi-Kernel SVM (MKSVM) Classification for Big Data Dimensionality Reduction

Improving Similarity Search of Multidimensional Data by Reducing Query Space

A High Dimensional Data Indexing Technique Based on Max Gap Space Mapping

Feature dimensionality reduction: a review

Dynamic High Dimensional Data Mapping for Efficient Similarity Query Processing

High-dimensional indexing with oriented cluster representation for multimedia databases

A Survey of Multi-Dimensional Indexes: Past and Future Trends

Fast Unsupervised Dimension Reduction Method Based on Maximum Entropy

Research on High-dimensional Indexing Scheme for Large Image Database

Composite Distance Transformation for Indexing and K -Nearest-neighbor Searching in High-Dimensional Spaces