Abstract:In this talk we review the recent work done by our group on data mining (DM) technologies deduced from simulating visual principle. Through viewing a DM problem as a cognition problems and treading a data set as an image with each light point located at a datum position, we developed a series of high efficient algorithms for clustering, classification and regression via mimicking visual principles. In pattern recognition, human eyes seem to possess a singular aptitude to group objects and find important structure in an efficient way. Thus, a DM algorithm simulating visual system may solve some basic problems in DM research. From this point of view, we proposed a new approach for data clustering by modeling the blurring effect of lateral retinal interconnections based on scale space theory. In this approach, as the data image blurs, smaller light blobs merge into large ones until the whole image becomes one light blob at a low enough level of resolution. By identifying each blob with a cluster, the blurring process then generates a family of clustering along the hierarchy. The proposed approach provides unique solutions to many long standing problems, such as the cluster validity and the sensitivity to initialization problems, in clustering. We extended such an approach to classification and regression problems, through combatively employing the Weber’s law in physiology and the cell response classification facts. The resultant classification and regression algorithms are proven to be very efficient and solve the problems of model selection and applicability to huge size of data set in DM technologies. We finally applied the similar idea to the difficult parameter setting problem in support vector machine (SVM). Viewing the parameter setting problem as a recognition problem of choosing a visual scale at which the global and local structures of a data set can be preserved, and the difference between the two structures be maximized in the feature space, we derived a direct parameter setting formula for the Gaussian SVM. The simulations and applications show that the suggested formula significantly outperforms the known model selection methods in terms of efficiency and precision. The advantages of the proposed approaches are: 1) The derived algorithms are computational stable and insensitive to initialization and they are totally free from solving difficult global optimization problems. 2) They facilitate the construction of new checks on DM validity and provide the final DM result a significant degree of robustness to noise in data and change in scale. 3) They are free from model selection in application. 4) The DM results are highly consistent with those perceived by our human eyes. 5) They provide unified frameworks for scale-related DM algorithms recently derived from many other fields such as estimation theory, recurrent signal processing, information theory and statistical mechanics, and artificial neural networks.

Computational intelligence based sustainable computing with classification model for big data visualization on map reduce environment

CLASSIFICATION ALGORITHMS FOR BIG DATA ANALYSIS, A MAP REDUCE APPROACH

Modeling of class imbalance handling with optimal deep learning enabled big data classification model

Closed-loop Big Data Analysis with Visualization and Scalable Computing

A Novel Intelligent Clustering Approach For High Dimensional Data In A Big Data Environment

Learning for Visual Semantic Understanding in Big Data

Improved classification approach for use with large-scale scene images in the Hadoop cluster environment.

Big Data Visualization Collaborative Filtering Algorithm Based on RHadoop

On the Architecture of a Big Data Classification Tool Based on a Map Reduce Approach for Hyperspectral Image Analysis

Optimized Big Data K-means Clustering Using MapReduce

An Intelligent Clustering Algorithm for High-Dimensional Multiview Data in Big Data Applications

An Efficient Big Data Visualization Deep Learning Architecture Model for Path Selection of College Students through Moral Education

Data Mining Technologies Inspired from Visual Principle

Hybrid local diffusion maps and improved cuckoo search algorithm for multiclass dataset analysis.

An optimized SVM-RFE based feature selection and weighted entropy K-means approach for big data clustering in mapreduce

Data Clustering in Urban Computational Modeling by Integrated Geometry and Imagery Features for Probabilistic Navigation

Parallel Implementation Of Classification Algorithms Based On Mapreduce

Research on Belt and Road Big Data Visualization Based on Text Clustering Algorithm

An Integrated Cluster Detection, Optimization, and Interpretation Approach for Financial Data

Towards Mapreduce Approach With Dynamic Fuzzy Inference/Interpolation For Big Data Classification Problems

Visual design of green information in urban environment based on global similarity calculation and multi-dimensional visualization technology