Abstract:Wisdom of the crowd, the collective intelligence derived from responses of multiple human or machine individuals to the same questions, can be more accurate than each individual, and improve social decision-making and prediction accuracy. This can also integrate multiple programs or datasets, each as an individual, for the same predictive questions. Crowd wisdom estimates each individual's independent error level arising from their limited knowledge, and finds the crowd consensus that minimizes the overall error. However, previous studies have merely built isolated, problem-specific models with limited generalizability, and mainly for binary (yes/no) responses. Here we show with simulation and real-world data that the crowd wisdom problem is analogous to one-dimensional unsupervised dimension reduction in machine learning. This provides a natural class of crowd wisdom solutions, such as principal component analysis and Isomap, which can handle binary and also continuous responses, like confidence levels, and consequently can be more accurate than existing solutions. They can even outperform supervised-learning-based collective intelligence that is calibrated on historical performance of individuals, e.g. penalized linear regression and random forest. This study unifies crowd wisdom and unsupervised dimension reduction, and thereupon introduces a broad range of highly-performing and widely-applicable crowd wisdom methods. As the costs for data acquisition and processing rapidly decrease, this study will promote and guide crowd wisdom applications in the social and natural sciences, including data fusion, meta-analysis, crowd-sourcing, and committee decision making.

Improving Image Clustering using Sparse Text and the Wisdom of the Crowds

Improving Short Text Classification Through Better Feature Space Selection

Bridging the Semantic Gap Between Image Contents and Tags

Web Image Clustering by Consistent Utilization of Visual Features and Surrounding Texts.

Clustering web images by correlation mining of image-text

Co-Clustering With Manifold And Double Sparse Representation

Sparse Poisson coding for high dimensional document clustering

Semantic Retrieval of Personal Photos Using Matrix Factorization and Two-Layer Random Walk Fusing Sparse Speech Annotations with Visual Features

Multiple Hypergraph Clustering of Web Images by MiningWord2Image Correlations.

Web image clustering method based on image and text relevant mining

Organizing Unstructured Image Collections using Natural Language

Constrained Coclustering for Textual Documents.

Semantic Term "Blurring" and Stochastic "Barcoding" for Improved Unsupervised Text Classification

An Efficient and Explanatory Image and Text Clustering System with Multimodal Autoencoder Architecture

A data-driven study of image feature extraction and fusion

Automatic annotation of weakly-tagged social images on flickr using latent topic discovery of multiple groups

Constrained Text Coclustering with Supervised and Unsupervised Constraints

Wisdom of the crowd from unsupervised dimension reduction

On improvability of hash clustering data from different sources by bipartite graph

Simultaneous Enhance Text Clustering and Annotation Based on Topic Model and Random Walks

Information Retrieval in long documents: Word clustering approach for improving Semantics