Abstract:The information age has brought a deluge of data. Much of this is in text form, insurmountable in scope for humans and incomprehensible in structure for computers. Text mining is an expanding field of research that seeks to utilize the information contained in vast document collections. General data mining methods based on machine learning face challenges with the scale of text data, posing a need for scalable text mining methods. This thesis proposes a solution to scalable text mining: generative models combined with sparse computation. A unifying formalization for generative text models is defined, bringing together research traditions that have used formally equivalent models, but ignored parallel developments. This framework allows the use of methods developed in different processing tasks such as retrieval and classification, yielding effective solutions across different text mining tasks. Sparse computation using inverted indices is proposed for inference on probabilistic models. This reduces the computational complexity of the common text mining operations according to sparsity, yielding probabilistic models with the scalability of modern search engines. The proposed combination provides sparse generative models: a solution for text mining that is general, effective, and scalable. Extensive experimentation on text classification and ranked retrieval datasets are conducted, showing that the proposed solution matches or outperforms the leading task-specific methods in effectiveness, with a order of magnitude decrease in classification times for Wikipedia article categorization with a million classes. The developed methods were further applied in two 2014 Kaggle data mining prize competitions with over a hundred competing teams, earning first and second places.

Optimizing a Data Science System for Text Reuse Analysis

A Review of Best Practice Recommendations for Text Analysis in R (and a User-Friendly App)

Text data mining and data quality management for research information systems in the context of open data and open science

A systematic evaluation of text mining methods for short texts: Mapping individuals' internal states from online posts

Patterns of Text Reuse in a Scientific Corpus

Text analysis using deep neural networks in digital humanities and information science

Text Mining in Big Data Analytics

Text Reuse Detection in Handwritten Documents

The Landscape of Data Reuse in Interactive Information Retrieval: Motivations, Sources, and Evaluation of Reusability

Analyzing Large Collections of Electronic Text Using OLAP

Text Preprocessing for Text Mining in Organizational Research: Review and Recommendations

How We Do Things With Words: Analyzing Text as Social and Cultural Data

Machine Identification of High Impact Research through Text and Image Analysis

Text Analysis in R

Reusing Data Technical and Ethical Challenges

The changing landscape of text mining: a review of approaches for ecology and evolution

Scalable Text Mining with Sparse Generative Models

Talking datasets: Understanding data sensemaking behaviours

A Survey of Text Representation Methods and Their Genealogy

What's In My Big Data?

Can You Explain That, Better? Comprehensible Text Analytics for SE Applications