Abstract:Recent advances in text mining and natural language processing technology have enabled researchers to detect an authors identity or demographic characteristics, such as age and gender, in several text genres by automatically analysing the variation of linguistic characteristics. However, applying such techniques in the wild, i.e., in both cybercriminal and regular online social media, differs from more general applications in that its defining characteristics are both domain and process dependent. This gives rise to a number of challenges of which contemporary research has only scratched the surface. More specifically, a text mining approach applied on social media communications typically has no control over the dataset size, the number of available communications will vary across users. Hence, the system has to be robust towards limited data availability. Additionally, the quality of the data cannot be guaranteed. As a result, the approach needs to be tolerant to a certain degree of linguistic noise (for example, abbreviations, non-standard language use, spelling variations and errors). Finally, in the context of cybercriminal fora, it has to be robust towards deceptive or adversarial behaviour, i.e. offenders who attempt to hide their criminal intentions (obfuscation) or who assume a false digital persona (imitation), potentially using coded language. In this work we present a comprehensive survey that discusses the problems that have already been addressed in current literature and review potential solutions. Additionally, we highlight which areas need to be given more attention.

How We Do Things With Words: Analyzing Text as Social and Cultural Data

Three Gaps in Computational Text Analysis Methods for Social Sciences: A Research Agenda

The cultural environment: measuring culture with big data

Text Analysis in R

Analyzing social media data: A mixed-methods framework combining computational and qualitative text analysis

Analysing Text in Software Projects

Text as Data Methods for Education Research

Advancing Interdisciplinary Work in Computational Communication Science

Text analysis using deep neural networks in digital humanities and information science

The Geometry of Culture: Analyzing Meaning through Word Embeddings

A Review of Best Practice Recommendations for Text Analysis in R (and a User-Friendly App)

A Survey of Relevant Text Mining Technology

Applications of Computer-Aided Text Analysis: Analyzing Literary and Nonliterary Texts

Proposals for a Discourse Analysis Practice Integrated into Digital Humanities: Theoretical Issues, Practical Applications, and Methodological Consequences

A Computational Analysis of Collective Discourse

Computational methods for the analysis of climate change communication: Towards an integrative and reflexive approach

Computational Modeling of Stereotype Content in Text

Critical reflections on three popular computational linguistic approaches to examine Twitter discourses

Computational Properties of Fiction Writing and Collaborative Work

Making Sense of Organization Dynamics Using Text Analysis.

What's In My Big Data?