An Evolutionary Approach of Text Mining

Fang Qun

DOI: https://doi.org/10.3969/j.issn.1627-9730.2010.08.042

2010-01-01

Abstract:During the course of text mining from data warehouse,a kind of information is produced with evolutionary characteristic.Then,the paper defined the mathematic model of the evolutionary information,and proposed some relevant suggestion in evolutionary algorithm.

What problem does this paper attempt to address?

LDA-based model for topic evolution mining on text

Qingqiang Wu,Xiang Deng,Caidong Zhang,Changlong Jiang

DOI: https://doi.org/10.1109/ICCSE.2011.6028792

2011-01-01

Abstract:A text mining model for topical evolutionary analysis was proposed through a text latent semantic analysis process on textual data. Analyzing topic evolution through tracking the topic different trends over time. Using the LDA model for the corpus and text to get the topics, and then using Clarity algorithm to measure the similarity of topics in order to identify topic mutation and discover the topic hidden in the text. Experiments show that the proposed model can discover meaningful topical evolution.
Evolving Sql Queries For Data Mining

M Salim,X Yao

DOI: https://doi.org/10.1007/3-540-45675-9_11

2002-01-01

Abstract:This paper presents a methodology for applying the principles of evolutionary computation to knowledge discovery in databases by evolving SQL queries that describe datasets. In our system, the fittest queries are rewarded by having their attributes being given a higher probability of surviving in subsequent queries. The advantages of using SQL queries include their readability for non-experts and ease of integration with existing databases. The evolutionary algorithm (EA) used in our system is very different from existing EAs, but seems to be effective and efficient according to the experiments to date with three different testing data sets.
An Evolutive Algorithm for the Data Mining in Population Data Warehouse.

Wenchuan Yang,Peng Wang,Chunyang Gao,Yanyang Fan,Huahua Luan

DOI: https://doi.org/10.1109/coginf.2006.365608

2006-01-01

Abstract:During the data processing based on population data warehouse, a large scale of evolutive information was produced accompany the data mining and knowledge discovery, which is very important for the final rule. This paper introduces the research of a multi-agent algorithm to process the evolutive information in data mining on population data warehousing, also gives the mathematic model and corresponding rule for it, which include data extraction and check-up, data normalization, and a mechanism to support market analysis and forecast. The paper also summarizes some basic requirements and data model constructing for applying data warehouse in population fields
An Evolutionary Approach for Searching Distributed Collections

Hui Yang,Minjie Zhang

2002-01-01

Abstract:This paper proposes an evolutionary approach for searching information collections in a distributed environment. This approach, which is given a set of information collections and user queries, finds the best possible matching between the information collections and user queries by taking into account the factors from both user queries perspective and collections’ perspective. The contribution of each factor in a searching model is indicated by a weighted parameter derived by a genetic algorithm. The values of these parameters are used to determine the contribution of the corresponding factors to the effectiveness of selection. Some preliminary results are demonstrated. Although inconclusive, they provide directions for possibly fruitful research and applications.
Mining Evolutionary Multi-Branch Trees from Text Streams

Xiting Wang,Shixia Liu,Yangqiu Song,Baining Guo

DOI: https://doi.org/10.1145/2487575.2487603

2013-01-01

Abstract:Understanding topic hierarchies in text streams and their evolution patterns over time is very important in many applications. In this paper, we propose an evolutionary multi-branch tree clustering method for streaming text data. We build evolutionary trees in a Bayesian online filtering framework. The tree construction is formulated as an online posterior estimation problem, which considers both the likelihood of the current tree and conditional prior given the previous tree. We also introduce a constraint model to compute the conditional prior of a tree in the multi-branch setting. Experiments on real world news data demonstrate that our algorithm can better incorporate historical tree information and is more efficient and effective than the traditional evolutionary hierarchical clustering algorithm.
Evolving Classifiers - Evolutionary Algorithms in Data Mining

Thomas Weise,Stefan Achler,Martin Gob,Christian Voigtmann,Michael Zapf

2007-01-01

Abstract:Data mining means to summarize information from large amounts of raw data. It is one of the key technologies in many ar- eas of economy, science, administration and the internet. In this re- port we introduce an approach for utilizing evolutionary algorithms to breed fuzzy classifier systems. This approach was exercised as part of a structured procedure by the students Achler, Gob, and Voigtmann as contribution to the 2006 Data-Mining-Cup contest, yielding en- couragingly positive results.
The changing landscape of text mining: a review of approaches for ecology and evolution

Maxwell J Farrell,Nicolas Le Guillarme,Liam Brierley,Bronwen Hunter,Daan Scheepens,Anna Willoughby,Andrew Yates,Nicole Mideo

DOI: https://doi.org/10.1098/rspb.2024.0423

Abstract:In ecology and evolutionary biology, the synthesis and modelling of data from published literature are commonly used to generate insights and test theories across systems. However, the tasks of searching, screening, and extracting data from literature are often arduous. Researchers may manually process hundreds to thousands of articles for systematic reviews, meta-analyses, and compiling synthetic datasets. As relevant articles expand to tens or hundreds of thousands, computer-based approaches can increase the efficiency, transparency and reproducibility of literature-based research. Methods available for text mining are rapidly changing owing to developments in machine learning-based language models. We review the growing landscape of approaches, mapping them onto three broad paradigms (frequency-based approaches, traditional Natural Language Processing and deep learning-based language models). This serves as an entry point to learn foundational and cutting-edge concepts, vocabularies, and methods to foster integration of these tools into ecological and evolutionary research. We cover approaches for modelling ecological texts, generating training data, developing custom models and interacting with large language models and discuss challenges and possible solutions to implementing these methods in ecology and evolution.
Evolutionary data mining approaches for rule-based and tree-based classifiers.

Thomas Weise,Raymond Chiong

DOI: https://doi.org/10.1109/COGINF.2010.5599821

2010-01-01

Abstract:Data mining is an important process, with applications found in many business, science and industrial problems. While a wide variety of algorithms have already been proposed in the literature for classification tasks in large data sets, and the majority of them have been proven to be very effective, not all of them are flexible and easily extensible. In this paper, we introduce two new approaches for synthesizing classifiers with Evolutionary Algorithms (EAs) in supervised data mining scenarios. The first method is based on encoding rule sets with bit string genomes and the second one utilizes Genetic Programming to create decision trees with arbitrary expressions attached to the nodes. Comparisons with some sophisticated standard approaches, such as C4.5 and Random-Forest, show that the performance of the evolved classifiers can be very competitive. We further demonstrate that both proposed approaches work well across different configurations of the EAs.
Data Evolution and Its Modeling

Deyou Tang,Jianqing Xi,Jinguo You,Chuan Zhang,Shujun Xu

DOI: https://doi.org/10.1109/FSKD.2008.592

2008-01-01

Abstract:Incomplete information about how data has evolved over time has caused many puzzles in applications such as audit trail, data quality. Such challenges mandate the need for rich and descriptive derivation information about data to accompany the data in order to understand and reuse it. This paper puts forward the concept of data evolution to describe the process of semantics change for data product in its lifecycle, in which data product is an entity with interactive computation capability. In practice, data has intrinsic semantics as well as extension semantics, but current data models only describe the intrinsic semantics for data. Therefore, this paper presents a new explanation of ‘data’, i.e. ‘data’ is a combination of data object, genetic information and computing component. Data object expresses the intrinsic semantics for ‘data’. The genetic information represents the extension semantics for ‘data’. The computing component interacts with user behaviors, evolves data object and genetic information and memorizes the process of semantics change. We present the framework of data evolution, analyze its characteristics and present its research challenges.
Generation of Topic Evolution Graphs from Short Text Streams

Wang Gao,Min Peng,Hua Wang,Yanchun Zhang,Weiguang Han,Gang Hu,Qianqian Xie

DOI: https://doi.org/10.1016/j.neucom.2019.11.077

IF: 6

2019-01-01

Neurocomputing

Abstract:Topic evolution mining on short texts is an important research topic in natural language processing. Existing methods have been focused either on the topic evolution of normal documents or on the evolution of topics along a timeline. In this paper, we aim to generate topic evolutionary graphs from short texts, which not only capture the main topic timeline, but also reveal the correlations between related subtopics. Firstly, we propose an Encoder-only Transformer Language Model (ETLM) to quantify the relationship between words. Then we propose a novel topic model, referred as weighted Conditional random field regularized Correlated Topic Model (CCTM), which leverages semantic correlations to discover meaningful topics and topic correlations. Finally, topic evolutionary graphs are generated by an Online version of CCTM (OCCTM) to capture the evolutionary patterns of main topics and related subtopics. Experimental results on real-world datasets demonstrate our method outperforms baselines on quality of topics and presents motivated patterns for topic evolution mining.
A Tool for Visualizing Topic Evolution in Large Text Collections

Feipeng Sun,Yanyan Li,Zhiqiang Zhang

DOI: https://doi.org/10.1109/ICALT.2013.21

2013-01-01

Abstract:Topic evolution in text data has become a flourishing frontier in the text mining community. Yet with the increasing number of texts, it is important and challenging to understand how topics evolve. In this paper, we introduce a tool to analyze various evolution patterns that emerge from multiple texts based on combination of topic modeling and visualization techniques. By mining topic hierarchical relationship and evolutionary trend, the tool provides three visualization views along with interactive functionality that enables users to understand the topic evolution in a flexible and easily way. Experiment on real dataset has shown that the developed tool is effective to visualizing meaningful topic evolution in large text collections.
Control and Cybernetics Evolutionary Computation in Data Mining

Ashish Ghosh,Lakhmi C. Jain,Jose Ramon Cano,Francisco Herrera,Manuel Lozano,Matthew G. Smith,Riyaz Sikora,J. STAŃCZAK,Xiju Fu,Lipo Wang,Qi Yu,Kay Chen Tan,Tong Heng Lee,Minh Ha Nguyen,Hussein Abbas

2008-01-01

Abstract:" Evolutionary Computation in Data Mining " edited by Ashish Ghosh and Lakhmi C. Jain, published in the series on Studies in Fuzziness and Soft Computing by Springer contains twelve skillful papers, which show the advances and state of the art in the domain of evolutionary methods' application in data mining. Data mining is a relatively broad domain of automatic knowledge discovery from databases and is now one of the most developed fields in the area of artificial intelligence. A rapid growth of data collected in various realms of human activity and their potential usefulness in these realms requires appropriate and efficient tools to extract and use of the potentially gathered knowledge. Evolutionary algorithms are very powerful tools and can be utilized in many ways to make use of knowledge hidden in terabites of data collected in databases all over the world. In the Chapter 1 by Ashish Ghosh some essential aspects of application of evolutionary computation methods for rule generation are discussed. focuses on data preprocessing methods meant to minimize the size of data to be processed. Data reduction is obtained using a CHC evolutionary algorithm with stratification strategy to select representative instances of the processed data set. The presented evolutionary method outperforms the non-evolutionary ones and gives better instance reduction rates, higher accuracy and lower resources consumption. The next chapter by Matthew G. Smith and Larry Bull presents also a preprocessing method, where genetic programming is used to feature construction (inferring new features enables to find hidden relationships between them) and a genetic algorithm for feature selection from the set produced by the first stage. The preprocessing method with the C4.5 classification algorithm works significantly better than the single C4.5 method. Also the fourth chapter by Riyaz Sikora presents a multi-agent based method of feature selection and inductive learning. Genetic algorithms are treated as learning agents to discover solutions of small subproblems into which the whole data set is decomposed.
On-line supervised theme-modeling and evolution-analyzing method

Jian Shao,Yin Zhang,Hongkai Ren,Fei Wu

2012-01-01

Abstract:The invention discloses an on-line supervised theme-modeling and evolution-analyzing method. The method comprises the following steps: (1) that news texts are downloaded from news media websites and are divided according to certain time granularity; (2) that word segmentation processing is carried out for news texts in each time period, and vocabulary are selected and updated according to word frequencies; (3) that text features are extracted to form a relational matrix between words and texts and to compose input of an on-line supervised theme model; (4) that the on-line supervised theme model is established, wherein the on-line supervised theme-modeling method is used to detect themes of data set in each time granularity to acquire a distribution matrix of words about theme and a distribution matrix of themes on texts; and (5) that a Jensen-Shannon divergence is used to carry out evolution analysis for themes acquired in step (4) and to calculate attributes of each theme, in order to acquire evolution processes of each theme. The method provided in the invention fully utilizes time and classification information of data itself, improves accuracy of theme mining, and effectively analyzes evolution processes of themes by combing classification information.
Research of a Multi-agent Algorithm to Process the Evolutive Information

wenchuan yang,bei jia,xiaoyan duan

DOI: https://doi.org/10.1007/978-3-642-27329-2_90

2012-01-01

Mechanical Engineering and Technology

Abstract:During the data processing based on population data warehouse, a large scale of evolutive information was produced accompany the data mining and knowledge discovery, which is very important to the final rule. This paper introduces the research of a multi-agent algorithm to process the evolutive information in data mining on population data warehousing, also gives the mathematic model and corresponding rule for it, which include data extraction and check-up. data normalization, and a mechanism to support market analysis and forecast. We also summarize some basic requirements and data model constructing for applying data warehouse in population fields.
Evolving Text Data Stream Mining

Jay Kumar

2024-08-15

Abstract:A text stream is an ordered sequence of text documents generated over time. A massive amount of such text data is generated by online social platforms every day. Designing an algorithm for such text streams to extract useful information is a challenging task due to unique properties of the stream such as infinite length, data sparsity, and evolution. Thereby, learning useful information from such streaming data under the constraint of limited time and memory has gained increasing attention. During the past decade, although many text stream mining algorithms have proposed, there still exists some potential issues. First, high-dimensional text data heavily degrades the learning performance until the model either works on subspace or reduces the global feature space. The second issue is to extract semantic text representation of documents and capture evolving topics over time. Moreover, the problem of label scarcity exists, whereas existing approaches work on the full availability of labeled data. To deal with these issues, in this thesis, new learning models are proposed for clustering and multi-label learning on text streams.

Information Retrieval,Computation and Language
Evolutionary Modeling Based On Overlap Reuse

Dazhi Jiang,Zhijian Wu,Jun Zou,Jianwei Zhang,Lishan Kang

DOI: https://doi.org/10.1109/CEC.2008.4630859

2008-01-01

Abstract:Reuse (or reusability) plays an important role in the software engineering. The software reuse technique, considered as an effective approach to improve the productivity, can reduce the cost in software design and development. This paper introduces the concept of reuse in the software into the chromosome and presents an evolutionary modeling algorithm based on the overlapped reuse. Furthermore, a new Gene Reading & Computing Machine is constructed for calculating the fitness of chromosome which has the characteristic of reusability. As a new kind of modeling algorithm, this is a new research way for evolutionary modeling.
Evolutionary Immune Mechanism and Its Application on Temporal Sequential Pattern Mining

Yang Bingru,Qin Yiqing,Song Zefeng

DOI: https://doi.org/10.3969/j.issn.1009-1742.2008.04.012

2008-01-01

Engineering Sciences

Abstract:A new approach to solve the problem of dynamic data mining is presented.Firstly a new concept of dynamic mining process is proposed.Next the evolutionary immune mechanism in KDD is illustrated,based on a comparison between the dynamic mining process and biological immune process.Additionally how to apply the approach to temporal sequential pattern mining and evaluate the experimental results are described.Finally the work and present proposals for future work are concluded.
Evolutionary learning of selection hyper-heuristics for text classification

Jonathán de Jesús Estrella Ramírez,Juan Carlos Gomez

DOI: https://doi.org/10.1016/j.asoc.2023.110721

2023-08-26

Applied Soft Computing Journal

Abstract:This paper introduces an evolutionary model in the scope of automated machine learning. This model is in charge of learning hyper-heuristics that represent selection rules of the form if-then, such that given a dataset for a text classification problem, the hyper-heuristics select the best classification method to use with it, based on the data distribution of the dataset. The evolutionary model starts by building a set of hyper-heuristics using a series of meta-features extracted from a training group of datasets that represent their data distribution. Hyper-heuristics are then evolved using adapted crossover and mutation operators. During the evolution, each hyper-heuristic is evaluated on its performance to classify each dataset in the training group. When the evolutionary process is done, the best hyper-heuristic is selected and evaluated for its generality with an independent test group of datasets. The results show that the best learned hyper-heuristic obtains an average classification performance close to the general optimum, and has a similar performance to the two most popular state-of-the-art automated machine learning systems, but with less computational cost. The approach used by the present model is relevant for automated machine learning in three aspects, the generality of the hyper-heuristics so they could be applied to groups of datasets; the interpretability of the representations that facilitate the understanding of the method selection by non-expert users; and the reduction of computational time and resources to reach a decision. Furthermore, the model extends the applicability of evolutionary computation methods, with their problem-independent properties and their ability to explore search spaces, to tackle new complex problems, such as the decision of the best classifier for a text classification dataset.
Computational Method for Word Sense Evolution

WANG Hong-jun,SHI Shui-cai,YU Shi-wen,L(u)Xue-qiang

DOI: https://doi.org/10.3969/j.issn.1001-6600.2006.04.046

2006-01-01

Abstract:Mining word sense from text is a challenge task in NLP.Word senses are not static and unchanged.As the time changed,word sense changed.How to find,detect the change of word sense,and make a model for word sense evolution is the main task of this paper.A computational method for word sense evolution based on monitor corpus is proposed to define the meaning of collocation words,indexe a large-scale monitor corpus of people daily news,get the distribution of collocation of each word and define the computation method for word sense evolution.The word sense changing curves,and a method using X2 to mining the relevance between collocation words and special time periods is proposed.
Data Gene: Model of Managing the Evolution of Data

Jian-Qing XI,Yu-Bin GUO,De-You TANG

DOI: https://doi.org/10.3969/j.issn.1002-137X.2007.01.003

2007-01-01

Computer Science

Abstract:Like life in biology, data is in the journey of evolution. According to life evolution theory, a model to manage the evolving information of data, Data Gene Model, is presented in this thesis. In this model all evolving information of data are named as genetic information of data, and kept in data gene. And data gene will transmit or mutate with the varying of data. So that most information about data like origin, creator, travel experience, relation with other data and so on can be obtained from its data gene. This model can be used in applications that need much information about evolution of data, for example enterprise information modeling, audit system. Several aspects of this model have been defined in this thesis, including the basic concepts such as data gene, data gene sequence and data genome, relationships of data genes and data genomes. And an instance of this model is also given.

An Evolutionary Approach of Text Mining

LDA-based model for topic evolution mining on text

Evolving Sql Queries For Data Mining

An Evolutive Algorithm for the Data Mining in Population Data Warehouse.

An Evolutionary Approach for Searching Distributed Collections

Mining Evolutionary Multi-Branch Trees from Text Streams

Evolving Classifiers - Evolutionary Algorithms in Data Mining

The changing landscape of text mining: a review of approaches for ecology and evolution

Evolutionary data mining approaches for rule-based and tree-based classifiers.

Data Evolution and Its Modeling

Generation of Topic Evolution Graphs from Short Text Streams

A Tool for Visualizing Topic Evolution in Large Text Collections

Control and Cybernetics Evolutionary Computation in Data Mining

On-line supervised theme-modeling and evolution-analyzing method

Research of a Multi-agent Algorithm to Process the Evolutive Information

Evolving Text Data Stream Mining

Evolutionary Modeling Based On Overlap Reuse

Evolutionary Immune Mechanism and Its Application on Temporal Sequential Pattern Mining

Evolutionary learning of selection hyper-heuristics for text classification

Computational Method for Word Sense Evolution

Data Gene: Model of Managing the Evolution of Data