Text Mining on the Internet

王伟强,高文,段立娟

DOI: https://doi.org/10.3969/j.issn.1002-137X.2000.04.010

2000-01-01

Computer Science

Abstract:The booming growth of the Internet has made text mining on it a promising research field in practice. The paper summarily introduces some aspects about it,which involve some potential applications,some techniques used and some present systems.

What problem does this paper attempt to address?

Research on Web Mining Technique Facing Electronic Business and Application

DONG De-min,HE Qin-ming

DOI: https://doi.org/10.3969/j.issn.1000-7024.2006.01.029

2006-01-01

Abstract:Enterprise and organize face a series of problems to capture information of web.Technique of solving these problems were summed up including web content mining,web structure mining and web usage mining.And some application of web mining was intro-duced,such as intelligent search engine,enterprise crisis management,client relation management and personalization service system.
Application of Web Text Mining in Study Assistance

HU Jin-feng,RONG Gang

DOI: https://doi.org/10.3969/j.issn.1007-7634.2006.03.019

IF: 8.1

2006-01-01

Information Sciences

Abstract:Web text mining is used to analyze the information gained from network databases,and useful knowledge can be obtained which is helpful for researchers.In this paper,the ways to collect data,preprocess and mine data are systematic introduced.Moreover,an application is presented which shows the validity of the idea.
Analysis of Web Information Mining

张燕,黄英

DOI: https://doi.org/10.3969/j.issn.1000-7490.2003.06.018

2003-01-01

Abstract:With the further development of the Internet and e-commerce,using mining technologies to acquire knowledge from Web data is a hot and rapidly growing field.This paper primarily analyzes Internet information mining from the perspectives such as its research background,basic signification,characteristics,types and trends,expecting to improve Web mining research and its application in China.
The Research of Web Mining

孙茂松,沈达阳

DOI: https://doi.org/10.3969/j.issn.1002-137X.2000.02.021

2000-01-01

Computer Science

Abstract:The application of knowledge mining technology,is the key to improve the information searching ability of World Wide Web. Atming at different types of information,the paper introduces several Web mining technologies,which are applied in ParaSite,DRS and WebKB respectively,after comparing their characteristics,an idea of building common Web mining systsem is presented.
Web mining: knowledge discovery on the Web

Wang Jicheng,Huang Zhen Yuan,Wu Gangshan,Zhang Fuyan

DOI: https://doi.org/10.1109/ICSMC.1999.825222

1999-01-01

Abstract:With the flood of information on the World Wide Web, Web mining is a new research issue which is drawing great interest from many communities. Currently, there is no agreement about Web mining; it needs more discussion among researchers in order to define exactly what it is. Meanwhile, the development of Web mining systems will in turn promote its research. In this paper, we present a preliminary discussion about Web mining, including its definition, the relationship between information mining and information retrieval on the Web, and the taxonomy and the function of Web mining. In addition, a prototype system called WebTMS (Web Text Mining System) has been designed. WebTMS is a multi-agent system which combines text mining and multi-dimensional document analysis to help users mine HTML documents on the Web effectively
Practice of Web Mining Based on Nature Language Understanding

蔡霞,张森

DOI: https://doi.org/10.3969/j.issn.1000-7024.2003.11.001

2003-01-01

Abstract:Given the rapid growth of internet, it is increasingly attractive to extract data from these sources. General search enging is based on keywords querying and its accuracy is low. A method of applying nature lauguage understanding technology to Web mining and designing personalize Web mining system to meet the needs of a particular user is proposed. NewsMiner (Web mining system applied to news mining) is such a system. This method can extend to other specific fields easily.
Automatic Text Summarization for Web Pages on Internet

Cunyan YIN,Xinyu DAI,Jiajun CHEN

DOI: https://doi.org/10.3969/j.issn.1000-3428.2006.03.032

2006-01-01

Abstract:This paper introduces automatic text summarization on Internet. Firstly, some main approaches to automatic text summarization are presented. Second, it discusses the new demands of automatic summarization for text on Internet and some related information. It also describes the process of text summarization on Internet and evaluation of it. Lastly, it draws a conclusion and prospect on the research of auto text summarization on Internet.
A Research of Data Mining Technologies on Web Search

GENG Hua,LI Yuan,ZHU Wei,PAN Jin-Gui

2005-01-01

Computer Science

Abstract:WWW is now the largest distributed information system in the world, and how to find useful information is always a hot topic for researchers. Web mining has become an important branch of data mining. This paper mainly discusses mining technologies used in Web searching. The paper begins with talking about popular technologies in Web content mining, and then focuses on algorithms and models on Web structure mining. Then Web usage mining is briefly discussed. In the end the author advances that the technologies in Web content mining, Web structure mining and Web usage mining will be combined to develop intelligent search engines.
Researches on Automatic Text Processing

LI Su-jian

DOI: https://doi.org/10.3969/j.issn.1007-2489.2011.01.011

2011-01-01

Abstract:With the development of network technology,there comes a rapid growth of textual information.The automatic processing of textual contents has therefore become an immediate concern of research.This paper provides a brief introduction to various applications of textual information processing,including automatic summarization,automatic indexing,information extraction,text classification and clustering,etc.The importance of fundamental research in this domain is hereby highlighted,with in-depth analysis on all levels ranging from lexical to discourse,being the most promising way toward a breakthrough in text processing.
A Distributed Text Mining System for Online Web Textual Data Analysis

Bin Zhou,Yan Jia,Chunyang Liu,Xu Zhang

DOI: https://doi.org/10.1109/cyberc.2010.11

2010-10-01

Abstract:Real world Web mining applications usually have different requirements, such as massive data processing, low system latency, and high scalability. In order to meet these different requirements, we proposed a distributed text mining system with a layered architecture that divides the system functions into three layers, namely, the crawling and storage layer, the basic mining layer, and the analysis service layer. Message-oriented middleware are used between these layer components and services to make the communication in a loosely-coupled way. To conquer the data-intensive and storage failure problems, a distributed file system is used to store and manage the raw text data and various indexes. As a case study and example, the design and implementation of an experimental online topic detection application., which can be scaled to handle thousands of Internet news and forum channels and perform online analysis., is also discussed.
Research on the Application of Artificial Intelligence and Computational Intelligence in the Internet of Things

Bing Li,Dan He,Yan Jiang

DOI: https://doi.org/10.1088/1742-6596/1915/4/042020

2021-05-01

Journal of Physics: Conference Series

Abstract:Abstract The integration of AI and computational intelligence tech in the Internet of things has gradually become an important support for industrial upgrading and economic restructuring, so it has important research value. Based on this, this paper first analyses the connotation and development status of the Internet of Things (IoT), then studies the specific utilization of AI and computational intelligence in the IoT, and finally gives the utilization strategy and utilization trend of AI and computational intelligence in the IoT.
Text Content Analysis for Web Big Data

Cheng Xueqi,Lan Yanyan

DOI: https://doi.org/10.11959/j.issn.2096-0271.2015029

2015-01-01

Abstract:Text content analysis is an effective way to understand and acquire the “value” of big fata.The challenges and research results were investigated in the three hot topics: topic modeling for short texts,word embedding and learning to rank for web pages.In the end,some remaining problems in this area were proposed.
Semantic Text Mining with Linked Data

Zhaohui Huang,Huajun Chen,Tong Yu,Hao Sheng,Zhaobo Luo,Yuxin Mao

DOI: https://doi.org/10.1109/ncm.2009.131

2009-01-01

Abstract:Linked Data is an open data space that emerges from the publication and interlinking of structured data on the Web using the Semantic Web technologies. How to utilize this wealth of data is currently a focused research theme of the Semantic Web community. In this paper, we aim to utilize Linked Data to generate semantic annotations for frequent patterns extracted from textual documents. First, we extract semantic relations from textual documents and merge them into a set of semantic graphs. Then, we apply a frequent subgraph discovery algorithm on the set of graphs to generate frequent patterns. Finally, we annotate the discovered patterns using Linked Data. Our approach can be applied in such domains as terrorist network analysis and biological network analysis. The efficacy of our approach is demonstrated through an empirical experiment that discovers and validates relationships between political figures from large number of news on the Web.
Semantic Framework-Based Defect Text Mining Technique and Application in Power Grid

CAO Jing,CHEN Lushen,QIU Jian,WANG Huifang,YING Gaoliang,ZHANG Bo

DOI: https://doi.org/10.13335/j.1000-3673.pst.2016.1044

2017-01-01

Abstract:Power grid enterprises have large amounts of equipment defect texts in Chinese, containing important reliability information. It is of low efficiency and uncertain accuracy to mine information hiding behind the texts manually. Taking transformer defect texts as study object, after analyzing text characteristics, a defect text mining model is established based on semantic framework. The model provides a new technology for unstructured data mining in power grid domain because it solves problems of segmenting sentence elements of defect texts and extracting digital information precisely. Firstly, defect texts are pretreated based on established ontology thesaurus, such as segmentation and feature extraction. Then, power semantic framework and semantic slots are defined, process of slot-filling and semantic framework construction is raised, and ontology dictionary is auto-perfected by merging word series. Finally, application of defect text mining results in statistical reliability is studied. Example shows that the proposed mining technology is feasible and effective when applied to automatic classification and statistics of grid defect.
Text Mining of User-Generated Content (UGC) for Business Applications in E-Commerce: A Systematic Review

Li,Liu,Zhang,Zhu,Zhu,Yu

DOI: https://doi.org/10.3390/math10193554

IF: 2.4

2022-09-30

Mathematics

Abstract:In the Web2.0 era, user-generated content (UGC) provides a valuable source of data to aid in understanding consumers and driving intelligent business. Text mining techniques, such as semantic analysis and sentiment analysis, help to extract meaningful information embedded in UGC. However, research on text mining of UGC for e-commerce business applications involves interdisciplinary knowledge, and few studies have systematically summarized the research framework and application directions of related research in this field. First, based on e-commerce practice, in this study, we derive a general framework to summarize the mainstream research in this field. Second, widely used text mining techniques are introduced, including semantic and sentiment analysis. Furthermore, we analyze the development status of semantic analysis in terms of text representation and semantic understanding. Then, the definition, development, and technical classification of sentiment analysis techniques are introduced. Third, we discuss mainstream directions of text mining for business applications, ranging from high-quality UGC detection and consumer profiling, to product enhancement and marketing. Finally, research gaps with respect to these efforts are emphasized, and suggestions are provided for future work. We also provide prospective directions for future research.

mathematics
INVESTIGATIONS ON MACHINE LEARNING

王珏,石纯一

DOI: https://doi.org/10.3969/j.issn.1001-6600.2003.02.001

2003-01-01

Abstract:As Internet is widely used,human beings can obtain a lot of information conveniently.However,how to use these information effectively and efficiently?Machine learning is just one of the important ways to solve this problem.This paper introduces some theories and future work in the field of machine learning in order to make more people pay attention to it.
Research on Methods of Parsing and Classification of Internet Super Large-scale Texts

Mengting Song,Hang Zheng,Zhen Tao,Jia Jiang,Bin Pan

DOI: https://doi.org/10.1088/1742-6596/1757/1/012121

2021-01-01

Journal of Physics: Conference Series

Abstract:Abstract Web crawlers are an important part of modern search engines. With the development of the times, data has shown explosive growth, and mankind has entered a “big data era”. For example, Wikipedia, which carries knowledge achievements from all over the world, records real-time news that occurs every day and provides users with a good text search database[1]. Wikipedia updates data up to 50+GB every day. This project focuses on solving the problems of data acquisition and data analysis. At the same time, it downloads and parses the latest data of Wikipedia and analyzes XML files, and then uses SVM algorithm and Naive Bayes algorithm to classify articles, Train the model to download Wikipedia files efficiently and parse XML files.
Text Mining in Big Data Analytics

Hossein Hassani,Christina Beneki,Stephan Unger,Maedeh Taj Mazinani,Mohammad Reza Yeganegi

DOI: https://doi.org/10.3390/bdcc4010001

2020-01-16

Big Data and Cognitive Computing

Abstract:Text mining in big data analytics is emerging as a powerful tool for harnessing the power of unstructured textual data by analyzing it to extract new knowledge and to identify significant patterns and correlations hidden in the data. This study seeks to determine the state of text mining research by examining the developments within published literature over past years and provide valuable insights for practitioners and researchers on the predominant trends, methods, and applications of text mining research. In accordance with this, more than 200 academic journal articles on the subject are included and discussed in this review; the state-of-the-art text mining approaches and techniques used for analyzing transcripts and speeches, meeting transcripts, and academic journal articles, as well as websites, emails, blogs, and social media platforms, across a broad range of application areas are also investigated. Additionally, the benefits and challenges related to text mining are also briefly outlined.
Research of Semantic Web Mining

FU Xiao,LUO Bin,CHEN Shi-Fu

DOI: https://doi.org/10.3969/j.issn.1002-137X.2005.03.054

2005-01-01

Computer Science

Abstract:This paper gives an overview of the main ideas and the research progress of Semantic Web Mining. Seman- tic Web Mining utilizes the semantic data extracted from the traditional Web or uses the semantic structure of the Se- mantic Web directly to help Web Mining. It combines two fast-developing research areas Semantic Web and Web Mining. This idea is to improve, on the one hand, the results of Web Mining by exploiting the new semantic structures in the Web; and to make use of Web Mining, on the other hand, for building up the Semantic Web. In this paper, how to extract semantics from the Web is introduced firstly. Then exploiting Semantics for Web Mining an mining the Semantic Web directly is discussed.
Data, text and web mining for business intelligence: a survey

Abdul-Aziz Rashid Al-Azmi

DOI: https://doi.org/10.48550/arXiv.1304.3563

2013-04-12

Information Retrieval

Abstract:The Information and Communication Technologies revolution brought a digital world with huge amounts of data available. Enterprises use mining technologies to search vast amounts of data for vital insight and knowledge. Mining tools such as data mining, text mining, and web mining are used to find hidden knowledge in large databases or the Internet.

Text Mining on the Internet

Research on Web Mining Technique Facing Electronic Business and Application

Application of Web Text Mining in Study Assistance

Analysis of Web Information Mining

The Research of Web Mining

Web mining: knowledge discovery on the Web

Practice of Web Mining Based on Nature Language Understanding

Automatic Text Summarization for Web Pages on Internet

A Research of Data Mining Technologies on Web Search

Researches on Automatic Text Processing

A Distributed Text Mining System for Online Web Textual Data Analysis

Research on the Application of Artificial Intelligence and Computational Intelligence in the Internet of Things

Text Content Analysis for Web Big Data

Semantic Text Mining with Linked Data

Semantic Framework-Based Defect Text Mining Technique and Application in Power Grid

Text Mining of User-Generated Content (UGC) for Business Applications in E-Commerce: A Systematic Review

INVESTIGATIONS ON MACHINE LEARNING

Research on Methods of Parsing and Classification of Internet Super Large-scale Texts

Text Mining in Big Data Analytics

Research of Semantic Web Mining

Data, text and web mining for business intelligence: a survey