Research On Web Monitoring System Based On Natural Language Processing

liu lin,fan xiaozhong,zhao xunping

DOI: https://doi.org/10.1109/NLPKE.2003.1276005

2003-01-01

Abstract:Sensitive information has become great barrier for people collecting useful information on Internet. By combining natural language processing with data mining technology, this paper studies and designs a Web monitoring system for controlling sensitive information spreading on Web.

What problem does this paper attempt to address?

Research on Monitor Information System in Seafloor Observatory Network

XUE Zhi-gang,JIN Bo,LI De-jun,YANG Can-jun

DOI: https://doi.org/10.3969/j.issn.1005-2895.2010.04.024

2010-01-01

Abstract:Seafloor observatory network is a subject service for undersea exploration and researching work.To realize condition monitoring,data measuring and the transmission preservation of other communicating signals,it is especially important to design and study monitor system of bank basestation and series data monitor system.Focusing on the features of Seafloor observatory,the paper realized working condition monitor,measurement transmission with VC and SQL-Serve technique,as well as share monitor data with Internet with the help of Web technique. Besides viewing of the long term and stableness features of seafloor observatory network,the paper put forward improving method and design idea,which were proved effective and reliable by practical running. [Ch,7 fig.10 ref.]
Research on Web Mining Technique Facing Electronic Business and Application

DONG De-min,HE Qin-ming

DOI: https://doi.org/10.3969/j.issn.1000-7024.2006.01.029

2006-01-01

Abstract:Enterprise and organize face a series of problems to capture information of web.Technique of solving these problems were summed up including web content mining,web structure mining and web usage mining.And some application of web mining was intro-duced,such as intelligent search engine,enterprise crisis management,client relation management and personalization service system.
A Study on Technology Monitoring Based on Semantic Web

CHEN Xiao-peng,TONG Yun-huan

2010-01-01

Abstract:Technology monitoring is a science and technology management method integrating information technology and expert knowledge.In this study we reviewed current technology monitoring methods,analyzed influence of the trend of the development of semantic web to technology monitoring activities and argued that the methods based on semantic web can improve the performances of technology monitoring systems by solving the problems in artificial intervention,native languages,costs and the reusability of system and data results.We then developed a technology monitoring system based on an open semantic proxy and applied the system in the field of clean technology monitoring.
Practice of Web Mining Based on Nature Language Understanding

蔡霞,张森

DOI: https://doi.org/10.3969/j.issn.1000-7024.2003.11.001

2003-01-01

Abstract:Given the rapid growth of internet, it is increasingly attractive to extract data from these sources. General search enging is based on keywords querying and its accuracy is low. A method of applying nature lauguage understanding technology to Web mining and designing personalize Web mining system to meet the needs of a particular user is proposed. NewsMiner (Web mining system applied to news mining) is such a system. This method can extend to other specific fields easily.
Research of Remote Monitoring and Control System for Industrial Process Based on Web Technology

Wu DENG,Hui-min ZHAO,Xin-hua YANG,Fei-long TANG

DOI: https://doi.org/10.3969/j.issn.1006-396X.2009.02.022

2009-01-01

Abstract:On the basis of the remote monitoring and control system function and structure, according to the industrial process, The remote monitoring and control system structure for industrial process based on Web technology was presented. From system development perspective, the key techniques of the development system, including Web application development, socket data communication, JDBC access, data gather, control tactic and real-time data etc were researched. A remote monitoring and control systems with high reliability was designed and implemented. The system shows that the remote monitoring and control system for the chemical industrial process has the merits of stable working, swiftle control, real-time transmitting data, high reliability and so on.
Research on Extraction Epidemiologic Exposures Based on Natural Language Processing Techniques

LU Yan-xin,YAO Xu-feng,WANG Song-wang

DOI: https://doi.org/10.3969/j.issn.1673-6036.2013.03.012

2013-01-01

Abstract:Based on natural language processing techniques,a system is designed automatically extract epidemiologic exposures.Evaluation of the system shows that it consists of a natural language processing subsystem and a logistic regression based or a support vector machine based information extraction subsystem.The system can efficiently help epidemiologic researchers get exposures automatically from biomedical literature.
An Adaptive Method to Identify the Web Sensitive Information

FengYao Zeng,Hui Gao,Yan Fu

DOI: https://doi.org/10.1109/isise.2009.41

2009-01-01

Abstract:Web public sentiment reflects the people's attitude to society and politics, it's important to identify the web sensitive information correctly to build a harmonious network. Those existing monitoring systems relied on large common category libraries to do accurate identification, yet faced with the new and unknown events which is not recorded in the category libraries did not do in-depth research. In view of this situation, this article proposes an adaptive method combination of content identification and acts recognition to achieve accurate and effective identification of web sensitive information.
The Design and Implementation of an Internet Public Opinion Monitoring and Analyzing System

Xiu Li,Liping Gao

DOI: https://doi.org/10.1109/icss.2013.59

2013-01-01

Abstract:In this paper, we provide a complete framework of an Internet Public Opinion Monitoring and Analyzing System. The system is composed of web crawler, information preprocessing, public opinion information analyzing and mining module, and information services module. This system can collect web pages from the entire Web space, including news groups, portal website, forum, BBS, blogs, micro-blogging and etc. Furthermore, through processing and analyzing the collected information, the system can give the public opinion information analysis results as stereoscopic, intuitive, natural way to the user. Finally, this paper describes the implementation of key technology used in this system. The system presented in this paper can help supervisors to timely monitor the concerned public opinion and guide them.
Development of an integrated wireless sensor network micro-environmental monitoring system.

Xianghui Cao,Jiming Chen,Yan Zhang,Youxian Sun

DOI: https://doi.org/10.1016/j.isatra.2008.02.001

IF: 7.3

2008-01-01

ISA Transactions

Abstract:Wireless Sensor Network (WSN) is increasingly popular in the field of micro-environmental monitoring due to its promising capability. However, most systems using WSN for environmental monitoring reported in the literature are developed for specific applications without functions for exploiting user’s data processing methods. In this paper, a new system is designed in detail to perform micro-environmental monitoring taking the advantages of the WSN. The application-oriented hardware working style is designed, and the system platform for data acquisition, validation, processing and visualization is systematically presented. Several strategies are proposed to guarantee the system capability in terms of extracting useful information, visualizing events to their authentic time are also described. Moreover, a web-based surveillance subsystem is presented for remote control and monitoring. In addition, the system is extensible for engineers to carry their own data analysis algorithms. Experimental results are to show the path reliability and real-time characteristics, and to display the feasibility and applicability of the developed system into practical deployment.
Intelligent Mining Monitoring System Based on Big Data Technology

Xiao Wang,Cheng Li,Bo Yang

DOI: https://doi.org/10.38007/proceedings.0001665

2020-01-01

Abstract:With the continuous improvement of my country's economic level, both the construction of urbanization and the continuous improvement of science and technology require a continuous supply of mineral resources and energy. Big data is a data processing and analysis technology. It was originally designed to solve the storage and processing problems of large amounts of data in distributed networks. Because of its high-precision and high-efficiency data analysis advantages, it has been widely used in various fields. Based on this, this article combines big data technology with mining intelligent monitoring system to design an intelligent mining monitoring system based on big data. Aiming at the problem of the traditional system's low accuracy of mining monitoring equipment, this article uses wireless sensors, card readers and central processing units in the hardware design of the system to achieve the system's collection of mining monitoring equipment operating data. The hardware design of the system; through the use of cloud computing and information fusion technology in the big data technology, the system has realized the analysis of the mine electromechanical equipment data, completed the system software design, and formed a big data-based mining intelligent monitoring system. Studies have shown that the specific high accuracy of the system designed this time is proved to ensure the safety, scientific and stability of the mining work.
Natural Language Processing Based on Naturally Annotated Web Resources

SUN Maosong

DOI: https://doi.org/10.3969/j.issn.1003-0077.2011.06.004

2011-01-01

Abstract:This article proposes an idea of "natural language processing based on naturally annotated Web resources".The discussion is carried out from three perspectives: the definition and types of naturally annotated resources,naturally annotated resource-based computing,as well as several key points concerned at the methodological level.A fundamental problem is presented for further exploration at last: If we could explore and integrate all the information provided by all the available naturally annotated resourcesin different respectssystematically,can themachine,as expected,ultimatelyachieve some degree of deep understanding of naturallanguage?
A Public Opinion Monitoring System Based on Big Data Technology

Bin CAO,Yi-li GU,Zhen-zhen XIE,Zhen CHEN

DOI: https://doi.org/10.3969/j.issn.1671-1122.2014.12.007

2014-01-01

Abstract:With the popularization of Internet, social network has become a vital part of people's lives. Social media promotes lfow and dissemination of information, but also brings a deluge of social media data and user data. Social media analysis is the main component of public opinion monitor system. Analysing and monitoring of public opinion data is one of the new technical problems caused by media in this era. In recent years, new technology such as big data processing provides proven solution to cope with the massive data . There are many big data processing platforms, in which Hadoop platform has a mature community and its structure is stable and easy to use. To text classiifcation problems, LDA statistical modeling brings a new approach. Therefore, this paper proposes a public opinion monitoring system based on proven open source architectures. The system bases on Hadoop platform, with Nutch as a crawler, using Solr to achieve the core index search function. The entire platform demonstrates its high efifciency in the mass data processing analysis. while providing intelligent analysis and statistical functions in response to the problems caused by massive amounts of data.
Research on an Online Monitoring System for Efficient and Accurate Monitoring of Mine Water

Lei Bo,Yang Liu,Zihang Zhang,Dongxu Zhu,Yiying Wang

DOI: https://doi.org/10.1109/access.2022.3151244

IF: 3.9

2022-01-01

IEEE Access

Abstract:Our goal is to solve the complexity of laying down wiring for traditional monitoring systems for mine water, while taking into account the poor timeliness of sampling and continuous monitoring, based on the processing and reuse of mine water. In this article, we focus on the theory of multi-sensor networks to estimate mine water quality, quantity monitoring equipment, and mine water Internet of Things (hereafter denoted “IoT”) communication systems. We designed a mine water IoT monitoring system for the wireless monitoring of water quantity and quality, developed an experimental platform for the wireless monitoring of mine water. This platform has the advantages of simple wiring and strong expandability. Finally, we tested and analyzed the system operation effects. To solve the problem of partial data abnormalities caused by problems of sensing equipment, we propose a data abnormality detection method based on an isolated forest that combines the characteristics of the sufficient timeliness of mine water monitoring data, and we offer experimental verification and analysis. The experimental results show that the system can realize the real-time wireless monitoring of mine water quality and quantity information with stable and fast data transmission capability. Furthermore, the system can quickly discover, analyze, and process abnormal data, has sufficient timeliness while guaranteeing the validity of the data output from the monitoring platform.

computer science, information systems,telecommunications,engineering, electrical & electronic
Detecting Malicious Websites in Depth through Analyzing Topics and Web-pages

Senhao Wen,Zhiyuan Zhao,Hanbing Yan

DOI: https://doi.org/10.1145/3199478.3199500

2018-03-16

Abstract:We are increasingly relying on HTML(Hypertext Markup Language) web-pages, including online shopping, obtaining information and handling official business, whether on a mobile phone or on a computer. But the underground industry or deliberate attacker has also targeted us. They forges misleading URLs(UniformResourceLocators) and web-pages with various tricky skills which are difficult to identify even for the professionals, so as to steal money, manipulate our devices, monitor our lives. Currently, most of the malicious websites detecting technology is based on features of URLs or Web page elements, which make us feel upset, because it is difficult to extract all the features, and its hysteresis quality make it hard to meet the requirement of tracking the rapid changes of malicious web sites, especially the phishing websites. This paper design a thorough associated analysis model of web-pages using the technology of topic tracking, topic abnormal discovery, web-page visual similarity assessment, web-page structure analyzing, URL analyzing, Internet Resources analyzing and so on, to solve the problem of missing detecting malicious websites, especially with unknown features. The detecting model is able to discover the forged payment web-pages, fake web page which damage the reputation of the relevant organization, personal attack web-pages, tampered web page, web-page trojan, etc. In the meantime, it can track the topic of underground industry and sense the topic evolution. According to our experiments, it is effective and has high accuracy.
Web Log Analysis and Security Assessment Method Based on Data Mining

Jingquan Jin,Xin Lin

DOI: https://doi.org/10.1155/2022/8485014

IF: 3.12

2022-08-27

Computational Intelligence and Neuroscience

Abstract:Web content mining describes the classification, clustering, and attribute analysis of a large number of text documents and multimedia files on the web. Special tasks include retrieval of data from the Internet search engine tool W; structured processing and analysis of web data. Today's blog analysis has security concerns. We do experiments to investigate its safety. Through experiments, we draw the following conclusions: (1) Web log extraction can use efficient data mining algorithms to systematically extract logs from web servers, then determine the main access types or interests of users, and then to a certain extent, based on the discovered user patterns, analyze the user's access settings and behavior. (2) No matter in the test set or the mixed test set, the curve value of deep mining is very stable, the curve value has been kept at 0.95, and the curve value of fuzzy statistics method and quantitative statistics method is stable within the interval of 0.90–095. The results also show that the data mining method has the highest identification accuracy and the best security performance. (3) Web usage analysis requires data abstraction for pattern discovery. This data abstraction can be achieved through data preprocessing, which introduces different formats of web server log files and how web server log data is preprocessed for web usage analysis. One of the most critical parts of the web mining field is web log mining. Web log mining can use powerful data mining algorithms to systematically mine the logs in the web server and then learn the user's access or preferred interests and then conduct a certain degree of user preferences and behavior patterns according to the discovered user patterns. Based on the above analysis, the current web log analysis is faced with security problems. We conduct experiments to study to verify the security performance of web logs and draw conclusions through experiments.

mathematical & computational biology,neurosciences
On-line Monitoring System for Mine Fans

CHEN Wangsheng,YAN Kaiyong,ZENG Yonglong,TU Fuquan

2009-01-01

Abstract:Aimed at the problem that the monitoring system for the high-power mine fan relies on import,a mine fan on-line monitoring system has been developed based on SCM,field bus and network communication technology.The system can achieve real-time monitoring for the fan and reaches the technological level of the foreign like products.
RESEARCH ON APPLYING DATA MINING IN DYNAMIC MALICIOUS WEB PAGE DETECTION

Luo Jian,Wang Yijun,Xue Zhi

DOI: https://doi.org/10.3969/j.issn.1000-386x.2013.05.001

2013-01-01

Abstract:In this paper,a dynamic malicious web page detection model is designed and implemented,and based on mining the data of Capture-HPC honeypot logs,the high false-alarm rate problem in honeypot system has been solved.The system converts honeypot logs into operation and data mining sequences,from which the attribution feature information can be extracted effectively by cluster analysis,and be the white and black list of differentiation basis after optimisation.In the paper we validate through an experiment the rationality of the model design and the effectiveness of model in false-alarm reduction.
Study on the automated monitoring control system in process quality under the network environment

Musheng Yang,Yu Zhang,Yong Xie

2007-01-01

Abstract:In the manufacturing process of modern corporations, great importance is attached to the application of on line monitoring technique, which is regarded as a significant way to improve the company market competition. In this paper, an automated online quality monitoring system using the SPC technique in the network environment is presented. The system's composition is mainly described. Its frame and software model is researched and designed with the C++ network programming technique to specifically make up of this set of quality monitoring distributed network system, which takes the remote quality monitoring centre as its sever and the field data acquisition as its client. It has the advantage of unifying the services of remote monitoring and quality analysis through network environment, and of high flexibility due to the application of the object-oriented technique and the module designing method.
A Text Semantics-Based Detection Method for Internet Sensitive Topics

刘霁,周亚东,高峰,赵俊舟,薛峰

DOI: https://doi.org/10.3969/j.issn.1672-6332.2011.03.009

2011-01-01

Abstract:Internet has become an important platform for information spreading, but not all of the information on the Internet is useful to people＇s daily life. Therefore, how to correctly detect sensitive topics on the Internet is one of the most important tasks for network public opinion supervision. This paper aims to detect sensitive topics in online communities on the basis of the features of Internet texts, such as short length, incomplete structure and colloquialism, using the vector space model to represent the texts. We propose a new feature extraction method based on the sentiment lexicon to improve Internet sensitive topic detection accuracy. Finally, the effectiveness of our method is discussed based on data from experiments.
An Online Monitoring Approach for Web Service Requirements

Qianxiang Wang,Jin Shao,Fang Deng,Yonggang Liu,Min Li,Jun Han,Hong Mei

DOI: https://doi.org/10.1109/tsc.2009.22

2007-01-01

Abstract:Web service technology aims to enable the interoperation of heterogeneous systems and the reuse of distributed functions in an unprecedented scale and has achieved significant success. There are still, however, challenges to realize its full potential. One of these challenges is to ensure the behavior of Web services consistent with their requirements. Monitoring events that are relevant to Web service requirements is, thus, an important technique. This paper introduces an online monitoring approach for Web service requirements. It includes a pattern-based specification of service constraints that correspond to service requirements, and a monitoring model that covers five kinds of system events relevant to client request, service response, application, resource, and management, and a monitoring framework in which different probes and agents collect events and data that are sensitive to requirements. The framework analyzes the collected information against the prespecified constraints, so as to evaluate the behavior and use of Web services. The prototype implementation and experiments with a case study shows that our approach is effective and flexible, and the monitoring cost is affordable.

Research On Web Monitoring System Based On Natural Language Processing

Research on Monitor Information System in Seafloor Observatory Network

Research on Web Mining Technique Facing Electronic Business and Application

A Study on Technology Monitoring Based on Semantic Web

Practice of Web Mining Based on Nature Language Understanding

Research of Remote Monitoring and Control System for Industrial Process Based on Web Technology

Research on Extraction Epidemiologic Exposures Based on Natural Language Processing Techniques

An Adaptive Method to Identify the Web Sensitive Information

The Design and Implementation of an Internet Public Opinion Monitoring and Analyzing System

Development of an integrated wireless sensor network micro-environmental monitoring system.

Intelligent Mining Monitoring System Based on Big Data Technology

Natural Language Processing Based on Naturally Annotated Web Resources

A Public Opinion Monitoring System Based on Big Data Technology

Research on an Online Monitoring System for Efficient and Accurate Monitoring of Mine Water

Detecting Malicious Websites in Depth through Analyzing Topics and Web-pages

Web Log Analysis and Security Assessment Method Based on Data Mining

On-line Monitoring System for Mine Fans

RESEARCH ON APPLYING DATA MINING IN DYNAMIC MALICIOUS WEB PAGE DETECTION

Study on the automated monitoring control system in process quality under the network environment

A Text Semantics-Based Detection Method for Internet Sensitive Topics

An Online Monitoring Approach for Web Service Requirements