A study of supervised term weighting scheme for sentiment analysis

DengZhi-Hong,LuoKun-Hu,YuHong-Liang

IF: 8.5

2014-01-01

Expert Systems with Applications

Abstract:We propose a supervised term weighting scheme for sentiment analysis.This scheme use ITD and ITS to measure the importance of a term in sentiment analysis.Experiment results on three real datasets ...

What problem does this paper attempt to address?

A study of supervised term weighting scheme for sentiment analysis

Zhi-Hong Deng,Kun-Hu Luo,Hong-Liang Yu

DOI: https://doi.org/10.1016/j.eswa.2013.10.056

IF: 8.5

2014-01-01

Expert Systems with Applications

Abstract:Term weighting is a strategy that assigns weights to terms to improve the performance of sentiment analysis and other text mining tasks. In this paper, we propose a supervised term weighting scheme based on two basic factors: Importance of a term in a document (ITD) and importance of a term for expressing sentiment (ITS), to improve the performance of analysis. For ITD, we explore three definitions based on term frequency. Then, seven statistical functions are employed to learn the ITS of each term from training documents with category labels. Compared with the previous unsupervised term weighting schemes originated from information retrieval, our scheme can make full use of the available labeling information to assign appropriate weights to terms. We have experimentally evaluated the proposed method against the state-of-the-art method. The experimental results show that our method outperforms the method and produce the best accuracy on two of three data sets.
An improved supervised term weighting scheme for text representation and classification

Zhong Tang,Wenqiang Li,Yan Li

DOI: https://doi.org/10.1016/j.eswa.2021.115985

IF: 8.5

2022-03-01

Expert Systems with Applications

Abstract:Term weighting scheme has significant effects on the text classification performance. The main reason is that in text classification tasks, term weighting scheme determines the way in which texts are represented in the vector space model. Currently, term frequency-inverse document frequency is the most widely utilized term weighting scheme but it does not use the available category information of the training texts. Taking this resource of category information (or category factor) into account in the study, an improved supervised term weighting method for representing text is developed, which combines a new measure of information namely cumulative residual entropy and the proportional distortion function. To verify the text classification performance of our proposed scheme, we conducted an extensive experimental comparison of proposed scheme with existing schemes on two corpora (i.e., Reuters-21578 and 20 Newsgroups datasets) with different characteristics. Results explicitly show that our proposed scheme can obtain significantly better effect for text classification than others. Specifically, when linear support vector machine classifier is run, performances were improved to 0.972 and 0.833 (micro-F1) on Reuters-21578 dataset and 20 Newsgroups dataset, respectively.

computer science, artificial intelligence,engineering, electrical & electronic,operations research & management science
A Supervised Term Weighting Scheme for Multi-class Text Categorization

Yiwei Gu,Xiaodong Gu

DOI: https://doi.org/10.1007/978-3-319-63315-2_38

2017-01-01

Abstract:Most supervised term weighting (STW) schemes can only be applied to binary text classification tasks such as sentiment analysis (SA) rather than text classification with more than two categories. In this paper, we proposed a new supervised term weighting scheme for multi-class text categorization. The so-called inverse term entropy (ite) measures the distribution of different terms across all the categories according to the definition of entropy in information theory. We present experimental results obtained on the 20NewsGroup dataset with a popular classifier learning method, support vector machine (SVM). Our weighting scheme ite achieved the best result in classification accuracy compared with other existing methods. And ite has the most stable performance with the reduction of training samples as well. Furthermore, our method has a built-in property to prevent over-weighting in STW. Over-weighting is a newly proposed concept especially with supervised term weightings in our earlier work and re-introduced here. Caused by the improper singular terms and too large ratios between term weights, over-weighting could deprive the performance of text classification tasks.
A Novel Term Weighting Scheme for Automated Text Categorization

Hongzhi Xu,Chunping Li

DOI: https://doi.org/10.1109/isda.2007.26

2007-01-01

Abstract:Term weighting is an important task for text classification. Inverse document frequency (IDF) is one of the most popular methods for this task; however, in some situations, such as supervised learning for text categorization, it doesn 't weight terms properly, because it neglects the category information and assumes that a term that occurs in smaller set of documents should get a higher weight. There have been several term weighting schemes that consider the category information. In this paper, we present a new term weighting scheme that considers more information provided by the term distribution among different categories. The experiments show that our method is more effective than three other popular schemes.
Reducing Over-Weighting in Supervised Term Weighting for Sentiment Analysis.

Haibing Wu,Xiaodong Gu

2014-01-01

Abstract:Recently the research on supervised term weighting has attracted growing attention in the field of Traditional Text Categorization (TTC) and Sentiment Analysis (SA). Despite their impressive achievements, we show that existing methods more or less suffer from the problem of over-weighting. Overlooked by prior studies, over-weighting is a new concept proposed in this paper. To address this problem, two regularization techniques, singular term cutting and bias term, are integrated into our framework of supervised term weighting schemes. Using the concepts of over-weighting and regularization, we provide new insights into existing methods and present their regularized versions. Moreover, under the guidance of our framework, we develop a novel supervised term weighting scheme, regularized entropy (re). The proposed framework is evaluated on three datasets widely used in SA. The experimental results indicate that our re enjoys the best results in comparisons with existing methods, and regularization techniques can significantly improve the performances of existing supervised weighting methods.
Supervised Term Weighting Metrics for Sentiment Analysis in Short Text

Hussam Hamdan,Patrice Bellot,Frederic Bechet

DOI: https://doi.org/10.48550/arXiv.1610.03106

2016-10-11

Abstract:Term weighting metrics assign weights to terms in order to discriminate the important terms from the less crucial ones. Due to this characteristic, these metrics have attracted growing attention in text classification and recently in sentiment analysis. Using the weights given by such metrics could lead to more accurate document representation which may improve the performance of the classification. While previous studies have focused on proposing or comparing different weighting metrics at two-classes document level sentiment analysis, this study propose to analyse the results given by each metric in order to find out the characteristics of good and bad weighting metrics. Therefore we present an empirical study of fifteen global supervised weighting metrics with four local weighting metrics adopted from information retrieval, we also give an analysis to understand the behavior of each metric by observing and analysing how each metric distributes the terms and deduce some characteristics which may distinguish the good and bad metrics. The evaluation has been done using Support Vector Machine on three different datasets: Twitter, restaurant and laptop reviews.

Computation and Language,Information Retrieval,Machine Learning
TF-IDFC-RF: A Novel Supervised Term Weighting Scheme

Flavio Carvalho,Gustavo Paiva Guedes

DOI: https://doi.org/10.48550/arXiv.2003.07193

2020-08-12

Abstract:Sentiment Analysis is a branch of Affective Computing usually considered a binary classification task. In this line of reasoning, Sentiment Analysis can be applied in several contexts to classify the attitude expressed in text samples, for example, movie reviews, sarcasm, among others. A common approach to represent text samples is the use of the Vector Space Model to compute numerical feature vectors consisting of the weight of terms. The most popular term weighting scheme is TF-IDF (Term Frequency - Inverse Document Frequency). It is an Unsupervised Weighting Scheme (UWS) since it does not consider the class information in the weighting of terms. Apart from that, there are Supervised Weighting Schemes (SWS), which consider the class information on term weighting calculation. Several SWS have been recently proposed, demonstrating better results than TF-IDF. In this scenario, this work presents a comparative study on different term weighting schemes and proposes a novel supervised term weighting scheme, named as TF-IDFC-RF (Term Frequency - Inverse Document Frequency in Class - Relevance Frequency). The effectiveness of TF-IDFC-RF is validated with SVM (Support Vector Machine) and NB (Naive Bayes) classifiers on four commonly used Sentiment Analysis datasets. TF-IDFC-RF shows promising results, outperforming all other weighting schemes on two datasets.

Information Retrieval,Machine Learning
Several alternative term weighting methods for text representation and classification

Zhong Tang,Wenqiang Li,Yan Li,Wu Zhao,Song Li

DOI: https://doi.org/10.1016/j.knosys.2020.106399

2020-11-01

Abstract:Text representation is one kind of hot topics which support text classification (TC) tasks. It has a substantial impact on the performance of TC. Although the most famous TF-IDF is specially designed for information retrieval rather than TC tasks, it is highly useful in the field of TC as a term weighting method to represent text contents. Inspired by the IDF part of TF-IDF which is defined as the logarithmic transformation, we proposed several alternative methods in this study to generate unsupervised term weighting schemes that can offset the drawback confronting TF-IDF. Moreover, owing to TC tasks are different from information retrieval, representing test texts as a vector in an appropriate way is also essential for TC tasks, especially for supervised term weighting approaches (e.g., TF-RF), mainly due to these methods need to use category information when weighting the terms. But most of current schemes do not clearly explain how to represent test texts with their schemes. To explore this problem and seek a reasonable solution to these schemes, we analyzed three typical supervised term weighting methods in depth to illustrate how to represent the test text. To investigate the effectiveness of our work, three sets of experiments are designed to compare their performance. Comparisons show that our proposed methods can indeed enhance the performance of TC, and sometimes even outperform existing supervised term weighting methods.

computer science, artificial intelligence
A Study of the Application of Weight Distributing Method Combining Sentiment Dictionary and TF-IDF for Text Sentiment Analysis

Hao Liu,Xi Chen,Xiaoxiao Liu

DOI: https://doi.org/10.1109/access.2022.3160172

IF: 3.9

2022-01-01

IEEE Access

Abstract:The most commonly used methods in text sentiment analysis are rule-based sentiment dictionary and machine learning, with the later referring to the use of vectors to represent text followed by the use of machine learning to classify the vectors. Both methods have their limitations, including inflexibility of rules, non-prominence of sentiment words. In this paper, we design a weight distributing method combining the two methods for text sentiment analysis, by which the sentence vectors obtained can both highlight words with sentiment meanings while retaining their text information. Empirical results show that based on this new method, the accuracy rate of text sentiment analysis can reach as high as 82.1%, which means 13.9% higher than rule-based sentiment dictionary method, and 7.7% higher than TF-IDF weighting method.

computer science, information systems,telecommunications,engineering, electrical & electronic
Balancing between over-weighting and under-weighting in supervised term weighting

Haibing Wu,Xiaodong Gu,Yiwei Gu

DOI: https://doi.org/10.1016/j.ipm.2016.10.003

2017-03-01

Abstract:Supervised term weighting could improve the performance of text categorization. A way proven to be effective is to assign larger weight to terms with more imbalanced distributions across categories. This paper shows that supervised term weighting should not just assign large weights to imbalanced terms, but should also control the trade-off between over-weighting and under-weighting. Over-weighting, a new concept proposed in this paper, is caused by the improper handling of singular terms and too large ratios between term weights. To prevent over-weighting, we present three regularization techniques: add-one smoothing, sublinear scaling and bias term. Add-one smoothing is used to handle singular terms. Sublinear scaling and bias term shrink the ratios between term weights. However, if sublinear functions scale down term weights too much, or the bias term is too large, under-weighting would occur and harm the performance. It is therefore critical to balance between over-weighting and under-weighting. Inspired by this insight, we also propose a new supervised term weighting scheme, regularized entropy (re). Our re employs entropy to measure term distribution, and introduces the bias term to control over-weighting and under-weighting. Empirical evaluations on topical and sentiment classification datasets indicate that sublinear scaling and bias term greatly influence the performance of supervised term weighting, and our re enjoys the best results in comparison with existing schemes.

computer science, information systems,information science & library science
A generic multi-level framework for building term-weighting schemes in text classification

Zhong Tang

DOI: https://doi.org/10.1093/comjnl/bxae068

2024-07-25

The Computer Journal

Abstract:Abstract Term weighting is essential for text classification tasks, and thus various supervised term-weighting (STW) methods have been designed and presented in recent years, such as TF (term frequency)-IG (information gain), TF-MI (mutual information), TF-RF (relevance frequency), and TF-IDF (inverse document frequency)-ICSDF (inverse class space density frequency). Unlike other schemes, TF-IDF-ICSDF considers not only the local factor (i.e. TF) and the category factor (i.e. ICSDF) but also the global factor (i.e. IDF) in the weighting process. Hence, a natural question is whether IDF is really useful for improving the classification performance of STW schemes. To explore this issue, a generic multi-level framework composed of term-level, text-level, and category-level is first established, which corresponds to local factor, global factor, and category factor, respectively. Based on the generic multi-level framework, a new two-level STW method, TF-ICSDF, can be generated by removing the IDF from the TF-IDF-ICSDF scheme. Conversely, we also integrated the IDF with other two-level STW schemes (e.g. TF-IG, TF-MI, TF-RF) to obtain several three-level STW schemes. We verified the general classification performance of our proposed STW schemes on three open benchmark datasets. The results manifest that performance can usually be boosted if IDF is incorporated into the STW schemes, indicating that weighting terms utilizing the IDF factor could provide better text representation. Therefore, the generic multi-level framework and STW schemes we proposed are effective.

computer science, information systems, theory & methods, software engineering, hardware & architecture
New term weighting schemes with combination of multiple classifiers for sentiment analysis

Mohamed Abdel Fattah

DOI: https://doi.org/10.1016/j.neucom.2015.04.051

IF: 6

2015-11-01

Neurocomputing

Abstract:The rapid growth of social media on the Web, such as forum discussions, reviews, blogs, micro-blogs, social networks and Twitter has created huge volume of opinionated data in digital forms. Therefore, last decade showed growth of sentiment analysis task to be one of the most active research areas in natural language processing. In this work, the problem of classifying documents based on overall sentiment is investigated. The main goal of this work is to present comprehensive investigation of different proposed new term weighting schemes for sentiment classification. The proposed new term weighting schemes exploit the class space density based on the class distribution in the whole documents set as well as in the class documents set. The proposed approaches provide positive discrimination on frequent and infrequent terms. We have compared our new term weighting schemes with traditional and state of art term weighting schemes. Some of our proposed terms weighting schemes outperform the traditional and state of art term weighting schemes results.

computer science, artificial intelligence
Exploiting Category Information and Document Information to Improve Term Weighting for Text Categorization

Jingyang Li,Maosong Sun

DOI: https://doi.org/10.1007/978-3-540-70939-8_52

2007-01-01

Abstract:Traditional tfidf-like term weighting schemes have a rough statistic -- idfas the term weighting factor, which does not exploit the category information (category labels on documents) and intra-document information (the relative importance of a given term to a given document that contains it) from the training data for a text categorization task. We present here a more elaborate nonparametric probabilistic model to make use of this sort of information in the term weighting phase. idfis theoretically proved to be a rough approximation of this new term weighting factor. This work is preliminary and mainly aiming at providing inspiration for further study on exploitation of this information, but it already provides a moderate performance boost on three popular document collections.
Research on dynamic self-adaptive term weighting for multi-class text classification algorithm

PEISong-wen,Bai-feng WU

DOI: https://doi.org/10.3969/j.issn.1001-3695.2011.11.024

2011-01-01

Abstract:Text classification plays an important role while studying text data mining and information retrieve,and computing and allocating term weight is the key process while classifying text.Therefore,this paper proposed a dynamic self-adaptive term weighting(DATW) for multi-class text classification,which overcame the disadvantages of the traditional term weighting algorithm TF-IDF.DATW not only considered the term frequency within a text and the number of a text corresponding the term within the whole training set,but also took into account the distribution coefficient and the gradient descent of a term to self-adapting dynamic text classification.It is validated that the performance of using DATW is superior to that of using TF-IDF.
Modified DFS-based term weighting scheme for text classification

Long Chen,Liangxiao Jiang,Chaoqun Li

DOI: https://doi.org/10.1016/j.eswa.2020.114438

IF: 8.5

2021-04-01

Expert Systems with Applications

Abstract:With the rapid growth of textual data on the Internet, text classification (TC) has attracted increasing attention. As a widely used text representation method, the vector space model (VSM) represents the content of a document as a vector composed of term frequency (TF) in the term space. Because different terms have different levels of importance in a document, designing an appropriate term weighting scheme is crucial to improve the performance of TC. In this study, we first conducted a comprehensive survey of the existing well-known term weighting schemes and found that they are not fully effective and that researchers are still focused on proposing new term weighting schemes. To further improve the performance of TC, we propose a new term weighting scheme based on the modified distinguishing feature selector (DFS), which we call TF-MDFS (modified DFS-based TF). Experimental results show that TF-MDFS is overall better than existing state-of-the-art term weighting schemes in terms of the classification accuracy of widely used base classifiers.

computer science, artificial intelligence,engineering, electrical & electronic,operations research & management science
Using modified term frequency to improve term weighting for text classification

Long Chen,Liangxiao Jiang,Chaoqun Li

DOI: https://doi.org/10.1016/j.engappai.2021.104215

IF: 8

2021-05-01

Engineering Applications of Artificial Intelligence

Abstract:Text classification (TC) is an essential task of natural language processing (NLP). In order to improve the performance of TC, term weighting is often used to obtain effective text representation by assigning appropriate weights to each term. A term weighting scheme is generally composed of term frequency factor, collection frequency factor and normalization factor. The normalization factor is commonly used as an optional factor to offset the influence of document length. Through the investigation of the existing term weighting schemes, we found that most of them focus on finding a more effective collection frequency factor, but rarely pay attention to finding a new term frequency factor. In this paper, we first proposed a new term frequency factor called modified term frequency (MTF). Different from the normalization factor, MTF directly modifies the raw term frequency based on the length information of all training documents. Then we proposed a new term weighting scheme by combining MTF with an existing collection frequency factor called modified distinguishing feature selector (MDFS). We denoted our scheme by MTF-MDFS (MDFS-based MTF). Extensive experimental results on 19 benchmark text datasets and 6 real-world text datasets show that our proposed MTF and MTF-MDFS are all much better than their state-of-the-art competitors in terms of the classification accuracy and the weighted average of <math>F1</math> of widely used base classifiers, such as MNB, SVM and LR.

automation & control systems,computer science, artificial intelligence,engineering, electrical & electronic, multidisciplinary
A Comparative Study on Feature Weight in Text Categorization

Zhi-hong Deng,Shi-Wei Tang,Dong-Qing Yang,Ming Zhang,Li-Yu Li,Kun-Qing Xie,Ming Zhang

DOI: https://doi.org/10.1007/978-3-540-24655-8_64

2004-01-01

Abstract:Text Categorization is the process of automatically assigning predefined categories to free text documents. Feature weight, which calculates feature (term) values in documents, is one of important preprocessing techniques in text categorization. This paper is a comparative study of feature weight methods in statistical learning of text categorization. Four methods were evaluated, including tf*idf, tf*CRF, tf*OddsRatio, and tf*CHI. We have evaluated these methods on benchmark collection Reuters-21578 with Support Vector Machines (SVMs) classifiers. We found that tf*CHI is most effective in our experiments. Using tf*CHI with a SVMs classifier yielded a very high classification accuracy (87.5% for micro-average F-1 and 87.8% for micro-average break-even point). tf*idf, which is widely used in text categorization, compares favorably with tf*CRF but is not as effective as tf*CHI and tf*OddsRatio.
A comparison of text weighting schemes on sentiment analysis of government policies: a case study of replacement of national examinations

Edi Sutoyo,Achmad Pratama Rifai,Anhar Risnumawan,Muhardi Saputra

DOI: https://doi.org/10.1007/s11042-022-11900-9

IF: 2.577

2022-01-12

Multimedia Tools and Applications

Abstract:The National Examination (UN) is a system of evaluation of education standards for elementary and secondary schools conducted nationally and is also used to equalize the quality between education levels. The national examination aims to determine graduation, national education quality mapping, and also for selection to higher education levels. Over the years the UN has become a benchmark for the standardization of education in Indonesia, meaning that the UN is very much needed to find out the size of the quality of student education and the quality of teaching of a school. The government’s policy regarding the plan to remove the UN system has received public attention. The removal of the UN is planned to be replaced with a competency assessment and character survey. In order to know the public’s sentiments regarding this policy, research needs to be done, one of which is to analyze public sentiment through social media Twitter. In text mining tasks such as text classification and sentiment analysis, careful selection of a term weighting scheme (TWS) can have a significant impact on effectiveness. We tested the effectiveness of six classification algorithms by varying the TWS in the dataset obtained from Twitter. The experimental results showed that overall TF-IGM outperformed TF-IDF on four classification algorithms. Finally, the sentiment analysis of the discourse on the removal of the UN is expected to provide a general picture to the government regarding public opinion from the point of view of data coming from social media.

computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering
Research on Text Similarity Measurement Hybrid Algorithm with Term Semantic Information and TF-IDF Method

Fei Lan

DOI: https://doi.org/10.1155/2022/7923262

2022-04-23

Advances in Multimedia

Abstract:TF-IDF (term frequency-inverse document frequency) is one of the traditional text similarity calculation methods based on statistics. Because TF-IDF does not consider the semantic information of words, it cannot accurately reflect the similarity between texts, and semantic information enhanced methods distinguish between text documents poorly because extended vectors with semantic similar terms aggravate the curse of dimensionality. Aiming at this problem, this paper advances a hybrid with the semantic understanding and TF-IDF to calculate the similarity of texts. Based on term similarity weighting tree (TSWT) data structure and the definition of semantic similarity information from the HowNet, the paper firstly discusses text preprocess and filter process and then utilizes the semantic information of those key terms to calculate similarities of text documents according to the weight of the features whose weight is greater than the given threshold. The experimental results show that the hybrid method is better than the pure TF-IDF and the method of semantic understanding at the aspect of accuracy, recall, and F1-metric by different K-means clustering methods.
Improve Precategorized Collection Retrieval by Using Supervised Term Weighting Schemes

Y Zhao,G Karypis

DOI: https://doi.org/10.1109/itcc.2002.1000353

2002-01-01

Abstract:The emergence of the World Wide Web has led to an increased interest in methods for searching for information. A key characteristic of many online document collections is that the documents have pre-defined category information, such as the variety of scientific articles accessible via digital libraries (e.g. ACM, IEEE, etc.), medical articles, news-wires and various directories (e.g. Yahoo, OpenDirectory Project, etc.). However, most previous information retrieval systems have not taken the pre-existing category information into account. In this paper, we present weight adjustment schemes based upon the category information in the vector-space model, which are able to select the most content-specific and discriminating features. Our experimental results on TREC data sets show that the pre-existing category information does provide additional beneficial information to improve retrieval. The proposed weight adjustment schemes perform better than the vector-space model with the inverse document frequency (IDF) weighting scheme when queries are less specific. The proposed weighting schemes can also benefit retrieval when clusters are used as an approximations to categories.

A study of supervised term weighting scheme for sentiment analysis

A study of supervised term weighting scheme for sentiment analysis

An improved supervised term weighting scheme for text representation and classification

A Supervised Term Weighting Scheme for Multi-class Text Categorization

A Novel Term Weighting Scheme for Automated Text Categorization

Reducing Over-Weighting in Supervised Term Weighting for Sentiment Analysis.

Supervised Term Weighting Metrics for Sentiment Analysis in Short Text

TF-IDFC-RF: A Novel Supervised Term Weighting Scheme

Several alternative term weighting methods for text representation and classification

A Study of the Application of Weight Distributing Method Combining Sentiment Dictionary and TF-IDF for Text Sentiment Analysis

Balancing between over-weighting and under-weighting in supervised term weighting

A generic multi-level framework for building term-weighting schemes in text classification

New term weighting schemes with combination of multiple classifiers for sentiment analysis

Exploiting Category Information and Document Information to Improve Term Weighting for Text Categorization

Research on dynamic self-adaptive term weighting for multi-class text classification algorithm

Modified DFS-based term weighting scheme for text classification

Using modified term frequency to improve term weighting for text classification

A Comparative Study on Feature Weight in Text Categorization

A comparison of text weighting schemes on sentiment analysis of government policies: a case study of replacement of national examinations

Research on Text Similarity Measurement Hybrid Algorithm with Term Semantic Information and TF-IDF Method

Improve Precategorized Collection Retrieval by Using Supervised Term Weighting Schemes