Abstract:The surge in the number of books published makes the manual evaluation methods (e.g. peer review) difficult to efficiently evaluate books. The use of books' citations and alternative evaluation metrics (e.g. library holdings, social media mentions, book reviews) can assist manual evaluation and reduce the cost of evaluation. However, most existing evaluation research was based on a single evaluation source with coarse-grained analysis, which may obtain incomprehensive or one-sided evaluation results of book impact. Meanwhile, relying on a single resource for book assessment may lead to the risk that the evaluation results cannot be obtained due to the lack of the evaluation data, especially for newly published books. Hence, this paper measured book impact based on an evaluation system constructed by integrating multiple evaluation sources. Specifically, we conducted finer-grained mining on the multiple evaluation sources, including books' internal evaluation resources (e.g. books' contents) and external evaluation resources (e.g. books' reviews, books' citations and books' usages). Various technologies (e.g. topic extraction, sentiment analysis, text classification) were used to extract corresponding evaluation metrics from the internal and external evaluation resources. Then, Expert evaluation combined with analytic hierarchy process was used to integrate the evaluation metrics and construct a book impact evaluation system. Finally, the reliability of the evaluation system was verified by comparing with the results of expert evaluation, detailed and diversified evaluation results were then obtained. The experimental results reveal that differential evaluation resources can measure the books' impacts from different dimensions, and the integration of multiple evaluation data can assess books more comprehensively. Meanwhile, the book impact evaluation system can provide personalized evaluation results according to the users' evaluation purposes. In addition, the disciplinary differences should be considered for assessing books' impacts.

Evaluating Book Impacts Via Integrating Multi-Source Reviews

Impacts towards a comprehensive assessment of the book impact by integrating multiple evaluation sources

Measuring Book Impact Based on the Multi-granularity Online Review Mining

Examining differences among book reviews from various online platforms

A Quantitative Study of Impact of Incentive to Quality of Software Reviews

Using Altmetrics for Assessing Impact of Highly-Cited Books in Chinese Book Citation Index

An Examination of Academic Monographs in Library and Information Studies A Dimensions Platform-Based Analysis of Traditional and Altmetrics Indicators

The Citation-Based Indicator and Combined Impact Indicator-New Options for Measuring Impact

Online Book Reviews and the Computational Modelling of Reading Impact

Exploration on the Multi-dimensional Values of Online Book Reviews

Quantifying Customer Review by Integrating Multiple Source of Knowledge

Review-Oriented Metadata Enrichment: A Case Study

Understanding the Impact of Prior Reviews on Subsequent Reviews: the Role of Rating Volume, Variance and Reviewer Characteristics

A RevieW of the Research on the Evaluation of International Influence of Academic Achievements in Social Science

Continuous, Dynamic and Comprehensive Article-Level Evaluation of Scientific Literature

A Quantitative Study of Software Reviews Using Content Analysis Methods

oriented metadata enrichment: A case study

A new scholars' impact evaluation method based on academic collaboration

An Empirical Study on Inline Impact Factors of Reviews Usefulness Based on Movie Reviews

Enriching meta-analyses through scoping review, bibliometrics, and alternative impact metrics: Visualizing study characteristics, hidden risk of bias, societal influence, and research translation

Analysis of Economic Impact of Online Reviews: An Approach for Market-Driven Requirements Evolution