Abstract:To address the insufficient expressive capabilities of traditional methods in assessing the development level of rural tourism, this study explores the fusion application of the Bidirectional Encoder Representations from Transformers (BERT) and the Back Propagation (BP) algorithm to enhance the accuracy and comprehensiveness of rural tourism development assessment. Firstly, this study introduces the BERT deep learning model and its applications in natural language processing, alongside the role of the BP algorithm in pattern recognition and predictive analysis. Subsequently, a framework for assessing rural tourism development levels, integrating BERT and the BP algorithm, is proposed. This framework collects multidimensional rural tourism-related data and utilizes the BERT model for sentiment analysis and topic extraction from textual data. Empirical analysis of rural tourism development in a specific region validates the effectiveness of the proposed approach. Experimental results demonstrate: (1) The model achieves an accuracy of 84.33% and an F1 score of 85.33% on the publicly available Laptop dataset, with a processing time of 20 s, significantly outperforming other methods. Compared to traditional approaches, the proposed method accurately captures correlations between textual information and numerical data, thereby enhancing the credibility and accuracy of assessment results. (2) From the ablation study results, it is evident that removing any component from the model leads to performance degradation. Specifically, removing the Bidirectional Gated Recurrent Unit (BiGRU) reduces accuracy and F1 scores to 78.21% and 76.33% on the Laptop dataset, and to 85.10% and 70.45% on the Tourist_F dataset. Removing Text Convolutional Neural Network (CNN) reduces accuracy and F1 scores to 79.34% and 77.56% on the Laptop dataset, and to 86.25% and 72.11% on the Tourist_F dataset. The most significant performance decline occurs upon removing BERT, with accuracy and F1 scores decreasing to 70.14% and 66.43% on the Laptop dataset, and to 78.45% and 60.33% on the Tourist_F dataset. These results indicate that BiGcRU, TextCNN, and BERT each contribute significantly to the model's performance. This study provides substantial support for advancing sustainable development in rural tourism, offering significant practical and innovative value.

TourBERT: A pretrained language model for the tourism industry

Evaluation of rural tourism development level using BERT-enhanced deep learning model and BP algorithm

POIBERT: A Transformer-based Model for the Tour Recommendation Problem

GottBERT: a pure German Language Model

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

ClimateBert: A Pretrained Language Model for Climate-Related Text

BTRec: BERT-Based Trajectory Recommendation for Personalized Tours

Application of the Lightweight BERT Model for the Warning of Tourism Public Opinion Emergencies

Unlocking Uniqueness: Analyzing Online Reviews of Airbnb Experiences Using BERT-based Models

RoBERTa: A Robustly Optimized BERT Pretraining Approach

SPBERT: An Efficient Pre-training BERT on SPARQL Queries for Question Answering over Knowledge Graphs

EstBERT: A Pretrained Language-Specific BERT for Estonian

Geo-BERT Pre-training Model for Query Rewriting in POI Search.

Geoscience Language Processing for Exploration

GeoBERT: Pre-Training Geospatial Representation Learning on Point-of-Interest

BERTaú: Itaú BERT for digital customer service

SpaBERT: A Pretrained Language Model from Geographic Data for Geo-Entity Representation

TopoBERT: Plug and Play Toponym Recognition Module Harnessing Fine-tuned BERT

Sentiment analysis of hotel online reviews using the BERT model and ERNIE model—Data from China

QUERT: Continual Pre-training of Language Model for Query Understanding in Travel Domain Search

Innovative Bert-based Reranking Language Models for Speech Recognition