Abstract:Textual representations play an important role in the field of natural language processing (NLP). The efficiency of NLP tasks, such as text comprehension and information extraction, can be significantly improved with proper textual representations. As neural networks are gradually applied to learn the representation of words and phrases, fairly efficient models of learning short text representations have been developed, such as the continuous bag of words (CBOW) and skip-gram models, and they have been extensively employed in a variety of NLP tasks. Because of the complex structure generated by the longer text lengths, such as sentences, algorithms appropriate for learning short textual representations are not applicable for learning long textual representations. One method of learning long textual representations is the Long Short-Term Memory (LSTM) network, which is suitable for processing sequences. However, the standard LSTM does not adequately address the primary sentence structure (subject, predicate and object), which is an important factor for producing appropriate sentence representations. To resolve this issue, this paper proposes the dependency-based LSTM model (D-LSTM). The D-LSTM divides a sentence representation into two parts: a basic component and a supporting component. The D-LSTM uses a pre-trained dependency parser to obtain the primary sentence information and generate supporting components, and it also uses a standard LSTM model to generate the basic sentence components. A weight factor that can adjust the ratio of the basic and supporting components in a sentence is introduced to generate the sentence representation. Compared with the representation learned by the standard LSTM, the sentence representation learned by the D-LSTM contains a greater amount of useful information. The experimental results show that the D-LSTM is superior to the standard LSTM for sentences involving compositional knowledge (SICK) data.

Learning Bilingual Sentence Representations for Quality Estimation of Machine Translation.

Dependency-based Siamese Long Short-Term Memory Network for Learning Sentence Representations.

NJUNLP's Submission for CCMT20 Quality Estimation Task.

Quality Estimation Using Round-trip Translation with Sentence Embeddings

Verdi: Quality Estimation and Error Detection for Bilingual Corpora

Local Translation Prediction with Global Sentence Representation

Submissions for the WMT 19 Quality Estimation Shared Task

Self-Supervised Quality Estimation for Machine Translation.

Towards Making the Most of LLM for Translation Quality Estimation.

Improving Translation Quality Estimation with Bias Mitigation

Learning Bilingual Distributed Phrase Represenations for Statistical Machine Translation

Ensemble-based Transfer Learning for Low-resource Machine Translation Quality Estimation

Alibaba-Translate China's Submission for WMT 2022 Quality Estimation Shared Task

Metric for Automatic Machine Translation Evaluation based on Universal Sentence Representations

QE-EBM: Using Quality Estimators as Energy Loss for Machine Translation

Enhancing Machine Translation Quality Estimation via Fine-Grained Error Analysis and Large Language Model

Multi-view fusion for universal translation quality estimation

HW-TSC 2023 Submission for the Quality Estimation Shared Task.

An Improved Multi-task Approach to Pre-trained Model Based MT Quality Estimation.

Sentence Level Human Translation Quality Estimation with Attention-based Neural Networks

Translation Error Detection as Rationale Extraction