Abstract:To achieve non-parametric NMT domain adaptation, $k$-Nearest-Neighbor Machine Translation ($k$NN-MT) constructs an external datastore to store domain-specific translation knowledge, which derives a $k$NN distribution to interpolate the prediction distribution of the NMT model via a linear interpolation coefficient $\lambda$. Despite its success, $k$NN retrieval at each timestep leads to substantial time overhead. To address this issue, dominant studies resort to $k$NN-MT with adaptive retrieval ($k$NN-MT-AR), which dynamically estimates $\lambda$ and skips $k$NN retrieval if $\lambda$ is less than a fixed threshold. Unfortunately, $k$NN-MT-AR does not yield satisfactory results. In this paper, we first conduct a preliminary study to reveal two key limitations of $k$NN-MT-AR: 1) the optimization gap leads to inaccurate estimation of $\lambda$ for determining $k$NN retrieval skipping, and 2) using a fixed threshold fails to accommodate the dynamic demands for $k$NN retrieval at different timesteps. To mitigate these limitations, we then propose $k$NN-MT with dynamic retrieval ($k$NN-MT-DR) that significantly extends vanilla $k$NN-MT in two aspects. Firstly, we equip $k$NN-MT with a MLP-based classifier for determining whether to skip $k$NN retrieval at each timestep. Particularly, we explore several carefully-designed scalar features to fully exert the potential of the classifier. Secondly, we propose a timestep-aware threshold adjustment method to dynamically generate the threshold, which further improves the efficiency of our model. Experimental results on the widely-used datasets demonstrate the effectiveness and generality of our model.\footnote{Our code is available at \url{<a class="link-external link-https" href="https://github.com/DeepLearnXMU/knn-mt-dr" rel="external noopener nofollow">this https URL</a>}.

Dynamic Fusion Nearest Neighbor Machine Translation Via Dempster-Shafer Theory

Faster Nearest Neighbor Machine Translation

Efficient k-Nearest-Neighbor Machine Translation with Dynamic Retrieval

Towards Faster K-Nearest-neighbor Machine Translation

Towards Robust k-Nearest-Neighbor Machine Translation

Adaptive Nearest Neighbor Machine Translation.

Efficient Cluster-Based k-Nearest-Neighbor Machine Translation

Simple and Scalable Nearest Neighbor Machine Translation

Bridging the Domain Gaps in Context Representations for K-Nearest Neighbor Neural Machine Translation.

Nearest neighbor machine translation

Datastore Distillation for Nearest Neighbor Machine Translation

Fast Nearest Neighbor Machine Translation

N-Gram Nearest Neighbor Machine Translation

Knn-Tl: K-Nearest-neighbor Transfer Learning for Low-Resource Neural Machine Translation.

Nearest Neighbor Machine Translation is Meta-Optimizer on Output Projection Layer

Federated Nearest Neighbor Machine Translation

Learning Decoupled Retrieval Representation for Nearest Neighbour Neural Machine Translation.

Revisiting Source Context in Nearest Neighbor Machine Translation.

Better Simultaneous Translation with Monotonic Knowledge Distillation.

Nearest Neighbor Knowledge Distillation for Neural Machine Translation.