Abstract:In recent years, there has been increasing interest in adopting published neural retrieval models learned from corpora for text retrieval. Although these models achieve excellent retrieval performance, in terms of popular accuracy metrics, on datasets they have been trained, their performance on new text data might degrade. To obtain the desired retrieval performance on both the data used in training and the latest data collected after training, the simple approach of learning a new model from both datasets is not always feasible since the annotated dataset used in training is often not published along with the learned model. Knowledge amalgamation (KA) is an emerging technique to deal with this problem of inaccessibility of data used in previous training. KA learns a new model (called a student model) from new data by reusing (called amalgamating) a number of trained models (called teacher models) instead of accessing the teachers' original training data. However, in order to efficiently learn an accurate student model, the classical KA approach requires manual selection of an appropriate subset of teacher models for amalgamation. This manual procedure for selecting teacher models prevents the classical KA from being scaled to retrieval tasks for which a large number of candidate teacher models are ready to be reused. This paper presents Arm, an intelligent system for efficiently learning a neural retrieval model with the desired accuracy on incoming data by automatically amalgamating a subset of teacher models (called a teacher model combination or simply combination ) among a large number of teacher models. o filter combinations that fail to produce accurate student models, Arm employs Bayesian optimization to derive an accuracy prediction model based on sampled amalgamation tasks. Then, Arm uses the derived prediction model to exclude unqualified combinations without training the rest combinations. To speed up training, Arm introduces a cost model that picks the teacher model combination with the minimal training cost among all qualified teacher model combinations to produce the final student model. This paper will demonstrate the major workflow of Arm and present the produced student models to users.

Flexible retrieval with NMSLIB and FlexNeuART

Constrained All-k-Nearest-Neighbor Search

Arm: Efficient Learning of Neural Retrieval Models with Desired Accuracy by Automatic Knowledge Amalgamation

FLEX: A Fast and Light-weight Learned Index for kNN Search in High-Dimensional Space

LexBoost: Improving Lexical Document Retrieval with Nearest Neighbors

OpenMatch: an Open Source Library for Neu-IR Research

LibN3L: A Lightweight Package for Neural NLP.

FlexNER: A Flexible LSTM-CNN Stack Framework for Named Entity Recognition.

Early Exit Strategies for Approximate k-NN Search in Dense Retrieval

Adaptive Retrieval and Scalable Indexing for k-NN Search with Cross-Encoders

NeRF-Loc: Visual Localization with Conditional Neural Radiance Field.

Revisiting K-Nn for Fine-Tuning Pre-trained Language Models

Fast Content-Based Image Retrieval Based on Equal-Average K-Nearest-Neighbor Search Schemes

Memory-Efficient RkNN Retrieval by Nonlinear k-Distance Approximation

Fast neighbor user searching for neighborhood-based collaborative filtering with hybrid user similarity measures

NUDGE: Lightweight Non-Parametric Fine-Tuning of Embeddings for Retrieval

Enhancing the Ranking Context of Dense Retrieval Methods through Reciprocal Nearest Neighbors

Pairing Clustered Inverted Indexes with kNN Graphs for Fast Approximate Retrieval over Learned Sparse Representations

ACORN: Performant and Predicate-Agnostic Search Over Vector Embeddings and Structured Data

kNN-CTC: Enhancing ASR via Retrieval of CTC Pseudo Labels

Neighborhood-Aware Neural Architecture Search