Abstract:In recent years, there has been increasing interest in adopting published neural retrieval models learned from corpora for text retrieval. Although these models achieve excellent retrieval performance, in terms of popular accuracy metrics, on datasets they have been trained, their performance on new text data might degrade. To obtain the desired retrieval performance on both the data used in training and the latest data collected after training, the simple approach of learning a new model from both datasets is not always feasible since the annotated dataset used in training is often not published along with the learned model. Knowledge amalgamation (KA) is an emerging technique to deal with this problem of inaccessibility of data used in previous training. KA learns a new model (called a student model) from new data by reusing (called amalgamating) a number of trained models (called teacher models) instead of accessing the teachers' original training data. However, in order to efficiently learn an accurate student model, the classical KA approach requires manual selection of an appropriate subset of teacher models for amalgamation. This manual procedure for selecting teacher models prevents the classical KA from being scaled to retrieval tasks for which a large number of candidate teacher models are ready to be reused. This paper presents Arm, an intelligent system for efficiently learning a neural retrieval model with the desired accuracy on incoming data by automatically amalgamating a subset of teacher models (called a teacher model combination or simply combination ) among a large number of teacher models. o filter combinations that fail to produce accurate student models, Arm employs Bayesian optimization to derive an accuracy prediction model based on sampled amalgamation tasks. Then, Arm uses the derived prediction model to exclude unqualified combinations without training the rest combinations. To speed up training, Arm introduces a cost model that picks the teacher model combination with the minimal training cost among all qualified teacher model combinations to produce the final student model. This paper will demonstrate the major workflow of Arm and present the produced student models to users.

Genetic Algorithm Based Dynamic Parameter Learning For Text Retrieval

Parameter Optimization For Information Retrieval With Genetic Algorithm

A Hybrid Dna Based Genetic Algorithm for Parameter Estimation of Dynamic Systems

Feature Selection and Parameter Optimization for Support Vector Machines: A New Approach Based on Genetic Algorithm with Feature Chromosomes.

A novel RNA genetic algorithm for parameter estimation of dynamic systems

A New DNA Genetic Algorithm and Its Application in Parameter Estimation

Parameter estimation for time-varying system based on improved genetic algorithm

A Genetic Algorithm Used in Multiple Parameters Optimization Problems with Constraints

Arm: Efficient Learning of Neural Retrieval Models with Desired Accuracy by Automatic Knowledge Amalgamation

Hyper Parameters Selection For Svr Based On Steady-State Genetic Algorithm

Deep Reinforcement Learning using Genetic Algorithm for Parameter Optimization

SVR Kernel Parameters Selection Based on Steady-State Genetic Algorithm

Hi-Gen: Generative Retrieval For Large-Scale Personalized E-commerce Search

Exploring the Practicality of Generative Retrieval on Dynamic Corpora

A Hybrid Approach To Parameter Tuning In Genetic Algorithms

A two-stage information retrieval system based on interactive multimodal genetic algorithm for query weight optimization

Enhancing Knowledge Retrieval with In-Context Learning and Semantic Search through Generative AI

An Iterative Implicit Feedback Approach To Personalized Search

GARA: A novel approach to Improve Genetic Algorithms' Accuracy and Efficiency by Utilizing Relationships among Genes

Adapting to Non-Stationary Environments: Multi-Armed Bandit Enhanced Retrieval-Augmented Generation on Knowledge Graphs

Learning to Retrieve Iteratively for In-Context Learning