Abstract:Due to the ambiguity and vagueness of a user query, it is essential to identify the query facets for the clarification of user intents. Existing work on query facet generation has achieved compelling performance by sequentially predicting the next facet given previously generated facets based on pre-trained language generation models such as BART. Given a query, there are mainly two types of training objectives to guide the facet generation models. One is to generate the default sequence of ground-truth facets, and the other is to enumerate all the permutations of ground-truth facets and use the sequence that has the minimum loss for model updates. The second is permutation-invariant while the first is not. In this paper, we aim to conduct a systematic comparative study of various types of training objectives, with different properties of not only whether it is permutation-invariant but also whether it conducts sequential prediction and whether it can control the count of output facets. To this end, we propose another three training objectives of different aforementioned properties. For comprehensive comparisons, besides the commonly used evaluation that measures the matching with ground-truth facets, we also introduce two diversity metrics to measure the diversity of the generated facets. Based on an open-domain query facet dataset, i.e., MIMICS, we conduct extensive analyses and show the pros and cons of each method, which could shed light on model training for clarification facet generation. The code can be found at \url{<a class="link-external link-https" href="https://github.com/ShiyuNee/Facet-Generation" rel="external noopener nofollow">this https URL</a>}

Multi-Facet Blending for Faceted Query-by-Example Retrieval

Improving Multi-Faceted Book Search by Incorporating Sparse Latent Semantic Analysis of Click-Through Logs

CSFCube -- A Test Collection of Computer Science Research Articles for Faceted Query by Example

Enhanced Facet Generation with LLM Editing

Facet Annotation by Extending CNN with a Matching Strategy

Multi-Facet Counterfactual Learning for Content Quality Evaluation

A Survey of Faceted Search

MultifacetEval: Multifaceted Evaluation to Probe LLMs in Mastering Medical Knowledge

FACET: Robust Counterfactual Explanation Analytics

FUSE: Multi-faceted Set Expansion by Coherent Clustering of Skip-Grams

Faceted Fusion of RDF Data

Enhancing multi-modal fusion in visual dialog via sample debiasing and feature interaction

BlendFilter: Advancing Retrieval-Augmented Large Language Models via Query Generation Blending and Knowledge Filtering

Fact Discovery from Knowledge Base via Facet Decomposition

A Comparative Study of Training Objectives for Clarification Facet Generation

Advancing Academic Knowledge Retrieval via LLM-enhanced Representation Similarity Fusion

FacetAtlas: Multifaceted Visualization for Rich Text Corpora.

REFINE on Scarce Data: Retrieval Enhancement through Fine-Tuning via Model Fusion of Embedding Models

GRAFS: Graphical Faceted Search System to Support Conceptual Understanding in Exploratory Search

Multi-Aspect Reviewed-Item Retrieval via LLM Query Decomposition and Aspect Fusion

Reproducibility Analysis and Enhancements for Multi-Aspect Dense Retriever with Aspect Learning