Enhancing AI Assisted Writing with One-Shot Implicit Negative Feedback

Benjamin Towle,Ke Zhou

2024-10-15

Abstract:AI-mediated communication enables users to communicate more quickly and efficiently. Various systems have been proposed such as smart reply and AI-assisted writing. Yet, the heterogeneity of the forms of inputs and architectures often renders it challenging to combine insights from user behaviour in one system to improve performance in another. In this work, we consider the case where the user does not select any of the suggested replies from a smart reply system, and how this can be used as one-shot implicit negative feedback to enhance the accuracy of an AI writing model. We introduce Nifty, an approach that uses classifier guidance to controllably integrate implicit user feedback into the text generation process. Empirically, we find up to 34% improvement in Rouge-L, 89% improvement in generating the correct intent, and an 86% win-rate according to human evaluators compared to a vanilla AI writing system on the MultiWOZ and Schema-Guided Dialog datasets.

Computation and Language,Artificial Intelligence,Machine Learning

What problem does this paper attempt to address?

### Problems Addressed by the Paper

The paper attempts to address how to utilize one-shot implicit negative feedback to improve the performance of AI-assisted writing systems. Specifically, when users do not select any suggested replies in a smart reply system, this behavior can be seen as implicit negative feedback. The paper proposes a method to integrate this feedback into AI writing models to enhance the relevance and accuracy of the generated text.

### Background and Motivation

1. **Need for AI-assisted Communication**:
- The average worker spends about 23% of their time reading and replying to emails (Mark et al., 2012). To alleviate this burden, an increasing number of AI-assisted communication systems are being developed to draft or even fully automate user replies.
- These systems speed up communication by providing suggestions at different stages of the conversation. For example, smart reply systems (such as those in Gmail and Outlook) offer preset reply options that users can click on; AI writing models (such as Jasper and Grammarly) generate more complex replies but may require additional manual editing or prompts.

2. **Limitations of Existing Systems**:
- The interaction forms and architectural differences between smart reply systems and AI writing systems are significant, making it difficult to directly apply information from one system to another.
- When users do not select any suggested replies, it usually means that the suggested replies do not match the user's intent, but this information is often ignored.

### Solution

1. **NIFTY Method**:
- The paper introduces NIFTY (Negative Implicit Feedback from Smart Reply), a classifier-guided method that integrates one-shot implicit negative feedback into the generation process of AI writing models.
- Specifically, when users do not select any suggested replies in a smart reply system, NIFTY uses this feedback to adjust the AI writing model's generation process to better align with the user's intent.

2. **Experimental Results**:
- Experimental results on the MultiWOZ and Schema-Guided Dialog datasets show that the NIFTY method improves the ROUGE-L metric by 34%, increases the generation of correct intents by 89%, and achieves an 86% win rate in human evaluations.
- By conditioning the generation process, NIFTY significantly improves the performance of AI writing models without increasing the user interaction burden.

### Main Contributions

1. **Introduction of Implicit Negative Feedback Framework**:
- Introducing the concept of implicit negative feedback into smart reply and AI writing tasks.
2. **Development and Open-Sourcing of the NIFTY Method**:
- Using classifier-guided techniques, considering intent-based and user behavior-based attributes for conditioning.
3. **Quantitative and Qualitative Analysis**:
- Comprehensive demonstration of the model's superior performance through automatic and human evaluations.

### Conclusion

The paper successfully utilizes one-shot implicit negative feedback to improve the performance of AI-assisted writing systems through the NIFTY method. Future work can further explore applying these techniques to data from real-world deployed systems and extending to more types of feedback.