Abstract:Large language models are increasingly applied in real-world scenarios, including research and education. These models, however, come with well-known ethical issues, which may manifest in unexpected ways in human-computer interaction research due to the extensive engagement with human subjects. This paper reports on research practices related to LLM use, drawing on 16 semi-structured interviews and a survey conducted with 50 HCI researchers. We discuss the ways in which LLMs are already being utilized throughout the entire HCI research pipeline, from ideation to system development and paper writing. While researchers described nuanced understandings of ethical issues, they were rarely or only partially able to identify and address those ethical concerns in their own projects. This lack of action and reliance on workarounds was explained through the perceived lack of control and distributed responsibility in the LLM supply chain, the conditional nature of engaging with ethics, and competing priorities. Finally, we reflect on the implications of our findings and present opportunities to shape emerging norms of engaging with large language models in HCI research.
What problem does this paper attempt to address?
### Problems the Paper Attempts to Solve
This paper aims to explore the ethical issues and practical applications of large language models (LLMs) in human-computer interaction (HCI) research. Specifically, the paper attempts to answer the following questions:
1. **How do HCI researchers integrate large language models into their projects?**
- At which research stages (e.g., ideation, design, execution, analysis, and paper writing) do researchers use LLMs?
- What are the specific ways LLMs are applied at these stages?
2. **What ethical concerns do researchers have about using LLMs?**
- What are the potential ethical issues that may arise from using LLMs, such as privacy breaches, harmful outputs, copyright issues, etc.?
- How aware are researchers of these ethical issues?
3. **How do HCI researchers address and handle these ethical issues?**
- Are researchers able to identify and resolve these ethical issues in actual projects?
- What measures have they taken to address these ethical challenges?
### Background and Motivation
With the rapid development and widespread application of large language models, their potential and risks in research and education are becoming increasingly prominent. Although LLMs have great potential to improve research efficiency and innovation, their ethical issues have also attracted widespread attention. Especially in human-computer interaction research, where frequent interaction with human subjects occurs, these ethical issues may manifest in unexpected ways.
### Methods
To comprehensively understand the practices and ethical considerations of HCI researchers when using LLMs, the authors adopted a mixed-methods research design, including:
1. **Surveys**:
- Collected data from 50 HCI researchers through online questionnaires to understand how they use LLMs in their projects and the ethical issues they encounter.
- The questionnaire covered application scenarios of LLMs, identification and handling of ethical challenges, etc.
2. **Semi-structured Interviews**:
- Conducted in-depth interviews with 16 HCI researchers to further explore their specific practices and ethical considerations when using LLMs in their research.
- The interview content included the application of LLMs in the research workflow, specific ethical concerns, and the process of handling ethical issues.
### Main Findings
1. **Application of LLMs in Research**:
- LLMs are widely used in various stages of research, from ideation, literature review, research design, data generation, system development to paper writing.
- Researchers generally believe that LLMs bring new possibilities to their research, enabling them to undertake innovative projects that were previously difficult to achieve.
2. **Ethical Concerns**:
- Researchers are generally aware of the potential ethical issues that may arise from using LLMs, including privacy breaches, harmful outputs, copyright issues, etc.
- However, many researchers fail to fully identify and address these ethical issues in actual projects, partly due to a lack of control and best practice guidance.
3. **Coping Strategies**:
- Researchers have taken various measures to address ethical issues, including enhancing data protection, improving informed consent processes, using ethical frameworks and toolkits, etc.
- Nevertheless, many researchers indicated that due to resource constraints and priority conflicts, they find it challenging to comprehensively address ethical issues in all projects.
### Conclusions and Recommendations
The paper emphasizes the importance of valuing research ethics while continuing to integrate LLMs into research practices. The authors call for:
- **Collaboration with IRB and other regulatory bodies** to ensure research meets ethical standards.
- **Redesigning effective informed consent processes** to enhance participant privacy protection.
- **Developing tools and processes** to interrupt potential ethical issues in the LLM supply chain.
- **Providing training opportunities on the ethical use of LLMs** to raise researchers' ethical awareness.
- **Adjusting existing academic incentive structures** to make ethical considerations an important part of research.
In summary, this paper reveals the ethical challenges faced by HCI researchers when using LLMs through empirical research and proposes corresponding countermeasures to promote the healthy development of this field.