Exploring the Impact of AI Value Alignment in Collaborative Ideation: Effects on Perception, Ownership, and Output

Alicia Guo,Pat Pataranutaporn,Pattie Maes
2024-04-22
Abstract:AI-based virtual assistants are increasingly used to support daily ideation tasks. The values or bias present in these agents can influence output in hidden ways. They may also affect how people perceive the ideas produced with these AI agents and lead to implications for the design of AI-based tools. We explored the effects of AI agents with different values on the ideation process and user perception of idea quality, ownership, agent competence, and values present in the output. Our study tasked 180 participants with brainstorming practical solutions to a set of problems with AI agents of different values. Results show no significant difference in self-evaluation of idea quality and perception of the agent based on value alignment; however, ideas generated reflected the AI's values and feeling of ownership is affected. This highlights an intricate interplay between AI values and human ideation, suggesting careful design considerations for future AI-supported brainstorming tools.
Human-Computer Interaction
What problem does this paper attempt to address?
This paper attempts to explore how the values of artificial intelligence assistants affect human participants' perception, sense of belonging, and the quality of creative output during the collaborative creative thinking process. Specifically, through experimental design, the researchers let participants conduct brainstorming tasks with artificial intelligence assistants having different values (the same as, opposite to, or neutral to the participants) to evaluate the impact of these AI assistants with different values on the ideas generated by the participants. The research questions include: 1. **How do the values of AI assistants affect the values in the final creativity?** The study found that the final creativity generated through interaction with AI assistants does indeed reflect the values of the AI assistants. For example, when participants cooperate with AI assistants holding positive values, their creativity is more likely to reflect these positive values; and vice versa. 2. **How does the consistency or inconsistency between the values of AI assistants and the personal values of participants affect participants' self - evaluation of the quality of their own creativity, their sense of belonging to the creativity, their views on AI assistants, and their perception of the entire brainstorming experience?** The results show that when the values of AI assistants are consistent with those of the participants, the participants' reported sense of belonging to the creativity is significantly reduced, but there are no significant differences in the evaluation of the quality of creativity and the ability of AI assistants. In addition, when cooperating with AI assistants holding opposite values, participants feel greater difficulty and frustration, and their sense of belonging to the creativity is further reduced. This study emphasizes the need to carefully consider the consistency and transparency of values when designing tools to support human - AI collaboration in order to promote better cooperation effects and user experiences.