Abstract:Background: Emerging technologies such as artificial intelligence (AI) require an early-stage assessment of potential societal and ethical implications to increase their acceptability, desirability, and sustainability. This paper explores and compares 2 of these assessment approaches: the responsible innovation (RI) framework originating from technology studies and the co-design approach originating from design studies. While the RI framework has been introduced to guide early-stage technology assessment through anticipation, inclusion, reflexivity, and responsiveness, co-design is a commonly accepted approach in the development of technologies to support the care for older adults with frailty. However, there is limited understanding about how co-design contributes to the anticipation of implications. Objective: This paper empirically explores how the co-design process of an AI-based decision support system (DSS) for dementia caregivers is complemented by explicit anticipation of implications. Methods: This case study investigated an international collaborative project that focused on the co-design, development, testing, and commercialization of a DSS that is intended to provide actionable information to formal caregivers of people with dementia. In parallel to the co-design process, an RI exploration took place, which involved examining project members' viewpoints on both positive and negative implications of using the DSS, along with strategies to address these implications. Results from the co-design process and RI exploration were analyzed and compared. In addition, retrospective interviews were held with project members to reflect on the co-design process and RI exploration. Results: Our results indicate that, when involved in exploring requirements for the DSS, co-design participants naturally raised various implications and conditions for responsible design and deployment: protecting privacy, preventing cognitive overload, providing transparency, empowering caregivers to be in control, safeguarding accuracy, and training users. However, when comparing the co-design results with insights from the RI exploration, we found limitations to the co-design results, for instance, regarding the specification, interrelatedness, and context dependency of implications and strategies to address implications. Conclusions: This case study shows that a co-design process that focuses on opportunities for innovation rather than balancing attention for both positive and negative implications may result in knowledge gaps related to social and ethical implications and how they can be addressed. In the pursuit of responsible outcomes, co-design facilitators could broaden their scope and reconsider the specific implementation of the process-oriented RI principles of anticipation and inclusion.

Care and choice architecture: Relatives' support for adults with intellectual disabilities in supported decision-making processes

Supportive care decision-making processes of persons with dementia and their caregivers

“Help me to decide”: A study of human rights-based supported decision making with persons with intellectual disabilities.

"A Real Bucket of Worms": Views of People Living with Dementia and Family Members on Supported Decision-Making

"What choice do we have?" Reactive and proactive decision-making for aging in place with dementia

Self-Advocate and Family Member Experiences With Supported Decision Making

Feeling responsible: Family caregivers' attitudes and experiences of shared decision-making regarding people diagnosed with schizophrenia: A qualitative study

Factors influencing choice and ability to age in place: A qualitative study with patients, caregivers, and clinicians

Getting the Balance Right: Conceptual Considerations Concerning Legal Capacity and Supported Decision-Making

"It feels terrible that people are making decisions for me": Reflections and experiences of individuals with psychiatric disability who have substitute decision makers for treatment

Shared decision-making in dementia care planning: barriers and facilitators in two European countries

Perspectives on advance research directives from individuals with mild cognitive impairment and family members: a qualitative interview study

Agency in dementia care: systematic review and meta-ethnography

A family carer decision support intervention for people with advanced dementia residing in a nursing home: a study protocol for an international advance care planning intervention (mySupport study)

How are people with dementia involved in care-planning and decision-making? An Irish social work perspective

Acceptability of Using a Decision Aid to Support Family Carers of People With Dementia Towards the End of Life: A Qualitative Study

Reclaiming Agency in Care Decisions and Barriers From the Perspectives of Individuals With Acquired Brain Injury and Their Family Members

"They must get to know the individual very well": relationship-building of family and volunteer supporters in supported decision-making schemes

Supported decision-making with persons with dementia: a scoping review protocol in partnership with lived experts

Considerations for Alternative Decision-Making When Transitioning to Adulthood for Youth With Intellectual and Developmental Disabilities: Policy Statement

Making Co-Design More Responsible: Case Study on the Development of an AI-Based Decision Support System in Dementia Care