Preference Testing in Medical Devices: Current Framework and Regulatory Gaps
Amy Lewis,Despoina Douka,Angeliki Koukoura,Vasiliki Valla,Amie Smirthwaite,Susanne Holm Faarbaek,Efstathios Vassiliadis
DOI: https://doi.org/10.2147/MDER.S368420
2022-07-06
Medical Devices: Evidence and Research
Abstract:Amy Lewis, 1 Despoina Douka, 1 Angeliki Koukoura, 1 Vasiliki Valla, 1 Amie Smirthwaite, 2 Susanne Holm Faarbaek, 3 Efstathios Vassiliadis 1 1 Evnia, Copenhagen, Denmark; 2 RQM+, Nottingham, England; 3 BK Medical, Herlev, Denmark Correspondence: Amy Lewis, Email Preference testing is a valuable source of information that can be provided by both healthcare professionals (HCPs) and patients (users). It can be used to improve the design and development of medical devices by feeding into device usability and, ultimately, risk management. Furthermore, it can aid with selecting the most appropriate clinical endpoints to be used in the clinical evaluation of a device and increase patient engagement by incorporating patient-relevant outcomes. Preference testing is widely conducted in the food industry but is not widespread in the medical field due to limited guidelines and a lack of regulatory framework. As such, manufacturers may be unaware of the benefits of preference testing and fail to take full advantage of it, or conversely, may use inappropriate methodology and/or analyses and consequently fail to collect meaningful data. In this position paper, we aim to highlight the benefits and uses of preference testing, along with potential methods that could be used for preference testing of medical devices. A key step towards the wider implementation of preference testing in medical devices is for the publication of international standards and guidelines for the collection, assessment, and implementation of preference data into the life cycle of a medical device. Keywords: preference testing, medical device, PPI, patient preference Preference testing refers to a research method in which a consumer/user indicates the most liked (preferred) product, usually from a choice of two. Preference testing is recommended when information on choice is required or the ordinal relationship between two products needs to be established. 1 In the context of medical device design, this could be used to address preferences for different design features (eg size, shape, weight), usability factors (interaction between a device and its user(s)), or clinical endpoints (eg efficacy, side effect, etc.). This can include both HCP and patient preferences, for example, preference testing could be used to establish the clinical outcomes/benefits that a patient would like to experience (eg improved quality of life). Common methods include paired-preference testing, best-worst scaling, and discrete choice experiments 2,3 (see Table 1). An overview of the advantages and disadvantages of preference testing is provided in Table 2. Table 1 Qualitative and Quantitative Preference Methods Table 2 Advantages and Disadvantages of Preference Testing 1 Acceptance is related to preference testing and describes the overall liking or acceptability of a product and can be measured in terms of behavior, such as the purchasing of a product. 4 Acceptance testing is recommended when information on the magnitude of liking/disliking of a product is required, and to establish the hedonic status (overall liking or acceptability) of two products. 1 Common methods include 9-point hedonic, labelled affective magnitude and unstructured line scales (see 1 for a description). Acceptance testing in this instance should not be confused with User Acceptance Testing (UAT) that may occur as part of validation and verification activities required for a medical device to conform with the relevant regulations. 5 UAT is used in various research settings, for example, in clinical trials/investigations to test and verify electronic Case Report Forms (eCRFS) and the databases that store them to ensure that they are fit for purpose (ie that they store and collect data as intended). 5 Although preference and acceptability are clearly related, they are not interchangeable terms as a product can be acceptable yet not preferred over an alternative product, 1 thus both types of information may be tested independently. For example, a manufacturer may wish to use acceptance testing to establish if their product is liked by the intended user and to modify the product accordingly, whereas preference testing could be used to gather information on how their product compares to a competitor product (ie if their product is the preferred product). In this article, we will focus on preference testing, specifically, patient preference testing (PPI, defined below), due to recent discussions surrounding PPI within the medical field. Preference testing is used within a variety of fields, such as insurance, public policy, and product development/design. For example, preference t -Abstract Truncated-