Abstract:Background: Increasingly, survey researchers rely on hybrid samples to improve coverage and increase the number of respondents by combining independent samples. For instance, it is possible to combine 2 probability samples with one relying on telephone and another on mail. More commonly, however, researchers are now supplementing probability samples with those from online panels that are less costly. Setting aside ad hoc approaches that are void of rigor, traditionally, the method of composite estimation has been used to blend results from different sample surveys. This means individual point estimates from different surveys are pooled together, 1 estimate at a time. Given that for a typical study many estimates must be produced, this piecemeal approach is computationally burdensome and subject to the inferential limitations of the individual surveys that are used in this process. Objective: In this paper, we will provide a comprehensive review of the traditional method of composite estimation. Subsequently, the method of composite weighting is introduced, which is significantly more efficient, both computationally and inferentially when pooling data from multiple surveys. With the growing interest in hybrid sampling alternatives, we hope to offer an accessible methodology for improving the efficiency of inferences from such sample surveys without sacrificing rigor. Methods: Specifically, we will illustrate why the many ad hoc procedures for blending survey data from multiple surveys are void of scientific integrity and subject to misleading inferences. Moreover, we will demonstrate how the traditional approach of composite estimation fails to offer a pragmatic and scalable solution in practice. By relying on theoretical and empirical justifications, in contrast, we will show how our proposed methodology of composite weighting is both scientifically sound and inferentially and computationally superior to the old method of composite estimation. Results: Using data from 3 large surveys that have relied on hybrid samples composed of probability-based and supplemental sample components from online panels, we illustrate that our proposed method of composite weighting is superior to the traditional method of composite estimation in 2 distinct ways. Computationally, it is vastly less demanding and hence more accessible for practitioners. Inferentially, it produces more efficient estimates with higher levels of external validity when pooling data from multiple surveys. Conclusions: The new realities of the digital age have brought about a number of resilient challenges for survey researchers, which in turn have exposed some of the inefficiencies associated with the traditional methods this community has relied upon for decades. The resilience of such challenges suggests that piecemeal approaches that may have limited applicability or restricted accessibility will prove to be inadequate and transient. It is from this perspective that our proposed method of composite weighting has aimed to introduce a durable and accessible solution for hybrid sample surveys.

Enhancing Qualitative and Quantitative Data Linkages in Complex Mixed Methods Designs: Illustrations from a Multi-Phase Healthcare Delivery Study

Harmonizing Qualitative Data Across Multiple Health Systems to Identify Quality Improvement Interventions: A Methodological Framework Using PROSPR II Cervical Research Center Data as Exemplar

Joint Display of Integrated Data Collection for Mixed Methods Research: An Illustration From a Pediatric Oncology Quality Improvement Study

Qualitative Research Methods in Chronic Disease: Introduction and Opportunities to Promote Health Equity

A Mixed Methods Evaluation of a Quality Improvement Model to Optimize Perinatal and Primary Care in the Community Health Setting

How Qualitative Research Methods can be Leveraged to Strengthen Mixed Methods Research in Public Policy and Public Administration

Aligning sampling and case selection in quantitative-qualitative research designs: Establishing generalizability limits in mixed-method studies

Beyond interviews and focus groups: a framework for integrating innovative qualitative methods into randomised controlled trials of complex public health interventions

Framing the Multi‐Centre Qualitative Research Design as a Novel Methodology for Nursing and Healthcare Research: Reflections and A Methodological Discussion

Improving the Efficiency of Inferences From Hybrid Samples for Effective Health Surveillance Surveys: Comprehensive Review of Quantitative Methods

Linking Maternal and Child Health Data to Enhance Public Health Surveillance and Implement Sustainable Interventions

Enhancing Clinical Content and Race/Ethnicity Data in Statewide Hospital Administrative Databases: Obstacles Encountered, Strategies Adopted, and Lessons Learned

A Digital Mixed Methods Research Design: Integrating Multimodal Analysis With Data Mining and Information Visualization for Big Data Analytics

Linking Electronic Health Records and In-Depth Interviews to Inform Efforts to Integrate Social Determinants of Health Into Health Care Delivery: Protocol for a Qualitative Research Study

Integrating Transformative Considerations and Quantitative Results Through a Participant Selection Joint Display in Explanatory Sequential Mixed Methods Studies

Methodological Issues in Combining Diverse Study Types in Systematic Reviews

Qualitative Research in Healthcare: Data Analysis

Integrating Quantitative and Qualitative Results in Health Science Mixed Methods Research Through Joint Displays

Integrating Quantitative and Qualitative Data in Mixed Methods Research--Challenges and Benefits.

Enhancing Healthcare Delivery through Integrated Management Strategies: A Multi-Sector Approach

Qualitative and mixed methods: informing and enhancing exposure science