Do low survey response rates bias results? Evidence from Japan

Ronald R. Rindfuss,Minja K. Choe,Noriko O. Tsuya,Larry L. Bumpass,Emi Tamaki

DOI: https://doi.org/10.4054/demres.2015.32.26

2015-03-25

Demographic Research

Abstract:In developed countries, response rates have dropped to such low levels that many in the population field question whether the data can provide unbiased results.

demography

What problem does this paper attempt to address?

Problems Relating to Declining Response Rates to Social Survey Research in Japan: Trends After 2000

Akihide Inaba

DOI: https://doi.org/10.1111/j.1475-6781.2007.00095.x

2007-10-23

International Journal of Japanese Sociology

Abstract:Abstract: Sociologists in Japan recognize that the circumstances under which social survey research is conducted have been deteriorating and have become critical since 2000. Social survey research is understood as a large‐scale survey that mainly draws samples by a random sampling method, using a questionnaire as a measurement tool. The crises of social survey research are summarized as following: (1) the increasing difficulty of conducting accurate sampling and (2) the decline in response rates to drawn samples (planned samples). This paper focuses on the decline in response rates to social survyes by examining recent trends in relation to social surveys conducted by the Japanese government and local government (prefectures). In summary, there has been a landslidedecline of the response rate between 2005 and 2006 in surveys conducted by Japanese government. This decline was thought to mainly come from the declining of response rates among the elderly and women, groups that had previously had high response rates. This seems to be the result of the growing level of the crime involving the abuse of the personal information. However, there did not appear to be a serious decline in the response rate for surveys conducted by local governments. Given that it is not easy to restore response rates, it is important to develop research methods and techniques to cope with the decline. Further, informing respondents of the purpose of the research and its benefit to may help raise response rates.
Inequalities in the Health Survey Using Validation Question to Filter Insufficient Effort Responding: Reducing Overestimated Effects or Creating Selection Bias?

Jingjing Lu,Feng Wang,Xiaomin Wang,Leesa Lin,Weiyi Wang,Lu Li,Xudong Zhou

DOI: https://doi.org/10.1186/s12939-019-1030-2

2019-01-01

International Journal for Equity in Health

Abstract:The presence of insufficient effort responding participants (IERPs) in a survey can produce systematic bias. Validation questions are commonly used to exclude IERPs. Participants were defined as IERPs if responding inconsistently to two matched validation questions, and non-insufficient effort responding participants (non-IERPs) if responding consistently. However, it has not been tested whether validation questions themselves could result in selection bias. This study was a cross-sectional survey conducted in Guangxi, China. Participants’ intentions to use antibiotics for their children when they have self-limiting diseases, including sore throat, cold, diarrhea, and fever, were measured. The Chi-square tests were used to compare the socio-economic status (SES) between non-IERPs and IERPs. Logistic regression was adopted to test the association between intentions to misuse antibiotics and groups (non-IERPs, IERPs with high SES, and IERPs with low SES). Data with 3264 non-IERPs and 1543 IERPs were collected. The results showed IERPs had a lower education level (χ2 = 6.100, p = 0.047) and a higher proportion of rural residence (χ2 = 4.750, p = 0.030) compared with non-IERPs. Rural IERPs reported significantly higher rates of intentions to misuse antibiotics when their children have a sore throat (OR = 1.32; 95% CI = 1.11,1.56; p < 0.01), cold (OR = 1.33; 95%CI = 1.13,1.58; p < 0.01), diarrhea (OR = 1.46; 95%CI = 1.20,1.77; p < 0.001), and fever (OR = 1.22; 95% CI = 1.04,1.43; p < 0.05) compared with non-IERPs. IERPs living in urban areas reported significantly lower rates of intentions to use antibiotics when their children have a sore throat (OR = 0.76; 95%CI = 0.62,0.93; p < 0.01) compared with non-IERPs. IERPs with lower levels of education reported significantly higher rates of intentions to use antibiotics when their children have a sore throat (OR = 1.19; 95%CI = 1.02,1.39; p < 0.05), cold (OR = 1.43; 95% CI = 1.23,1.66; p < 0.001), diarrhea (OR = 1.38; 95%CI = 1.15,1.64; p < 0.01), and fever (OR = 1.25; 95% CI = 1.09,1.44; p < 0.01) compared with non-IERPs. IERPs with higher education levels reported significantly lower rates of intentions to use antibiotics when their children have a sore throat (OR = 0.72; 95% CI = 0.56,0.94; p < 0.05), cold (OR = 0.66; 95% CI = 0.51,0.86; p < 0.01), and fever (OR = 0.74; 95% CI = 0.60,0.92; p < 0.01) compared with non-IERPs. IERPs with low-income reported significantly higher rates of intentions to use antibiotics when their children have a cold (OR = 1.36; 95% CI = 1.13,1.64; p < 0.01) and diarrhea (OR = 1.30; 95% CI = 1.05,1.62; p < 0.05) compared with non-IERPs. Using validation questions to exclude IERPs can result in selection bias in which participants with lower socio-economic standing and poor antibiotic use intentions were disproportionately excluded.
A Meta-Analysis of How Country-Level Factors Affect Web Survey Response Rates

Jessica Daikeler,Henning Silber,Michael Bošnjak

DOI: https://doi.org/10.1177/14707853211050916

2021-11-26

International Journal of Market Research

Abstract:A major challenge in web-based cross-cultural data collection is varying response rates, which can result in low data quality and non-response bias. Country-specific factors such as the political and demographic, economic, and technological factors as well as the socio-cultural environment may have an effect on the response rates to web surveys. This study evaluates web survey response rates using meta-analytical methods based on 110 experimental studies from seven countries. Three dependent variables, so-called effect sizes, are used: the web response rate, the response rate to the comparison survey mode, and the difference between the two response rates. The meta-analysis indicates that four country-specific factors (political and demographic, economic, technological, and socio-cultural) impact the magnitude of web survey response rates. Specifically, web surveys achieve high response rates in countries with high population growth, high internet coverage, and a high survey participation propensity. On the other hand, web surveys are at a disadvantage in countries with a high population age and high cell phone coverage. This study concludes that web surveys can be a reliable alternative to other survey modes due to their consistent response rates and are expected to be used more frequently in national and international settings.

business
Frequent Survey Requests and Declining Response Rates: Evidence from the 2020 Census and Household Surveys

Jonathan Eggleston

DOI: https://doi.org/10.1093/jssam/smae022

2024-04-26

Journal of Survey Statistics and Methodology

Abstract:Abstract One hypothesis to explain declining survey response rates over time has been that individuals are receiving more and more survey requests. However, there has been little prior investigation of this hypothesis, largely due to difficulty in knowing whether nonrespondents were recently sampled for a different survey. This article investigates the frequent survey request hypothesis by analyzing self-response in the 2020 Census for the United States. Specifically, do households that were sampled in the American Community Survey (ACS) or the Current Population Survey (CPS) from 2015 to 2019 have a lower self-response rate to the 2020 Census? By leveraging two large, nationally representative surveys with monthly data collections, these analyses have statistical power that smaller surveys may not provide. This allows for precise estimates of how the frequent survey effect varies by the time between two data collections, and how the effect varies depending on the similarities between the two data collections. Households recently sampled for the ACS had lower self-response rates to the 2020 Census, with the decrease varying from 1.65 percentage points for households sampled in January 2019 to 15.23 percentage points for households sampled in December 2019. Smaller effect sizes are found for the CPS, which has more dissimilarities to the decennial census than the ACS. In summary, these results provide additional evidence that the proliferation of surveys may lead to lower response rates.

statistics & probability,social sciences, mathematical methods
Surveying Nonrespondents

Ineke A. L. Stoop

DOI: https://doi.org/10.1177/1525822x03259479

2004-02-01

Field Methods

Abstract:Nonresponse rates in household surveys in the Netherlands are high. As low response rates are generally assumed to increase nonresponse bias, doubts have arisen concerning the value of survey research. The costs of fieldwork have substantially increased in recent years and will increase even more to compensate for the unfavorable response trends. This article describes a survey in which high response rates were attained and which measures were taken to achieve this. It also studies the differences between respondents who are hard to reach and those who are reluctant to participate in a survey. Additional data from a follow-up survey among refusers cast doubt on the assumption that reluctant respondents are similar to refusers.

social sciences, interdisciplinary,anthropology
Factors Affecting Response Rates in Medical Imaging Survey Studies

Nanxi Zha,Mostafa Alabousi,Douglas S Katz,Johnny Su,Michael Patlas,Douglas S. Katz

DOI: https://doi.org/10.1016/j.acra.2019.06.005

IF: 5.482

2020-03-01

Academic Radiology

Abstract:<h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Rationale and Objective</h3><p>To review response rates published in medical imaging journals, and to analyze potential factors which contributed to a low response rate.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Materials and Methods</h3><p>A literature search was performed in MEDLINE and Embase to identify and assess published medical imaging survey studies. Variables assessed were response rate, incentives such as reminders and remuneration, and rationales provided for a potential low response rate. Statistical significance was calculated using unpaired <em>t</em> tests, ANOVA, Mann-Whitney, and Kruskal-Wallis tests.</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Results</h3><p>Three hundred and fifty-six unique surveys were included for analysis. The mean survey response rate in the current age of predominately electronic surveys was 45%. Factors which statistically significantly demonstrated a difference in response rate were survey location (European countries: 52%, Canada: 47%, United States: 42%; <em>p</em> < 0.05), survey topic (musculoskeletal: 69%, nuclear medicine: 64%, and education: 47%; <em>p</em> < 0.05), survey delivery method (telephone: 76%, email: 41%; <em>p</em> < 0.0001), and survey question type (short answer: 62%, multiple choice: 43%; <em>p</em> < 0.01). Statistically significant linear correlations were observed between the response rate compared to the number of reminders sent (<em>r</em> = 0.27; <em>p</em> < 0.01) and the number of participants (<em>r</em> = −0.26; <em>p</em> < 0.0001).</p><h3 class="u-h4 u-margin-m-top u-margin-xs-bottom">Conclusion</h3><p>The survey response rate serves as a surrogate marker for nonresponse bias. Survey response controlled for intrinsic nonadjustable characteristics offer achievable research goals. Adjustable factors to low response, including survey delivery method, question type, and number of reminders demonstrated statistical difference in response rate, and can be utilized by researchers to prospectively minimize nonresponse bias.</p>

radiology, nuclear medicine & medical imaging
Survey response rates: Trends and a validity assessment framework

Brooks Holtom,Yehuda Baruch,Herman Aguinis,Gary A Ballinger

DOI: https://doi.org/10.1177/00187267211070769

IF: 5.658

2022-02-01

Human Relations

Abstract:Survey methodology has been and continues to be a pervasively used data-collection method in social science research. To better understand the state of the science, we first analyze response-rate information reported in 1014 surveys described in 703 articles from 17 journals from 2010 to 2020. Results showed a steady increase in average response rate from 48% in 2005 to 53% in 2010 to 56% in 2015 and 68% in 2020; a marked increase in the number of surveys per published article from 1.27 in 2015 to 1.79 in 2020; and that variables that predict response-rate fluctuations over time are related to research design (e.g. data-collection medium), participant motivation (e.g. incentives), and researcher motivation (i.e. number of surveys per article). Second, we propose complementary information on contemporary response-rate norms and benchmarks with a response-rate validity assessment framework to gather evidence on accuracy of inferences based on a particular response-rate level. Implementing this validation process involves gathering information on the researcher–participant relationship, participant qualifications and motivation, survey length and complexity, and cultural and national context. Future survey research should implement the validity assessment framework in addition to reporting the response-rate value to better indicate a sample’s quality, appropriateness, and representativeness.

management,social sciences, interdisciplinary
Respondents with low motivation tend to choose middle category: survey questions on happiness in Japan

Shinya Masuda,Takayuki Sakagami,Hideaki Kawabata,Nobuhiko Kijima,Takahiro Hoshino

DOI: https://doi.org/10.1007/s41237-017-0026-8

2017-07-01

Behaviormetrika

Abstract:Some studies have shown low proportions of Japanese people rating their lives as happy. However, most surveys in Japan revealed that response distributions for subjective well-being items indicated excessive blips in middle categories. In this study, participants responded to four items that were designed to detect careless or unmotivated respondents; these items instructed respondents to choose a certain response category. Of the study’s respondents, about 40% failed to follow instructions for at least one of the four items. Besides, they often chose middle categories for well-being items. When those who did not follow instructions were excluded from the complete sample, middle categories showed low or no blips, and the proportion of respondents with high rating scores increased. Thus, this study suggested that one reason for reportedly low proportions of happy people in Japan was respondents who were not diligent in reading items.
Predictors of response rates of safety culture questionnaires in healthcare: a systematic review and analysis

Louise A Ellis,Chiara Pomare,Kate Churruca,Ann Carrigan,Isabelle Meulenbroeks,Maree Saba,Jeffrey Braithwaite

DOI: https://doi.org/10.1136/bmjopen-2022-065320

IF: 3.006

2022-09-17

BMJ Open

Abstract:Objectives Safety culture questionnaires are widely used in healthcare to understand how staff feel at work, their attitudes and views, and the influence this has on safe and high-quality patient care. A known challenge of safety culture questionnaires is achieving high response rates to enhance reliability and validity. This review examines predictors of response rates, explores reasons provided for low response rates and identifies strategies to improve those rates. Methods Four bibliometric databases were searched for studies assessing safety culture in hospitals from January 2008 to May 2022. Data were extracted from 893 studies that included a safety culture questionnaire conducted in the hospital setting. Regression was used to predict response rate based on recruitment and data collection methods (incentives, reminders, method of survey administration) and country income classification. Reasons for low response were thematically analysed and used to identify strategies to improve response rates. Results Of the 893 studies that used a questionnaire to assess safety culture in hospitals, 75.6% reported a response rate. Response rates varied from 4.2% to 100%, with a mean response rate of 66.5% (SD=21.0). Regression analyses showed that safety culture questionnaires conducted in low-income and middle-income countries were significantly more likely to yield a higher response rate compared with high-income countries. Mode of administration, questionnaire length and timing of administration were identified as key factors. Remote methods of questionnaire data collection (electronic and by post) were significantly less likely to result in a higher response rate. Reasons provided for low response included: survey fatigue, time constraints, and lack of resources. Conclusion This review presents strategies for researchers and hospital staff to implement when conducting safety culture questionnaires: principally, distribute questionnaires in-person, during meetings or team training sessions; use a local champion; and consider the appropriate time of distribution to manage survey fatigue.

medicine, general & internal
Differences between odd number and even number response formats: Evidence from mainland Chinese respondents

Chi-Sum Wong,Kelly Z. Peng,Junqi Shi,Yina Mao

DOI: https://doi.org/10.1007/s10490-009-9143-6

IF: 4.5

2011-01-01

Asia Pacific Journal of Management

Abstract:Scholars have speculated that the Chinese may be more reluctant to express their opinions strongly and that this may be reinforced if the odd number response format with a mid-point option of “no opinion” or “neither agree nor disagree” is provided. This may undermine the quality of survey data because less variances or even inaccurate information will be collected. This study provides empirical evidence from 532 mainland Chinese employees in Beijing to test this speculation. These employees were randomly assigned to complete either an odd number or even number response format questionnaire. In contrast to the speculation, in a wide variety of measures that are relevant to the area of organizational behavior (OB) and human resource management (HRM), it appears that the odd number response format does not show systematic differences when compared with the even number response format. This result holds even for some sensitive measures of personal beliefs, evaluation of and judgments about employing organizations, supervisors, and colleagues. Given the increasing number of studies surveying Chinese and other Asian respondents, we call for further research on this issue.
Distribution of Non-responses in Chinese Political Survey Research

Yan Jie

2008-01-01

Abstract:In recent years,an increasing number of scholars have been employing survey research methods to study Chinese politics and relevant political theories.This paper first provides an examination of the general practice of Chinese political survey research.It further analyzes the distribution of unit non-responses and item non-responses in these studies,and cautions that non-response rate has reached such a high level that it will cause estimation bias.
Demographic differences between health care workers who did or did not respond to a safety and organizational culture survey

Tita A Listyowardojo,Raoul E Nap,Addie Johnson

DOI: https://doi.org/10.1186/1756-0500-4-328

2011-09-07

BMC Research Notes

Abstract:BackgroundAreas for institutional improvement to enhance patient safety are commonly identified by surveying health care workers' (HCWs) attitudes, values, beliefs, perceptions and assumptions regarding institutional practices. An ideal response rate of 100% is rarely achieved in such surveys, and non-response bias can occur when non-respondents differ from respondents on a dimension likely to influence survey conclusions. The conditions for non-response bias to occur can be detected by comparing demographic characteristics of respondents and non-respondents and relating any differences to findings in the literature of differences in the construct of interest as a function of these demographic characteristics. The current study takes this approach.FindingsAll 5,609 HCWs at a university medical center were invited to participate in a survey measuring safety and organizational culture (response rate = 53.40%). Respondents indicated their professional group, gender, age group, years of working in the hospital and executive function. Because all HCWs were invited, the demographic composition of the group who did not respond was known. Differences in the demographic composition of respondents and non-respondents were compared using separate Pearson's chi-square tests for each demographic characteristic.Nurses and clinical workers were generally more likely to respond than were physicians, laboratory workers and non-medical workers. Male HCWs were less likely to respond than were females, HCWs aged younger than 45 years old had a lower response rate than did HCWs aged 45 to 54 years old, HCWs who had worked in the hospital for less than 5 years were less likely to respond than were those who had worked in the hospital for 5 years or more and HCWs without an executive function were less likely to respond than were executives.ConclusionsDemographic characteristics can be linked to response rates and need to be considered in conducting surveys among HCWs. The possibility of non-response bias can be reduced by conducting analyses separately as a function of relevant demographic characteristics, sampling a higher percentage of groups that are known to be less likely to respond, or weighting responses with the reciprocal of the response rate for the respective demographic group.
Medical researchers perceptions regarding research evaluation: a web-based survey in Japan

Minoura,A.,Shimada,Y.,Kuwahara,K.,Kondo,M.,Fukushima,H.,Sugiyama,T.

DOI: https://doi.org/10.1136/bmjopen-2023-079269

IF: 3.006

2024-05-09

BMJ Open

Abstract:Objectives Japanese medical academia continues to depend on quantitative indicators, contrary to the general trend in research evaluation. To understand this situation better and facilitate discussion, this study aimed to examine how Japanese medical researchers perceive quantitative indicators and qualitative factors of research evaluation and their differences by the researchers' characteristics. Design We employed a web-based cross-sectional survey and distributed the self-administered questionnaire to academic society members via the Japanese Association of Medical Sciences. Participants We received 3139 valid responses representing Japanese medical researchers in any medical research field (basic, clinical and social medicine). Outcomes The subjective importance of quantitative indicators and qualitative factors in evaluating researchers (eg, the journal impact factor (IF) or the originality of the research topic) was assessed on a four-point scale, with 1 indicating 'especially important' and 4 indicating 'not important'. The attitude towards various opinions in quantitative and qualitative research evaluation (eg, the possibility of research misconduct or susceptibility to unconscious bias) was also evaluated on a four-point scale, ranging from 1, 'strongly agree', to 4, 'completely disagree'. Results Notably, 67.4% of the medical researchers, particularly men, younger and basic medicine researchers, responded that the journal IF was important in researcher evaluation. Most researchers (88.8%) agreed that some important studies do not get properly evaluated in research evaluation using quantitative indicators. The respondents perceived quantitative indicators as possibly leading to misconduct, especially in basic medicine (strongly agree—basic, 22.7%; clinical, 11.7%; and social, 16.1%). According to the research fields, researchers consider different qualitative factors, such as the originality of the research topic (especially important—basic, 46.2%; social, 39.1%; and clinical, 32.0%) and the contribution to solving clinical and social problems (especially important—basic, 30.4%; clinical, 41.0%; and social, 52.0%), as important. Older researchers tended to believe that qualitative research evaluation was unaffected by unconscious bias. Conclusion Despite recommendations from the Declaration on Research Assessment and the Leiden Manifesto to de-emphasise quantitative indicators, this study found that Japanese medical researchers have actually tended to prioritise the journal IF and other quantitative indicators based on English-language publications in their research evaluation. Therefore, constantly reviewing the research evaluation methods while respecting the viewpoints of researchers from different research fields, generations and genders is crucial.

medicine, general & internal
Detecting Insufficient Effort Responding with an Infrequency Scale: Evaluating Validity and Participant Reactions

Jason L. Huang,Nathan A. Bowling,Mengqiao Liu,Yuhui Li

DOI: https://doi.org/10.1007/s10869-014-9357-6

IF: 6.604

2014-01-01

Journal of Business and Psychology

Abstract:Purpose Insufficient effort responding (IER), which occurs due to a lack of motivation to comply with survey instructions and to correctly interpret item content, represents a serious problem for researchers and practitioners who employ survey methodology (Huang et al. 2012 ). Extending prior research, we examine the validity of the infrequency approach to detecting IER and assess participant reactions to such an approach. Design/Methodology/Approach Two online surveys ( Studies 1 and 2 ) completed by employed undergraduates were utilized to assess the validity of the infrequency approach. An on-line survey of paid participants ( Study 3 ) and a paper-and-pencil survey in an organization ( Study 4 ) were conducted to evaluate participant reactions, using random assignment into survey conditions that either did or did not contain infrequency items. Findings Studies 1 and 2 provided evidence for the reliability, unidimensionality, and criterion-related validity of the infrequency scales. Study 3 and Study 4 showed that surveys that contained infrequency items did not lead to more negative reactions than did surveys that did not contain such items. Implications The current findings provide evidence of the effectiveness and feasibility of the infrequency approach for detecting IER, supporting its application in low-stakes organizational survey contexts. Originality/Value The current studies provide a more in-depth examination of the infrequency approach to IER detection than had been done in prior research. In particular, the evaluation of participant reactions to infrequency scales represents a novel contribution to the IER literature.
Survey response rates in health sciences education research: A 10-year meta-analysis

Adam B Wilson,William S Brooks,Danielle N Edwards,Jill Deaver,Jessica A Surd,Obadiah J Pirlo,William A Byrd,Edgar R Meyer,Amy Beresheim,Stephanie L Cuskey,Jack G Tsintolas,Eric S Norrell,Harriet C Fisher,Christopher W Skaggs,Dmytro Mysak,Samantha R Levin,Carlos E Escutia Rosas,Andrew S Cale,Md Nazmul Karim,Jenna Pollock,Nicholas J Kakos,Monica S O'Brien,Rebecca S Lufler

DOI: https://doi.org/10.1002/ase.2345

Abstract:Growth in the online survey market may be increasing response burden and possibly jeopardizing higher response rates. This meta-analysis evaluated survey trends over one decade (2011-2020) to determine: (1) changes in survey publication rates over time, (2) changes in response rates over time, (3) typical response rates within health sciences education research, (4) the factors influencing survey completion levels, and (5) common gaps in survey methods and outcomes reporting. Study I estimated survey publication trends between 2011 and 2020 using articles published in the top three health sciences education research journals. Study II searched the anatomical sciences education literature across six databases and extracted study/survey features and survey response rates. Time plots and a proportional meta-analysis were performed. Per 2926 research articles, the annual estimated proportion of studies with survey methodologies has remained constant, with no linear trend (p > 0.050) over time (Study I). Study II reported a pooled absolute response rate of 67% (95% CI = 63.9-69.0) across 360 studies (k), totaling 115,526 distributed surveys. Despite response rate oscillations over time, no significant linear trend (p = 0.995) was detected. Neither survey length, incentives, sponsorship, nor population type affected absolute response rates (p ≥ 0.070). Only 35% (120 of 339) of studies utilizing a Likert scale reported evidence of survey validity. Survey response rates and the prevalence of studies with survey methodologies have remained stable with no linear trends over time. We recommend researchers strive for a typical absolute response rate of 67% or higher and clearly document evidence of survey validity for empirical studies.
Advances in strategies for minimizing and adjusting for survey nonresponse

Ronald C Kessler, Roderick JA Little, Robert M Groves

1995-01-01

Abstract:The decrease in survey response rates since the 1950s (1, 2) has sensitized survey researchers to the importance of studying the effects of nonresponse bias, of developing procedures to minimize the magnitude of nonresponse, and of adjusting survey estimates for nonresponse (3-5). This presentation reviews recent developments in these areas. The discussion addresses the problem of" unit" nonresponse (when a sampled individual is not surveyed at all) in face-to-face household surveys. For a broader discussion of unit nonresponse, see Groves (2). For a more general discussion of how to perform statistical analysis when data are missing, see Little and Rubin (4), Madow et al.(5), and Rubin (6). Unit nonresponse is a problem for at least two reasons: First, in a sample with a fixed number of predesignated cases, a reduction in unit response translates directly into a reduction in sample size, which reduces the …
Is suicide underreported? Evidence from Japan

Tetsuya Matsubayashi,Michiko Ueda

DOI: https://doi.org/10.1007/s00127-021-02188-5

Abstract:Purpose: The underreporting of suicides has been a serious global concern among scholars and policymakers. Several studies have sought to detect the prevalence of underreporting by examining whether suicide mortality rates are negatively correlated with those due to unknown intent or causes. This study adds to the literature by examining the potential underreporting of suicides in Japan, where suicide rates have greatly declined in the recent years. Methods: We compiled subnational data from 47 prefectures between 1995 and 2016, obtained from Vital Statistics of Japan. We examined whether (1) mortality rates due to unknown intent or causes increased as suicide rates decreased; and (2) major socioeconomic causes of suicide (unemployment and divorce rates) had any relationship with the deaths due to unknown intent or causes. Results: Our analysis indicates that mortality rates due to unknown intent or causes were uncorrelated with suicide rates and the above socioeconomic indicators. Conclusions: In Japan, the frequency of suicides has no systematic relationship with deaths due to unknown intent or causes, suggesting the accuracy of suicide statistics.
Factors Influencing Respondents Drop Out Of Internet Surveys

Zhu Donghong

2008-01-01

Abstract:Respondents online drop out of internet Surveys is an important factor Which Caused the low rate of response. This paper investigates the factors that influence respondents drop Out Of internet surveys by empirical method in China. The result shows that "occupation of time". "subjective experience". "content of question" and "form of question" is important factors.
The Sensitivity of Respondent-driven Sampling Method

Xin Lu,Linus Bengtsson,Tom Britton,Martin Camitz,Beom Jun Kim,Anna Thorson,Fredrik Liljeros

DOI: https://doi.org/10.48550/arXiv.1002.2426

2010-02-16

Abstract:Researchers in many scientific fields make inferences from individuals to larger groups. For many groups however, there is no list of members from which to take a random sample. Respondent-driven sampling (RDS) is a relatively new sampling methodology that circumvents this difficulty by using the social networks of the groups under study. The RDS method has been shown to provide unbiased estimates of population proportions given certain conditions. The method is now widely used in the study of HIV-related high-risk populations globally. In this paper, we test the RDS methodology by simulating RDS studies on the social networks of a large LGBT web community. The robustness of the RDS method is tested by violating, one by one, the conditions under which the method provides unbiased estimates. Results reveal that the risk of bias is large if networks are directed, or respondents choose to invite persons based on characteristics that are correlated with the study outcomes. If these two problems are absent, the RDS method shows strong resistance to low response rates and certain errors in the participants' reporting of their network sizes. Other issues that might affect the RDS estimates, such as the method for choosing initial participants, the maximum number of recruitments per participant, sampling with or without replacement and variations in network structures, are also simulated and discussed.

Applications,Data Analysis, Statistics and Probability,Quantitative Methods
A Case Study of Nonresponse Bias Analysis in Educational Assessment Surveys

Yajuan Si,Roderick J. A. Little,Ya Mo,Nell Sedransk

DOI: https://doi.org/10.3102/10769986221141074

2022-12-17

Journal of Educational and Behavioral Statistics

Abstract:Journal of Educational and Behavioral Statistics, Ahead of Print. Nonresponse bias is a widely prevalent problem for data on education. We develop a ten-step exemplar to guide nonresponse bias analysis (NRBA) in cross-sectional studies and apply these steps to the Early Childhood Longitudinal Study, Kindergarten Class of 2010–2011. A key step is the construction of indices of nonresponse bias based on proxy pattern-mixture models for survey variables of interest. A novel feature is to characterize the strength of evidence about nonresponse bias contained in these indices, based on the strength of the relationship between the characteristics in the nonresponse adjustment and the key survey variables. Our NRBA improves the existing methods by incorporating both missing at random and missing not at random mechanisms, and all analyses can be done straightforwardly with standard statistical software.

education & educational research,psychology, mathematical,social sciences, mathematical methods

Do low survey response rates bias results? Evidence from Japan

Problems Relating to Declining Response Rates to Social Survey Research in Japan: Trends After 2000

Inequalities in the Health Survey Using Validation Question to Filter Insufficient Effort Responding: Reducing Overestimated Effects or Creating Selection Bias?

A Meta-Analysis of How Country-Level Factors Affect Web Survey Response Rates

Frequent Survey Requests and Declining Response Rates: Evidence from the 2020 Census and Household Surveys

Surveying Nonrespondents

Factors Affecting Response Rates in Medical Imaging Survey Studies

Survey response rates: Trends and a validity assessment framework

Respondents with low motivation tend to choose middle category: survey questions on happiness in Japan

Predictors of response rates of safety culture questionnaires in healthcare: a systematic review and analysis

Differences between odd number and even number response formats: Evidence from mainland Chinese respondents

Distribution of Non-responses in Chinese Political Survey Research

Demographic differences between health care workers who did or did not respond to a safety and organizational culture survey

Medical researchers perceptions regarding research evaluation: a web-based survey in Japan

Detecting Insufficient Effort Responding with an Infrequency Scale: Evaluating Validity and Participant Reactions

Survey response rates in health sciences education research: A 10-year meta-analysis

Advances in strategies for minimizing and adjusting for survey nonresponse

Is suicide underreported? Evidence from Japan

Factors Influencing Respondents Drop Out Of Internet Surveys

The Sensitivity of Respondent-driven Sampling Method

A Case Study of Nonresponse Bias Analysis in Educational Assessment Surveys