Abstract:Objectives Japanese medical academia continues to depend on quantitative indicators, contrary to the general trend in research evaluation. To understand this situation better and facilitate discussion, this study aimed to examine how Japanese medical researchers perceive quantitative indicators and qualitative factors of research evaluation and their differences by the researchers' characteristics. Design We employed a web-based cross-sectional survey and distributed the self-administered questionnaire to academic society members via the Japanese Association of Medical Sciences. Participants We received 3139 valid responses representing Japanese medical researchers in any medical research field (basic, clinical and social medicine). Outcomes The subjective importance of quantitative indicators and qualitative factors in evaluating researchers (eg, the journal impact factor (IF) or the originality of the research topic) was assessed on a four-point scale, with 1 indicating 'especially important' and 4 indicating 'not important'. The attitude towards various opinions in quantitative and qualitative research evaluation (eg, the possibility of research misconduct or susceptibility to unconscious bias) was also evaluated on a four-point scale, ranging from 1, 'strongly agree', to 4, 'completely disagree'. Results Notably, 67.4% of the medical researchers, particularly men, younger and basic medicine researchers, responded that the journal IF was important in researcher evaluation. Most researchers (88.8%) agreed that some important studies do not get properly evaluated in research evaluation using quantitative indicators. The respondents perceived quantitative indicators as possibly leading to misconduct, especially in basic medicine (strongly agree—basic, 22.7%; clinical, 11.7%; and social, 16.1%). According to the research fields, researchers consider different qualitative factors, such as the originality of the research topic (especially important—basic, 46.2%; social, 39.1%; and clinical, 32.0%) and the contribution to solving clinical and social problems (especially important—basic, 30.4%; clinical, 41.0%; and social, 52.0%), as important. Older researchers tended to believe that qualitative research evaluation was unaffected by unconscious bias. Conclusion Despite recommendations from the Declaration on Research Assessment and the Leiden Manifesto to de-emphasise quantitative indicators, this study found that Japanese medical researchers have actually tended to prioritise the journal IF and other quantitative indicators based on English-language publications in their research evaluation. Therefore, constantly reviewing the research evaluation methods while respecting the viewpoints of researchers from different research fields, generations and genders is crucial.

Mixed-methods study of medical students' attitudes toward peer physical examinations in Japan

Practicing Peer Physical Examination by Medical and Allied Health Professions Students: Why the Hesitation and Where are We Now? A Narrative Literature Review

Students’ perceptions of general medicine following community‐based medical education in rural Japan

Medical students' attitudes toward interactions with the pharmaceutical industry: a national survey in Japan

Prevalence and curriculum of sexual and gender minority education in Japanese medical school and future direction

Implementation of peer‐to‐peer oral care objective structured clinical examination‐based learning for nursing students

Assessment of oral self-care in patients with periodontitis: a pilot study in a dental school clinic in Japan

Medical Students’ Perception and Perceived Value of Peer Learning in Undergraduate Clinical Skill Development and Assessment: Mixed Methods Study

Current perception of social accountability of medical schools in Japan: A qualitative content analysis

A Comparative Study on Patient Safety Awareness Between Medical School Freshmen and Age-Matched Individuals

Exploration of Mental Health Issues of Students among University Health Science Academics in Japan

Peer assessment platform of clinical skills in undergraduate medical education

Survey on the current status of undergraduate education on self-care in university medical schools and medical colleges in Japan

Can Hybrid Educational Activities of Team and Problem Based Learning Program be Effective for Japanese Medical Students?

Validation of the professional self-identity questionnaire for medical students during clinical practice in Japan

Performance of Physical Examination Skills in Medical Students during Diagnostic Medicine Course in a University Hospital of Northwest China

Competencies required to make use of Information Science and Technology among Japanese medical students: a cross-sectional study

Association between Undergraduate Education for Community-Based Medicine and General Practice Majors: A Longitudinal Study in Japan

Translating, adapting, and validating the medical student version of the patient care ownership scale for use in Japan

Medical researchers perceptions regarding research evaluation: a web-based survey in Japan

The Impact of an Undergraduate Community-Based Medical Education Program in a Japanese Urban City