Transparency on Scientific Instruments
Carsten Bergenholtz,Samuel C. MacAulay,Christos Kolympiris,Inge Seim
DOI: https://doi.org/10.15252/embr.201845853
IF: 9.071
2018-01-01
EMBO Reports
Abstract:Opinion22 May 2018Open Access Transparency on scientific instruments Carsten Bergenholtz Carsten Bergenholtz [email protected] orcid.org/0000-0002-6020-561X Department of Management, School of Business and Social Sciences, Aarhus University, Aarhus, Denmark Search for more papers by this author Samuel C MacAulay Samuel C MacAulay orcid.org/0000-0001-5242-7004 UTS Business School, University of Technology Sydney, Sydney, NSW, Australia Search for more papers by this author Christos Kolympiris Christos Kolympiris School of Management, University of Bath, Bath, UK Search for more papers by this author Inge Seim Inge Seim orcid.org/0000-0001-8594-7217 School of Biomedical Sciences, Queensland University of Technology, Brisbane, Qld, Australia Search for more papers by this author Carsten Bergenholtz Carsten Bergenholtz [email protected] orcid.org/0000-0002-6020-561X Department of Management, School of Business and Social Sciences, Aarhus University, Aarhus, Denmark Search for more papers by this author Samuel C MacAulay Samuel C MacAulay orcid.org/0000-0001-5242-7004 UTS Business School, University of Technology Sydney, Sydney, NSW, Australia Search for more papers by this author Christos Kolympiris Christos Kolympiris School of Management, University of Bath, Bath, UK Search for more papers by this author Inge Seim Inge Seim orcid.org/0000-0001-8594-7217 School of Biomedical Sciences, Queensland University of Technology, Brisbane, Qld, Australia Search for more papers by this author Author Information Carsten Bergenholtz1, Samuel C MacAulay2, Christos Kolympiris3 and Inge Seim4 1Department of Management, School of Business and Social Sciences, Aarhus University, Aarhus, Denmark 2UTS Business School, University of Technology Sydney, Sydney, NSW, Australia 3School of Management, University of Bath, Bath, UK 4School of Biomedical Sciences, Queensland University of Technology, Brisbane, Qld, Australia EMBO Reports (2018)19:e45853https://doi.org/10.15252/embr.201845853 PDFDownload PDF of article text and main figures. ToolsAdd to favoritesDownload CitationsTrack CitationsPermissions ShareFacebookTwitterLinked InMendeleyWechatReddit Figures & Info Scientific instruments are at the heart of the scientific process, from 17th-century telescopes and microscopes, to modern particle colliders and DNA sequencing machines. Nowadays, most scientific instruments in biomedical research come from commercial suppliers 1, 2, and yet, compared to the biopharmaceutical and medical devices industries, little is known about the interactions between scientific instrument makers and academic researchers. Our research suggests that this knowledge gap is a cause for concern. It is the norm—and usually a requirement—that scientists mention instruments and their suppliers in the materials and methods sections of research articles, since their colleagues rely on this information to replicate or adapt their experiments. However, as the production and distribution of instruments have become increasingly commercialized 3, there are signs that this information is no longer sufficient. For example, research conducted by one of us (C.B.) revealed that some scientific instrument makers preferred not to appear as co-authors on manuscripts—even when their employees contributed significantly to it 1. It was believed that a manuscript would appear more credible if the company's employees did not appear as co-authors, thus enhancing the marketing value of their instrument. To complement this study, we conducted two surveys of academic researchers in the USA and EU to gauge how they judge information sources for scientific instruments [preprint: 4]. The responses from almost 1,000 academic researchers revealed a marked distrust in manuscripts co-authored by commercial makers of scientific instruments. The first survey inquired whether academic researchers consider information on instruments important, while the second survey focused on the perceived reliability of different information sources. Combined, they provide insight into how credible academic researchers find information on scientific instruments in peer-reviewed manuscripts. As Fig 1 shows, academics discount both the importance and the reliability of information on instruments in peer-reviewed manuscripts co-authored by scientific instrument firm employees—even when the firm's instrument is not mentioned in the manuscript. When directly comparing the reliability of information on instruments in manuscripts authored by someone from the mentioned instrument firm or not, the difference was statistically significant and substantial. The same perceptions were evident in all scientific fields surveyed [preprint: 4]. Figure 1. The reliability and importance of information sources on scientific instrumentsIllustration of how important and reliable respondents, indicated in percent on the y-axis, consider information on scientific instruments to be in peer-reviewed publications in general and various subcategories (x-axis). Download figure Download PowerPoint We argue that these perceptions create an, as yet underappreciated, incentive for non-disclosure and complementary tactics by scientific instrument makers. This pattern of incentives mirrors those that have generated controversial practices, such as ghostwriting and hidden sponsorship 5. The revelations of these practices in the biopharmaceutical industry likely fueled a Zeitgeist of inherent distrust in firm co-authorship by academic researchers and scientific instrument firms alike. From a commercial perspective, it is not surprising that some companies circumvent the perceived reduced credibility by not allowing employees to be listed as co-authors, irrespective of whether they contributed significantly to the published work 1. It boosts the credibility of the manuscript and, presumably, also the commercial instruments employed to generate the research data. Revelations from the biopharmaceutical and medical devices industries have demonstrated that such concerns are valid. For example, a range of studies showed how commercial sponsorship of academic research on drugs shaped the likelihood of reporting results 6 and influenced the perception of the research 7. Critically, non-disclosure not only leaves readers unable to judge potential conflicts of interests, but it also makes replication more difficult. More transparency on if and how companies were involved in the experiments could mitigate these risks, as could more detailed information in materials and methods sections, such as instrument settings and downstream data analysis. In order to assess how much information authors are asked to provide about instruments, we carried out an informal analysis of the guidelines of the 20 most cited journals, as measured by the Google Scholar h5-index in the categories “Health & Medical Sciences”, “Life Sciences & Earth Sciences”, and “Chemical & Material Sciences”. Almost none of the guidelines require the sort of detailed information about instrument settings and procedures required to allow others to replicate the experiment. Moreover, with one notable exception, none of these journals explicitly address the issue of contributions by instrument makers [preprint: 4]—be they financial or technical. Only the guidelines by the American Medical Association (AMA) require disclosing financial contribution, specifying that if an instrument was provided free of charge (a 100% discount), it should be made explicit [preprint: 4]. To illustrate the disclosure dilemma facing scientists, it may be useful to imagine a situation in which an academic researcher received a 20% discount on an instrument and considerable assistance from the company with generating and analyzing data from said instrument. The academic publishes the results in a peer-reviewed journal, and the manuscript is cited multiple times. A strict interpretation of journal guidelines would not require the scientist to disclose either the financial benefit or the involvement of the company in data generation and interpretation. Moreover, since being affiliated with a commercial company seems to influence how fellow academic researchers value the manuscript, the academic and the instrument maker have a shared incentive against disclosing pertinent facts. Public debate and guidelines or policies by academic journals have contributed significantly to tackling non-disclosure issues in pharmaceutical research 3. More recently, public debate on the reproducibility of the results from biomedical research led to further changes in both norms and journal guidelines 8, 9. We argue that there should be equal attention to commercial instruments that are central to scientific research. As the scientific instrument industry is increasingly dominated by large corporations and as expensive instruments have become commonplace in academic laboratories 10, the debate on reproducibility of and transparency in research should address the issue of how and when researchers should disclose the involvement of instrument firms in research. Each day that goes by without change further undermines the transparency that is required for reproducibility and scientific progress. Acknowledgements This work was supported by a Thiess Fellowship (to S.M.) and a QUT Vice-Chancellor's Senior Research Fellowship (to I.S.). References Bergenholtz C (2014) Eur Man Rev 11: 159–171Wiley Online LibraryWeb of Science®Google Scholar Stephan P (2012) How economics shapes science. Cambridge, MA: Harvard University PressCrossrefGoogle Scholar Ruff K (2015) Environ Health 14: 45CrossrefPubMedWeb of Science®Google Scholar Bergenholtz C, MacAulay S, Kolympiris C et al (2018) bioRxiv https://www.biorxiv.org/content/early/2018/05/03/253799 [PREPRINT]Google Scholar Goldacre B (2012) Bad pharma. London, UK: Fourth EstateGoogle Scholar Lexchin J, Bero LA, Djulbegovic B et al (2003) BMJ 326: 1167–1170CrossrefPubMedWeb of Science®Google Scholar Kesselheim AS, Robertson CT, Myers JA et al (2012) N Engl J Med 367: 1119–1127CrossrefCASPubMedWeb of Science®Google Scholar Pulverer B (2014) EMBO J 33: 2597Wiley Online LibraryCASPubMedWeb of Science®Google Scholar Berg J (2018) Science 359: 9CrossrefCASPubMedWeb of Science®Google Scholar Thayer AM (2017) Chem Eng News 95: 18–23Google Scholar Previous ArticleNext Article Read MoreAbout the coverClose modalView large imageVolume 19,Issue 6,June 2018Cover: YAP is a transcriptional co‐activator and major effector of the Hippo pathway, promoting cell proliferation and stemness. YAP interacts with PRDM4, thereby promoting transendothelial invasion of cancer cells by inducing expression of the leukocyte‐specific integrin ITGB2. From Huan Liu, Xiaoming Dai, Xiaolei Cao, Bin Zhao and colleagues: PRDM4 mediates YAP‐induced cell invasion by activating leukocyte‐specific integrin β2 expression. For detail, see Scientific Report on page e45180. Cover concept by Bin Zhao, Zhejiang University. (Cover design by Uta Mackensen) Volume 19Issue 61 June 2018In this issue FiguresReferencesRelatedDetailsLoading ...