Towards an Open-Source Social Science:The Replication Study in Quantitative Social Analysis

Chen Yunsong,Wu Xiaogang

2012-01-01

Chinese Journal of Sociology

Abstract:The development of quantitative analysis in social science calls for the establishment of an open and transparent mechanism to allow research data and models to be shared to the community,and the research findings to be verify and elaborated by others.The core in this practice is replication studies in social sciences.In this essay,we review the discussion and practices of replication studies in western social sciences and highlight its significance in promoting quantitative social science research in China.Why is the replication study necessary?First,the collectivity of social science research suggests the research process should be transparent;Second,the principle of parsimony inquantitative social analysis requires the verification of research process;Third, the issue of endogeneity calls for extension of the past quantitative social analysis;Four,as a matter of fact,the rate of successful verification in published social science literature is low.Fifth,replication study is important to the teaching and training of quantitative social science;and finally, replication study can facilitate the professionalization of quantitative sociology and make us of late-development advantages.Why is replication study feasible? First,the nature of quantitative data suggests that the results be verifiable; second,the development of techniques in quantitative social research makes it possible to extend the replications;third,internet provides an easy platform for sharing data and working programs;third,the practice of replication studies in other disciplines such as economics in other countries has provided valuable experience;and finally,replicable studies can increase the academic reputation of the author and the journal.Notwithstanding what are said above, there are many concerns that need to be addressed in promoting replication study.The first is the ownership of the data analyzed.The author may not have rights to share the data with other colleagues.The second issue is that it may bring extra burden to the authors,reviewers,and replicators.There might also be issues related to the sharing of the programs,the choice between the sharing of original data and working data,and results from replication studies may lead to pressures on the authors and personal attacks.We use two empirical examples as the template how to conduct the replication and the extension.The first example by Chen,Volker and Flap (2011),using more sophisticated modeling to replicate a study by two Dutch sociologists on how the use of social capital affects the attainment of the first job in East Germany.The second example is a rejoinder to the replication results on how selectivity of entry into the private sector affects earnings inequality in urban China.Both examples show how the replication and extensions help to advance the knowledge in the field.The paper concludes with the consensus and practical protocol that should be established in the academia of sociology.