Abstract:The development of quantitative analysis in social science calls for the establishment of an open and transparent mechanism to allow research data and models to be shared to the community,and the research findings to be verify and elaborated by others.The core in this practice is replication studies in social sciences.In this essay,we review the discussion and practices of replication studies in western social sciences and highlight its significance in promoting quantitative social science research in China.Why is the replication study necessary?First,the collectivity of social science research suggests the research process should be transparent;Second,the principle of parsimony inquantitative social analysis requires the verification of research process;Third, the issue of endogeneity calls for extension of the past quantitative social analysis;Four,as a matter of fact,the rate of successful verification in published social science literature is low.Fifth,replication study is important to the teaching and training of quantitative social science;and finally, replication study can facilitate the professionalization of quantitative sociology and make us of late-development advantages.Why is replication study feasible? First,the nature of quantitative data suggests that the results be verifiable; second,the development of techniques in quantitative social research makes it possible to extend the replications;third,internet provides an easy platform for sharing data and working programs;third,the practice of replication studies in other disciplines such as economics in other countries has provided valuable experience;and finally,replicable studies can increase the academic reputation of the author and the journal.Notwithstanding what are said above, there are many concerns that need to be addressed in promoting replication study.The first is the ownership of the data analyzed.The author may not have rights to share the data with other colleagues.The second issue is that it may bring extra burden to the authors,reviewers,and replicators.There might also be issues related to the sharing of the programs,the choice between the sharing of original data and working data,and results from replication studies may lead to pressures on the authors and personal attacks.We use two empirical examples as the template how to conduct the replication and the extension.The first example by Chen,Volker and Flap (2011),using more sophisticated modeling to replicate a study by two Dutch sociologists on how the use of social capital affects the attainment of the first job in East Germany.The second example is a rejoinder to the replication results on how selectivity of entry into the private sector affects earnings inequality in urban China.Both examples show how the replication and extensions help to advance the knowledge in the field.The paper concludes with the consensus and practical protocol that should be established in the academia of sociology.

A Comparison of Reproducibility Guidelines and Its Implications on Undergraduate Statistical Education

Irreproducibility in Searches of Scientific Literature: A Comparative Analysis.

Reproducibility in the Classroom

Statistical Assessment of Replicability via Bayesian Model Criticism

The state of play of reproducibility in Statistics: an empirical analysis

Reproducible Research: A Retrospective

In-class Data Analysis Replications: Teaching Students while Testing Science

Statistics in Service of Metascience: Measuring Replication Distance with Reproducibility Rate

Towards an Open-Source Social Science:The Replication Study in Quantitative Social Analysis

Approachable Case Studies Support Learning and Reproducibility in Data Science: An Example from Evolutionary Biology

A large-scale in silico replication of ecological and evolutionary studies

Replicability of simulation studies for the investigation of statistical methods: the RepliSims project

Case Studies and Challenges in Reproducibility in the Computational Sciences

Teaching Single-Case Evaluation to Graduate Social Work Students: A Replication

A discipline-wide investigation of the replicability of Psychology papers over the past two decades

Statistical Methods for Replicability Assessment

Reproducibility Beyond the Research Community: Experience from NLP Beginners

ReproduceMe: Lessons from a pilot project on computational reproducibility

Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015

Lessons Learned: Reproducibility, Replicability, and When to Stop

Reproducibility Signals in Science: A preliminary analysis