Private Vs. Public Ranking in MOOCs:A Randomized Field Experiment

Xitong Li,Jiayin Zhang,Paul A. Pavlou

DOI: https://doi.org/10.5465/ambpp.2017.14908abstract

2017-01-01

Academy of Management Proceedings

Abstract:This paper examines if the provision of ranking where learners are ranked relative to others in terms of their effort levels can motivate their participations in massive open online courses (MOOCs). We distinguish two important variants of ranking information, depending on whether the ranking information is only revealed to the self (private ranking) or is publicly visible to all learners in a class group (public ranking). We aim to examine the relative effectiveness of public ranking (vs. private ranking) in a situation where there are no monetary rewards and where small monetary rewards are present. The empirical evidence from a field experiment suggests that public ranking is more effective than private ranking in the situation without monetary rewards. However, the relative effectiveness of public ranking (vs. private ranking) is significantly reduced by the presence of small monetary rewards. The reduction is so profound that public ranking becomes less effective than private ranking. Further analysis shows the reduction in the relative effectiveness is primarily due to that the small monetary rewards undermine the effect of public ranking, while the effect of private ranking is not significantly affected. Moreover, we find that the substitution effect between public ranking and monetary rewards primarily comes from learners with relatively high average grades of past courses. Because those learners are likely to care about public recognition more than those with relatively low average grades of past courses, the findings suggest that public recognition is the underlying mechanism that drives the effect of public ranking.