Abstract:Click to increase image sizeClick to decrease image size Notes 1. Although RCTs have many powerful features, there is a continuing debate among evaluators concerning the strengths and weaknesses of RCTs. Many evaluations have revealed some of the theoretical and practical limitations of RCT designs. Some of the limitations that have been mentioned include: the designs are rigid and inflexible and do not adapt well to changes in project design or implementation (which occur frequently) or to the changes in context in which the project is implemented; mono-method bias (relying on a single data collection method and outcome indicator; construct validity (simplifying complex outcome indicators to a single indicator that is easier to manipulate); difficulties in measuring qualitative dimensions; lack of attention to contextual variables (economic, political, institutional, socio-cultural; ignoring the process of project implementation; and long delays in providing feedback to policy-makers (compared with other evaluation models that are designed to provide feedback to managers and policy-makers during implementation). There are ways to address many of these issues in mixed design. REAP also participates in, designs, and advocates evaluations that use mixed design. 2. It should be noted that having relationships with local policy-makers can be tricky. Policy-makers are expecting their programmes/policies to work. If the evaluation shows success, it is easy. If the evaluation shows the programme/project is not successful, there may be friction. The key is to make sure that policy-makers understand the ground rules in advance. It is also helpful to develop a careful logic chain analysis plan in order to try to help policy-makers understand why a certain programme did not work as originally designed. This is true in all projects. But, it is especially true in the case of collaborations between evaluation teams and policy-makers. 3. We know cases when our advice has been heard and ‘accepted’ by the State Council but rejected by the Ministry of Education. When this happened, we saw no policy change. For example, we wrote a brief on financial aid for college for poor students in poor rural areas. In China all financial aid for college is given after the student enters college. Therefore, when the student is making his/her college decision, poor students do not know whether they will receive aid or not. Because of this we showed that poor students tended to pick majors that had tuition waivers (in exchange for postgraduation obligations – for example, teaching majors do not pay tuition and fees but they must teach in rural schools for five to seven years). We showed that if poor students were given financial aid offers before the college decision was made, they would change their decision-making process a lot. In other words, the current financial aid system distorts the decisions of those that need the aid the most. We suggested giving aid decisions out earlier. The Ministry of Education (for many possible reasons) objected. Until now there has not been any change.

Does the Expert-based Collective Advising Mechanism Promote Educational Equity? Experience from China

Education Finance Equity in Chinese Compulsory Education——An Empirical Study on Data Analysis on Regular Primary Schools in Zhejiang

Bridging the Gap: How Education Transforms Health Outcomes and Influences Health Inequality in Rural China

Parental Absence, After-school Tutoring, and Student Achievement: Experimental Evidence from Rural China

Educational Equity in the Context of China's Economic Development: Implementation and Practice of Educational Policies

The Influence of Individual, Peer, and Family Factors on the Educational Aspirations of Adolescents in Rural China.

Equity in China's Compulsory Education: A Comparative Analysis of Rural and Urban Differences in Educational Development

Conducting Influential Impact Evaluations in China: the Experience of the Rural Education Action Project

Beneficiaries of educational technology in universities ——A Study on the Equity of Urban and Rural Education in Henan Province

The Marketization of Educational Resources and Individual Choice: Examining the Heterogeneous Treatment Effect of Private Tutoring in Middle Schools

Giving Kids A Head Start: the Impact and Mechanisms of Early Commitment of Financial Aid on Poor Students in Rural China

Research on the impact of the socio-educational environment on the academic performance of college students: the mediating role of study motivation

The spillover effect and external welfare of extracurricular tutoring: evidence from academic tutoring for middle-school students in China

Education Inequality Between Rural and Urban Areas in China

Extracurricular tutoring fever: Competitive pressure and peer effect

The Education Gap of China’s Migrant Children and Rural Counterparts

The parents' internet use and children's extracurricular tutoring class participation

Does private tutoring improve students' National College Entrance Exam performance?-A case study from Jinan, China

Computer assisted learning as extracurricular tutor? Evidence from a randomised experiment in rural boarding schools in Shaanxi

Student Feedback, Parent-Teacher Communication, and Academic Performance: Experimental Evidence from Rural China

Inequality in the shadow: The role of private tutoring in SES achievement gaps