Abstract:We are witnessing a rapid trend towards the adoption of exercises for evaluation of national research systems, generally based on the peer review approach. They respond to two main needs: stimulating higher efficiency in research activities by public laboratories, and realizing better allocative efficiency in government funding of such institutions. However the peer review approach is typified by several limitations that raise doubts for the achievement of the ultimate objectives. In particular, subjectivity of judgment, which occurs during the step of selecting research outputs to be submitted for the evaluations, risks heavily distorting both the final ratings of the organizations evaluated and the ultimate funding they receive. These distortions become ever more relevant if the evaluation is limited to small samples of the scientific production of the research institutions. The objective of the current study is to propose a quantitative methodology based on bibliometric data that would provide a reliable support for the process of selecting the best products of a laboratory, and thus limit distortions. Benefits are twofold: single research institutions can maximize the probability of receiving a fair evaluation coherent with the real quality of their research. At the same time, broader adoptions of this approach could also provide strong advantages at the macroeconomic level, since it guarantees financial allocations based on the real value of the institutions under evaluation. In this study, the proposed methodology has been applied to the hard science sectors of the Italian university research system for the period 2004-2006.

How do public research labs use funding for research? A case study

How research policy changes can affect the organization and productivity of public research institutes: An analysis within the italian national system of innovation

Human Resource Management and Organizational Behavior of Public Research Institutions

PUBLIC R&D POLICIES AND PRIVATE R&D INVESTMENT: A SURVEY OF THE EMPIRICAL EVIDENCE

Assessing public-private research collaboration: is it possible to compare university performance?

How public funding affects complexity in R&D projects. An analysis of team project perceptions

National-scale research performance assessment at the individual level

The firm-level innovation impact of public R&D funding: Evidence from the German renewable energy sector

The alignment of public research supply and industry demand for effective technology transfer: the case of Italy

New Economic Thinking on Current Sustainability Transformations

Effectiveness of Public Innovation Support in Europe. Does Public Support Foster Turnover, Employment and Labour Productivity?

Is public R&D a complement or substitute for private R&D? A review of the econometric evidence

The Technology Transfer of the Italian Public Research System: the Case of the National Research Council of Italy

A Decision Support System for Public Research Organizations Participating in National Research Assessment Exercises

Public sector replacement of privately funded pharmaceutical R&D: cost and efficiency considerations

The different responses of universities to introduction of performance-based research funding

Public-private research collaborations: longitudinal field-level analysis of determinants, frequency and impact

National research assessment exercises: a measure of the distortion of performance rankings when labor input is treated as uniform

Administration Costs in the Management of Research Funds; A Case Study of a Public Fund for the Promotion of Industrial Innovation

Drivers of academic engagement in public-private research collaboration: an empirical study

Individual research performance: a proposal for comparing apples to oranges