Abstract:Purpose Relative performance evaluation (RPE) is a widely practiced employee appraisal process in the services industry. In a global delivery model, teams are spread across different geographical locations. The team members work on various tasks under the guidance of different managers and at times under more than one manager for performing the same task. Such complexities make RPE of the team members quite challenging. The paper proposes a methodical step-by-step approach to simplify the evaluation process without compromising on the rigour. Design/methodology/approach RPE has followed three different approaches. First is the traditional way, wherein evaluators had a common meeting to discuss and arrive at relative evaluation and ranking of members of the peer group employees. In the second, the number of evaluators and employees in a peer group were split in to 2 subgroups. The evaluators provided independent ratings and rankings. Simple mathematical tool then derived the combined ranking. In the third approach, each evaluator evaluated each employee in the peer group and provided the relative ranking for each employee. Again, mathematical tools provided the final ranking considering inputs from all evaluators. All the three evaluation approaches were analysed through an inter-rater agreement method. Findings All the three approaches for evaluation provided similar results giving confidence that less time-consuming methods could be adopted by evaluators without compromising on the rigour of the evaluation. The outcome of the exercise proved effective as the complaints reaching the ombudsmen reduced as compared to the earlier years. Considerable evaluation time was also saved. The study described in this paper is carried out in a non-unionized, Indian private sector services firm. Its effectiveness in other set ups is yet to be tested. Research limitations/implications The research is carried out in the Indian Engineering services firm operating in the Knowledge based sector. Though study results are encouraging, the adaptability of methodology across different sectors and geographies is yet to be tested. More broad based studies are needed to evaluate suitability across firms and regions. Practical implications Relative evaluation exercise is challenging for evaluators. Although openness in evaluation is desired, it also makes evaluators uncomfortable in appearing to be taking sides or being opposing a candidate's ranking. The proposed approach brings in anonymity to each evaluator without scarifying individual evaluation. Social implications The proposed methodology can be deployed across different services industries as the proposed methodology is business domain agnostic. It can be easily ported and tailored to align with an individual organization's evaluation philosophy. The suitability and effectiveness of the method can be studied under various types of firms like manufacturing, private, public, NGO, labour oriented, etc. As the proposed method reduces efforts, the stake holders can focus on understanding the relation between employee performance measurement, employee engagement, and long-term outcomes related to employee performance evaluation. Originality/value The proposed employee evaluation method leverages inter-rater reliability and agreement tool as a consensus approach to the relative performance ranking exercise. Such an approach to relative performance ranking is original as no prior studies with such an approach are found in the existing Literature.

Comparison of online and traditional performance appraisal systems

Assessing the ethics of implementing performance appraisal systems

Consequences of the performance appraisal experience

Examining the Role of Employee Participation, Supervisor Trust, and Appraisal Reactions for a Pay-for-Performance Appraisal System

Comparison of online and classroom-based student evaluations of instruction

Satisfaction with a performance appraisal system and appraisal discussion

Performance Appraisal Systems, Productivity, and Motivation: A Case Study

Performance Appraisal Systems: Determinants and Change

To Rate or Not to Rate? Autonomic Response and Psychological Well-being of Employees During Performance Review

Participation and performance on paper- and computer-based low-stakes assessments

Investigating students' behavior and performance in online conceptual assessment

Performance differences for in-class and online administration of low-stakes research-based assessments

Effectiveness of performance appraisal: Evidence on the utilization criteria

INVESTIGATING THE EFFECTIVENESS OF EMPLOYEES' PERFORMANCE APPRAISAL SYSTEM: KUWAIT CASE STUDY

Benefits and costs of pay for performance as perceived by residents: a qualitative study

Improving relative performance evaluation process of employees within a peer group

From paper to pixels: A comparison of paper and computer formats in psychological assessment

The Social Context of Performance Appraisal: A Review and Framework for the Future

Reinventing Performance Management

Evaluating the Efficacy of Online Assessments in Higher Education

Performance appraisal and culture: practice and attitudes in Hong Kong and Great Britain