Abstract:Aim/Purpose: The purpose of this study is to develop an efficient methodology that can assist the evaluators in assessing a variable number of individuals that are working in groups and guarantee that the assessment is dependent on the group members’ performance and contribution to the work developed. Background: Collaborative work has been gaining more popularity in academic settings. However, group assessment needs to be performed according to each individual’s performance. The problem rests on the need to distinguish each member of the group in order to provide fair and unbiased assessments. Methodology: Design Science Research methodology supported the design of a framework able to provide the evaluator with the means to distinguish individuals in a workgroup and deliver fair results. Hevner’s DSR guidelines were fulfilled in order to describe WebAVALIA. To evaluate the framework, a quantitative study was performed and the first results are presented. Contribution: This paper provides a methodological solution regarding a fair evaluation of collaborative work through a tool that allows its users to perform their own assessment and peer assessment. These are made accordingly to the user’s perspectives on the performance of each group member throughout the work development. Findings: The first analysis of the results indicates that the developed method provides fairness in the assessment of group members, delivering a distinction amongst individuals. Therefore, each group member obtains a mark that corresponds to their specific contribution to the workgroup. Recommendations for Practitioners: For those who intend to apply this workgroup assessment method, it is relevant to raise student awareness about the methodology that is going to be used. That is, all the functionalities and steps in WebAVALIA have to be thoroughly explained before beginning of the project. Then, the evaluators have to decide about the students’ intermediate voting, namely if the evaluator chooses or not to publish student results throughout the project’s development. If there is the decision to display these intermediate results, the evaluator must try to encourage collaboration among workgroup members, instead of competition. Recommendation for Researchers: This study explores the design and development of an e-assessment tool – WebAVALIA. In order to assess its feasibility, its use in other institutions or contexts is recommended. The gathering of user opinions is suggested as well. It would then be interesting to compare the findings of this study with the results from other experimentations Impact on Society: Sometimes, people develop a rejection of collaborative work because they feel exploited due to the biased evaluation results. However, the group members assessment distinction, according to each one’s performance, may give each individual a sense of fairness and reward, leading to an openness/willingness towards collaborative work. Future Research: As future work, there are plans to implement the method in other group assessment contexts – such as sports and business environments, other higher education institutions, technical training students – in other cultures and countries. From this myriad of contexts, satisfaction results would be compared. Other future plans are to further explore the mathematical formulations and the respective WebAVALIA supporting algorithms.

SAFA: A System for Assisting Fair Assessments in Team Collaboration

Translation, Revision and Assessment of Reliability and Validity of the Assessment of Interprofessional Team Collaboration Scale

Self-Assessment Survey: Evaluation of a Revised Measure Assessing Positive Behavioral Interventions and Supports

Improving Workgroup Assessment with WebAVALIA: The Concept, Framework and First Results

Who engaged in the team-based assessment? Leveraging EdTech for a self and intra-team peer-assessment solution to free-riding

Examining the Effects of a Real-Time, Knowledge-Aware Tool for Academic Writing Assessment

Assessment as Learning: How Does Peer Assessment Function in Students' Learning?

An Empirical Study of the Impact of Peer Assessment on Teamwork from the Perspective of Experiential FL Teaching and Learning

Team dynamics feedback for post-secondary student learning teams: introducing the “Bare CARE” assessment and report

An online collaborative peer-assessment approach to strengthening pre-service teachers’ digital content development competence and higher-order thinking tendency

Developing assessment literacy among trainee translators: scaffolding self and peer assessment as an intervention

Peer assessment, self-assessment, and resultant feedback: an examination of feasibility and reliability

Self-assessment complements peer assessment for undergraduate students in an academic writing task

The Study of Peer Assessment Impact on Group Learning Activities

FORMATIVE ASSESSMENT IN L2 CLASSROOM IN CHINA: THE CURRENT SITUATION, PREDICAMENT AND FUTURE

Developing an Improved ACT-R Model for Pilot Situation Awareness Measurement

Towards a Success Model for Automated Programming Assessment Systems Used as a Formative Assessment Tool

Computer-based assessment of collaborative problem solving skills: A systematic review of empirical research

Effectiveness of AR-Based Formative Peer Assessment on Chinese Writing Performance of Students with Different Cognitive Styles

An approach to situation awareness (SA) assessment in flight simulation: SA dynamic circulation (SADC) model

The affordances of a technology-aided formative assessment platform for the assessment and teaching of English as a foreign language: an ecological perspective