Abstract:In the field of evaluation research, computer scientists live constantly upon dilemmas and conflicting theories. As evaluation is differently perceived and modeled among educational areas, it is not difficult to become trapped in dilemmas, which reflects an epistemological weakness. Additionally, designing and developing a computer-based learning scenario is not an easy task. Advancing further, with end-users probing the system in realistic settings, is even harder. Computer science research in evaluation faces an immense challenge, having to cope with contributions from several conflicting and controversial research fields. We believe that deep changes must be made in our field if we are to advance beyond the CBT (computer-based training) learning model and to build an adequate epistemology for this challenge. The first task is to relocate our field by building upon recent results from philosophy, psychology, social sciences, and engineering. In this article we locate evaluation in respect to communication studies. Evaluation presupposes a definition of goals to be reached, and we suggest that it is, by many means, a silent communication between teacher and student, peers, and institutional entities. If we accept that evaluation can be viewed as set of invisible rules known by nobody, but somehow understood by everybody, we should add anthropological inquiries to our research toolkit. The paper is organized around some elements of the social communication and how they convey new insights to evaluation research for computer and related scientists. We found some technical limitations and offer discussions on how we relate to technology at same time we establish expectancies and perceive others work.

Adapting ubicomp software and its evaluation

Using Evaluators to Enable Intelligent Adaptation for Mobile Web Applications

SimUser: Generating Usability Feedback by Simulating Various Users Interacting with Mobile Applications

Responsive Equilibrium for Self-Adaptive Ubiquitous Interaction

An Architecture Of Adaptive Interface And Its Implementation

Method to Design Adaptable and Adaptive User Interfaces

Context Aware Adaptable Applications - A global approach

An adaptable software architecture based on mobile components in pervasive computing

On-the-Fly Usability Evaluation of Mobile Adaptive UIs Through Instant User Feedback

Real-Time Adaptation of Context-Aware Intelligent User Interfaces, for Enhanced Situational Awareness

Activity-based prototyping of ubicomp applications for long-lived, everyday human activities

Adaptive mobile web interface: user readiness in context

Redesigning Computer-based Learning Environments: Evaluation as Communication

AppEcho: a user-driven, in situ feedback approach for mobile platforms and applications

Uiwear: Easily Adapting User Interfaces For Wearable Devices

An Adaptive Agent-Based Interface for Personalized Health Interventions

Understanding Individual Differences: Towards Effective Mobile Interface Design and Adaptation for the Blind

An Automated Feedback-Based Approach to Support Mobile App Development

Model-based adaptive user interface based on context and user experience evaluation

Automated Application Offloading through Ant-inspired Decision-Making

The architecture of innovation: Tracking face-to-face interactions with ubicomp technologies