Abstract:The fast-paced evolution of technology has compelled the digitalization of education, requiring educators to interact with computers and develop digital competencies relevant to the teaching–learning process. This need has prompted various organizations to define frameworks for assessing digital competency emphasizing teachers' interaction with computer technologies in education. Different authors have presented assessment methods for teachers' digital competence based on the video analysis of recorded classes using sensors such as cameras, microphones, or electroencephalograms. The main limitation of these solutions is the large number of resources they require, making it difficult to assess large numbers of teachers in resource-constrained environments. This article proposes the automation of teachers' digital competence evaluation process based on monitoring metrics obtained from teachers' interaction with a Learning Management System (LMS). Based on the Digital Competence Framework for Educators (DigCompEdu), indicators were defined and extracted that allow automatic measurement of a teacher's competency level. A tool was designed and implemented to conduct a successful proof of concept capable of automating the evaluation process of all university faculty, including 987 lecturers from different fields of knowledge. Results obtained allow for drawing conclusions on technological adoption according to the teacher's profile and planning educational actions to improve these competencies.
engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
What problem does this paper attempt to address?
### Problems the Paper Attempts to Solve
This paper aims to address the resource-intensive issue in the assessment of teachers' digital competence. Specifically, existing assessment methods often rely on video analysis, sensors (such as cameras, microphones, or EEG), which require substantial resources and are challenging to implement for a large number of teachers in resource-limited environments. Therefore, this paper proposes an automated monitoring method based on Learning Management System (LMS) data extraction to evaluate teachers' digital competence.
### Background and Motivation
With the rapid development of technology, digitalization in the field of education has become an inevitable trend. Teachers need to interact with computers and develop digital competencies related to the teaching process. To this end, various organizations have proposed frameworks for assessing digital competence, emphasizing teachers' interaction with computer technology in education. However, the main limitation of existing assessment methods is their high resource demand, making large-scale application difficult.
### Solution
This paper proposes an automated monitoring method based on Learning Management System (LMS) data extraction to evaluate teachers' digital competence. The method is based on the European Framework for the Digital Competence of Educators (DigCompEdu), defining assessment indicators and designing a tool to automatically measure teachers' digital competence levels. The tool successfully underwent proof of concept and can automatically assess the digital competence of all university teachers, including 987 lecturers from different knowledge domains.
### Objectives
- **Automated Assessment Process**: Achieve automated assessment of teachers' digital competence by monitoring their interaction data with the LMS.
- **Resource Efficiency**: Reduce the need for expensive equipment and human resources, making the assessment process more efficient.
- **Provide Basis for Improvement**: Based on the assessment results, experts can determine whether training actions are needed to enhance teachers' digital competence.
### Methodology
This paper adopts the ADDIE model (Analysis, Design, Development, Implementation, Evaluation) for research design. The specific steps include:
1. **Analysis**: Determine the learning environment, audience, problems, and constraints, clarifying objectives, scope, and limitations.
2. **Design**: Develop the process to achieve the objectives, decide on feedback mechanisms, and collect necessary data.
3. **Development**: Create all assets and materials defined in the previous stage.
4. **Implementation**: Deliver the research outcomes.
5. **Evaluation**: Measure the effectiveness and efficiency of the research.
### Conclusion
By automating the monitoring of LMS data, the assessment method proposed in this paper can efficiently evaluate the digital competence of a large number of teachers in resource-limited environments. The assessment results help determine the level of teachers' digital competence and provide a basis for developing training plans, thereby improving teaching quality.