Abstract:This study proposes and demonstrates how computer‐aided methods can be used to extend qualitative data analysis by quantifying qualitative data, and then through exploration, categorization, grouping, and validation. Computer‐aided approaches to inquiry have gained important ground in educational research, mostly through data analytics and large data set processing. We argue that qualitative data analysis methods can also be supported and extended by computer‐aided methods. In particular, we posit that computing capacities rationally applied can expand the innate human ability to recognize patterns and group qualitative information based on similarities. We propose a principled approach to using machine learning in qualitative education research based on the three interrelated elements of the assessment triangle: cognition, observation, and interpretation. Through the lens of the assessment triangle, the study presents three examples of qualitative studies in engineering education that have used computer‐aided methods for visualization and grouping. The first study focuses on characterizing students' written explanations of programming code, using tile plots and hierarchical clustering with binary distances to identify the different approaches that students used to self‐explain. The second study looks into students' modeling and simulation process and elicits the types of knowledge that they used in each step through a think‐aloud protocol. For this purpose, we used a bubble plot and a k‐means clustering algorithm. The third and final study explores engineering faculty's conceptions of teaching, using data from semi‐structured interviews. We grouped these conceptions based on coding similarities, using Jaccard's similarity coefficient, and visualized them using a treemap. We conclude this manuscript by discussing some implications for engineering education qualitative research.

Design and analysis of computer experiments with quantitative and qualitative inputs: A selective review

Computer Experiments with Both Qualitative and Quantitative Variables

The User in Experimental Computer Systems Research

Doubly Coupled Designs for Computer Experiments with Both Qualitative and Quantitative Factors

Sequential Design of Computer Experiments with Quantitative and Qualitative Factors in Applications to HPC Performance Optimization

Sequential Computer Experimental Design for Estimating an Extreme Probability or Quantile

Design and analysis of computer experiments with both numeral and distribution inputs

Space-filling designs for computer experiments: A review

A Tutorial on Latin Hypercube Design of Experiments

Better than a petaflop: The power of efficient experimental design

Design for Sequential Follow-Up Experiments in Computer Emulations

Category, Process, and Recommendation of Design in an Interactive Evolutionary Computation Interior Design Experiment: a Data-Driven Study

Computer Simulation Research of Desk Design Based on ABC Attitude Theory

Supporting the Design and Analysis of HCI Experiments

Beyond analytics: Using computer‐aided methods in educational research to extend qualitative data analysis

The Statistical Analysis of Pairwise Experiments with Qualitative Responses

Prudent Practices for Designing Virtual Desktop Experiments.

Computational Experiments for Complex Social Systems: Integrated Design of Experiment System

Computational Experiments: Past, Present and Future

Computational Experiments for Complex Social Systems--Part I: the Customization of Computational Model

Comparisons among Different Design and Modeling Methods for Computer Experiments