Abstract:Studying developers’ behavior in software development tasks is crucial for designing effective techniques and tools to support developers’ daily work. In modern software development, developers frequently use different applications including IDEs, Web Browsers, documentation software (such as Office Word, Excel, and PDF applications), and other tools to complete their tasks. This creates significant challenges in collecting and analyzing developers’ behavior data. Researchers usually instrument the software tools to log developers’ behavior for further studies. This is feasible for studies on development activities using specific software tools. However, instrumenting all software tools commonly used in real work settings is difficult and requires significant human effort. Furthermore, the collected behavior data consist of low-level and fine-grained event sequences, which must be abstracted into high-level development activities for further analysis. This abstraction is often performed manually or based on simple heuristics. In this paper, we propose an approach to address the above two challenges in collecting and analyzing developers’ behavior data. First, we use our ActivitySpace framework to improve the generalizability of the data collection. ActivitySpace uses operating-system level instrumentation to track developer interactions with a wide range of applications in real work settings. Secondly, we use a machine learning approach to reduce the human effort to abstract low-level behavior data. Specifically, considering the sequential nature of the interaction data, we propose a Condition Random Field (CRF) based approach to segment and label the developers’ low-level actions into a set of basic, yet meaningful development activities. To validate the generalizability of the proposed data collection approach, we deploy the ActivitySpace framework in an industry partner’s company and collect the real working data from ten professional developers’ one-week work in three actual software projects. The experiment with the collected data confirms that with initial human-labeled training data, the CRF model can be trained to infer development activities from low-level actions with reasonable accuracy within and across developers and software projects. This suggests that the machine learning approach is promising in reducing the human efforts required for behavior data analysis.

A Novel Method for Acquiring Engineering-Oriented Operational Empirical Knowledge

A novel two-stage method for acquiring engineering-oriented empirical tacit knowledge

Automated experiential engineering knowledge acquisition through Q&A contextualization and transformation

Inference of Development Activities from Interaction with Uninstrumented Applications

A Novel Approach for Analysing Evolutional Motivation of Empirical Engineering Knowledge

Production Assessment using a Knowledge Transfer Framework and Evidence Theory

Long-term Knowledge Evolution Modeling for Empirical Engineering Knowledge.

Development of an expert system-based experimental frame for modeling of manufacturing systems

Tacit Knowledge Acquisition Method for the Process of Concept Design

Three-phase Approach to Service Staff Assignment for MRO Tasks

Proactive Search Enabled Context-Sensitive Knowledge Supply Situated in Computer-Aided Engineering

How to Accumulate Empirical Engineering Knowledge in the Complex Problem-Solving Process for Novice Engineers

A novel knowledge graph-based optimization approach for resource allocation in discrete manufacturing workshops

A Knowledge Engineering Method for New Product Development

Leveraging multi-modal knowledge graph for operation and maintenance knowledge management and application: a case study of bridge cranes

A New Computational Method for Acquiring Effect Knowledge to Support Product Innovation

A knowledge management-driven and DevOps-based method for situational method engineering

Knowledge Based Engineering and Ontology Engineering Approaches for Product Development: Methods and Tools for Design Automation in Industrial Engineering

Managing engineering analysis knowledge

STUDY AND APPLICATION OF OPERATIONAL PROFILE ESTIMATION BASED ON AOP

Collaborative Robots and New Product Introduction: Capturing and Transferring Human Expert Knowledge to the Operators