Abstract:The major goal of software development is to deliver high-quality software efficiently. To achieve this goal of delivering high-quality software efficiently, programmers often reuse existing frameworks or libraries, hereby referred to as libraries, instead of developing similar code artifacts from the scratch. However, programmers often face challenges in reusing existing libraries due to two major factors. First, many existing libraries are not well-documented. Even when such documentations exist, they are often outdated. Second, many existing libraries expose a large number of application programming interfaces (APIs), which represent interfaces through which libraries expose their functionalities. For example, the .NET base library provides nearly 10,000 API classes. Due to these two preceding factors, there exist three major problems that affect both software productivity and quality. First, programmers often spend more time in reusing existing libraries, thereby reducing software productivity. Second, programmers introduce defects while using APIs due to lack of proper knowledge on how to reuse those APIs. Third, existing white-box test generation techniques face challenges in effectively generating test inputs for the client code that reuses libraries. To address these three preceding issues, in this dissertation, we propose a general framework, called WebMiner, that uses existing open source code available on the web by leveraging a code search engine. In particular, WebMiner infers usage specifications for API methods under analysis by automatically collecting relevant code examples from the open source code available on the web. WebMiner next applies data mining techniques on those collected code examples to identify common patterns, which represent likely usage of APIs, referred to as API usage specifications. The primary reason for identifying common patterns is based on the observation that majority of the programmers correctly adhere to API usage specifications and those common patterns are likely to represent the correct usage of APIs. We further propose six approaches based on our general framework, where each approach focuses on a specific software engineering (SE) task such as detecting defects in an application under analysis. In particular, the first two approaches assist programmers in effectively reusing APIs provided by existing libraries. The next two approaches use mined API usage specifications as programming rules and detect defects in applications under analysis as deviations from the mined specifications. Finally, the last two approaches mine static and dynamic traces, respectively, for effectively generating test inputs that achieve high structural coverage of the code under test. We also propose another approach that addresses a major issue with mining-based approaches, which are not effective in scenarios where usage information is not available for the API methods under analysis or usage information is not sufficient to achieve the SE task under analysis. Our empirical results show that the approaches developed based on our WebMiner framework effectively address the respective SE tasks handled by those approaches. In particular, our empirical results demonstrate the effectiveness of expanding the data scope of mining-based approaches to large open source code available on the web. Our results also show that our approaches address queries posted in developer forums and detect new defects that are not detected by existing related approaches, thereby improving both software productivity and quality.

On the Use of Information Retrieval to Automate the Detection of Third-Party Java Library Migration at the Method Level

Learning to Recommend Third-Party Library Migration Opportunities at the API Level

Third-party software library migration at the method-level using multi-objective evolutionary search

MUT: Human-in-the-Loop Unit Test Migration

Accurate Library Recommendation Using Combining Collaborative Filtering and Topic Model for Mobile Development.

A Study of Library Migration in Java Software

How Does API Migration Impact Software Quality and Comprehension? An Empirical Study

A Multi-Metric Ranking Approach for Library Migration Recommendations

Automated Inference of Software Library Usage Patterns

A Large-Scale Empirical Study on Java Library Migrations: Prevalence, Trends, and Rationales

MigrationAdvisor: Recommending Library Migrations from Large-Scale Open-Source Data

M3: Semantic API Migrations

A Multi-Metric Ranking with Label Correlations Approach for Library Migration Recommendations

Improving software reliability and productivity via mining program source code

Mining API Mapping for Language Migration

Characterizing Python Library Migrations

API-misuse detection driven by fine-grained API-constraint knowledge graph

Improving software productivity and quality via mining source code

A3: Assisting Android API Migrations Using Code Examples

Self-Admitted Library Migrations in Java, JavaScript, and Python Packaging Ecosystems: A Comparative Study

Migrating Client Code without Change Examples