Abstract:Software forges like GitHub host millions of repositories. Software engineering researchers have been able to take advantage of such a large corpora of potential study subjects with the help of tools like GHTorrent and Boa. However, the simplicity in querying comes with a caveat: there are limited means of separating the signal (e.g. repositories containing engineered software projects) from the noise (e.g. repositories containing home work assignments). The proportion of noise in a random sample of repositories could skew the study and may lead to researchers reaching unrealistic, potentially inaccurate, conclusions. We argue that it is imperative to have the ability to sieve out the noise in such large repository forges. We propose a framework, and present a reference implementation of the framework as a tool called reaper, to enable researchers to select GitHub repositories that contain evidence of an engineered software project. We identify software engineering practices (called dimensions) and propose means for validating their existence in a GitHub repository. We used reaper to measure the dimensions of 1,857,423 GitHub repositories. We then used manually classified data sets of repositories to train classifiers capable of predicting if a given GitHub repository contains an engineered software project. The performance of the classifiers was evaluated using a set of 200 repositories with known ground truth classification. We also compared the performance of the classifiers to other approaches to classification (e.g. number of GitHub Stargazers) and found our classifiers to outperform existing approaches. We found stargazers-based classifier (with 10 as the threshold for number of stargazers) to exhibit high precision (97%) but an inversely proportional recall (32%). On the other hand, our best classifier exhibited a high precision (82%) and a high recall (86%). The stargazer-based criteria offers precision but fails to recall a significant portion of the population.

Patterns of folder use and project popularity: a case study of github repositories.

The Relationship Between Folder Use and the Number of Forks : A Case Study on Github Repositories

An Exploratory Study to Find Motives Behind Cross-platform Forks from Software Heritage Dataset

Why is My Code Change Abandoned?

A Large-Scale Empirical Study of Open Source License Usage: Practices and Challenges

Branch Use in Practice: A Large-Scale Empirical Study of 2,923 Projects on GitHub

On the Popularity of GitHub Applications: A Preliminary Note

Understanding the Factors that Impact the Popularity of GitHub Repositories

An empirical study of code reuse between GitHub and stack overflow during software development

Exploring GitHub Topics: Unveiling Their Content and Potential

How do Software Engineering Researchers Use GitHub? An Empirical Study of Artifacts & Impact

Fork Entropy: Assessing the Diversity of Open Source Software Projects' Forks

Fork Entropy: Assessing the Diversity of Open Source Software Projects' Forks

Recommending relevant projects via user behaviour: an exploratory study on github.

On GitHub's Programming Languages

Focus-shifting Patterns of OSS Developers and Their Congruence with Call Graphs

Characterization and Prediction of Popular Projects on GitHub

Forking Around: Correlation of forking practices with the success of a project

Forking Without Clicking: on How to Identify Software Repository Forks

An Empirical Study On Correlation between Readme Content and Project Popularity

Curating GitHub for engineered software projects