Abstract:Using API reference documentation like JavaDoc is an integral part of software development. Previous research introduced a grounded taxonomy that organizes API documentation knowledge in 12 types, including knowledge about the Functionality, Structure, and Quality of an API. We study how well modern text classification approaches can automatically identify documentation containing specific knowledge types. We compared conventional machine learning (k-NN and SVM) and deep learning approaches trained on manually annotated Java and .NET API documentation (n = 5,574). When classifying the knowledge types individually (i.e., multiple binary classifiers) the best AUPRC was up to 87%. The deep learning and SVM classifiers seem complementary. For four knowledge types (Concept, Control, Pattern, and Non-Information), SVM clearly outperforms deep learning which, on the other hand, is more accurate for identifying the remaining types. When considering multiple knowledge types at once (i.e., multi-label classification) deep learning outperforms naïve baselines and traditional machine learning achieving a MacroAUC up to 79%. We also compared classifiers using embeddings pre-trained on generic text corpora and StackOverflow but did not observe significant improvements. Finally, to assess the generalizability of the classifiers, we re-tested them on a different, unseen Python documentation dataset. Classifiers for Functionality, Concept, Purpose, Pattern, and Directive seem to generalize from Java and .NET to Python documentation. The accuracy related to the remaining types seems API-specific. We discuss our results and how they inform the development of tools for supporting developers sharing and accessing API knowledge. Published article: <a class="link-external link-https" href="https://doi.org/10.1145/3338906.3338943" rel="external noopener nofollow">this https URL</a>

A Comprehensive Analysis of Deep Learning Techniques for Documentation Classification

Deep Learning for Technical Document Classification

Comparative Study between Traditional Machine Learning and Deep Learning Approaches for Text Classification

An Assessment of Machine Learning and Deep Learning Techniques with Applications

Amplifying document categorization with advanced features and deep learning

Deep Learning Based Text Classification: A Comprehensive Review

A document image classification system fusing deep and machine learning models

Deep Learning Models for Image Classification: Comparison and Applications

A Survey on Deep Learning: Algorithms, Techniques, and Applications.

Evaluation of Deep Convolutional Nets for Document Image Classification and Retrieval

An abbreviated review of deep learning-based image classification models

Text Classification: A Perspective of Deep Learning Methods

Deep Learning Architect: Classification for Architectural Design Using Artificial Intelligence

On Using Machine Learning to Identify Knowledge in API Reference Documentation

Comparative Study of Long Document Classification

A review of deep learning methods for digitisation of complex documents and engineering diagrams

Deep Learning: Applications, Architectures, Models, Tools, and Frameworks: A Comprehensive Survey

A Survey of Deep Learning Approaches for OCR and Document Understanding

Document AI: Benchmarks, Models and Applications

Real-Time Document Image Classification using Deep CNN and Extreme Learning Machines

Deep Learning Techniques for Image Recognition and Object Detection