Abstract:Type inference for dynamic programming languages such as Python is an important yet challenging task. Static type inference techniques can precisely infer variables with enough static constraints but are unable to handle variables with dynamic features. Deep learning (DL) based approaches are feature-agnostic, but they cannot guarantee the correctness of the predicted types. Their performance significantly depends on the quality of the training data (i.e., DL models perform poorly on some common types that rarely appear in the training dataset). It is interesting to note that the static and DL-based approaches offer complementary benefits. Unfortunately, to our knowledge, precise type inference based on both static inference and neural predictions has not been exploited and remains an open challenge. In particular, it is hard to integrate DL models into the framework of rule-based static approaches. This paper fills the gap and proposes a hybrid type inference approach named HiTyper based on both static inference and deep learning. Specifically, our key insight is to record type dependencies among variables in each function and encode the dependency information in type dependency graphs (TDGs). Based on TDGs, we can easily integrate type inference rules in the nodes to conduct static inference and type rejection rules to inspect the correctness of neural predictions. HiTyper iteratively conducts static inference and DL-based prediction until the TDG is fully inferred. Experiments on two benchmark datasets show that HiTyper outperforms state-of-the-art DL models by exactly matching 10% more human annotations. HiTyper also achieves an increase of more than 30% on inferring rare types. Considering only the static part of HiTyper, it infers 2x similar to 3x more types than existing static type inference tools. Moreover, HiTyper successfully corrected seven wrong human annotations in six GitHub projects, and two of them have already been approved by the repository owners.

Static Type Analysis for Python

Automated Return Type Annotation for Python

Towards a Large-Scale Empirical Study of Python Static Type Annotations

How Well Static Type Checkers Work with Gradual Typing? A Case Study on Python.

Generating Python Type Annotations from Type Inference: How Far Are We?

Static Type Recommendation for Python.

Path-sensitive Type Analysis with Backward Analysis for Quality Assurance of Dynamic Typed Language Code

PoTo: A Hybrid Andersen's Points-to Analysis for Python

TPython:An Extension of Python

Static Type Inference for Foreign Functions of Python

Static Inference Meets Deep Learning: A Hybrid Type Inference Approach for Python

Where to Start: Studying Type Annotation Practices in Python

DLInfer: Deep Learning with Static Slicing for Python Type Inference.

TIPICAL -- Type Inference for Python In Critical Accuracy Level

TypeEvalPy: A Micro-benchmarking Framework for Python Type Inference Tools

Securing c programs by dynamic type checking

Type4Py: Practical Deep Similarity Learning-Based Type Inference for Python

An Empirical Study of Dynamic Types for Python Projects.

Python Probabilistic Type Inference with Natural Language Support

An Empirical Study on Dynamic Typing Related Practices in Python Systems

Static Inference Meets Deep Learning