PyPOTS: A Python Toolbox for Data Mining on Partially-Observed Time Series

Wenjie Du

2023-05-30

Abstract:PyPOTS is an open-source Python library dedicated to data mining and analysis on multivariate partially-observed time series, i.e. incomplete time series with missing values, A.K.A. irregularlysampled time series. Particularly, it provides easy access to diverse algorithms categorized into four tasks: imputation, classification, clustering, and forecasting. The included models contain probabilistic approaches as well as neural-network methods, with a well-designed and fully-documented programming interface for both academic researchers and industrial professionals to use. With robustness and scalability in its design philosophy, best practices of software construction, for example, unit testing, continuous integration (CI) and continuous delivery (CD), code coverage, maintainability evaluation, interactive tutorials, and parallelization, are carried out as principles during the development of PyPOTS. The toolkit is available on both Python Package Index (PyPI) and Anaconda. PyPOTS is open-source and publicly available on GitHub <a class="link-external link-https" href="https://github.com/WenjieDu/PyPOTS" rel="external noopener nofollow">this https URL</a>.

Machine Learning

What problem does this paper attempt to address?

The paper introduces an open-source Python library named PyPOTS, which focuses on handling Partially Observed Time Series (POTS) data, i.e., multivariate time series data with missing values. PyPOTS aims to address the common issue of missing data in practical applications, especially when reliable data mining tasks need to be performed on large amounts of incomplete time series.

Specifically, PyPOTS provides the following features:
1. **Multiple Algorithms**: It includes 10 algorithms covering four main tasks—imputation, classification, clustering, and forecasting. These algorithms encompass both probabilistic methods and neural network methods.
2. **Unified Interface and Documentation**: All algorithms have a unified programming interface, accompanied by detailed documentation and interactive tutorials, making it convenient for academic researchers and industry professionals to use.
3. **High-Quality Assurance**: The software quality is ensured through unit testing, continuous integration, code coverage measurement, and maintainability assessment.
4. **Optimization and Extensibility**: The library employs data lazy loading strategy, multi-device parallel acceleration, and a unified model serialization and deserialization interface to enhance its extensibility and performance.

In summary, PyPOTS aims to provide researchers and engineers with a comprehensive toolbox for handling various complex time series datasets with missing values, thereby supporting applications in multiple fields such as urban traffic forecasting, telecommunication network fault prediction, patient health monitoring, and gene expression analysis.