Abstract:The distribution of the Kolmogorov-Smirnov (KS) test statistic has been widely studied under the assumption that the underlying theoretical cumulative distribution function (CDF), F (x), is continuous. However, there are many real-life applications in which fitting discrete or mixed distributions is required. Nevertheless, due to inherent difficulties, the distribution of the KS statistic when F (x) has jump discontinuities has been studied to a much lesser extent and no exact and efficient computational methods have been proposed in the literature. In this paper, we provide a fast and accurate method to compute the (complementary) CDF of the KS statistic when F (x) is discontinuous, and thus obtain exact p values of the KS test. Our approach is to express the complementary CDF through the rectangle probability for uniform order statistics, and to compute it using fast Fourier transform (FFT). Secondly, we provide a C++ and an R implementation of the proposed method, which fills the existing gap in statistical software. We give also a useful extension of the Schmid's asymptotic formula for the distribution of the KS statistic, relaxing his requirement for F (x) to be increasing between jumps and thus allowing for any general mixed or purely discrete F (x). The numerical performance of the proposed FFT-based method, implemented both in C++ and in the R package KSgeneral, available from https://CRAN.R-project.org/package=KSgeneral, is illustrated when F (x) is mixed, purely discrete, and continuous. The performance of the general asymptotic formula is also studied.

Kolmogorov–Smirnov Test: Overview

Deriving CDF of Kolmogorov-Smirnov Test Statistic

On Misuses of the Kolmogorov–Smirnov Test for One-Sample Goodness-of-Fit

On the Kolmogorov-Smirnov Test for Normality with Mean and Variance Unknown

Tests for the Equality of Two Distributions Based on Kolmgorov-Smirnov Statistic

Graphical n-sample tests of correspondence of distributions

The power of visualizing distributional differences: formal graphical n-sample tests

A Kolmogorov–Smirnov-type test for the two-sample problem with left-truncated data

Computing the Kolmogorov-Smirnov Distribution When the Underlying CDF is Purely Discrete, Mixed, or Continuous

Extension of the one-sample Kolmogorov-Smirnov test

A Higher-Order Kolmogorov-Smirnov Test

On the Kolmogorov-Smirnov Test for the Exponential Distribution with Mean Unknown

Power comparison of the Kolmogorov–Smirnov test under ranked set sampling and simple random sampling

A distance based two-sample test of means difference for multivariate datasets

A Stream-Suitable Kolmogorov-Smirnov-Type Test for Big Data Analysis

Two-Sample Smooth Tests for the Equality of Distributions

Some notes on biasedness and unbiasedness of two-sample Kolmogorov-Smirnov test

Kolmogorov-Smirnov type statistics for structural breaks - a new adjusted-range based self-normalization approach

Testing for Structural Breaks – A New Self-Normalization Approach Based on the Adjusted Sample Range

Kolmogorov–Smirnov type testing for structural breaks: A new adjusted-range based self-normalization approach

Goodness-of-Fit Tests for Large Datasets