Abstract:Most machine learning applications in quantum-chemistry (QC) data sets rely on a single statistical error parameter such as the mean square error (MSE) to evaluate their performance. However, this approach has limitations or can even yield incorrect interpretations. Here, we report a systematic investigation of the two components of the MSE, i.e., the bias and variance, using the QM9 data set. To this end, we experiment with three descriptors, namely (i) symmetry functions (SF, with two-body and three-body functions), (ii) many-body tensor representation (MBTR, with two- and three-body terms), and (iii) smooth overlap of atomic positions (SOAP), to evaluate the prediction process's performance using different numbers of molecules in training samples and the effect of bias and variance on the final MSE. Overall, low sample sizes are related to higher MSE. Moreover, the bias component strongly influences the larger MSEs. Furthermore, there is little agreement among molecules with higher errors (outliers) across different descriptors. However, there is a high prevalence among the outliers intersection set and the convex hull volume of geometric coordinates (VCH). According to the obtained results with the distribution of MSE (and its components bias and variance) and the appearance of outliers, it is suggested to use ensembles of models with a low bias to minimize the MSE, more specifically when using a small number of molecules in the training set.The Supporting Information is available free of charge at https://pubs.acs.org/doi/10.1021/acs.jcim.1c00503.Detailed description of MBTR, SOAP, SF and used tools, software, and methods. The algorithm configuration parameters and result's detailed charts (PDF)This article has not yet been cited by other publications.

The Lognormal Distribution and Quantum Monte Carlo Data

Quantum Algorithms for Sampling Log-Concave Distributions and Estimating Normalizing Constants.

Quantum-enhanced Markov chain Monte Carlo

Impact of non-normal error distributions on the benchmarking and ranking of quantum machine learning models

Quantum Metropolis-Hastings algorithm with the target distribution calculated by quantum Monte Carlo integration

Stochastic Quantum Sampling for Non-Logconcave Distributions and Estimating Partition Functions

Statistical Inference with Quantum Measurements: Methodologies for Nitrogen Vacancy Centers in Diamond

Quantum systems for Monte Carlo methods and applications to fractional stochastic processes

Post-measurement Quantum Monte Carlo

Non-Zero Mean Quantum Wishart Distribution Of Random Quantum States And Application

Normal quantum channels and Markovian correlated two-qubit quantum errors

Quantum Probability via the Method of Arbitrary Functions

Quantum hypothesis testing in many-body systems

A refinement of the binomial distribution using the quantum binomial theorem

A numerical method for generation of quantum noise and solution of generalized c-number quantum Langevin equation

Deterministic and Bayesian Characterization of Quantum Computing Devices

A New Initial Distribution for Quantum Generative Adversarial Networks to Load Probability Distributions

Distributional Property Testing in a Quantum World

Non-equilibrium quantum Monte Carlo algorithm for stabilizer Renyi entropy in spin systems

Systematic Investigation of Error Distribution in Machine Learning Algorithms Applied to the Quantum-Chemistry QM9 Data Set Using the Bias and Variance Decomposition

Probability assignment in a quantum statistical model