The Impact of Measurement Error in Regression Models Using Police Recorded Crime Rates

Jose Pina-Sánchez,David Buil-Gil,Ian Brunton-Smith,Alexandru Cernat

DOI: https://doi.org/10.1007/s10940-022-09557-6

2022-08-29

Journal of Quantitative Criminology

Abstract:Assess the extent to which measurement error in police recorded crime rates impact the estimates of regression models exploring the causes and consequences of crime.

criminology & penology

What problem does this paper attempt to address?

The impact of measurement error in models using police recorded crime rates

Jose Pina-Sánchez,David Buil-Gil,ian brunton-smith,Alexandru Cernat

DOI: https://doi.org/10.31235/osf.io/ydf4b

2021-02-03

Abstract:Objectives: Assess the extent to which measurement error in police recorded crime rates impact the estimates of regression models exploring the causes and consequences of crime.Methods: We focus on linear models where crime rates are included either as the response or as an explanatory variable, in their original scale, or log-transformed. Two measurement error mechanisms are considered, systematic errors in the form of under-recorded crime, and random errors in the form of recording inconsistencies across areas. The extent to which such measurement error mechanisms impact model parameters is demonstrated algebraically, using formal notation, and graphically, using simulations.Results: Most coefficients and measures of uncertainty from models where crime rates are included in their original scale are severely biased. However, in many cases, this problem could be minimised, or altogether eliminated by log-transforming crime rates. This transforms the multiplicative measurement error observed in police recorded crime rates into a less harmful additive mechanism.Conclusions: The validity of findings from regression models where police recorded crime rates are used in their original scale is put into question. In interpreting the large evidence base exploring the effects and consequences of crime using police statistics we urge researchers to consider the biasing effects shown here. Equally, we urge researchers to log-transform crime rates before they are introduced in statistical models.
Exploring the impact of measurement error in police recorded crime rates through sensitivity analysis

Jose Pina-Sánchez,Ian Brunton-Smith,David Buil-Gil,Alexandru Cernat

DOI: https://doi.org/10.1186/s40163-023-00192-5

2023-07-26

Crime Science

Abstract:It is well known that police recorded crime data is susceptible to substantial measurement error. However, despite its limitations, police data is widely used in regression models exploring the causes and effects of crime, which can lead to different types of bias. Here, we introduce a new R package ('rcme': Recounting Crime with Measurement Error) that can be used to facilitate sensitivity assessments of the impact of measurement error in analyses using police recorded crime rates across a wide range of settings. To demonstrate the potential of such sensitivity analysis, we explore the robustness of the effect of collective efficacy on criminal damage across Greater London's neighbourhoods. We show how the crime reduction effect attributed to collective efficacy appears robust, even when most criminal damage incidents are not recorded by the police, and if we accept that under-recording rates are moderately affected by collective efficacy.
The Impact of Incorrectly-Measured Variables when Mixed with Precisely Measured Variables on the Study of Validity in Epidemiological Research

Mei-Xia Yang,Yi-Biao Zhou,Qing-Wu Jiang

DOI: https://doi.org/10.3760/j.issn:0254-6450.2007.08.021

2007-01-01

Abstract:OBJECTIVE:To explore the impact of measurement error on the associated effects under the incorrectly-measured variables when mixed with precisely measured variables.METHODS:Based on the functions of measurement error, correlation of incorrectly-measured predictors and precisely measured explanatory variables, number of precisely measured explanatory variables and associated effect, the 'R Project for Statistical Computing' method is used to analyze the impact of measurement on the validity of a study.RESULTS:Under the scenario that the continuous response Y and the continuous explanatory Z are precisely measured but the continuous predictor X is incorrectly-measured, when focusing on inference about the effect of X on Y, the non-differential measurement error always makes the value of estimated effect less than the actual value, and the attenuation effect of measurement error more closely worsens the correlation of X and Z. Under a misclassification dichotomous predictor X with an additional precisely measured explanatory variable Z and focusing on inference about the effect of X on Y, the misclassification bias is not only related to the sensitivity and specificity of exposure measurement, but also to the correlation between X and Z and exposure proportion of X. The attenuation factor (AF) decreases gradually with the increasing correlation between X and Z. For instance, in the p = 0.5 scenario, AF is 1.419, and the estimated effect of dichotomous predictor X on continuous response Y is more than the actual effect. When it increases to 0.9, AF is 0.474, the estimated effect becomes less than the true effect.CONCLUSION:In the studies of the impact of measurement error in linear regression with additional precisely measured explanatory variables, the impact of measurement error on the associated effect is relatively complex, suggesting that it is necessary to control and to assess the measurement error bias in order to correctly interpret the results of a study.
The accuracy of crime statistics: assessing the impact of police data bias on geographic crime analysis

David Buil-Gil,Angelo Moretti,Samuel H. Langton

DOI: https://doi.org/10.1007/s11292-021-09457-y

2021-03-26

Journal of Experimental Criminology

Abstract:Abstract Objectives Police-recorded crimes are used by police forces to document community differences in crime and design spatially targeted strategies. Nevertheless, crimes known to police are affected by selection biases driven by underreporting. This paper presents a simulation study to analyze if crime statistics aggregated at small spatial scales are affected by larger bias than maps produced for larger geographies. Methods Based on parameters obtained from the UK Census, we simulate a synthetic population consistent with the characteristics of Manchester. Then, based on parameters derived from the Crime Survey for England and Wales, we simulate crimes suffered by individuals, and their likelihood to be known to police. This allows comparing the difference between all crimes and police-recorded incidents at different scales. Results Measures of dispersion of the relative difference between all crimes and police-recorded crimes are larger when incidents are aggregated to small geographies. The percentage of crimes unknown to police varies widely across small areas, underestimating crime in certain places while overestimating it in others. Conclusions Micro-level crime analysis is affected by a larger risk of bias than crimes aggregated at larger scales. These results raise awareness about an important shortcoming of micro-level mapping, and further efforts are needed to improve crime estimates.

criminology & penology
Learning Models from Data with Measurement Error: Tackling Underreporting

Roy Adams,Yuelong Ji,Xiaobin Wang,Suchi Saria

DOI: https://doi.org/10.48550/arXiv.1901.09060

IF: 5.414

2019-01-25

Machine Learning

Abstract:Measurement error in observational datasets can lead to systematic bias in inferences based on these datasets. As studies based on observational data are increasingly used to inform decisions with real-world impact, it is critical that we develop a robust set of techniques for analyzing and adjusting for these biases. In this paper we present a method for estimating the distribution of an outcome given a binary exposure that is subject to underreporting. Our method is based on a missing data view of the measurement error problem, where the true exposure is treated as a latent variable that is marginalized out of a joint model. We prove three different conditions under which the outcome distribution can still be identified from data containing only error-prone observations of the exposure. We demonstrate this method on synthetic data and analyze its sensitivity to near violations of the identifiability conditions. Finally, we use this method to estimate the effects of maternal smoking and opioid use during pregnancy on childhood obesity, two import problems from public health. Using the proposed method, we estimate these effects using only subject-reported drug use data and substantially refine the range of estimates generated by a sensitivity analysis-based approach. Further, the estimates produced by our method are consistent with existing literature on both the effects of maternal smoking and the rate at which subjects underreport smoking.
The integrity of crime statistics: Assessing the impact of police data bias on crime mapping

David Buil-Gil,Angelo Moretti,Samuel Langton

DOI: https://doi.org/10.31235/osf.io/myfhp

2020-06-25

Abstract:Police-recorded crimes are used by police forces to map crime patterns and design spatially-targeted strategies. Nevertheless, maps of crimes known to police are affected by selection biases driven by unequal crime reporting rates across social groups. This paper presents a simulation study to analyse the impact of selection biases on crime maps produced at different spatial scales. Based on parameters obtained from the UK Census, we simulate a synthetic population consistent with the characteristics of Manchester. Then, based on parameters derived from the Crime Survey for England and Wales, we simulate crimes suffered by individuals, and their likelihood to be known to police. This allows comparing the relative difference between all crimes and police-recorded incidents at the different spatial scales. While the average relative difference between all crimes and those known to police is 62% across all geographical scales, the measures of dispersion of the relative difference are larger when crimes are aggregated to small geographies. The percentage of crimes unknown to police varies widely across small areas, underestimating the prevalence of crime in certain places while overestimating it in others. Micro-level crime maps are affected by a larger risk of bias than maps produced at larger scales.
Robust Bayesian Inference for Berkson and Classical Measurement Error Models

Charita Dellaporta,Theodoros Damoulas

DOI: https://doi.org/10.48550/arXiv.2306.01468

2024-04-29

Abstract:Measurement error occurs when a covariate influencing a response variable is corrupted by noise. This can lead to misleading inference outcomes, particularly in problems where accurately estimating the relationship between covariates and response variables is crucial, such as causal effect estimation. Existing methods for dealing with measurement error often rely on strong assumptions such as knowledge of the error distribution or its variance and availability of replicated measurements of the covariates. We propose a Bayesian Nonparametric Learning framework that is robust to mismeasured covariates, does not require the preceding assumptions, and can incorporate prior beliefs about the error distribution. This approach gives rise to a general framework that is suitable for both Classical and Berkson error models via the appropriate specification of the prior centering measure of a Dirichlet Process (DP). Moreover, it offers flexibility in the choice of loss function depending on the type of regression model. We provide bounds on the generalization error based on the Maximum Mean Discrepancy (MMD) loss which allows for generalization to non-Gaussian distributed errors and nonlinear covariate-response relationships. We showcase the effectiveness of the proposed framework versus prior art in real-world problems containing either Berkson or Classical measurement errors.

Methodology,Machine Learning
Spatial autoregressive model with measurement error in covariates

Subhadeep Paul,Shanjukta Nath

2024-08-06

Abstract:The Spatial AutoRegressive model (SAR) is commonly used in studies involving spatial and network data to estimate the spatial or network peer influence and the effects of covariates on the response, taking into account the dependence among units. While the model can be efficiently estimated with a Quasi maximum likelihood approach (QMLE), the detrimental effect of covariate measurement error on the QMLE and how to remedy it is currently unknown. If covariates are measured with error, then the QMLE may not have the $\sqrt{n}$ convergence and may even be inconsistent even when a node is influenced by only a limited number of other nodes or spatial units. We develop a measurement error-corrected ML estimator (ME-QMLE) for the parameters of the SAR model when covariates are measured with error. The ME-QMLE possesses statistical consistency and asymptotic normality properties and we derive its limiting covariance. We consider two types of applications. The first is when the true covariate is imprecisely measured with replicated measurements or cannot be measured directly, and a proxy is observed instead. The second one involves including latent homophily factors estimated with error from the network for estimating peer influence. Our numerical results verify the bias correction property of the estimator and the accuracy of the standard error estimates in finite samples. We illustrate the method on two real datasets; i) peer influence in GPA for middle school students in New Jersey and ii) county-level death rates from the COVID-19 pandemic.

Methodology,Statistics Theory
Seemingly Unrelated Regression with Measurement Error: Estimation via Markov chain Monte Carlo and Mean Field Variational Bayes Approximation

Georges Bresson,Anoop Chaturvedi,Mohammad Arshad Rahman,Shalabh

DOI: https://doi.org/10.48550/arXiv.2006.07074

2020-06-12

Abstract:Linear regression with measurement error in the covariates is a heavily studied topic, however, the statistics/econometrics literature is almost silent to estimating a multi-equation model with measurement error. This paper considers a seemingly unrelated regression model with measurement error in the covariates and introduces two novel estimation methods: a pure Bayesian algorithm (based on Markov chain Monte Carlo techniques) and its mean field variational Bayes (MFVB) approximation. The MFVB method has the added advantage of being computationally fast and can handle big data. An issue pertinent to measurement error models is parameter identification, and this is resolved by employing a prior distribution on the measurement error variance. The methods are shown to perform well in multiple simulation studies, where we analyze the impact on posterior estimates arising due to different values of reliability ratio or variance of the true unobserved quantity used in the data generating process. The paper further implements the proposed algorithms in an application drawn from the health literature and shows that modeling measurement error in the data can improve model fitting.

Methodology,Econometrics
A Unified Bayesian Framework for Modeling Measurement Error in Multinomial Data

Matthew D. Koslovsky,Andee Kaplan,Victoria A. Terranova,Mevin B. Hooten

DOI: https://doi.org/10.48550/arXiv.2310.09345

2024-10-12

Abstract:Measurement error in multinomial data is a well-known and well-studied inferential problem that is encountered in many fields, including engineering, biomedical and omics research, ecology, finance, official statistics, and social sciences. Methods developed to accommodate measurement error in multinomial data are typically equipped to handle false negatives or false positives, but not both. We provide a unified framework for accommodating both forms of measurement error using a Bayesian hierarchical approach. We demonstrate the proposed method's performance on simulated data and apply it to acoustic bat monitoring and official crime data.

Methodology,Applications
Right-censored nonparametric regression with measurement error

Dursun Aydın,Ersin Yılmaz,Nur Chamidah,Budi Lestari,I. Nyoman Budiantara

DOI: https://doi.org/10.1007/s00184-024-00953-5

IF: 0.96

2024-03-06

Metrika

Abstract:This study focuses on estimating a nonparametric regression model with right-censored data when the covariate is subject to measurement error. To achieve this goal, it is necessary to solve the problems of censorship and measurement error ignored by many researchers. Note that the presence of measurement errors causes biased and inconsistent parameter estimates. Moreover, non-parametric regression techniques cannot be applied directly to right-censored observations. In this context, we consider an updated response variable using the Buckley–James method (BJM), which is essentially based on the Kaplan–Meier estimator, to solve the censorship problem. Then the measurement error problem is handled using the kernel deconvolution method, which is a specialized tool to solve this problem. Accordingly, three denconvoluted estimators based on BJM are introduced using kernel smoothing, local polynomial smoothing, and B-spline techniques that incorporate both the updated response variable and kernel deconvolution.The performances of these estimators are compared in a detailed simulation study. In addition, a real-world data example is presented using the Covid-19 dataset.

statistics & probability
Bayesian Adjustment for Measurement Error in an Offset Variable in a Poisson Regression Model

Kangjie Zhang,Juxin Liu,Yang Liu,Peng Zhang,Raymond J. Carroll

DOI: https://doi.org/10.1177/1471082x211008011

2021-01-01

Statistical Modelling

Abstract:Fatal car crashes are the leading cause of death among teenagers in the USA. The Graduated Driver Licensing (GDL) programme is one effective policy for reducing the number of teen fatal car crashes. Our study focuses on the number of fatal car crashes in Michigan during 1990–2004 excluding 1997, when the GDL started. We use Poisson regression with spatially dependent random effects to model the county level teen car crash counts. We develop a measurement error model to account for the fact that the total teenage population in the county level is used as a proxy for the teenage driver population. To the best of our knowledge, there is no existing literature that considers adjustment for measurement error in an offset variable. Furthermore, limited work has addressed the measurement errors in the context of spatial data. In our modelling, a Berkson measurement error model with spatial random effects is applied to adjust for the error-prone offset variable in a Bayesian paradigm. The Bayesian Markov chain Monte Carlo (MCMC) sampling is implemented in rstan. To assess the consequence of adjusting for measurement error, we compared two models with and without adjustment for measurement error. We found the effect of a time indicator becomes less significant with the measurement-error adjustment. It leads to our conclusion that the reduced number of teen drivers can help explain, to some extent, the effectiveness of GDL.
A general algorithm for error-in-variables regression modelling using Monte Carlo expectation maximization

Jakub Stoklosa,Wen-Han Hwang,David I Warton

DOI: https://doi.org/10.1371/journal.pone.0283798

IF: 3.7

2023-04-03

PLoS ONE

Abstract:In regression modelling, measurement error models are often needed to correct for uncertainty arising from measurements of covariates/predictor variables. The literature on measurement error (or errors-in-variables) modelling is plentiful, however, general algorithms and software for maximum likelihood estimation of models with measurement error are not as readily available, in a form that they can be used by applied researchers without relatively advanced statistical expertise. In this study, we develop a novel algorithm for measurement error modelling, which could in principle take any regression model fitted by maximum likelihood, or penalised likelihood, and extend it to account for uncertainty in covariates. This is achieved by exploiting an interesting property of the Monte Carlo Expectation-Maximization (MCEM) algorithm, namely that it can be expressed as an iteratively reweighted maximisation of complete data likelihoods (formed by imputing the missing values). Thus we can take any regression model for which we have an algorithm for (penalised) likelihood estimation when covariates are error-free, nest it within our proposed iteratively reweighted MCEM algorithm, and thus account for uncertainty in covariates. The approach is demonstrated on examples involving generalized linear models, point process models, generalized additive models and capture-recapture models. Because the proposed method uses maximum (penalised) likelihood, it inherits advantageous optimality and inferential properties, as illustrated by simulation. We also study the model robustness of some violations in predictor distributional assumptions. Software is provided as the refitME package on R, whose key function behaves like a refit() function, taking a fitted regression model object and re-fitting with a pre-specified amount of measurement error.
A location discrete choice model of crime: Police elasticity and optimal deployment

Douglas Newball-Ramírez,Álvaro J. Riascos Villegas,Andrés Hoyos,Mateo Dulce Rubio

DOI: https://doi.org/10.1371/journal.pone.0294020

IF: 3.7

2024-03-12

PLoS ONE

Abstract:Despite the common belief that police presence reduces crime, there is mixed evidence of such causal effects in major Latin America cities. In this work we identify the casual relationship between police presence and criminal events by using a large dataset of a randomized controlled police intervention in Bogotá D.C., Colombia. We use an Instrumental Variables approach to identify the causal effect of interest. Then we consistently estimate a Conditional Logit discrete choice model with aggregate data that allow us to identify agents’ utilities for crime location using Two Stage Least Squares. The estimated parameters allow us to compute the police own and cross-elasticities of crime for each of the spatial locations and to evaluate different police patrolling strategies. The elasticity of crime to police presence is, on average across spatial locations, −0.26 for violent crime, −0.38 for property crime and −0.38 for total crime, all statistically significant. Estimates of cross-elasticities are close to zero; however, spillover effects are non-negligible. Counterfactual analysis of different police deployment strategies show, for an optimal allocating algorithm, an average reduction in violent crime of 7.09%, a reduction in property crimes of 8.48% and a reduction in total crimes of 5.15% at no additional cost. These results show the potential efficiency gains of using the model to deploy police resources in the city without increasing the total police time required.

multidisciplinary sciences
Problems in Modeling and Measuring Recidivism

Alfred Blumstein,Richard C. Larson

DOI: https://doi.org/10.1177/002242787100800202

1971-07-01

Journal of Research in Crime and Delinquency

Abstract:Despite the fundamental character of recidivism as a measure of correctional effectiveness, and its wide use in all aspects of the theory and operations of the crime control process, there is sur prising misconception regarding its use and measurement. This paper uses probabilistic models to examine two types of potential misconception. The first arises from alternative definitions of recidivism based on the stage in the criminal justice process at which recidivism is measured. The second arises from alternative methods of sampling criminal careers. The analysis helps to clarify possible interpretations of recidivism data, including those reported by the FBI under "Careers in Crime."

criminology & penology
Accounting for Measurement Error and Untruthfulness in Binary RRT Models

Bailey Meche,Venu Poruri,Sat Gupta,Sadia Khalil

DOI: https://doi.org/10.3390/math12060875

IF: 2.4

2024-03-16

Mathematics

Abstract:This study examines the effect of measurement error on binary Randomized Response Technique models. We discuss a method for estimating and accounting for measurement error and untruthfulness in two basic models and one comprehensive model. Both theoretical and empirical results show that not accounting for measurement error leads to inaccurate estimates. We introduce estimators that account for the effect of measurement error. Furthermore, we introduce a new measure of model privacy using an odds ratio statistic, which offers better interpretability than traditional methods.

mathematics
Improved estimation in a multivariate regression with measurement error

Sévérien Nkurunziza,Yubin (Eric) Li

DOI: https://doi.org/10.1080/00949655.2023.2299346

IF: 1.225

2024-01-12

Journal of Statistical Computation and Simulation

Abstract:In this paper, we study the estimation problem about the regression coefficients of a multivariate regression model with measurement errors under some uncertain restrictions. Specifically, we propose the unrestricted estimator (UE) and three restricted estimators (REs), and prove that they are all consistent for the true coefficients. We derive the asymptotic distributions of the proposed estimators under the sequence of local alternative restrictions. We also propose shrinkage estimators (SEs) to address the problem of the uncertainty of the restrictions. In addition, we establish the asymptotic distributional risk (ADR) of the proposed estimators and compare the risk performance of these estimators. It is established that the REs perform better than the UE only near the restriction, while they perform poorly as one moves farther away from the restriction. We also prove that SEs dominate the UE. These theoretical results are confirmed by simulations.

statistics & probability,computer science, interdisciplinary applications
Estimating the Likelihood of Arrest from Police Records in Presence of Unreported Crimes

Riccardo Fogliato,Arun Kumar Kuchibhotla,Zachary Lipton,Daniel Nagin,Alice Xiang,Alexandra Chouldechova

DOI: https://doi.org/10.48550/arXiv.2310.07935

2023-10-12

Abstract:Many important policy decisions concerning policing hinge on our understanding of how likely various criminal offenses are to result in arrests. Since many crimes are never reported to law enforcement, estimates based on police records alone must be adjusted to account for the likelihood that each crime would have been reported to the police. In this paper, we present a methodological framework for estimating the likelihood of arrest from police data that incorporates estimates of crime reporting rates computed from a victimization survey. We propose a parametric regression-based two-step estimator that (i) estimates the likelihood of crime reporting using logistic regression with survey weights; and then (ii) applies a second regression step to model the likelihood of arrest. Our empirical analysis focuses on racial disparities in arrests for violent crimes (sex offenses, robbery, aggravated and simple assaults) from 2006--2015 police records from the National Incident Based Reporting System (NIBRS), with estimates of crime reporting obtained using 2003--2020 data from the National Crime Victimization Survey (NCVS). We find that, after adjusting for unreported crimes, the likelihood of arrest computed from police records decreases significantly. We also find that, while incidents with white offenders on average result in arrests more often than those with black offenders, the disparities tend to be small after accounting for crime characteristics and unreported crimes.

Methodology,Applications
Crime prediction through urban metrics and statistical learning

Luiz G A Alves,Haroldo V Ribeiro,Francisco A Rodrigues

DOI: https://doi.org/10.1016/j.physa.2018.03.084

2018-04-09

Abstract:Understanding the causes of crime is a longstanding issue in researcher's agenda. While it is a hard task to extract causality from data, several linear models have been proposed to predict crime through the existing correlations between crime and urban metrics. However, because of non-Gaussian distributions and multicollinearity in urban indicators, it is common to find controversial conclusions about the influence of some urban indicators on crime. Machine learning ensemble-based algorithms can handle well such problems. Here, we use a random forest regressor to predict crime and quantify the influence of urban indicators on homicides. Our approach can have up to 97% of accuracy on crime prediction, and the importance of urban indicators is ranked and clustered in groups of equal influence, which are robust under slightly changes in the data sample analyzed. Our results determine the rank of importance of urban indicators to predict crime, unveiling that unemployment and illiteracy are the most important variables for describing homicides in Brazilian cities. We further believe that our approach helps in producing more robust conclusions regarding the effects of urban indicators on crime, having potential applications for guiding public policies for crime control.

Physics and Society,Applications,Machine Learning

The Impact of Measurement Error in Regression Models Using Police Recorded Crime Rates

The impact of measurement error in models using police recorded crime rates

Exploring the impact of measurement error in police recorded crime rates through sensitivity analysis

The Impact of Incorrectly-Measured Variables when Mixed with Precisely Measured Variables on the Study of Validity in Epidemiological Research

The accuracy of crime statistics: assessing the impact of police data bias on geographic crime analysis

Learning Models from Data with Measurement Error: Tackling Underreporting

The integrity of crime statistics: Assessing the impact of police data bias on crime mapping

Robust Bayesian Inference for Berkson and Classical Measurement Error Models

Spatial autoregressive model with measurement error in covariates

Seemingly Unrelated Regression with Measurement Error: Estimation via Markov chain Monte Carlo and Mean Field Variational Bayes Approximation

A Unified Bayesian Framework for Modeling Measurement Error in Multinomial Data

Right-censored nonparametric regression with measurement error

Bayesian Adjustment for Measurement Error in an Offset Variable in a Poisson Regression Model

A general algorithm for error-in-variables regression modelling using Monte Carlo expectation maximization

A location discrete choice model of crime: Police elasticity and optimal deployment

Problems in Modeling and Measuring Recidivism

Accounting for Measurement Error and Untruthfulness in Binary RRT Models

Improved estimation in a multivariate regression with measurement error

Estimating the Likelihood of Arrest from Police Records in Presence of Unreported Crimes

Crime prediction through urban metrics and statistical learning