Un problema da discutere: un inganno con le percentuali

Claudio Bernardi

DOI: https://doi.org/10.48550/arXiv.1602.07552

2016-02-24

Abstract:We discuss a non-intuitive situation concerning percentages.

History and Overview

What problem does this paper attempt to address?

Talking about Probability, Inference and Decisions. Part 1: The Witches of Bayes

Giulio D'Agostini,Noemi Cifani,Alba Gilardi

DOI: https://doi.org/10.48550/arXiv.1802.10432

2018-02-25

History and Overview

Abstract:In October 2017 the Italian National Institute of Statistics (ISTAT), Italy's body for official statistics, has published the book of fairy tales Le streghe di Bayes (The witches of Bayes) written by ISTAT staff members with the commendable aim of introducing statistical and probabilistic reasoning to children. In this paper the fairy tale which gives the name to the book is analyzed in a dialog between three teachers with different background and expertise. The outcomes are definitively discouraging, especially when the story is compared to the appendix of the book, in which the teaching power of every story is indeed explained (as a matter of fact, without the appendix the fairy tale of the witches seemed to be written with the purpose of make the 'Bayesians', meant as the villagers from 'Bayes', ridiculous). In fact the fairy tale of the witches does not contain any Bayesian reasoning, the suggested decision strategy is simply wrong and the story does not even seem to be easily modifiable (besides the trivial correction of the decision strategy) in order to make it usable as a teaching tool. As it happens in real dialogues, besides the fairy tale in question, the dialogue touches several issues somehow related to the story and concerning probability, inference, prediction and decision making. The present paper is an indirect response to the invitation by the ISBA bulletin to comment on the fairy tale.
Errors and secret data in the Italian research assessment exercise. A comment to a reply

Alberto Baccini,Giuseppe De Nicolao

DOI: https://doi.org/10.13130/2282-5398/8872

2017-07-21

Abstract:Italy adopted a performance-based system for funding universities that is centered on the results of a national research assessment exercise, realized by a governmental agency (ANVUR). ANVUR evaluated papers by using 'a dual system of evaluation', that is by informed peer review or by bibliometrics. In view of validating that system, ANVUR performed an experiment for estimating the agreement between informed review and bibliometrics. Ancaiani et al. (2015) presents the main results of the experiment. Baccini and De Nicolao (2017) documented in a letter, among other critical issues, that the statistical analysis was not realized on a random sample of articles. A reply to the letter has been published by Research Evaluation (Benedetto et al. 2017). This note highlights that in the reply there are (1) errors in data, (2) problems with 'representativeness' of the sample, (3) unverifiable claims about weights used for calculating kappas, (4) undisclosed averaging procedures; (5) a statement about 'same protocol in all areas' contradicted by official reports. Last but not least: the data used by the authors continue to be undisclosed. A general warning concludes: many recently published papers use data originating from Italian research assessment exercise. These data are not accessible to the scientific community and consequently these papers are not reproducible. They can be hardly considered as containing sound evidence at least until authors or ANVUR disclose the data necessary for replication.

Digital Libraries
Un problema da discutere: una rappresentazione geometrica del teorema del coseno

Claudio Bernardi

DOI: https://doi.org/10.48550/arXiv.1602.07554

2016-02-23

History and Overview

Abstract:We present, discuss and generalize an elegant geometrical proof of the law of cosines, due to Al Cuoco.
Una tentazione affascinante

Claudio Bernardi

DOI: https://doi.org/10.48550/arXiv.1605.03015

2016-05-09

Abstract:We discuss several aspects of infinity in the history of mathematics.

History and Overview
Uncertainties and Ambiguities in Percentiles and how to Avoid Them

Michael Schreiber

DOI: https://doi.org/10.48550/arXiv.1205.3588

2012-05-16

Abstract:The recently proposed fractional scoring scheme is used to attribute publications to percentile rank classes. It is shown that in this way uncertainties and ambiguities in the evaluation of percentile ranks do not occur. Using the fractional scoring the total score of all papers exactly reproduces the theoretical value.

Other Statistics,Digital Libraries,Physics and Society
From rankings to funnel plots: the question of accounting for uncertainty when measuring university research performance

Giovanni Abramo,Ciriaco Andrea D'Angelo,Leonardo Grilli

DOI: https://doi.org/10.1016/j.joi.2016.07.005

2018-10-30

Abstract:The work applies the funnel plot methodology to measure and visualize uncertainty in the research performance of Italian universities in the science disciplines. The performance assessment is carried out at both discipline and overall university level. The findings reveal that for most universities the citation-based indicator used gives insufficient statistical evidence to infer that their research productivity is inferior or superior to the average. This general observation is one that we could indeed expect in a higher education system that is essentially non-competitive. The question is whether the introduction of uncertainty in performance reporting, while technically sound, could weaken institutional motivation to work towards continuous improvement.

Digital Libraries
Numerical format and public perception of foreign immigration growth rates

Maria Michela Dickson,Giuseppe Espa,Rocco Micciolo,Lucia Savadori

DOI: https://doi.org/10.1371/journal.pone.0310382

IF: 3.7

2024-10-02

PLoS ONE

Abstract:The study aimed to explore whether the 1-in-X bias is also present in relation to immigration growth rates. We tested this research question on a representative sample of adult residents in Trento, Italy, between March and April 2019. Participants were presented with data comparing the foreign immigrant-to-resident population ratio in Italy for 2001 (1 in 40) and 2011 (1 in 15), using two distinct formats-1-in-X and percentages. They were then asked to express the perceived increase. Baseline measures of several individual-level factors, including cultural worldviews, perceptions of immigration, numeracy, science literacy, and economic literacy, were also collected to explore the potential role of individual differences in influencing the effect of the 1-in-X format on the perceived increase in immigrants. The results confirmed the existence of the 1-in-X bias, demonstrating that the immigration growth rate in the 1-in-X format was perceived as higher than in the percentage format, even after controlling for the effects of the idiosyncratic variables. The results of this study provide insight into how different numerical formats can influence public perceptions of immigration growth rates, offering suggestions to policymakers, communicators, and stakeholders about how the presentation of information can shape public opinion.
Taming Fantastic Beasts of Mathematics: Struggling with Incommensurability

Anna Sfard

DOI: https://doi.org/10.1007/s40753-021-00156-7

2021-10-06

International Journal of Research in Undergraduate Mathematics Education

Abstract:According to commognitive conceptualization, development of mathematical thinking, whether historical or ontogenetic, requires periodic transitions to mathematical discourse incommensurable with the one that has been practiced so far. In this new discourse, some familiar mathematical words will be used in a new way. Historically, such discursive transformations were usually greeted with resistance and led to heated, centuries-long debates. Also for today’s learners, a discourse incommensurable with the one currently in use constitutes a source of much trouble. This is particularly true in those cases in which the change in the use of words occurs tacitly, leading to apparent paradoxes. In this paper, I argue that discourses of finite and infinite sets are mutually incommensurable, and thus the case of students grappling with Sierpiński triangle (ST) may lead to insights about ways in which learners act in the face of incommensurability. Here, possible sources of the confusion reported by the participants are identified with the help of specially designed discourse-analytic tools. It is shown that the students, imperceptibly to themselves, oscillate between the discourses of area-as-a-segment-of-a-plane and of area-as-a-number. The analysis is followed with discussion on theoretical, methodological and practical implications of this study.
Hot Hands, Streaks and Coin-flips: Numerical Nonsense in the New York Times

Dan Gusfield

DOI: https://doi.org/10.48550/arXiv.1512.08773

2015-12-29

History and Overview

Abstract:The existence of "Hot Hands" and "Streaks" in sports and gambling is hotly debated, but there is no uncertainty about the recent batting-average of the New York Times: it is now two-for-two in mangling and misunderstanding elementary concepts in probability and statistics; and mixing up the key points in a recent paper that re-examines earlier work on the statistics of streaks. In so doing, it's high-visibility articles have added to the general-public's confusion about probability, making it seem mysterious and paradoxical when it needn't be. However, those articles make excellent case studies on how to get it wrong, and for discussions in high-school and college classes focusing on quantitative reasoning, data analysis, probability and statistics. What I have written here is intended for that audience.
Reassessing Accuracy Rates of Median Decisions

Andrea Capotorti,Frank Lad,Giuseppe Sanfilippo

DOI: https://doi.org/10.1198/000313007X190943

2017-09-17

Abstract:We show how Bruno de Finetti's fundamental theorem of prevision has computable applications in statistical problems that involve only partial information. Specifically, we assess accuracy rates for median decision procedures used in the radiological diagnosis of asbestosis. Conditional exchangeability of individual radiologists' diagnoses is recognized as more appropriate than independence which is commonly presumed. The FTP yields coherent bounds on probabilities of interest when available information is insufficient to determine a complete distribution. Further assertions that are natural to the problem motivate a partial ordering of conditional probabilities, extending the computation from a linear to a quadratic programming problem.

Applications
Quanto è importante risolvere e far risolvere problemi?

Gilles Aldon

DOI: https://doi.org/10.33683/ddm.21.10.1

2023-07-05

Abstract:Doing mathematics implies three levels of manipulation: manipulating the abstract, manipulating symbols and manipulating logic. Teaching mathematics therefore involves the teacher proposing situations in which pupils can explore a small part of mathematics through these manipulations. In doing so, the pupils work on both the heuristics enabling them to confront themselves with a real mathematical research and knowledge in construction. Through examples of didactic situations of problem solving, this article aims to show how problems can be drivers of mathematics learning.

History and Overview
Is the panel fair? Evaluating panel compositions through network analysis. The case of research assessments in Italy

Alberto Baccini,Cristina Re

2024-10-10

Abstract:In research evaluation, the fair representation of panels is usually defined in terms of observable characteristics of scholars such as gender or affiliations. An empirical strategy is proposed for exploring hidden connections between panellists such that, despite the respect of formal requirements, the panel could be considered alike as unfair with respect to the representation of diversity of research approaches and methodologies. The case study regards the three panels selected to evaluate research in economics, statistics and business during the Italian research assessment exercises. The first two panels were appointed directly by the governmental agency responsible for the evaluation, while the third was randomly selected. Hence the third panel can be considered as a control for evaluating about the fairness of the others. The fair representation is explored by comparing the networks of panellists based on their co-authorship relations, the networks based on journals in which they published and the networks based on their affiliated institutions (universities, research centres and newspapers). The results show that the members of the first two panels had connections much higher than the members of the control group. Hence the composition of the first two panels should be considered as unfair, as the results of the research assessments.

General Economics,Social and Information Networks
The Problem of Moments: A Bunch of Classical Results With Some Novelties

Pier Luigi Novi Inverardi,Aldo Tagliani,Jordan M. Stoyanov

2023-10-06

Abstract:We summarize significant classical results on (in)determinacy of measures in terms of their finite positive integer order moments. Well-known is the role of the smallest eigenvalues of Hankel matrices, starting from Hamburger's results a century ago and ending with the great progress made only in recent times by C. Berg and collaborators. We describe here known results containing necessary and sufficient conditions for moment (in)determinacy in both Hamburger and Stieltjes moment problems. In our exposition we follow an approach different from that commonly used. There are novelties well complementing the existing theory. Among them are: (a) to emphasize on the geometric interpretation of the indeterminacy conditions; (b) exploit fine properties of the eigenvalues of perturbed symmetric matrices allowing to derive new lower bounds for the smallest eigenvalues of Hankel matrices; these bounds are used for concluding indeterminacy; (c) provide new arguments to confirm classical results; (d) give new numerical illustrations involving commonly used probability distributions.

Functional Analysis
Mind the gap in university rankings: a complex network approach towards fairness

Loredana Bellantuono,Alfonso Monaco,Nicola Amoroso,Vincenzo Aquaro,Marco Bardoscia,Annamaria Demarinis Loiotile,Angela Lombardi,Sabina Tangaro,Roberto Bellotti

DOI: https://doi.org/10.48550/arXiv.2112.01341

2022-03-08

Abstract:University rankings are increasingly adopted for academic comparison and success quantification, even to establish performance-based criteria for funding assignment. However, rankings are not neutral tools, and their use frequently overlooks disparities in the starting conditions of institutions. In this research, we detect and measure structural biases that affect in inhomogeneous ways the ranking outcomes of universities from diversified territorial and educational contexts. Moreover, we develop a fairer rating system based on a fully data-driven debiasing strategy that returns an equity-oriented redefinition of the achieved scores. The key idea consists in partitioning universities in similarity groups, determined from multifaceted data using complex network analysis, and referring the performance of each institution to an expectation based on its peers. Significant evidence of territorial biases emerges for official rankings concerning both the OECD and Italian university systems, hence debiasing provides relevant insights suggesting the design of fairer strategies for performance-based funding allocations.

Physics and Society
Estimation and Inference of Average Treatment Effect in Percentage Points under Heterogeneity

Ying Zeng

DOI: https://doi.org/10.48550/arXiv.2408.06624

2024-08-13

Abstract:In semi-log regression models with heterogeneous treatment effects, the average treatment effect (ATE) in log points and its exponential transformation minus one underestimate the ATE in percentage points. I propose new estimation and inference methods for the ATE in percentage points, with inference utilizing the Fenton-Wilkinson approximation. These methods are particularly relevant for staggered difference-in-differences designs, where treatment effects often vary across groups and periods. I prove the methods' large-sample properties and demonstrate their finite-sample performance through simulations, revealing substantial discrepancies between conventional and proposed measures. Two empirical applications further underscore the practical importance of these methods.

Econometrics
Group Fairness Is Not Derivable From Justice: a Mathematical Proof

Nicolò Cangiotti,Michele Loi

DOI: https://doi.org/10.48550/arXiv.2202.03880

2022-02-08

Abstract:We argue that an imperfect criminal law procedure cannot be group-fair, if 'group fairness' involves ensuring the same chances of acquittal or convictions to all innocent defendants independently of their morally arbitrary features. We show mathematically that only a perfect procedure (involving no mistake), a non-deterministic one, or a degenerate one (everyone or no one is convicted) can guarantee group fairness, in the general case. Following a recent proposal, we adopt a definition of group fairness, requiring that individuals who are equal in merit ought to have the same statistical chances of obtaining advantages and disadvantages, in a way that is statistically independent of any of their feature that does not count as merit. We explain by mathematical argument that the only imperfect procedures offering an a-priori guarantee of fairness in relation to all non-merit trait are lotteries or degenerate ones (i.e., everyone or no one is convicted). To provide a more intuitive point of view, we exploit an adjustment of the well-known ROC space, in order to represent all possible procedures in our model by a schematic diagram. The argument seems to be equally valid for all human procedures, provided they are imperfect. This clearly includes algorithmic decision-making, including decisions based on statistical predictions, since in practice all statistical models are error prone.

Computers and Society
Elementary Statistics on Trial (the case of Lucia de Berk)

Richard D. Gill,Piet Groeneboom,Peter de Jong

DOI: https://doi.org/10.1080/09332480.2018.1549809

2019-10-22

Abstract:In the conviction of Lucia de Berk an important role was played by a simple hypergeometric model, used by the expert consulted by the court, which produced very small probabilities of occurrences of certain numbers of incidents. We want to draw attention to the fact that, if we take into account the variation among nurses in incidents they experience during their shifts, these probabilities can become considerably larger. This points to the danger of using an oversimplified discrete probability model in these circumstances.

Applications,Statistics Theory
On merit and equity in math

Alexander Givental

2024-01-05

Abstract:In recent paper "Quantifying Inequities and Documenting Elitism in PhD-granting Mathematical Sciences Departments in the United States" (

History and Overview
Cost Issue in Estimation of Proportion in a Finite Population Divided Among Two Strata

Dominik Sieradzki,Wojciech Zieliński

DOI: https://doi.org/10.48550/arXiv.1903.09935

2019-03-24

Statistics Theory

Abstract:The problem of estimation of the proportion of units with a given attribute in a~finite population is considered. From the population a sample is drawn due to the simple random sampling without replacement. There are limited funds for conducting survey sample. Suppose that the population is divided into two strata. The question now arises: how should sample sizes be chosen from each strata to obtain the best estimation of proportion without exceeding the budget planned. In the paper it is shown, that with the appropriate sample allocation the variance of the stratified estimator may be reduced up to 30% off of the standard, unstratified estimator.
A population level analysis of the gender gap in mathematics: Results on over 13 million children using the INVALSI dataset

David Giofrè,Cesare Cornoldi,Angela Martini,Enrico Toffalini

DOI: https://doi.org/10.1016/j.intell.2020.101467

2021-12-21

Abstract:Whether males outperform females in mathematics is still debated. Such a gender gap varies across countries, but the determinants of the differences are unclear and could be produced by heterogeneity in the instructional systems or cultures and may vary across school grades. To clarify this issue, we took advantage of the INVALSI dataset, that offered over 13 million observations covering one single instructional system (i.e., the Italian system) in grades 2, 5, and 8, in the period 2010-2018. Results showed that males outperformed females in mathematics (and vice versa in reading), with gaps widening from the 2nd through to the 8th grade. The gender gap in mathematics was larger in the richer northern Italian regions (also characterized by greater gender equality) than in southern regions. This was not explained by average performance or fully accounted for by economic factors. No such north-south difference of the gap emerged in reading. Results are discussed with reference to the literature showing that the gender gap varies across world regions.

History and Overview

Un problema da discutere: un inganno con le percentuali

Talking about Probability, Inference and Decisions. Part 1: The Witches of Bayes

Errors and secret data in the Italian research assessment exercise. A comment to a reply

Un problema da discutere: una rappresentazione geometrica del teorema del coseno

Una tentazione affascinante

Uncertainties and Ambiguities in Percentiles and how to Avoid Them

From rankings to funnel plots: the question of accounting for uncertainty when measuring university research performance

Numerical format and public perception of foreign immigration growth rates

Taming Fantastic Beasts of Mathematics: Struggling with Incommensurability

Hot Hands, Streaks and Coin-flips: Numerical Nonsense in the New York Times

Reassessing Accuracy Rates of Median Decisions

Quanto è importante risolvere e far risolvere problemi?

Is the panel fair? Evaluating panel compositions through network analysis. The case of research assessments in Italy

The Problem of Moments: A Bunch of Classical Results With Some Novelties

Mind the gap in university rankings: a complex network approach towards fairness

Estimation and Inference of Average Treatment Effect in Percentage Points under Heterogeneity

Group Fairness Is Not Derivable From Justice: a Mathematical Proof

Elementary Statistics on Trial (the case of Lucia de Berk)

On merit and equity in math

Cost Issue in Estimation of Proportion in a Finite Population Divided Among Two Strata

A population level analysis of the gender gap in mathematics: Results on over 13 million children using the INVALSI dataset