Abstract:My first reaction to “The Credibility Revolution in Empirical Economics,” authored by Joshua D. Angrist and Jörn-Steffen Pischke, was: Wow! This paper makes a stunningly good case for relying on purposefully randomized or accidentally randomized experiments to relieve the doubts that afflict inferences from nonexperimental data. On further reflection, I realized that I may have been overcome with irrational exuberance. Moreover, with this great honor bestowed on my “con” article, I couldn't easily throw this child of mine overboard. As Angrist and Pischke persuasively argue, either purposefully randomized experiments or accidentally randomized “natural” experiments can be extremely helpful, but Angrist and Pischke seem to me to overstate the potential benefits of the approach. I begin with some thoughts about the inevitable limits of randomization, and the need for sensitivity analysis in this area, as in all areas of applied empirical work. I argue that the recent financial catastrophe is a powerful illustration of the fact that extrapolating from natural experiments will inevitably be hazardous. I discuss how the difficulties of applied econometric work cannot be evaded with econometric innovations, offering as examples some under-recognized difficulties with instrumental variables and robust standard errors. I conclude with comments about the shortcomings of an experimentalist paradigm as applied to macroeconomics, and some warnings about the willingness of applied economists to apply push-button methodologies without sufficient hard thought regarding their applicability and shortcomings.

'Ergodicity Economics' is Pseudoscience

Economists’ views on the ergodicity problem

Most Psychological Researchers Assume Their Samples Are Ergodic: Evidence From a Year of Articles in Three Major Journals

Experimental Econophysics: Complexity, Self-Organization, and Emergent Properties

The Ergodic Hypothesis: A Typicality Statement

Tantalus on the Road to Asymptopia

Ergodicity-breaking reveals time optimal decision making in humans

WARNING: Physics Envy May Be Hazardous To Your Wealth!

Odd period cycles and ergodic properties in price dynamics for an exchange economy

Insider apology for microeconomic theorising?

The time interpretation of expected utility theory

The virtues and vices of equilibrium and the future of financial economics

The Entropy of Knowledge (EoN): Complexity, Uncertainty, and the Quest for Scientific Knowledge

Energy, Entropy, Constraints, and Creativity in Economic Growth and Crises

"Contingency, Irony, and Solidarity" in the Era of Polycrisis: Institutionalist Economics beyond the t/T Duality

Response to Worrying Trends in Econophysics

Economics in the Social Science Spectrum: Evolution and Overlap with Different Academic Areas

Crises and collective socio-economic phenomena: simple models and challenges

The struggle for the soul of macroeconomics

Economic psychology for laymen

A Contextual Risk Model for the Ellsberg Paradox