Abstract:System 1 vs. 2 theory [6, 19] describes two modes of thought, a fast, instinctive one and a slow, logical one. When we ask a question (e.g. A bat and ball cost $1.10. The bat costs $1 more than the ball. How much does the ball cost?), with prior, we can identify fast/slow thinking ($.10/$.05). But what if we do not have prior? A very clever method, surprisingly popular [13], additionally asks what percentage of other people answer $.10/$.05 and selects the answer that is more popular than people predict. However, the distribution report is non-minimal for many people especially for non-binary choices, the choices design requires prior and only the best answer is selected. Here we propose a simple minimal paradigm that elicits the full hierarchy of the collected answers: we ask a single open response question and elicit each respondent’s answer (e.g. $.05) and guess(es) for other people’s answers (e.g. $.10). We record the number of people who report a specific answer-guess pair (e.g. 10 people answer $.05 and guess $.10) by an answer-guess matrix. By ranking the answers to maximize the sum of the upper triangular area of the matrix, we obtain and visualize the hierarchy of the answers without any prior. Our paradigm has minimal requirement for both the respondent (no distribution report) and the requester (no choices design; check the hierarchy visually) and can be also used to research how people reason about other people’s minds [14]. We conduct four studies including math problems, Life-and-death Go problems, general knowledge and pronunciation questions. The empirical results not only validate our approach but also show that more sophisticated people can reason about less sophisticated people’s minds.

How to Answer Questions of the Type: If you toss a coin n times, how likely is HH to show up more than HT?

A proof that HT is more likely to outnumber HH than vice versa in a sequence of n coin flips

Alice and Bob on $\Bbb X$: reversal, coupling, renewal

On cases where Litt's game is fair

Choosing 1 of N with and without lucky numbers

Resolving Bertrand's Probability Paradox

Twenty (simple) questions

Gambler's Ruin? Some Aspects of Coin Tossing

Winning a CHSH Game without Entangled Particles in a Finite Number of Biased Rounds: How Much Luck Is Needed?

How to Lose with Least Probability

Variable Bias Coin Tossing

Optimal Sets of Questions for Twenty Questions

Note on a Coin Tossing Problem Posed by Daniel Litt

A numbers-on-foreheads game

Identifying Fast/Slow Thinking without Prior

Fair coins tend to land on the same side they started: Evidence from 350,757 flips

Minimum Guesswork with an Unreliable Oracle

A Fair Shake: How close can the sum of $n$-sided dice be to a uniform distribution?

The intransitive dice kernel:

Quantum Coin Flipping, Qubit Measurement and Generalized Fibonacci Numbers