Turing test — all my broken hearts

Gareth Owens

DOI: https://doi.org/10.1038/d41586-024-00331-1

IF: 64.8

2024-02-08

Nature

Abstract:Nature, Published online: 07 February 2024; doi:10.1038/d41586-024-00331-1 A chance encounter.

multidisciplinary sciences

What problem does this paper attempt to address?

Turing's Test, a Beautiful Thought Experiment

Bernardo Gonçalves

DOI: https://doi.org/10.1109/MAHC.2024.3432278

2024-07-23

Abstract:In the wake of the latest trends of artificial intelligence (AI), there has been a resurgence of claims and questions about the Turing test and its value, which are reminiscent of decades of practical "Turing" tests. If AI were quantum physics, by now several "Schrödinger's" cats would have been killed. It is time for a historical reconstruction of Turing's beautiful thought experiment. This paper presents a wealth of evidence, including new archival sources, and gives original answers to several open questions about Turing's 1950 paper, including its relation with early AI.

Artificial Intelligence,Computers and Society
Passed the Turing Test: Living in Turing Futures

Bernardo Gonçalves

2024-09-12

Abstract:The world has seen the emergence of machines based on pretrained models, transformers, also known as generative artificial intelligences for their ability to produce various types of content, including text, images, audio, and synthetic data. Without resorting to preprogramming or special tricks, their intelligence grows as they learn from experience, and to ordinary people, they can appear human-like in conversation. This means that they can pass the Turing test, and that we are now living in one of many possible Turing futures where machines can pass for what they are not. However, the learning machines that Turing imagined would pass his imitation tests were machines inspired by the natural development of the low-energy human cortex. They would be raised like human children and naturally learn the ability to deceive an observer. These ``child machines,'' Turing hoped, would be powerful enough to have an impact on society and nature.

Artificial Intelligence,Computers and Society
The Turing Test and our shifting conceptions of intelligence

Melanie Mitchell

DOI: https://doi.org/10.1126/science.adq9356

IF: 56.9

2024-08-16

Science

Abstract:"Can machines think?" So asked Alan Turing in his 1950 paper, "Computing Machinery and Intelligence." Turing quickly noted that, given the difficulty of defining thinking, the question is "too meaningless to deserve discussion." As is often done in philosophical debates, he proposed replacing it with a different question. Turing imagined an "imitation game," in which a human judge converses with both a computer and a human (a "foil"), each of which vies to convince the judge that they are the human. Importantly, the computer, foil, and judge do not see one another; they communicate entirely through text. After conversing with each candidate, the judge guesses which one is the real human. Turing's new question was, "Are there imaginable digital computers which would do well in the imitation game?"
Hard to Cheat: A Turing Test based on Answering Questions about Images

Mateusz Malinowski,Mario Fritz

DOI: https://doi.org/10.48550/arXiv.1501.03302

2015-01-15

Abstract:Progress in language and image understanding by machines has sparkled the interest of the research community in more open-ended, holistic tasks, and refueled an old AI dream of building intelligent machines. We discuss a few prominent challenges that characterize such holistic tasks and argue for "question answering about images" as a particular appealing instance of such a holistic task. In particular, we point out that it is a version of a Turing Test that is likely to be more robust to over-interpretations and contrast it with tasks like grounding and generation of descriptions. Finally, we discuss tools to measure progress in this field.

Artificial Intelligence,Computation and Language,Computer Vision and Pattern Recognition,Machine Learning
Can machines think? The controversy that led to the Turing test

Bernardo Gonçalves

DOI: https://doi.org/10.1007/s00146-021-01318-6

2022-01-11

Abstract:Turing’s much debated test has turned 70 and is still fairly controversial. His 1950 paper is seen as a complex and multilayered text, and key questions about it remain largely unanswered. Why did Turing select learning from experience as the best approach to achieve machine intelligence? Why did he spend several years working with chess playing as a task to illustrate and test for machine intelligence only to trade it out for conversational question-answering in 1950? Why did Turing refer to gender imitation in a test for machine intelligence? In this article, I shall address these questions by unveiling social, historical and epistemological roots of the so-called Turing test. I will draw attention to a historical fact that has been only scarcely observed in the secondary literature thus far, namely that Turing’s 1950 test emerged out of a controversy over the cognitive capabilities of digital computers, most notably out of debates with physicist and computer pioneer Douglas Hartree, chemist and philosopher Michael Polanyi, and neurosurgeon Geoffrey Jefferson. Seen in its historical context, Turing’s 1950 paper can be understood as essentially a reply to a series of challenges posed to him by these thinkers arguing against his view that machines can think. Turing did propose gender learning and imitation as one of his various imitation tests for machine intelligence, and I argue here that this was done in response to Jefferson's suggestion that gendered behavior is causally related to the physiology of sex hormones.
Found in translation

Gio Clairval

DOI: https://doi.org/10.1038/d41586-024-03066-1

IF: 64.8

2024-10-02

Nature

Abstract:Nature, Published online: 02 October 2024; doi:10.1038/d41586-024-03066-1 Try to stand out from the crowd.

multidisciplinary sciences
The Human-or-Machine Matter: Turing-Inspired Reflections on an Everyday Issue

David Harel,Assaf Marron

2023-08-02

Abstract:In his seminal paper ``Computing Machinery and Intelligence'', Alan Turing introduced the ``imitation game'' as part of exploring the concept of machine intelligence. The Turing Test has since been the subject of much analysis, debate, refinement and extension. Here we sidestep the question of whether a particular machine can be labeled intelligent, or can be said to match human capabilities in a given context. Instead, we first draw attention to the seemingly simpler question a person may ask themselves in an everyday interaction: ``Am I interacting with a human or with a machine?''. We then shift the focus from seeking a method for eliciting the answer, and, rather, reflect upon the importance and significance of this Human-or-Machine question and the use one may make of a reliable answer thereto. Whereas Turing's original test is widely considered to be more of a thought experiment, the Human-or-Machine matter as discussed here has obvious practical relevance. While it is still unclear if and when machines will be able to mimic human behavior with high fidelity in everyday contexts, we argue that near-term exploration of the issues raised here can contribute to refinement of methods for developing computerized systems, and may also lead to new insights into fundamental characteristics of human behavior.

Artificial Intelligence,Human-Computer Interaction
The Turing Deception

David Noever,Matt Ciolino

DOI: https://doi.org/10.48550/arXiv.2212.06721

2022-12-24

Abstract:This research revisits the classic Turing test and compares recent large language models such as ChatGPT for their abilities to reproduce human-level comprehension and compelling text generation. Two task challenges -- summarization, and question answering -- prompt ChatGPT to produce original content (98-99%) from a single text entry and also sequential questions originally posed by Turing in 1950. We score the original and generated content against the OpenAI GPT-2 Output Detector from 2019, and establish multiple cases where the generated content proves original and undetectable (98%). The question of a machine fooling a human judge recedes in this work relative to the question of "how would one prove it?" The original contribution of the work presents a metric and simple grammatical set for understanding the writing mechanics of chatbots in evaluating their readability and statistical clarity, engagement, delivery, and overall quality. While Turing's original prose scores at least 14% below the machine-generated output, the question of whether an algorithm displays hints of Turing's truly original thoughts (the "Lovelace 2.0" test) remains unanswered and potentially unanswerable for now.

Machine Learning,Artificial Intelligence,Computation and Language
Turing Test Revisited: A Framework for an Alternative

Aladdin Ayesh

DOI: https://doi.org/10.48550/arXiv.1906.11068

IF: 14.4

2019-06-26

Artificial Intelligence

Abstract:This paper aims to question the suitability of the Turing Test, for testing machine intelligence, in the light of advances made in the last 60 years in science, medicine, and philosophy of mind. While the main concept of the test may seem sound and valid, a detailed analysis of what is required to pass the test highlights a significant flow. Once the analysis of the test is presented, a systematic approach is followed in analysing what is needed to devise a test or tests for intelligent machines. The paper presents a plausible generic framework based on categories of factors implied by subjective perception of intelligence. An evaluative discussion concludes the paper highlighting some of the unaddressed issues within this generic framework.
A Tale of Two Turing Machines

Eric Hehner

DOI: https://doi.org/10.48550/arXiv.1610.09235

2016-10-29

Abstract:Two Turing Machines may be able to answer questions about each other that they cannot answer about themselves.

Logic in Computer Science
Learning, Social Intelligence and the Turing Test - why an "out-of-the-box" Turing Machine will not pass the Turing Test

Bruce Edmonds,Carlos Gershenson

DOI: https://doi.org/10.48550/arXiv.1203.3376

IF: 14.4

2012-03-15

Artificial Intelligence

Abstract:The Turing Test (TT) checks for human intelligence, rather than any putative general intelligence. It involves repeated interaction requiring learning in the form of adaption to the human conversation partner. It is a macro-level post-hoc test in contrast to the definition of a Turing Machine (TM), which is a prior micro-level definition. This raises the question of whether learning is just another computational process, i.e. can be implemented as a TM. Here we argue that learning or adaption is fundamentally different from computation, though it does involve processes that can be seen as computations. To illustrate this difference we compare (a) designing a TM and (b) learning a TM, defining them for the purpose of the argument. We show that there is a well-defined sequence of problems which are not effectively designable but are learnable, in the form of the bounded halting problem. Some characteristics of human intelligence are reviewed including it's: interactive nature, learning abilities, imitative tendencies, linguistic ability and context-dependency. A story that explains some of these is the Social Intelligence Hypothesis. If this is broadly correct, this points to the necessity of a considerable period of acculturation (social learning in context) if an artificial intelligence is to pass the TT. Whilst it is always possible to 'compile' the results of learning into a TM, this would not be a designed TM and would not be able to continually adapt (pass future TTs). We conclude three things, namely that: a purely "designed" TM will never pass the TT; that there is no such thing as a general intelligence since it necessary involves learning; and that learning/adaption and computation should be clearly distinguished.
Every part of you

Helena O’Connor

DOI: https://doi.org/10.1038/d41586-024-02388-4

IF: 64.8

2024-07-25

Nature

Abstract:Nature, Published online: 24 July 2024; doi:10.1038/d41586-024-02388-4 How to be happy?

multidisciplinary sciences
The AI tuner

Joanna Friedman

DOI: https://doi.org/10.1038/d41586-024-01219-w

IF: 64.8

2024-05-02

Nature

Abstract:Nature, Published online: 01 May 2024; doi:10.1038/d41586-024-01219-w If music be the food of love.

multidisciplinary sciences
Human or Not? A Gamified Approach to the Turing Test

Daniel Jannai,Amos Meron,Barak Lenz,Yoav Levine,Yoav Shoham

2023-06-01

Abstract:We present "Human or Not?", an online game inspired by the Turing test, that measures the capability of AI chatbots to mimic humans in dialog, and of humans to tell bots from other humans. Over the course of a month, the game was played by over 1.5 million users who engaged in anonymous two-minute chat sessions with either another human or an AI language model which was prompted to behave like humans. The task of the players was to correctly guess whether they spoke to a person or to an AI. This largest scale Turing-style test conducted to date revealed some interesting facts. For example, overall users guessed the identity of their partners correctly in only 68% of the games. In the subset of the games in which users faced an AI bot, users had even lower correct guess rates of 60% (that is, not much higher than chance). This white paper details the development, deployment, and results of this unique experiment. While this experiment calls for many extensions and refinements, these findings already begin to shed light on the inevitable near future which will commingle humans and AI.

Artificial Intelligence,Computation and Language,Computers and Society,Human-Computer Interaction
Intelligence as a Social Concept: a Socio-Technological Interpretation of the Turing Test

Shlomo Danziger

DOI: https://doi.org/10.1007/s13347-022-00561-z

2022-07-24

Abstract:Alan Turing's 1950 imitation game has been widely understood as a means for testing if an entity is intelligent. Following a series of papers by Diane Proudfoot, I offer a socio-technological interpretation of Turing's paper and present an alternative way of understanding both the imitation game and Turing's concept of intelligence. Turing, I claim, saw intelligence as a social concept, meaning that possession of intelligence is a property determined by society's attitude toward the entity. He realized that as long as human society held a prejudiced attitude toward machinery—seeing machines a priori as mindless objects—machines could not be said to be intelligent, by definition. He also realized, though, that if humans' a priori, chauvinistic attitude toward machinery changed, the existence of intelligent machines would become logically possible. Turing thought that such a change would eventually occur: He believed that when scientists overcome the technological challenge of constructing sophisticated machines that could imitate human verbal behavior—i.e., do well in the imitation game—humans' prejudiced attitude toward machinery will have altered in such a way that machines could be said to be intelligent. The imitation game, for Turing, was not an intelligence test, but a technological aspiration whose realization would likely involve a change in society's attitude toward machines.
How Can You Mend a Broken Heart?

Tanushree Nair

DOI: https://doi.org/10.1370/afm.2956

2023-02-07

The Annals of Family Medicine

Abstract:Being a resident is hard. Being a resident dealing with a recent breakup is even harder. I wrote this piece after a serendipitous encounter on Valentine's Day with an elderly woman who embraced her messy journey to finding love, no matter her age or circumstance. We learn a lot from our patients: from their bodies, physiologies, and illnesses, we learn to become stronger clinicians; from their stories, traumas, and emotions, we learn to become more full, well-rounded humans. Looking back, I think about how easily I almost missed this heartfelt connection by being absorbed in my usual checklist of tasks for a new hospital admission. My patient's keen insight into her own romantic life taught me a vital skill in both medicine and personal relationships: the importance of being open to the unexpected.<i>Annals</i> "Online First" article.

medicine, general & internal,primary health care
When Human Intelligence Meets Artificial Intelligence

Jifan Zhou,Mowei Shen

DOI: https://doi.org/10.1002/pchj.216

IF: 1.559

2018-01-01

PsyCh Journal

Abstract:PsyCh JournalVolume 7, Issue 3 p. 156-157 CHINESE PSYCHOLOGY REPORT When human intelligence meets artificial intelligence Jifan Zhou, Jifan Zhou Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, ChinaSearch for more papers by this authorMowei Shen, Corresponding Author Mowei Shen mwshen@zju.edu.cn Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, ChinaCorrespondence to: Mowei Shen, Department of Psychology and Behavioral Sciences, Zhejiang University, Xixi Campus, 148 Tianmushan Road, Hangzhou, ZJ 310028, China. Email: mwshen@zju.edu.cnSearch for more papers by this author Jifan Zhou, Jifan Zhou Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, ChinaSearch for more papers by this authorMowei Shen, Corresponding Author Mowei Shen mwshen@zju.edu.cn Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, ChinaCorrespondence to: Mowei Shen, Department of Psychology and Behavioral Sciences, Zhejiang University, Xixi Campus, 148 Tianmushan Road, Hangzhou, ZJ 310028, China. Email: mwshen@zju.edu.cnSearch for more papers by this author First published: 25 June 2018 https://doi.org/10.1002/pchj.216Citations: 1 [Correction added on 31 July 2018, after first online publication: Correspondence information section has been added.] Read the full textAboutPDF ToolsRequest permissionExport citationAdd to favoritesTrack citation ShareShare Give accessShare full text accessShare full-text accessPlease review our Terms and Conditions of Use and check box below to share full-text version of article.I have read and accept the Wiley Online Library Terms and Conditions of UseShareable LinkUse the link below to share a full-text version of this article with your friends and colleagues. Learn more.Copy URL Share a linkShare onFacebookTwitterLinkedInRedditWechat No abstract is available for this article.Citing Literature Volume7, Issue3September 2018Pages 156-157 RelatedInformation
A new Turing test: metaphor vs. nonsense

Irving Massey

DOI: https://doi.org/10.1007/s00146-021-01242-9

Abstract:My basic argument is that a computer cannot distinguish between metaphor and nonsense. This would be my new "Turing Test." I was very fond of a particular Italian poem, but I was told by an Italian friend that it was a hackneyed poem of little worth. I then taught myself to experience the poem alternately, as real poetry and as the silly nonsense that my friend claimed it really was. Having done so, I realized that I could do the same with any metaphor, such as "having a green thumb." Thinking about the nature of this switch, from the literal to the metaphorical, I also realized that it was the sort of change that could not be prescribed or even described: this, the basic aesthetic gesture, remains beyond the boundary of logical definition. It then dawned on me that it might provide a test for the validity of a "Turing Test," by any definition. Can a computer track a mind as it goes through this transformation? I could not envisage such a possibility. This would be a "Turing Test" based on the discipline of aesthetics rather than on technology. It may even be argued that the ability to experience metaphor is the very definition of the human.
Deceptive Appearances: the Turing Test, Response-Dependence, and Intelligence as an Emotional Concept

Michael Wheeler

DOI: https://doi.org/10.1007/s11023-020-09533-8

IF: 5.339

2020-08-12

Minds and Machines

Abstract:Abstract The Turing Test is routinely understood as a behaviourist test for machine intelligence. Diane Proudfoot (Rethinking Turing’s Test, Journal of Philosophy , 2013) has argued for an alternative interpretation. According to Proudfoot, Turing’s claim that intelligence is what he calls ‘an emotional concept’ indicates that he conceived of intelligence in response-dependence terms. As she puts it: ‘Turing’s criterion for “thinking” is...: x is intelligent (or thinks) if in the actual world, in an unrestricted computer-imitates-human game, x appears intelligent to an average interrogator’. The role of the famous test is thus to provide the conditions in which to examine the average interrogator’s responses. I shall argue that Proudfoot’s analysis falls short. The philosophical literature contains two main models of response-dependence, what I shall call the transparency model and the reference - fixing model. Proudfoot resists the thought that Turing might have endorsed one of these models to the exclusion of the other. But the details of her own analysis indicate that she is, in fact , committed to the claim that Turing’s account of intelligence is grounded in a transparency model, rather than a reference-fixing one. By contrast, I shall argue that while Turing did indeed conceive of intelligence in response-dependence terms, his account is grounded in a reference-fixing model, rather than a transparency one. This is fortunate (for Turing), because, as an account of intelligence, the transparency model is arguably problematic in a way that the reference-fixing model isn’t.

computer science, artificial intelligence
All we are is our memories

Simon Quellen Field

DOI: https://doi.org/10.1038/d41586-024-03597-7

IF: 64.8

2024-11-07

Nature

Abstract:Nature, Published online: 06 November 2024; doi:10.1038/d41586-024-03597-7 Perfect recall.

multidisciplinary sciences

Turing test — all my broken hearts

Turing's Test, a Beautiful Thought Experiment

Passed the Turing Test: Living in Turing Futures

The Turing Test and our shifting conceptions of intelligence

Hard to Cheat: A Turing Test based on Answering Questions about Images

Can machines think? The controversy that led to the Turing test

Found in translation

The Human-or-Machine Matter: Turing-Inspired Reflections on an Everyday Issue

The Turing Deception

Turing Test Revisited: A Framework for an Alternative

A Tale of Two Turing Machines

Learning, Social Intelligence and the Turing Test - why an "out-of-the-box" Turing Machine will not pass the Turing Test

Every part of you

The AI tuner

Human or Not? A Gamified Approach to the Turing Test

Intelligence as a Social Concept: a Socio-Technological Interpretation of the Turing Test

How Can You Mend a Broken Heart?

When Human Intelligence Meets Artificial Intelligence

A new Turing test: metaphor vs. nonsense

Deceptive Appearances: the Turing Test, Response-Dependence, and Intelligence as an Emotional Concept

All we are is our memories