Human misidentification in Turing tests

Research output: Contribution to journalArticle

12 Citations (Scopus)

Abstract

This paper presents some important issues on misidentification of human interlocutors in text-based communication during practical Turing tests. The study here presents transcripts in which human judges succumbed to theconfederate effect, misidentifying hidden human foils for machines. An attempt is made to assess the reasons for this. The practical Turing tests in question were held on 23 June 2012 at Bletchley Park, England. A selection of actual full transcripts from the tests is shown and an analysis is given in each case. As a result of these tests, conclusions are drawn with regard to the sort of strategies which can perhaps lead to erroneous conclusions when one is involved as an interrogator. Such results also serve to indicate conversational directions to avoid for those machine designers who wish to create a conversational entity that performs well on the Turing test.
Original languageEnglish
Pages (from-to)123-135
JournalJournal of Experimental & Theoretical Artificial Intelligence
Volume27
Issue number2
Early online date24 Jun 2014
DOIs
Publication statusPublished - 2015

    Fingerprint

Bibliographical note

This article is not available on the repository

Keywords

  • chatbots
  • confederate effect
  • practical Turing tests
  • imitation game
  • intelligence
  • philosophy of mind

Cite this