Good Machine Performance in Turing's Imitation Game

Research output: Contribution to journalArticle

16 Citations (Scopus)
86 Downloads (Pure)

Abstract

In this paper, we consider transcripts which originated from a practical series of Turing's Imitation Game that was held on June 23, 2012, at Bletchley Park, U.K. In some cases, the tests involved a three-participant simultaneous comparison of two hidden entities, whereas others were the result of a direct two-participant interaction. Each of the transcripts considered here resulted in a human interrogator being fooled, by a machine, into concluding that they had been conversing with a human. Particular features of the conversation are highlighted, successful ploys on the part of each machine are discussed, and likely reasons for the interrogator being fooled are considered. Subsequent feedback from the interrogators involved is also included.
Original languageEnglish
Pages (from-to)289-299
JournalComputational Intelligence and AI in Games, IEEE Transactions on
Volume6
Issue number3
Early online date25 Sep 2013
DOIs
Publication statusPublished - Sep 2014
Externally publishedYes

Fingerprint

Feedback

Bibliographical note

© © 2014 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.

Keywords

  • Chatbots
  • Turing's imitation game
  • deception detection
  • machine misidentification
  • natural language

Cite this

Good Machine Performance in Turing's Imitation Game. / Warwick, Kevin; Shah, Huma.

In: Computational Intelligence and AI in Games, IEEE Transactions on, Vol. 6, No. 3, 09.2014, p. 289-299.

Research output: Contribution to journalArticle

@article{34cc196e14e544aaa61a2808a2cb71aa,
title = "Good Machine Performance in Turing's Imitation Game",
abstract = "In this paper, we consider transcripts which originated from a practical series of Turing's Imitation Game that was held on June 23, 2012, at Bletchley Park, U.K. In some cases, the tests involved a three-participant simultaneous comparison of two hidden entities, whereas others were the result of a direct two-participant interaction. Each of the transcripts considered here resulted in a human interrogator being fooled, by a machine, into concluding that they had been conversing with a human. Particular features of the conversation are highlighted, successful ploys on the part of each machine are discussed, and likely reasons for the interrogator being fooled are considered. Subsequent feedback from the interrogators involved is also included.",
keywords = "Chatbots, Turing's imitation game, deception detection, machine misidentification, natural language",
author = "Kevin Warwick and Huma Shah",
note = "{\circledC} {\circledC} 2014 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.",
year = "2014",
month = "9",
doi = "10.1109/TCIAIG.2013.2283538",
language = "English",
volume = "6",
pages = "289--299",
journal = "IEEE Transactions on Computational Intelligence and AI in Games",
issn = "1943-068X",
publisher = "Institute of Electrical and Electronics Engineers",
number = "3",

}

TY - JOUR

T1 - Good Machine Performance in Turing's Imitation Game

AU - Warwick, Kevin

AU - Shah, Huma

N1 - © © 2014 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.

PY - 2014/9

Y1 - 2014/9

N2 - In this paper, we consider transcripts which originated from a practical series of Turing's Imitation Game that was held on June 23, 2012, at Bletchley Park, U.K. In some cases, the tests involved a three-participant simultaneous comparison of two hidden entities, whereas others were the result of a direct two-participant interaction. Each of the transcripts considered here resulted in a human interrogator being fooled, by a machine, into concluding that they had been conversing with a human. Particular features of the conversation are highlighted, successful ploys on the part of each machine are discussed, and likely reasons for the interrogator being fooled are considered. Subsequent feedback from the interrogators involved is also included.

AB - In this paper, we consider transcripts which originated from a practical series of Turing's Imitation Game that was held on June 23, 2012, at Bletchley Park, U.K. In some cases, the tests involved a three-participant simultaneous comparison of two hidden entities, whereas others were the result of a direct two-participant interaction. Each of the transcripts considered here resulted in a human interrogator being fooled, by a machine, into concluding that they had been conversing with a human. Particular features of the conversation are highlighted, successful ploys on the part of each machine are discussed, and likely reasons for the interrogator being fooled are considered. Subsequent feedback from the interrogators involved is also included.

KW - Chatbots

KW - Turing's imitation game

KW - deception detection

KW - machine misidentification

KW - natural language

U2 - 10.1109/TCIAIG.2013.2283538

DO - 10.1109/TCIAIG.2013.2283538

M3 - Article

VL - 6

SP - 289

EP - 299

JO - IEEE Transactions on Computational Intelligence and AI in Games

JF - IEEE Transactions on Computational Intelligence and AI in Games

SN - 1943-068X

IS - 3

ER -