Can Machines Talk? Comparison of Eliza with Modern Dialogue Systems

Huma Shah, Kevin Warwick, Jordi Vallverdú, Defeng Wu

Research output: Contribution to journalArticle

35 Citations (Scopus)
245 Downloads (Pure)

Abstract

To find if current dialogue systems use the same, psychotherapist questioning technique as Joseph Weizenbaum's 1960 natural language understanding programme, Eliza, the authors carried out an original experiment comparing five successful artificial dialogue systems, Cleverbot, Elbot, Eugene Goostman, JFred and Ultra Hal with an online version of Eliza. More than one hundred male and female participants with 1st or non-1st English language, age range 13–64, interacted with the systems over the Internet scoring each for conversation ability. Developers of the modern conversation systems show they deploy a variety of techniques to initiate and maintain dialogue learning from interactions with humans over the Internet. Statistical significance shows these dialogue systems are an improvement on their predecessor. Embedded on the web affording round-the-clock interaction the nature of artificial dialogue systems is evolving as these systems learn from the way humans converse. The uses of modern Elizas are proven successful as virtual assistants in e-commerce; their conversational basis is already extending into education. What we can say is modern artificial dialogue systems do talk. They are able to participate in conversation in a way their predecessor Eliza could not: they are able to share personal opinions, relay experience of family dramas, be relevant, but also be vague, and mislead just as humans do.
Original languageEnglish
Pages (from-to)278–295
JournalComputers in Human Behavior
Volume58
Early online date19 Jan 2016
DOIs
Publication statusPublished - May 2016

Bibliographical note

NOTICE: this is the author’s version of a work that was accepted for publication in Computers in Human Behavior. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in Computers in Human Behavior, [58, (2016)]
DOI: 10.1016/j.chb.2016.01.004

© 2015, Elsevier. Licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International http://creativecommons.org/licenses/by-nc-nd/4.0/

Keywords

  • conversation ability
  • dialogue systems
  • Eliza
  • machine
  • talk
  • Turing test
  • Artificial Intelligence
  • Machine Intelligence
  • Human Computer Interaction
  • Chatbots

Fingerprint Dive into the research topics of 'Can Machines Talk? Comparison of Eliza with Modern Dialogue Systems'. Together they form a unique fingerprint.

  • Activities

    • 1 Participation in conference

    EEMA's 30th Annual Conference

    Huma Shah (Speaker)
    5 Jul 2017

    Activity: Participating in or organising an eventParticipation in conference

    Cite this