Without knowledge of other features, can the sex of a person be determined through text-based communication alone? In the first Turing test experiment enclosing 24 human-duo set-ups embedded among machine-human pairs the interrogators erred 50% of the time in assigning the correct sex to a hidden interlocutor identified as human. In this paper we present five transcripts, in four gender blur occurred: Turing test interrogators misclassified male for female and vice versa. In the fifth, machine-human conversation artificial dialogue was branded as female teen. Did stereotypical views on male and female talk sway the judges to assign one way or another? This research is part of ongoing analysis of over 400 tests involving more than 80 human judges. Can we overcome unconscious bias and improve development of agent language?
|Title of host publication||Proceedings of the 8th International Conference on Agents and Artificial Intelligence (ICAART2016)|
|Publication status||Published - 2016|
|Event||8th International Conference on Agents and Artificial Intelligence - Rome, Italy|
Duration: 24 Feb 2016 → 26 Feb 2016
|Conference||8th International Conference on Agents and Artificial Intelligence|
|Period||24/02/16 → 26/02/16|
Bibliographical noteIt will be presented at the 8th International Conference on Agents and Artificial Intelligence (ICAART2016), Rome, Italy, 24-26 February, 2016
- Computer-mediated communication
- imitation game
- Loebner Prize
- simultaneous comparison
- Turing test.