The confederate effect is the phenomenon of people falsely classifying human intelligence as machine (or artificial) intelligence during

Turing test The Turing test, originally called the imitation game by Alan Turing in 1950, is a test of a machine's ability to exhibit intelligent behaviour equivalent to, or indistinguishable from, that of a human. Turing proposed that a human evaluato ...

s. For example, in the

Loebner Prize The Loebner Prize was an annual competition in artificial intelligence that awards prizes to the computer programs considered by the judges to be the most human-like. The prize is reported as defunct since 2020. The format of the competition was tha ...

during which a tester conducts a text exchange with one human and one

artificial-intelligence Artificial intelligence (AI) is intelligence—perceiving, synthesizing, and inferring information—demonstrated by machines, as opposed to intelligence displayed by animals and humans. Example tasks in which this is done include speech ...

chatbot A chatbot or chatterbot is a software application used to conduct an on-line chat conversation via text or text-to-speech, in lieu of providing direct contact with a live human agent. Designed to convincingly simulate the way a human would behav ...

and is tasked to identify which is which, the confederate effect describes the tester inaccurately identifying the human as the machine.The Confederate Effect in Human Machine Textual Interaction
/ref> The confederate effect is the reverse of the

ELIZA effect The ELIZA effect, in computer science, is the tendency to unconsciously assume computer behaviors are analogous to human behaviors; that is, anthropomorphisation. Overview In its specific form, the ELIZA effect refers only to "the susceptibility ...

, which

Sherry Turkle Sherry Turkle (born June 18, 1948) is the Abby Rockefeller Mauzé Professor of the Social Studies of Science and Technology at the Massachusetts Institute of Technology. She obtained an BA in social studies and later a PhD in sociology and perso ...

states is humans' "more general tendency to treat responsive computer programs as more intelligent than they really are": that is, anthropomorphizing. The phenomenon was seen in the

University of Surrey The University of Surrey is a public research university in Guildford, Surrey, England. The university received its royal charter in 1966, along with a number of other institutions following recommendations in the Robbins Report. The institu ...

2003

for Artificial Intelligence, when both confederate (tested) humans, one male and one female, were each ranked as machine by at least one judge. More precisely, Judge 7 and Judge 9 ranked the female 'Confederate 2' as "1.00=definitely a machine"; the male 'Confederate 1' was ranked "1.00=definitely a machine" by Judge 4 and Judge 9.2003 Loebner Prize results
/ref> Also, the gender of these two hidden-humans were incorrectly identified (male considered female; woman considered man) in independent transcript analysis ('gender-blurring' phenomenon, see Shah & Henry, 2005).

Notes

References

* {{Refend Human–computer interaction