UD Logo
School of Education

ChatGPT & AI Chatbots

Module 6. Can Chatbots Be Detected?

The quick answer is no, chatbots cannot reliably be detected. Here the keyword is reliably. Some companies claim to have developed chatbot detectors but when used in the real world, chatbot detectors err on both sides of the equation by saying that AI written articles are original, or conversely, claiming that original articles were written by AI. Here is an article from ZDNET in which three ChatGPT detectors failed to work reliably:

In the following Medium article, writing teacher Whitney Gegg-Harrison has a similar experience. After having this very article judged as having been written by AI, Gegg-Harrison concludes that chatbot detectors are unhelpful and counter-productive. Along the way she questions equity issues related to the algorithms that AI Chatbot detectors use:

The artificial intelligence company that created ChatGPT is called OpenAI. In order to stop kids from cheating, OpenAI created an AI Text Classifier designed to detect whether an essay got written by ChatGPT:

Plagiarism detection company TurnItIn likewise entered the fray, claiming to have invented a new technology that can detect student use of AI:

Not everyone opposes student use of AI. The following article is by a writing professor who believes that students should never be required to have their essays scanned by AI writing detectors. Ironically, when this professor had an AI writing detector scan this article, the AI said the professor’s article was likely to be written entirely by AI. Follow this link and see what you think:

In the following open access research article, a group of University of Maryland computer science professors and doctoral candidates explain why AI generated text cannot be reliably detected: