Scientists create 'New Tool' to detect AI-based chatbot writing

Source: Sputniknews  11.6.2023

OpenAI's ChatGPT language model, which was launched in late November 2022, met with a mixed response; it has the ability to mimic human conversations and generate unique texts based on users’ prompts.

Scientists have developed "a new tool" to detect the difference between real scientific papers and fake examples created by the Artificial Intelligence (AI)-based chatbot ChatGPT, a new study has revealed.

First study author Heather Desaire, a professor at the University of Kansas, said in a media release that she and her colleagues “tried hard to create an accessible method so that with little guidance, even high school students could build an AI detector for different types of writing.”

According to the survey, the researchers trained the new program to identify key differences between 64 real studies published in the journal Science and 128 ChatGPT-generated counterfeits.

The scientists said that the program flagged the AI-written papers more than 99% of the time and could correctly tell the difference between human-created and chatbot-generated paragraphs 92% of the time.

The study revealed that ChatGPT-written papers differed from human text in at least four key aspects, including paragraph complexity, sentence-level diversity in length, punctuation marks and "popular words."

The launch of OpenAI’s ChatGPT in late November 2022 prompted some to praise the language model for its professional applications, such as for developing code, while others have criticized its potential for abuse; it's been alleged that students are using the model to write essays.