ChatGPT fools scientists by writing fake research paper abstracts
IANS 16 January 2023
Artificial-Intelligence (AI) chatbot called ChatGPT has written convincing fake research-paper abstracts that scientists were unable to spot, a new research has revealed.
 
A research team led by Catherine Gao at Northwestern University in Chicago used ChatGPT to generate artificial research-paper abstracts to test whether scientists can spot them.
 
According to a report in the prestigious journal Nature, the researchers asked the chatbot to write 50 medical-research abstracts based on a selection published in JAMA, The New England Journal of Medicine, The BMJ, The Lancet and Nature Medicine.
 
They then compared these with the original abstracts by running them through a plagiarism detector and an AI-output detector, and they asked a group of medical researchers to spot the fabricated abstracts.
 
The ChatGPT-generated abstracts sailed through the plagiarism checker: the median originality score was 100 per cent, which indicates that no plagiarism was detected.
 
The AI-output detector spotted 66 per cent the generated abstracts. But the human reviewers didn't do much better - they correctly identified only 68 per cent of the generated abstracts and 86 per cent of the genuine abstracts.
 
They incorrectly identified 32 per cent of the generated abstracts as being real and 14 per cent of the genuine abstracts as being generated, according to the Nature article.
 
"I am very worried," said Sandra Wachter from University of Oxford who was not involved in the research.
 
"If we're now in a situation where the experts are not able to determine what's true or not, we lose the middleman that we desperately need to guide us through complicated topics," she was quoted as saying.
 
Microsoft-owned software company OpenAI released the tool for public use in November and it is free to use.
 
"Since its release, researchers have been grappling with the ethical issues surrounding its use, because much of its output can be difficult to distinguish from human-written text," said the report.
 
Disclaimer: Information, facts or opinions expressed in this news article are presented as sourced from IANS and do not reflect views of Moneylife and hence Moneylife is not responsible or liable for the same. As a source and news provider, IANS is responsible for accuracy, completeness, suitability and validity of any information in this article.
Comments
Otter.ai: Audio to Text
Yazdi Tantra, 14 January 2023
This is a different kind of artificial intelligence (AI) tool—it helps you record oral conversations, lectures, meetings, etc. and transcribes them into text automatically. It records meetings, takes notes in real-time and generates...
WordTune.com: Improve Your Writing
Yazdi Tantra, 06 January 2023
Convert your thoughts into words and say exactly what you mean, through clear, compelling and authentic writing. Add this extension in your browser (Chrome / Edge) and enjoy all the benefits online—whether you are using Gmail,...
Cleanup.Pictures: Online Tool To Have Clean Pictures
Yazdi Tantra, 31 December 2022
This is an online tool which helps you remove unwanted objects, defects, people or text from any of your pictures in seconds. Just upload your picture, use the brush to erase any unwanted stuff and voila! Your clean picture is...
ChatGPT - 2: How Is It Useful?
Yogesh Sapkale, 23 December 2022
After storming the world with its dialogue-based artificially intelligent (AI) chat, OpenAI Foundation's ChatGPT, which is still a prototype, is throwing out 'chats', some useful and some full of misinformation. People are busy...
Free Helpline
Legal Credit
Feedback