Letter to Editor regarding: "Between human and AI: methodological issues on reliability, effectiveness and accuracy to avoid misinterpretation" by Semeraro et al.

Amirhossein Sabour,Fariba Ghassemi
DOI: https://doi.org/10.1080/03007995.2024.2408464
2024-10-05
Current Medical Research and Opinion
Abstract:Dear Editor We were interested to read the paper by Bellini V and colleagues published in Jan 2024 issue of the Curr Med Res Opin Citation 1 . The authors aimed to evaluate the effectiveness of online detection tools in identifying ChatGPT-4 vs human-written text. A two texts produced by ChatGPT-4 using differing prompts and one text created by a human author were analytically assessed using the following online detection tools: GPTZero, ZeroGPT, Writer ACD, and Originality. In the title of the paper, they mentioned assessing the reliability of AI text detection tools which methodologically is a different issue. They reported a notable variance in the detection capabilities of the employed detection tools, which highlighted Originality's enhanced sensitivity to patterns characteristic of AI-generated text. They concluded that while automatic detection tools may discern texts generated by ChatGPT-4 significant variability exists in their accuracy.
medicine, general & internal, research & experimental
What problem does this paper attempt to address?