I am writing a paper. I thought it would be interestig to see what an AI detector would say.
I got hold of GPTzero. If someone could let me know if that is one of the better one… GPTZero says it is….they would, wouldn’t they!
1st I uploaded the entire piece of work (ToC, reference list, appendices (these are particularly technical). It decided that “We are uncertain about this document. If we had to classify it, it would likely be considered human” (55% chance it is human, 38% it is AI and 7% chance it is mixed).
If I copy paste the body only (no, ToC, no ref, no appendices), it now is 100% chance it is AI generated.
Remember, this is an academic paper. GPTzero assesses the following as AI Vocal (see screenshot):
As for this sentence, it is all AI generated: The searches reported here were conducted to test whether the research gap identified in Section 3.6 holds against the available published record. Three databases were targeted: Google Scholar, for broad academic and maximal reach; Scopus, for interdisciplinary coverage spanning linguistics, political science, and law; and LLBA (Linguistics and Language Behavior Abstracts), as the specialist linguistics abstract service. The search strings are reproduced as used. Searches were organised by the four conceptual clusters set out in Section 3.6. The goal was to find adjacent literature combining two of the three core variables (CADS, CDA, peace agreement implementation), not just to confirm absence”.
Here are some of the reasons GPTzero flags writing as AI (do the other one like Turnitin use the same criteria?). Remember , it is academic writing, no a newspaper article. I take all of these as a compliment!!!
- Mechanical Precision
-Precise and technical word choice prioritizes clarity and specificity, avoiding colloquial language (!!!!)
- Sophisticated Clarity
- Precise word choice prioritizes clarity and sophistication, sometimes affecting natural flow
- The text maintains a formal and academic tone, using indirect speech and paraphrasing, resulting in an impersonal tone
- Formulaic Organization
- Complex sentence structures with multiple clauses convey detailed information and nuanced arguments, often using technical jargon and advanced vocabulary
And there are more reasons. GPTZero (and maybe othes) have no ability to assess writing based on genre. I find it interesting, and worrying that academia may be using these “detectors” to assess students.
Any thoughts?