The Telltale Words That Could Identify Generative AI Text

A new study suggests at least 10% of scientific abstracts in 2024 were processed using large language models, researchers from the University of Tubingen and Northwestern University report. Analyzing 14 million PubMed abstracts from 2010-2024, the team identified an unprecedented surge in certain "style words" following LLMs' widespread adoption in late 2022. Words like "delves" and "showcasing" saw a 25-fold and 9-fold increase respectively in 2024 abstracts compared to pre-LLM trends. Common terms such as "potential" and "findings" also spiked in usage. The researchers drew parallels to studies measuring COVID-19's impact through excess deaths, applying a similar methodology to detect "excess word usage" in scientific writing.

Read more of this story at Slashdot.