AI Beats Human Sleuth at Finding Problematic Images in Research Papers
An algorithm that takes just seconds to scan a paper for duplicated images racks up more suspicious images than a person. Nature: Scientific-image sleuth Sholto David blogs about image manipulation in research papers, a pastime that has exposed him to many accounts of scientific fraud. But other scientists "are still a little bit in the dark about the extent of the problem," David says. He decided he needed some data. The independent biologist in Pontypridd, UK, spent the best part of several months poring over hundreds of papers in one journal, looking for any with duplicated images. Then he ran the same papers through an artificial-intelligence (AI) tool. Working at two to three times David's speed, the software found almost all of the 63 suspect papers that he had identified -- and 41 that he'd missed. David described the exercise last month in a preprint, one of the first published comparisons of human versus machine for finding doctored images. The findings come as academic publishers reckon with the problem of image manipulation in scientific papers. In a 2016 study, renowned image-forensics specialist Elisabeth Bik, based in San Francisco, California, and her colleagues reported that almost 4% of papers she had visually scanned in 40 biomedical-science journals contained inappropriately duplicated images. Not all image manipulation is done with nefarious intent. Authors might tinker with images by accident, for aesthetic reasons or to make a figure more understandable. But journals and others would like to catch images with alterations that cross the line, whatever the authors' motivation. And now they are turning to AI for help. Some 200 universities, publishers and scientific societies already rely on Imagetwin, the tool that David used for his study. The software compares images in a paper with more than 25 million images from other publications -- the largest such database in the image-integrity world, according to Imagetwin's developers. Bik has been using Imagetwin regularly to supplement her own skills and calls it her "standard tool," although she emphasizes that the AI has weaknesses as well as strengths -- for instance, it can miss duplications in images with low contrast.
Read more of this story at Slashdot.