← Back to Model Beat
Models·Oct 27·all news from October 27, 2026

When the Forger Is the Judge: GPT-Image-2 Cannot Recognize Its Own Faked Documents

arXiv:2604.25213v2 Announce Type: replace Abstract: OpenAI's GPT-Image-2 has effectively erased the visual boundary between authentic and AI-edited document images: a single number on a receipt can be replaced in under a second for a few cents. We release AIForge-Doc v2, a paired dataset of 3,066 GPT-Image-2 document forgeries with pixel-precise masks in DocTamper-compatible format, and benchmark four lines of defence: human inspectors (N=120, n=365 pair-votes via the public 2AFC site CanUSpotAI.com), TruFor (generic forensic), DocTamper (qcf-568, document-specific), and the same GPT-Image-2 model as a zero-shot self-judge -- asked, to avoid the trivial "image is mostly real" reading, whether any region was generated or edited by an AI image model. Human 2AFC accuracy is 0.501, indistinguishable from chance: even side-by-side, inspectors cannot tell GPT-Image-2 receipt forgeries from authentic counterparts. The three computational judges sit only modestly above (TruFor 0.599, DocTamper 0.585, self-judge 0.532). The self-judge fails consistently, not by chance: across…

ModelsGPT Image 2

Covered by 1 source

  • AarXiv CS.AI↗Jiaqi Wu, Yuchen Zhou, Dennis Tsang Ng, Xingyu Shen, Kidus Zewde, Ankit Raj, Tommy Duong, Simiao RenOct 27

Related stories

ModelsxAI's Imagine Image 2.0 lands just behind OpenAI's GPT-Image-2 in Arena benchmarksAug 8ModelsGPT-Image-2 in the Wild: A Twitter Dataset of Self-Reported AI-Generated Images from the First Week of DeploymentOct 27ModelsOpenAI's GPT-Image-2 can now generate images without a backgroundAug 21ModelsA Multi-Domain Benchmark for Detecting AI-Generated Text-Rich Images from GPT-Image-2Jun 18