← Back to Model Beat
Research·19h ago·all news from July 9, 2026

OpenAI finds roughly 30 percent of popular AI coding test is broken

OpenAI reviewed SWE-Bench Pro, a widely used test for measuring AI models' programming skills, and found roughly 30 percent of its tasks are broken. The company is pulling its earlier endorsement of the benchmark. The article OpenAI finds roughly 30 percent of popular AI coding test is broken appeared first on The Decoder .

Covered by 1 source

Related stories

ResearchIncentivizing Temporal-Awareness in Egocentric Video Understanding ModelsJul 7 · 6 sourcesResearchOpenAI may have made a fatal misstep in copyright fight with news orgsJul 9 · 4 sourcesResearchRecursive Self-Improvement in AI: From Bounded Self-Refinement to Autonomous Research LoopsJul 9ResearchMemory Scarcity, Open Models, and the Restructuring of the AI Industry, 2026-2030 -- A quantitative scenario analysis of inference economics, training-cost divergence, and infrastructure solvencyJul 9