← Back to Model Beat
Research·Aug 31·all news from August 31, 2026

Keenable AI Open-Sources NEEDLE: A Live Search Benchmark That Rebuilds Its Query Set Every Hour

How do you benchmark a web search API when the thing being tested can read the answer key? A search agent has a fetch tool. If the gold labels sit in a public dataset, the agent can download them mid-evaluation and skip retrieval entirely. A similar problem arises when the answers are already encoded in […] The post Keenable AI Open-Sources NEEDLE: A Live Search Benchmark That Rebuilds Its Query Set Every Hour appeared first on MarkTechPost .

Covered by 1 source

Related stories

ResearchUS Department of Justice backs fair use for AI training in landmark copyright caseSep 1 · 7 sourcesResearchFrontier Red Team ResearchSep 1 · 2 sourcesResearchREFACTOR-VLA: Unsupervised Library Learning of Typed Motor ProgramsSep 2 · 2 sourcesResearchFederal Appeals Court Blocks Charge Over Private Possession of AI-Generated Child Sexual Abuse ImagesAug 30 · 5 sources