4Research·5h ago
Office Comprehension Benchmark
Researchers have introduced the Office Comprehension Bench, a new public evaluation tool designed to test how well large language models navigate native Word, Excel, and PowerPoint file formats. By requiring systems to process these document types directly rather than through simplified text conversions, the benchmark aims to measure an AI's ability to interpret complex office software data and structures.
Covered by 1 source
- AarXiv CS.AI↗Firoz Shaik, Mateus Pican\c{c}o Lima Gomes, Tanvir Aumi, Jingci Wang, Milos Milunovic, Filip Basara, Ivana Jovanovic, Vishwas Suryanarayanan, Neha Nandan Kenkare, Weiyao Xie, Zhipeng Han, Zheng Zhang, Waleed Shahid, Jay Rathi, Russell Scherer, Thong Q. Nguyen, Michael Bentley, Tamara Stankovic, Rasika Chakravarthy, Vishal Chowdhary5h ago