GPT-6-Astra solves 49 of 50 physics research problems at $2.40 apiece
Researchers have introduced TheoPhysEval, a collection of 50 unpublished, high-level theoretical physics problems designed to test the autonomous problem-solving capabilities of AI agents. By providing a standardized set of verifiable challenges that typically require a day of work for an expert, the suite offers a new benchmark for evaluating how effectively artificial intelligence can perform independent scientific research.
ModelsGPT-6 Astra
Covered by 2 sources
- TThe Decoder↗Maximilian Schreiner3d ago
- AarXiv CS.AI↗A. Ramesh Chandra, Aaghaz Mahajan, Ainesh Sanyal, Mianqi Wang, Shubhadeep Chakraborty, Sudip Chakraborty, Shailesh Chandrasekharan, Rama Govindarajan, Akshit Goyal, Jonathan J. Heckman, Yasir Iqbal, Divya Jaganathan, Saumav Kapoor, Andreas Karch, Pushkar Khandare, Sandeep Krishna, Anupam Kundu, Alok Laddha, Tongyan Lin, Swarnendu Maity, Nilmani Mathur, Shani Nadir Meynet, Alessandro Mininno, Abhijeet Mishra, Vidur Niranjan, Abhishodh Prakash, Pratik Rath, Durbar Roy, Debargha Sarkar, Srikanth Sastry, Gary Shiu, Aninda Sinha, Thomas Van Riet, Praneeth Netrapalli, Suvrat Raju4d ago