ProCUA-SFT Technical Report
Researchers have released a technical report on ProCUA-SFT, a new dataset designed to improve how artificial intelligence models interact with desktop computer interfaces. By providing large-scale examples of keyboard and mouse actions linked to specific screen visuals, the resource aims to help developers train more capable agents for automating tasks in graphical operating systems.
Covered by 1 source
- AarXiv CS.AI↗Jaehun Jung, Ximing Lu, Brandon Cui, Muhammad Khalifa, Shaokun Zhang, Hao Zhang, Jin Xu, Amala Sanjay Deshmukh, Karan Sapra, Andrew Tao, Yejin Choi, Jan Kautz, Mingjie Liu, Yi DongJun 17