arXiv · AI· Bingran You, Wenjun Ke, Ria Rosenauer, Bo Liu, Wenbo Chen, Min Chen, Shuqi Xu, Yue Ma, Jiechao Feng, Bo Chen, Xiangkai Sun, Jiarui Liu, Jinen Guo, Zeyu Zhou, Xu Huang, Zhuohan Li, Haoyu Li, Heguang Lin, Lijie Ding, Yadong Zeng, Kangqi Zhang, Xinge Liu, Hanwen Liu, Zhenghong Li, Alexander von Recum, Yuchen Zhu, Felix Schwarzfischer, Yizhou Zhao, Jicheng Wang, Binxu Li, Qian Yu, Chan Li, Cheng Dai, Di Wang, Haoyu Zhang, Jiankai Sun, Kaituo Feng, Mian Qin, Ruihong Yin, Yiqun Luo, Weiwei Wu, Shihong Pan, Tsung Yeh Hsieh, Xiao Huang, Yan Zhang, Sihan Li, Zirui Ren, Zengji Tu, Kyoung Whan Choe, Ke Sun, Vincenzo Galia, Vaisakhi Mishra, Jiashu He, Hongyang Wang, Zhiheng Yang, Shubham Gaur, Yifan Gu, Shuyi Wang, Zihao Zuo, Steven Dillmann, Yiyou Sun, Xinyang Han, Hanchung Lee, Molei Tao, Yue Zhao, Shilong Liu, Yuchen Wu, Xuandong Zhao, Xiangyi Li, Florian Brand, Gerbrand Ceder, Hartmut Haeffner·· 8 小时前AI 评分44
FrontierPhysics：评估智能体端到端物理研究的基准
FrontierPhysics: Evaluating Agents for End-to-End Physics Research
AI 导读
42 位物理学家构建的 FrontierPhysics 基准包含 56 个任务，要求 AI 智能体完成从文献综述到生成科学手稿的全流程研究。 在 22 种模型共 26 种配置中，最佳配置仅通过 168 次运行中的 46 次；专家审阅显示智能体主要缺陷在于推理严谨性不足及缺乏专家直觉，而非物理知识或执行错误。 该基准通过结合确定性验证器与专家评分标准，首次系统性评估了智能体研究的正确性与可发表性。
来源：arXiv · AI · arxiv.org