arXiv · AI· Siyang Wu, Weizhi Zhang, Chen Yang, Esther Xu Fei, Jorin Overwiening, Xu Pan, Jing Tang, Yixuan He, Kelvin C. Mo, Peiwen Li, Defu Cao, Xu Hu, Haixin Wang, Taoran Li, Haoming Li, Zheyuan Deng, Jingwen Zhang, Pengsong Zhang, Haichao Zhang, Guangze Luo, Yi Daniel Lu, Zihuai He, Chenxi Qiu, Dianzhuo Wang, Zhejian Peng, Shushu Liang, Wenyi Lu, Yifan Wang, Jintao Huang, Yijun Wang, Xiaomin Li, Yuexing Hao·· 2 小时前AI 评分21
PersonaScienceBench:评估与多样化模拟研究者协作的科学智能体
PersonaScienceBench: Evaluating Scientific Agents with Diverse Simulated Researchers
AI 导读
PersonaScienceBench发布,包含五个基准的200项任务,覆盖四个科学领域。模拟研究者根据画像提供上下文和反馈,但任务目标和评分标准保持不变,智能体仅通过对话了解研究者偏好。
来源:arXiv · AI · arxiv.org