arXiv · NLP· Zhiqun Zhao (Advanced Medical Research Institute and Key Laboratory for Experimental Teratology of the Ministry of Education, Cheeloo College of Medicine, Shandong University, Jinan, China), Xiaodong Yang (Department of Urology, Shandong Provincial Hospital Affiliated to Shandong First Medical University, Jinan, China), Bruce Gu (Shandong Computer Science Center, National Supercomputer Center in Jinan, Jinan, China, Qilu University of Technology, Shandong Academy of Sciences, Jinan, China), Ming Li (Department of Rheumatology and Immunology, Shandong Provincial Hospital Affiliated to Shandong First Medical University, Jinan, China), Yi Fu (Information Network Management Office, Shandong Provincial Hospital Affiliated to Shandong First Medical University, Jinan, China), Song Li (Department of Medical Oncology, Qilu Hospital, Shandong University, Jinan, China), Qi Mei (Department of Oncology, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China), Zhi Liu (Department of Clinical Laboratory, Shandong Provincial Hospital Affiliated to Shandong First Medical University, Jinan, China), Kai Zhang (Department of Breast Surgery, General Surgery, Qilu Hospital, Shandong University, Jinan, China), Kexue Fu (Shandong Computer Science Center, National Supercomputer Center in Jinan, Jinan, China, Qilu University of Technology, Shandong Academy of Sciences, Jinan, China), Jing Wu (Department of Central Laboratory, Public Health Clinical Center Affiliated to Shandong University, Shandong University, Jinan, China), Xiaofei Lu (Department of Breast Surgery, The First Affiliated Hospital of Shandong First Medical University, Jinan, China), Yule Li (Advanced Medical Research Institute and Key Laboratory for Experimental Teratology of the Ministry of Education, Cheeloo College of Medicine, Shandong University, Jinan, China), Zheng Wang (Department of Urology, Shandong Provincial Hospital Affiliated to Shandong First Medical University, Jinan, China), Haiquan Lu (Advanced Medical Research Institute and Key Laboratory for Experimental Teratology of the Ministry of Education, Cheeloo College of Medicine, Shandong University, Jinan, China), Xiaoming Wu (Shandong Computer Science Center, National Supercomputer Center in Jinan, Jinan, China, Qilu University of Technology, Shandong Academy of Sciences, Jinan, China)·· 9 天前AI 评分33
临床大语言模型证据可追溯基准 Med Evidence Bench 发布
An evidence-traceable benchmark of clinical reasoning in large language models
AI 导读
针对医疗大语言模型基准分数难以追溯临床证据的问题,研究团队发布了 Med Evidence Bench(MEB)。该基准包含 1,536 条医师构建题目,涵盖指南知识、标准化及真实临床场景。
来源:arXiv · NLP · arxiv.org