arXiv · ML· Zhipeng Zhang (China Mobile Research Institute, Beijing, China, China Mobile GBA), Fujie Ren (University of Electronic Science and Technology of China, Chengdu, China), Kai Li (China Mobile Research Institute, Beijing, China), Bo Qiu (University of Science and Technology Beijing, Beijing, China)·· 5 小时前AI 评分34
稳定但错误:学习在偏离真理时如何收敛
Stable but Wrong: When Learning Stabilizes Away from the Truth
AI 导读
研究提出“稳定但错误”(SBW)概念,指出优化稳定性不代表正确性。持续的系统性偏差可使学习结果稳定在偏离真实目标的状态。 实验表明,在科学发现和CIFAR-10任务中,针对性证据比等量通用证据更有效地纠正预设错误,而未明显损害正确状态。 该研究揭示了收敛等内部指标在持续偏差下的局限性。
来源:arXiv · ML · arxiv.org