arXiv · NLP· Zhiyu Li, Zeyu Zhang, Linyun Liu, Yiwei Bu, Chenyang Xi, Xichong Zhang, Yi Yu, Yu Yu, Zhichen Liu, Yuxiao Yi, Chunyu Li, Haoran Liu, Zhenkai Ding, Le Zhou, Juncheng Zhang, Boyu Chen, Zehao Lin, Guorui Li, Renyu Fu, Ji Li, Youyang Xia, Jiajun Shen, Harvey Li, Jingsong Zhou, Helan Hu, Tong Shen, Tianxiao Xu, Chenye Han, Weijie Li, Zhongquan Zhou, Hongming Xu, Yuekeng Li, Erenkai Zhu, Peng Yu, Wenhao Li, Jingyi Kang, Xixuan Hao, Xuzhou Zhu, Can Chen, Jiawei Liu, Chen Jiang, Tao Jiang, Fangwei Xiang, Zepeng Yao, Kai Chen, Guang Yang, Mingfei Lu, Chunhui Li, Zhengxuan Jiang, Bo Tang, Shiyu Zhan, Yihang Sun, Jie Chu, Wenjun Xiong, Zhenxiang Hua, Chen Lin, Detong Su, Dongyu Deng, Qiuping Ding, Guofeng Ding, Si Chen, Guohua Wen, Xu Chen, Zhi-Qin John Xu, Ying-Cong Chen, Ningyu Zhang, Haofen Wang, Muning Wen, Haotian Chen, Wentao Zhang, Xuanhe Zhou, Rita Zhang, Junchi Yan, Feiyu Xiong·· 6 小时前AI 评分42
MemT-1.0 架构发布：迈向记忆原生进化的基础模型
MemT-1.0: Towards Memory-Native Evolution
AI 导读
MemT-1.0 架构将记忆内化为模型计算的一部分，实现了记忆原生进化。该架构基于 Metis，采用 Gated DeltaNet-2 机制及混合存储模块，并通过 34B tokens 训练数据优化。 模型在 128K 历史长度下实现 1.86 倍推理加速和 66 倍存储减少，发布 MemT-1.0-Nano 和 Flash 系列。在智能体任务中，内部化经验提升了任务成功率。
来源：arXiv · NLP · arxiv.org