YuyaoGe's Website
YuyaoGe's Website
About
Coverage
Highlight Papers
Experience
Posts
Projects
Gallery
Light
Dark
Automatic
Home
Tags
Memory
Memory
Gated Differentiable Working Memory for Long-Context Language Modeling
Long contexts challenge transformers as attention scores dilute across thousands of tokens and critical information is often lost in …
Lingrui Mei
,
Shenghua Liu
,
Yiwei Wang
,
Yuyao Ge
,
Baolong Bi
,
Jiayu Yao
,
Jun Wan
,
Ziling Yin
,
Jiafeng Guo
,
Xueqi Cheng
Cite
DOI
PDF
ACL Anthology
Ask KIMI
Cite
×
