NEWSparse Delta Memory: Linear RNNs with Sparse Memory Scale State Size Substantially9. July 2026AI ModelsSparse Delta Memory significantly increases the state capacity of linear RNNs without raising computational costs, thereby improving long-context and reasoning performance. Share on: