Coupling Liquid Time-Constant Encoders with Modern Hopfield Memory
Published in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2026
Continuous-time neural networks often struggle to preserve long-term context because a single hidden state must encode both fast-changing inputs and slower temporal information. We address this by coupling a Liquid Time-Constant Network (LTC) with a Modern Hopfield Network (MHN) for associative memory retrieval. The resulting LTC-MHN model produces bounded representations, smooths optimization through gradient contraction, and improves performance on time-series benchmarks.
