Kavli Affiliate: Terrence Sejnowski
| Authors: Yusi Chen, Huanqiu Zhang and Terrence J Sejnowski
| Summary:
The interaction between hippocampus and cortex is key to memory formation and representation learning. Based on anatomical wiring and transmission delays, we proposed a self-supervised recurrent neural network (PredRAE) with a predictive reconstruction loss to account for the cognitive functions of hippocampus. This framework extends predictive coding in the time axis and incorporates predictive features in Bayes filters for temporal prediction. In simulations, we were able to reproduce characteristic place cell features such as one-shot plasticity, localized spatial representation and replay, which marks the trace of memory formation. The simulated place cells also exhibited precise spike timing, evidenced by phase precession. Trained on MNIST sequences, PredRAE learned the underlying temporal dependencies and a spontaneous representation of digit labels and rotation dynamics in the linear transformation of its hidden unit activities. Such learning is robust against 16 different image corruptions. Inspired by the brain circuit, the simple and concise framework has great potential to approximate human performance with its capacity to robustly disentangle representations and generalize temporal dynamics.