A complementary systems theory of meta-learning
Status: This talk is in preparation - details may change
Status: This talk has been cancelled
Humans have the ability to quickly adapt to new tasks and generalize what they learned to improve the learning process itself. This capacity has been referred to as learning to learn or meta-learning. To support meta-learning, synaptic plasticity must solve a difficult long-term credit assignment problem and determine how to change a synapse such that the outcome of a complex learning process improves. Here, we revisit systems consolidation theories and propose that the neocortex is a meta-learning system supported by the hippocampus. In particular, we show that local synaptic plasticity rules can extract long-term credit assignment information when neocortical learning based on current experience is intermixed with auxiliary learning problems prescribed by the hippocampus. We test our theory on a spiking neural network with fast and slow synaptic components and find that our plasticity rules configure the slow synaptic components such that a family of regression tasks can be quickly learned from few examples. Additional benchmark experiments with deep neural networks show that our plasticity rules match and sometimes even outperform existing biologically-implausible meta-learning algorithms. Our theory extends the conventional view on the hippocampus and the neocortex as complementary learning systems, providing a unified perspective of systems-level consolidation and synaptic consolidation.
Date: 2 December 2021, 13:00 (Thursday, 8th week, Michaelmas 2021)
Venue: Pharmacology, off Mansfield Road OX1 3QT
Venue Details: Lecture Theatre
Speaker: João Sacramento (University of Bern, Switzerland)
Organising department: Nuffield Department of Clinical Neurosciences
Organiser: Dr Rafal Bogacz (University of Oxford)
Organiser contact email address: rafal.bogacz@ndcn.ox.ac.uk
Booking required?: Not required
Audience: Members of the University only
Editor: Jacqueline Pumphrey