Dynamics of learning in many option foraging
In natural environments, animals must effectively allocate their choices across many concurrently available resources when foraging. This is a complex decision-making process not fully captured by existing models. In this talk I will describe a novel paradigm that we developed, in which untrained, water-restricted mice were free to sample from six options rewarded at a range of deterministic intervals and positioned around the walls of a large (~2m) arena. Mice exhibited rapid learning, matching their choices to integrated reward ratios across six options within the first session. To develop a mechanistic description of this learning, we constructed a reinforcement learning model inspired by foraging theory. In combination with a dynamic, global (across all options) learning rate, this model was able to accurately reproduce mouse learning and decision-making. Finally, I will discuss results of fiber photometry recordings in the nucleus accumbens core (NAcC) and dorsomedial striatum (DMS). We found that NAcC, but not DMS, dopamine more closely reflected this global learning rate than local error-based updating. Altogether, our results provide insight into the neural substrate of a learning algorithm that allows mice to rapidly exploit multiple options when foraging in large spatial environments.
Date:
28 January 2025, 13:00
Venue:
New Radcliffe House, Walton Street OX2 6NW
Venue Details:
Seminar rooms, 2nd floor - lift available
Speaker:
Dr Laura Grima (Janelia Research Campus, USA)
Organising department:
Department of Experimental Psychology
Organisers:
Dr Fei-Yang Huang (University of Oxford),
Dr Sophia Shatek (University of Oxford),
Dr Ali Mahmoodi (University of Oxford)
Organiser contact email address:
beacon-seminar@psy.ox.ac.uk
Host:
Professor Mark Walton (University of Oxford)
Part of:
Department of Experimental Psychology - Cognitive & Behavioural Neuroscience Seminar series (BEACON)
Booking required?:
Not required
Audience:
Members of the University only
Editor:
Anne-Marie Honeyman-Tafa
